Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 845935 Details for
Bug 923196
[RHEVM-RHS] Error "error: type "brick" does not exist." seen when trying to perform replace-brick from rhevm-shell.
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine.log
engine.log (text/x-log), 3.67 MB, created by
SATHEESARAN
on 2014-01-06 07:01:51 UTC
(
hide
)
Description:
engine.log
Filename:
MIME Type:
Creator:
SATHEESARAN
Created:
2014-01-06 07:01:51 UTC
Size:
3.67 MB
patch
obsolete
>2014-01-06 03:07:05,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f363169 >2014-01-06 03:07:05,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5f363169 >2014-01-06 03:07:05,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 294bb352 >2014-01-06 03:07:05,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e321def}, log id: 294bb352 >2014-01-06 03:07:10,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a99e215 >2014-01-06 03:07:11,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2a99e215 >2014-01-06 03:07:11,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47b29dc >2014-01-06 03:07:11,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2dba35b}, log id: 47b29dc >2014-01-06 03:07:16,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ca4f3c6 >2014-01-06 03:07:16,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5ca4f3c6 >2014-01-06 03:07:16,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7cdc7ba5 >2014-01-06 03:07:16,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b11479c6}, log id: 7cdc7ba5 >2014-01-06 03:07:21,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23a5056d >2014-01-06 03:07:22,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 23a5056d >2014-01-06 03:07:22,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12dd6d76 >2014-01-06 03:07:22,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98e3ddb2}, log id: 12dd6d76 >2014-01-06 03:07:27,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 53cf9b6a >2014-01-06 03:07:27,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 53cf9b6a >2014-01-06 03:07:27,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52ef2b45 >2014-01-06 03:07:27,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47ce525b}, log id: 52ef2b45 >2014-01-06 03:07:32,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1713d0ad >2014-01-06 03:07:32,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1713d0ad >2014-01-06 03:07:32,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 141d3b23 >2014-01-06 03:07:33,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c2f4678}, log id: 141d3b23 >2014-01-06 03:07:38,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 278145af >2014-01-06 03:07:38,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 278145af >2014-01-06 03:07:38,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 213ec30b >2014-01-06 03:07:38,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc437cfb}, log id: 213ec30b >2014-01-06 03:07:43,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c9ea73e >2014-01-06 03:07:43,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3c9ea73e >2014-01-06 03:07:43,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64b67271 >2014-01-06 03:07:44,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@855421a8}, log id: 64b67271 >2014-01-06 03:07:47,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6603a48d >2014-01-06 03:07:48,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6603a48d >2014-01-06 03:07:49,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 711a0b2e >2014-01-06 03:07:49,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 711a0b2e >2014-01-06 03:07:49,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62313866 >2014-01-06 03:07:49,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@376dffd}, log id: 62313866 >2014-01-06 03:07:54,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64071dff >2014-01-06 03:07:54,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 64071dff >2014-01-06 03:07:54,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c9a3305 >2014-01-06 03:07:54,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7adbcc4e}, log id: 3c9a3305 >2014-01-06 03:08:00,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b828c95 >2014-01-06 03:08:00,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b828c95 >2014-01-06 03:08:00,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c0b7806 >2014-01-06 03:08:00,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f6b4315}, log id: 1c0b7806 >2014-01-06 03:08:05,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ed6455f >2014-01-06 03:08:05,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5ed6455f >2014-01-06 03:08:05,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5126da95 >2014-01-06 03:08:05,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@577279f4}, log id: 5126da95 >2014-01-06 03:08:10,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 498ab665 >2014-01-06 03:08:11,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 498ab665 >2014-01-06 03:08:11,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f6696a >2014-01-06 03:08:11,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5cb57a9}, log id: 3f6696a >2014-01-06 03:08:16,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2cb5616e >2014-01-06 03:08:16,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2cb5616e >2014-01-06 03:08:16,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e55f08f >2014-01-06 03:08:16,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a03dc174}, log id: 7e55f08f >2014-01-06 03:08:21,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3906939 >2014-01-06 03:08:22,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3906939 >2014-01-06 03:08:22,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3eed5d1d >2014-01-06 03:08:22,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85e36fef}, log id: 3eed5d1d >2014-01-06 03:08:27,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a3cdb6 >2014-01-06 03:08:27,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5a3cdb6 >2014-01-06 03:08:27,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4aa6d638 >2014-01-06 03:08:27,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f626898a}, log id: 4aa6d638 >2014-01-06 03:08:32,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f17e0e1 >2014-01-06 03:08:33,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1f17e0e1 >2014-01-06 03:08:33,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44c0af6a >2014-01-06 03:08:33,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60aed7c8}, log id: 44c0af6a >2014-01-06 03:08:36,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d06f331 >2014-01-06 03:08:37,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@324fb1e0, log id: 1d06f331 >2014-01-06 03:08:38,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22397eeb >2014-01-06 03:08:38,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 22397eeb >2014-01-06 03:08:38,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5cd0277e >2014-01-06 03:08:38,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4138ede}, log id: 5cd0277e >2014-01-06 03:08:43,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 445a4621 >2014-01-06 03:08:43,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 445a4621 >2014-01-06 03:08:43,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c471f15 >2014-01-06 03:08:44,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2228ec2}, log id: 7c471f15 >2014-01-06 03:08:48,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8879c91 >2014-01-06 03:08:48,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterTasksListVDSCommand, return: [], log id: 8879c91 >2014-01-06 03:08:49,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e7bd62c >2014-01-06 03:08:49,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e7bd62c >2014-01-06 03:08:49,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a55125 >2014-01-06 03:08:49,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fb8223a}, log id: 2a55125 >2014-01-06 03:08:54,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 41dbb202 >2014-01-06 03:08:54,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 41dbb202 >2014-01-06 03:08:54,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c1d4fac >2014-01-06 03:08:55,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c67e311}, log id: 2c1d4fac >2014-01-06 03:09:00,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46ec470e >2014-01-06 03:09:00,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 46ec470e >2014-01-06 03:09:00,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f702262 >2014-01-06 03:09:00,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8440534}, log id: 4f702262 >2014-01-06 03:09:05,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e145c2c >2014-01-06 03:09:05,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: e145c2c >2014-01-06 03:09:05,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55f4d91a >2014-01-06 03:09:06,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e293cd3f}, log id: 55f4d91a >2014-01-06 03:09:11,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a540b61 >2014-01-06 03:09:11,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2a540b61 >2014-01-06 03:09:11,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 454c2434 >2014-01-06 03:09:11,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31fb48fb}, log id: 454c2434 >2014-01-06 03:09:16,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61a157d3 >2014-01-06 03:09:16,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 61a157d3 >2014-01-06 03:09:16,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1bfae69f >2014-01-06 03:09:16,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@604555ce}, log id: 1bfae69f >2014-01-06 03:09:21,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4fde527c >2014-01-06 03:09:22,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4fde527c >2014-01-06 03:09:22,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 453fc784 >2014-01-06 03:09:22,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a80c1890}, log id: 453fc784 >2014-01-06 03:09:27,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 169072f5 >2014-01-06 03:09:27,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 169072f5 >2014-01-06 03:09:27,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 24fbceec >2014-01-06 03:09:27,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a39ee94}, log id: 24fbceec >2014-01-06 03:09:32,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 205917d8 >2014-01-06 03:09:33,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 205917d8 >2014-01-06 03:09:33,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8d4ad1c >2014-01-06 03:09:33,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a6a2745}, log id: 8d4ad1c >2014-01-06 03:09:38,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7537c817 >2014-01-06 03:09:38,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7537c817 >2014-01-06 03:09:38,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e339a59 >2014-01-06 03:09:38,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c65d63c}, log id: 6e339a59 >2014-01-06 03:09:43,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66042170 >2014-01-06 03:09:44,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66042170 >2014-01-06 03:09:44,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1195cab6 >2014-01-06 03:09:44,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@724cd9f1}, log id: 1195cab6 >2014-01-06 03:09:48,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 679c6c8a >2014-01-06 03:09:48,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 679c6c8a >2014-01-06 03:09:49,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7fb9f4f0 >2014-01-06 03:09:49,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7fb9f4f0 >2014-01-06 03:09:49,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 43e4f874 >2014-01-06 03:09:49,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@855d598b}, log id: 43e4f874 >2014-01-06 03:09:54,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1504bb44 >2014-01-06 03:09:55,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1504bb44 >2014-01-06 03:09:55,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7329002a >2014-01-06 03:09:55,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f81b8ae}, log id: 7329002a >2014-01-06 03:10:00,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39fb0251 >2014-01-06 03:10:00,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 39fb0251 >2014-01-06 03:10:00,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ba3b754 >2014-01-06 03:10:00,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f8a648a}, log id: 5ba3b754 >2014-01-06 03:10:05,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9e0fa25 >2014-01-06 03:10:05,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 9e0fa25 >2014-01-06 03:10:05,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7883a244 >2014-01-06 03:10:06,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bc4e1d9}, log id: 7883a244 >2014-01-06 03:10:11,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78a45721 >2014-01-06 03:10:11,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 78a45721 >2014-01-06 03:10:11,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f155230 >2014-01-06 03:10:11,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc996701}, log id: 3f155230 >2014-01-06 03:10:16,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 124e04a8 >2014-01-06 03:10:16,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 124e04a8 >2014-01-06 03:10:16,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e46036f >2014-01-06 03:10:17,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b23b6b3}, log id: 5e46036f >2014-01-06 03:10:22,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a10c4bc >2014-01-06 03:10:22,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2a10c4bc >2014-01-06 03:10:22,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 759ba2b0 >2014-01-06 03:10:22,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dee2dd54}, log id: 759ba2b0 >2014-01-06 03:10:27,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14777b23 >2014-01-06 03:10:27,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 14777b23 >2014-01-06 03:10:27,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ea90da9 >2014-01-06 03:10:27,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47db62b5}, log id: 4ea90da9 >2014-01-06 03:10:32,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d9df7c2 >2014-01-06 03:10:33,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: d9df7c2 >2014-01-06 03:10:33,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 364dc8b >2014-01-06 03:10:33,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99715719}, log id: 364dc8b >2014-01-06 03:10:38,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e2b5dbf >2014-01-06 03:10:38,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5e2b5dbf >2014-01-06 03:10:38,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2fe32a55 >2014-01-06 03:10:38,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3d0a29f}, log id: 2fe32a55 >2014-01-06 03:10:43,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26a32a78 >2014-01-06 03:10:44,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 26a32a78 >2014-01-06 03:10:44,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4cbad9ee >2014-01-06 03:10:44,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6129fa70}, log id: 4cbad9ee >2014-01-06 03:10:48,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c55a7ab >2014-01-06 03:10:48,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7c55a7ab >2014-01-06 03:10:49,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2529b3d6 >2014-01-06 03:10:49,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2529b3d6 >2014-01-06 03:10:49,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76c456b3 >2014-01-06 03:10:49,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab03aa0}, log id: 76c456b3 >2014-01-06 03:10:54,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62b3ea41 >2014-01-06 03:10:55,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 62b3ea41 >2014-01-06 03:10:55,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c44d9e8 >2014-01-06 03:10:55,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@562f1df1}, log id: 1c44d9e8 >2014-01-06 03:11:00,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a6eb53 >2014-01-06 03:11:00,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6a6eb53 >2014-01-06 03:11:00,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7845c8d4 >2014-01-06 03:11:00,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d87de956}, log id: 7845c8d4 >2014-01-06 03:11:05,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e6c42cb >2014-01-06 03:11:05,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e6c42cb >2014-01-06 03:11:05,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58ffe5f6 >2014-01-06 03:11:06,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b209eb61}, log id: 58ffe5f6 >2014-01-06 03:11:11,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4debbc7a >2014-01-06 03:11:11,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4debbc7a >2014-01-06 03:11:11,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5bd69a93 >2014-01-06 03:11:11,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ea9384c}, log id: 5bd69a93 >2014-01-06 03:11:16,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f9459c0 >2014-01-06 03:11:16,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1f9459c0 >2014-01-06 03:11:16,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e3ddfeb >2014-01-06 03:11:17,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@807f6519}, log id: 7e3ddfeb >2014-01-06 03:11:22,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4813a2ac >2014-01-06 03:11:22,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4813a2ac >2014-01-06 03:11:22,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23bbf54d >2014-01-06 03:11:22,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb6388c5}, log id: 23bbf54d >2014-01-06 03:11:27,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7df1b09b >2014-01-06 03:11:27,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7df1b09b >2014-01-06 03:11:27,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9387f8b >2014-01-06 03:11:27,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9556186b}, log id: 9387f8b >2014-01-06 03:11:32,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c22c1ea >2014-01-06 03:11:33,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1c22c1ea >2014-01-06 03:11:33,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1bb05924 >2014-01-06 03:11:33,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@492cb78d}, log id: 1bb05924 >2014-01-06 03:11:38,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1fc856e6 >2014-01-06 03:11:38,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1fc856e6 >2014-01-06 03:11:38,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63aab5b8 >2014-01-06 03:11:38,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2a3fc9e}, log id: 63aab5b8 >2014-01-06 03:11:43,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2fd13aa2 >2014-01-06 03:11:44,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2fd13aa2 >2014-01-06 03:11:44,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d60c105 >2014-01-06 03:11:44,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76cacd22}, log id: 4d60c105 >2014-01-06 03:11:48,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25a95925 >2014-01-06 03:11:48,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 25a95925 >2014-01-06 03:11:49,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a231275 >2014-01-06 03:11:49,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3a231275 >2014-01-06 03:11:49,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75217b3d >2014-01-06 03:11:49,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d4d5521}, log id: 75217b3d >2014-01-06 03:11:54,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a9083c6 >2014-01-06 03:11:55,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6a9083c6 >2014-01-06 03:11:55,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 452c5353 >2014-01-06 03:11:55,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8701887f}, log id: 452c5353 >2014-01-06 03:12:00,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 215ba020 >2014-01-06 03:12:00,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 215ba020 >2014-01-06 03:12:00,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: abd9702 >2014-01-06 03:12:00,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e5d05}, log id: abd9702 >2014-01-06 03:12:05,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36902919 >2014-01-06 03:12:05,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 36902919 >2014-01-06 03:12:05,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5004b144 >2014-01-06 03:12:06,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52007adc}, log id: 5004b144 >2014-01-06 03:12:11,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63e96088 >2014-01-06 03:12:11,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 63e96088 >2014-01-06 03:12:11,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f372706 >2014-01-06 03:12:11,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3999e9a}, log id: 1f372706 >2014-01-06 03:12:16,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25aaa388 >2014-01-06 03:12:16,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25aaa388 >2014-01-06 03:12:16,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d3637d6 >2014-01-06 03:12:17,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1d9d83a}, log id: 1d3637d6 >2014-01-06 03:12:22,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4521f91a >2014-01-06 03:12:22,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4521f91a >2014-01-06 03:12:22,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e09f2cc >2014-01-06 03:12:22,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f572415b}, log id: 4e09f2cc >2014-01-06 03:12:27,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b624af2 >2014-01-06 03:12:27,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b624af2 >2014-01-06 03:12:27,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e45cc66 >2014-01-06 03:12:27,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34742cc2}, log id: 1e45cc66 >2014-01-06 03:12:32,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41394b03 >2014-01-06 03:12:33,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 41394b03 >2014-01-06 03:12:33,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 334a733d >2014-01-06 03:12:33,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f70704bd}, log id: 334a733d >2014-01-06 03:12:38,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8ec10e0 >2014-01-06 03:12:38,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 8ec10e0 >2014-01-06 03:12:38,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 571b79d2 >2014-01-06 03:12:38,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45f7c15d}, log id: 571b79d2 >2014-01-06 03:12:43,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d15e2e7 >2014-01-06 03:12:44,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7d15e2e7 >2014-01-06 03:12:44,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29077cad >2014-01-06 03:12:44,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0802dfd}, log id: 29077cad >2014-01-06 03:12:48,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 750abf67 >2014-01-06 03:12:48,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 750abf67 >2014-01-06 03:12:49,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46b249df >2014-01-06 03:12:49,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 46b249df >2014-01-06 03:12:49,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6600219f >2014-01-06 03:12:49,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@199c11ba}, log id: 6600219f >2014-01-06 03:12:54,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45b0260 >2014-01-06 03:12:55,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 45b0260 >2014-01-06 03:12:55,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4beee781 >2014-01-06 03:12:55,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12b0a62d}, log id: 4beee781 >2014-01-06 03:13:00,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b55ae2e >2014-01-06 03:13:00,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: b55ae2e >2014-01-06 03:13:00,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53422a1d >2014-01-06 03:13:00,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebe7340f}, log id: 53422a1d >2014-01-06 03:13:05,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f40f9b9 >2014-01-06 03:13:06,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1f40f9b9 >2014-01-06 03:13:06,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12c751c >2014-01-06 03:13:06,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6a089c9}, log id: 12c751c >2014-01-06 03:13:11,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d87c985 >2014-01-06 03:13:11,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6d87c985 >2014-01-06 03:13:11,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63924803 >2014-01-06 03:13:11,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f413db81}, log id: 63924803 >2014-01-06 03:13:16,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60a58680 >2014-01-06 03:13:16,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 60a58680 >2014-01-06 03:13:16,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51b56306 >2014-01-06 03:13:17,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0a8e5e1}, log id: 51b56306 >2014-01-06 03:13:22,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3168bafe >2014-01-06 03:13:22,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3168bafe >2014-01-06 03:13:22,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c5c681b >2014-01-06 03:13:22,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96e2d4d3}, log id: 1c5c681b >2014-01-06 03:13:27,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3bfa24a6 >2014-01-06 03:13:27,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3bfa24a6 >2014-01-06 03:13:27,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f370683 >2014-01-06 03:13:28,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dcefc89}, log id: 4f370683 >2014-01-06 03:13:33,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 663e2d9d >2014-01-06 03:13:33,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 663e2d9d >2014-01-06 03:13:33,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c8efdbb >2014-01-06 03:13:33,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a829fc6}, log id: 4c8efdbb >2014-01-06 03:13:37,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14981724 >2014-01-06 03:13:37,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@196bfb11, log id: 14981724 >2014-01-06 03:13:38,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 15d5b406 >2014-01-06 03:13:38,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 15d5b406 >2014-01-06 03:13:38,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c735965 >2014-01-06 03:13:38,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@522700fc}, log id: 1c735965 >2014-01-06 03:13:43,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 133ccdbd >2014-01-06 03:13:44,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 133ccdbd >2014-01-06 03:13:44,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e2d786f >2014-01-06 03:13:44,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b2b05d5}, log id: 4e2d786f >2014-01-06 03:13:48,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d1d81bd >2014-01-06 03:13:49,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3d1d81bd >2014-01-06 03:13:49,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28cdbaa7 >2014-01-06 03:13:49,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 28cdbaa7 >2014-01-06 03:13:49,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56eb4cb8 >2014-01-06 03:13:49,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f04a85a}, log id: 56eb4cb8 >2014-01-06 03:13:54,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4cc31895 >2014-01-06 03:13:55,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4cc31895 >2014-01-06 03:13:55,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b5e04cd >2014-01-06 03:13:55,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98568321}, log id: b5e04cd >2014-01-06 03:14:00,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 782b02d6 >2014-01-06 03:14:00,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 782b02d6 >2014-01-06 03:14:00,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c652a27 >2014-01-06 03:14:00,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1c11b81}, log id: c652a27 >2014-01-06 03:14:05,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 742a540 >2014-01-06 03:14:06,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 742a540 >2014-01-06 03:14:06,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47420886 >2014-01-06 03:14:06,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaeffa13}, log id: 47420886 >2014-01-06 03:14:11,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40d527a9 >2014-01-06 03:14:11,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 40d527a9 >2014-01-06 03:14:11,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f2be33c >2014-01-06 03:14:11,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6e83f77}, log id: 3f2be33c >2014-01-06 03:14:16,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4fdcd1a4 >2014-01-06 03:14:17,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4fdcd1a4 >2014-01-06 03:14:17,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c673ed6 >2014-01-06 03:14:17,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@754063b}, log id: 4c673ed6 >2014-01-06 03:14:22,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5008c5f3 >2014-01-06 03:14:22,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5008c5f3 >2014-01-06 03:14:22,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f6c01eb >2014-01-06 03:14:22,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85e37422}, log id: 2f6c01eb >2014-01-06 03:14:27,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ccecf62 >2014-01-06 03:14:27,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4ccecf62 >2014-01-06 03:14:27,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60498d6 >2014-01-06 03:14:28,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9653fc52}, log id: 60498d6 >2014-01-06 03:14:33,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b255530 >2014-01-06 03:14:33,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b255530 >2014-01-06 03:14:33,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74b9c724 >2014-01-06 03:14:33,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@668505ee}, log id: 74b9c724 >2014-01-06 03:14:38,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7cb8cbed >2014-01-06 03:14:38,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7cb8cbed >2014-01-06 03:14:38,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c521879 >2014-01-06 03:14:39,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3d13434}, log id: 6c521879 >2014-01-06 03:14:44,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ac75c53 >2014-01-06 03:14:44,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4ac75c53 >2014-01-06 03:14:44,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: fcecb88 >2014-01-06 03:14:44,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa1f90c4}, log id: fcecb88 >2014-01-06 03:14:49,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30280230 >2014-01-06 03:14:49,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 30280230 >2014-01-06 03:14:49,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d729cdc >2014-01-06 03:14:49,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d729cdc >2014-01-06 03:14:49,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c1deb11 >2014-01-06 03:14:49,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c6d4810}, log id: 3c1deb11 >2014-01-06 03:14:54,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77f7c31 >2014-01-06 03:14:55,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 77f7c31 >2014-01-06 03:14:55,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 423fb902 >2014-01-06 03:14:55,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b5edda}, log id: 423fb902 >2014-01-06 03:15:00,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 422be071 >2014-01-06 03:15:00,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 422be071 >2014-01-06 03:15:00,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13d66a1 >2014-01-06 03:15:00,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28a8757c}, log id: 13d66a1 >2014-01-06 03:15:05,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27c07fc6 >2014-01-06 03:15:06,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 27c07fc6 >2014-01-06 03:15:06,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 639f63f7 >2014-01-06 03:15:06,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e1863a6}, log id: 639f63f7 >2014-01-06 03:15:11,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2554c742 >2014-01-06 03:15:11,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2554c742 >2014-01-06 03:15:11,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2d9e9bdd >2014-01-06 03:15:11,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9610dea6}, log id: 2d9e9bdd >2014-01-06 03:15:16,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 69ea11b0 >2014-01-06 03:15:17,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 69ea11b0 >2014-01-06 03:15:17,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b6d65d8 >2014-01-06 03:15:17,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@894cacfd}, log id: b6d65d8 >2014-01-06 03:15:22,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 186835b4 >2014-01-06 03:15:22,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 186835b4 >2014-01-06 03:15:22,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d5f1d38 >2014-01-06 03:15:22,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df4a8086}, log id: 6d5f1d38 >2014-01-06 03:15:27,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: a96f0a9 >2014-01-06 03:15:27,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: a96f0a9 >2014-01-06 03:15:27,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5052ec51 >2014-01-06 03:15:28,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4018ef}, log id: 5052ec51 >2014-01-06 03:15:33,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e3ef577 >2014-01-06 03:15:33,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e3ef577 >2014-01-06 03:15:33,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f247c4b >2014-01-06 03:15:33,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@518fead}, log id: 5f247c4b >2014-01-06 03:15:38,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24d5730c >2014-01-06 03:15:38,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 24d5730c >2014-01-06 03:15:38,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 783858ae >2014-01-06 03:15:39,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6931ccec}, log id: 783858ae >2014-01-06 03:15:44,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3adcb317 >2014-01-06 03:15:44,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3adcb317 >2014-01-06 03:15:44,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b8e1fc4 >2014-01-06 03:15:44,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2fbf427}, log id: 7b8e1fc4 >2014-01-06 03:15:49,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74974bbb >2014-01-06 03:15:49,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [], log id: 74974bbb >2014-01-06 03:15:49,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49a83dea >2014-01-06 03:15:49,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 49a83dea >2014-01-06 03:15:49,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d5312fa >2014-01-06 03:15:49,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d538791}, log id: 7d5312fa >2014-01-06 03:15:55,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43963a0f >2014-01-06 03:15:55,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43963a0f >2014-01-06 03:15:55,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13f35156 >2014-01-06 03:15:55,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71844fd2}, log id: 13f35156 >2014-01-06 03:16:00,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1223e2b1 >2014-01-06 03:16:00,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1223e2b1 >2014-01-06 03:16:00,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15ae8e94 >2014-01-06 03:16:00,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0f7ebff}, log id: 15ae8e94 >2014-01-06 03:16:05,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31a9f7e1 >2014-01-06 03:16:06,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 31a9f7e1 >2014-01-06 03:16:06,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28f4b7f4 >2014-01-06 03:16:06,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9834bd21}, log id: 28f4b7f4 >2014-01-06 03:16:09,576 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-50) Start refreshing all users data >2014-01-06 03:16:10,533 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-01-06 03:16:10,534 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VM OVFs in Data Center Posixfs-DC-1 >2014-01-06 03:16:10,536 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully updated VM OVFs in Data Center Posixfs-DC-1 >2014-01-06 03:16:10,536 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update template OVFs in Data Center Posixfs-DC-1 >2014-01-06 03:16:10,537 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully updated templates OVFs in Data Center Posixfs-DC-1 >2014-01-06 03:16:10,537 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to remove unneeded template/vm OVFs in Data Center Posixfs-DC-1 >2014-01-06 03:16:10,538 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully removed unneeded template/vm OVFs in Data Center Posixfs-DC-1 >2014-01-06 03:16:10,538 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VM OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 03:16:10,540 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully updated VM OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 03:16:10,540 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update template OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 03:16:10,541 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully updated templates OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 03:16:10,541 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to remove unneeded template/vm OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 03:16:10,543 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully removed unneeded template/vm OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 03:16:11,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a1ece19 >2014-01-06 03:16:11,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-47) START, GlusterHooksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 11bc7fa0 >2014-01-06 03:16:11,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-50) START, GlusterHooksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e5eea78 >2014-01-06 03:16:11,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-47) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c9e3e485, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@85cfbb87, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@638cc9e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c17aadaf, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c0435cab, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@590494d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f10755ad, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bc356415, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d5bc76d0, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@76cbea9a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@eb0fac42, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a88d575e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@342ea7c7], log id: 11bc7fa0 >2014-01-06 03:16:11,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-50) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@94a8848c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2f84d54a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@21fbf2a1, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@554d51e8, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2134aa8f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a4d58ae2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4f98b8c9, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ce01547d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c1387e3e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6c146d2f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@15049843, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@20ffc381, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b7e0a64c], log id: 6e5eea78 >2014-01-06 03:16:11,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5a1ece19 >2014-01-06 03:16:11,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b04b776 >2014-01-06 03:16:11,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33f11a3a}, log id: 1b04b776 >2014-01-06 03:16:16,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22e54435 >2014-01-06 03:16:17,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 22e54435 >2014-01-06 03:16:17,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9983446 >2014-01-06 03:16:17,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a6b334a}, log id: 9983446 >2014-01-06 03:16:22,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50ee4f0f >2014-01-06 03:16:22,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 50ee4f0f >2014-01-06 03:16:22,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 53c173c7 >2014-01-06 03:16:22,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c269d699}, log id: 53c173c7 >2014-01-06 03:16:27,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 32a50c84 >2014-01-06 03:16:28,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 32a50c84 >2014-01-06 03:16:28,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5fbd2a82 >2014-01-06 03:16:28,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@996d59f1}, log id: 5fbd2a82 >2014-01-06 03:16:33,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47389cd5 >2014-01-06 03:16:33,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 47389cd5 >2014-01-06 03:16:33,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c8064cd >2014-01-06 03:16:33,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b3a3938}, log id: c8064cd >2014-01-06 03:16:38,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e7e74b3 >2014-01-06 03:16:39,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6e7e74b3 >2014-01-06 03:16:39,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14cf0c12 >2014-01-06 03:16:39,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c5a57c4}, log id: 14cf0c12 >2014-01-06 03:16:44,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b6c217d >2014-01-06 03:16:44,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b6c217d >2014-01-06 03:16:44,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e97308f >2014-01-06 03:16:44,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a729343}, log id: e97308f >2014-01-06 03:16:49,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74f0f83f >2014-01-06 03:16:49,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 74f0f83f >2014-01-06 03:16:49,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 398f00d8 >2014-01-06 03:16:49,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 398f00d8 >2014-01-06 03:16:49,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 343354e9 >2014-01-06 03:16:50,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c243512}, log id: 343354e9 >2014-01-06 03:16:55,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40308745 >2014-01-06 03:16:55,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 40308745 >2014-01-06 03:16:55,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46e64535 >2014-01-06 03:16:55,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83c29dac}, log id: 46e64535 >2014-01-06 03:17:00,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25e65d8a >2014-01-06 03:17:00,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25e65d8a >2014-01-06 03:17:00,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ce76357 >2014-01-06 03:17:01,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3813193}, log id: 6ce76357 >2014-01-06 03:17:06,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 557a4af7 >2014-01-06 03:17:06,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 557a4af7 >2014-01-06 03:17:06,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20e8ca66 >2014-01-06 03:17:06,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efeed645}, log id: 20e8ca66 >2014-01-06 03:17:11,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5717ce25 >2014-01-06 03:17:11,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5717ce25 >2014-01-06 03:17:11,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6af8ebe4 >2014-01-06 03:17:11,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ab32276}, log id: 6af8ebe4 >2014-01-06 03:17:17,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b16f8f2 >2014-01-06 03:17:17,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7b16f8f2 >2014-01-06 03:17:17,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4de1bdcd >2014-01-06 03:17:17,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80fc930c}, log id: 4de1bdcd >2014-01-06 03:17:22,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 12c712e9 >2014-01-06 03:17:22,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 12c712e9 >2014-01-06 03:17:22,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f27b60e >2014-01-06 03:17:22,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd0e2a2b}, log id: 2f27b60e >2014-01-06 03:17:27,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50c9eef1 >2014-01-06 03:17:28,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 50c9eef1 >2014-01-06 03:17:28,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43754fbd >2014-01-06 03:17:28,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7080b97}, log id: 43754fbd >2014-01-06 03:17:33,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33c961e0 >2014-01-06 03:17:33,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 33c961e0 >2014-01-06 03:17:33,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57d800c8 >2014-01-06 03:17:33,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba9d1c91}, log id: 57d800c8 >2014-01-06 03:17:38,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b0fe20f >2014-01-06 03:17:39,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3b0fe20f >2014-01-06 03:17:39,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46bc4cdf >2014-01-06 03:17:39,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eda26920}, log id: 46bc4cdf >2014-01-06 03:17:44,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 900bbb2 >2014-01-06 03:17:44,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 900bbb2 >2014-01-06 03:17:44,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64be509d >2014-01-06 03:17:44,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87c69b1e}, log id: 64be509d >2014-01-06 03:17:49,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 482e18d4 >2014-01-06 03:17:49,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 482e18d4 >2014-01-06 03:17:49,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e9fb79a >2014-01-06 03:17:50,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3e9fb79a >2014-01-06 03:17:50,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b17d0a7 >2014-01-06 03:17:50,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb4f0c95}, log id: 5b17d0a7 >2014-01-06 03:17:55,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e6ec12 >2014-01-06 03:17:55,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7e6ec12 >2014-01-06 03:17:55,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b13fb4b >2014-01-06 03:17:55,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bce05943}, log id: 6b13fb4b >2014-01-06 03:18:00,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64bb5d4a >2014-01-06 03:18:01,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 64bb5d4a >2014-01-06 03:18:01,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2177ca83 >2014-01-06 03:18:01,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52e3ff4c}, log id: 2177ca83 >2014-01-06 03:18:06,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 638d4611 >2014-01-06 03:18:06,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 638d4611 >2014-01-06 03:18:06,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 18636039 >2014-01-06 03:18:06,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c8c269b}, log id: 18636039 >2014-01-06 03:18:11,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b07bd8a >2014-01-06 03:18:11,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b07bd8a >2014-01-06 03:18:11,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: aceb177 >2014-01-06 03:18:12,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c49a5dd}, log id: aceb177 >2014-01-06 03:18:12,642 INFO [org.ovirt.engine.core.bll.gluster.ReplaceGlusterVolumeBrickCommand] (ajp-/127.0.0.1:8702-7) [62678f59] Running command: ReplaceGlusterVolumeBrickCommand internal: false. Entities affected : ID: b6e2ed30-370d-46b1-9071-fe851aa57caf Type: GlusterVolume >2014-01-06 03:18:12,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.ReplaceGlusterVolumeBrickVDSCommand] (ajp-/127.0.0.1:8702-7) [62678f59] START, ReplaceGlusterVolumeBrickVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43978848 >2014-01-06 03:18:17,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ac15cb4 >2014-01-06 03:18:17,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2ac15cb4 >2014-01-06 03:18:17,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18e23f82 >2014-01-06 03:18:17,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f42a7af}, log id: 18e23f82 >2014-01-06 03:18:21,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.ReplaceGlusterVolumeBrickVDSCommand] (ajp-/127.0.0.1:8702-7) [62678f59] FINISH, ReplaceGlusterVolumeBrickVDSCommand, log id: 43978848 >2014-01-06 03:18:21,275 ERROR [org.ovirt.engine.core.bll.gluster.ReplaceGlusterVolumeBrickCommand] (ajp-/127.0.0.1:8702-7) [62678f59] Command org.ovirt.engine.core.bll.gluster.ReplaceGlusterVolumeBrickCommand throw exception: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.ReplaceGlusterVolumeBrickCommand.executeCommand(ReplaceGlusterVolumeBrickCommand.java:80) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view10.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.api.restapi.resource.BackendResource.doAction(BackendResource.java:242) > at org.ovirt.engine.api.restapi.resource.AbstractBackendActionableResource.doAction(AbstractBackendActionableResource.java:74) > at org.ovirt.engine.api.restapi.resource.AbstractBackendActionableResource.doAction(AbstractBackendActionableResource.java:116) > at org.ovirt.engine.api.restapi.resource.gluster.BackendGlusterBrickResource.replace(BackendGlusterBrickResource.java:65) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:167) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceMethod.invokeOnTarget(ResourceMethod.java:269) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceMethod.invoke(ResourceMethod.java:227) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceLocator.invokeOnTargetObject(ResourceLocator.java:159) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceLocator.invoke(ResourceLocator.java:107) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceLocator.invokeOnTargetObject(ResourceLocator.java:154) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceLocator.invoke(ResourceLocator.java:107) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceLocator.invokeOnTargetObject(ResourceLocator.java:154) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceLocator.invoke(ResourceLocator.java:107) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceLocator.invokeOnTargetObject(ResourceLocator.java:154) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceLocator.invoke(ResourceLocator.java:107) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceLocator.invokeOnTargetObject(ResourceLocator.java:154) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.ResourceLocator.invoke(ResourceLocator.java:92) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.SynchronousDispatcher.getResponse(SynchronousDispatcher.java:542) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:524) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:126) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:208) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:55) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:50) [resteasy-jaxrs.jar:2.3.7.Final-redhat-2] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45] > >2014-01-06 03:18:21,307 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [62678f59] Correlation ID: 62678f59, Job ID: 2cdd8bbf-66d7-4753-aa15-cbcc9ab0234c, Call Stack: null, Custom Event ID: -1, Message: Could not start Gluster Volume distrep Replace Brick. >2014-01-06 03:18:21,339 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (ajp-/127.0.0.1:8702-7) Operation Failed: [Internal Engine Error] >2014-01-06 03:18:22,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47b76163 >2014-01-06 03:18:22,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 47b76163 >2014-01-06 03:18:22,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b2238af >2014-01-06 03:18:23,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4b677bd}, log id: 1b2238af >2014-01-06 03:18:28,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 42138d7d >2014-01-06 03:18:28,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 42138d7d >2014-01-06 03:18:28,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: db052f7 >2014-01-06 03:18:28,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6247ff4e}, log id: db052f7 >2014-01-06 03:18:33,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b56a0af >2014-01-06 03:18:33,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b56a0af >2014-01-06 03:18:33,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3423a302 >2014-01-06 03:18:33,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@517f6bb3}, log id: 3423a302 >2014-01-06 03:18:37,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: a729d6e >2014-01-06 03:18:37,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@159027f2, log id: a729d6e >2014-01-06 03:18:38,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21cd7ecb >2014-01-06 03:18:39,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 21cd7ecb >2014-01-06 03:18:39,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 176eab5d >2014-01-06 03:18:39,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba8d36d7}, log id: 176eab5d >2014-01-06 03:18:44,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d852a88 >2014-01-06 03:18:44,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5d852a88 >2014-01-06 03:18:44,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6483a7a4 >2014-01-06 03:18:44,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c1a19f3}, log id: 6483a7a4 >2014-01-06 03:18:49,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 616ebe50 >2014-01-06 03:18:49,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25f841ef >2014-01-06 03:18:50,048 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:18:50,056 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:18:50,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterTasksListVDSCommand, log id: 616ebe50 >2014-01-06 03:18:50,057 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-6) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:18:50,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25f841ef >2014-01-06 03:18:50,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7cd25417 >2014-01-06 03:18:50,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da003f65}, log id: 7cd25417 >2014-01-06 03:18:55,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 193af348 >2014-01-06 03:18:55,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 193af348 >2014-01-06 03:18:55,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ca95927 >2014-01-06 03:18:55,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e19ba9c}, log id: 5ca95927 >2014-01-06 03:19:00,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15a65f6d >2014-01-06 03:19:01,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 15a65f6d >2014-01-06 03:19:01,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d98d264 >2014-01-06 03:19:01,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aff8d57}, log id: 7d98d264 >2014-01-06 03:19:06,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6cb663d8 >2014-01-06 03:19:06,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6cb663d8 >2014-01-06 03:19:06,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50684622 >2014-01-06 03:19:06,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cf8a232}, log id: 50684622 >2014-01-06 03:19:11,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56212c51 >2014-01-06 03:19:12,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56212c51 >2014-01-06 03:19:12,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4810ccf6 >2014-01-06 03:19:12,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@693acc31}, log id: 4810ccf6 >2014-01-06 03:19:17,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76e578c3 >2014-01-06 03:19:17,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 76e578c3 >2014-01-06 03:19:17,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46055ba9 >2014-01-06 03:19:17,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1707a66c}, log id: 46055ba9 >2014-01-06 03:19:22,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f6c9cc8 >2014-01-06 03:19:22,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4f6c9cc8 >2014-01-06 03:19:22,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b7777b3 >2014-01-06 03:19:23,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce8f6636}, log id: 6b7777b3 >2014-01-06 03:19:28,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 664feb47 >2014-01-06 03:19:28,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 664feb47 >2014-01-06 03:19:28,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 460f3c8f >2014-01-06 03:19:28,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d641c8dc}, log id: 460f3c8f >2014-01-06 03:19:33,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3937ef2f >2014-01-06 03:19:33,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3937ef2f >2014-01-06 03:19:33,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 779b29ea >2014-01-06 03:19:34,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39184f51}, log id: 779b29ea >2014-01-06 03:19:39,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 62f8c6e >2014-01-06 03:19:39,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 62f8c6e >2014-01-06 03:19:39,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 38bf16c5 >2014-01-06 03:19:39,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3331246}, log id: 38bf16c5 >2014-01-06 03:19:44,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f00856d >2014-01-06 03:19:44,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6f00856d >2014-01-06 03:19:44,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22d0e9ed >2014-01-06 03:19:44,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abe7ab78}, log id: 22d0e9ed >2014-01-06 03:19:47,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (ajp-/127.0.0.1:8702-8) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4942ca2b >2014-01-06 03:19:48,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@71e2badb, log id: 4942ca2b >2014-01-06 03:19:49,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63a75f13 >2014-01-06 03:19:50,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e0295f0 >2014-01-06 03:19:50,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 63a75f13 >2014-01-06 03:19:50,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6bf7345d >2014-01-06 03:19:50,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6c156f6}, log id: 6bf7345d >2014-01-06 03:19:50,405 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:19:50,405 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:19:50,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterTasksListVDSCommand, log id: e0295f0 >2014-01-06 03:19:50,406 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-21) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:19:55,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6444ccc4 >2014-01-06 03:19:55,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6444ccc4 >2014-01-06 03:19:55,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 448fa469 >2014-01-06 03:19:55,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b084011a}, log id: 448fa469 >2014-01-06 03:20:00,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b4590db >2014-01-06 03:20:01,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b4590db >2014-01-06 03:20:01,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78cb9ebd >2014-01-06 03:20:01,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d45255a9}, log id: 78cb9ebd >2014-01-06 03:20:06,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 726c5268 >2014-01-06 03:20:06,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 726c5268 >2014-01-06 03:20:06,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2971bc87 >2014-01-06 03:20:06,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7602bce4}, log id: 2971bc87 >2014-01-06 03:20:11,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 544f927e >2014-01-06 03:20:12,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 544f927e >2014-01-06 03:20:12,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a27a18 >2014-01-06 03:20:12,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ed5523a}, log id: 2a27a18 >2014-01-06 03:20:17,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c0faaa0 >2014-01-06 03:20:17,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5c0faaa0 >2014-01-06 03:20:17,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 663aaca8 >2014-01-06 03:20:17,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff383ebc}, log id: 663aaca8 >2014-01-06 03:20:22,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6df2f879 >2014-01-06 03:20:22,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6df2f879 >2014-01-06 03:20:22,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3cdf646a >2014-01-06 03:20:23,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8a4e699}, log id: 3cdf646a >2014-01-06 03:20:28,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 281007fe >2014-01-06 03:20:28,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 281007fe >2014-01-06 03:20:28,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ebb22a4 >2014-01-06 03:20:28,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a41dc7af}, log id: 2ebb22a4 >2014-01-06 03:20:33,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b07a10d >2014-01-06 03:20:33,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b07a10d >2014-01-06 03:20:33,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f5bdfdb >2014-01-06 03:20:34,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38a9eec5}, log id: 6f5bdfdb >2014-01-06 03:20:39,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e4fdd02 >2014-01-06 03:20:39,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4e4fdd02 >2014-01-06 03:20:39,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4922a497 >2014-01-06 03:20:39,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2d130b4}, log id: 4922a497 >2014-01-06 03:20:44,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e3704de >2014-01-06 03:20:44,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3e3704de >2014-01-06 03:20:44,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48242cb4 >2014-01-06 03:20:44,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5267ba8a}, log id: 48242cb4 >2014-01-06 03:20:50,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73641eca >2014-01-06 03:20:50,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73641eca >2014-01-06 03:20:50,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3107faac >2014-01-06 03:20:50,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 175554a7 >2014-01-06 03:20:50,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4372657b}, log id: 3107faac >2014-01-06 03:20:50,737 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:20:50,737 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:20:50,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, log id: 175554a7 >2014-01-06 03:20:50,737 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-80) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:20:55,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e986ab9 >2014-01-06 03:20:55,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e986ab9 >2014-01-06 03:20:55,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62257e42 >2014-01-06 03:20:55,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7091b43c}, log id: 62257e42 >2014-01-06 03:21:00,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23fbef42 >2014-01-06 03:21:01,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 23fbef42 >2014-01-06 03:21:01,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 586e5349 >2014-01-06 03:21:01,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8b34734}, log id: 586e5349 >2014-01-06 03:21:06,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22571dad >2014-01-06 03:21:06,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 22571dad >2014-01-06 03:21:06,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c69282a >2014-01-06 03:21:06,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce44bfb0}, log id: 5c69282a >2014-01-06 03:21:08,403 INFO [org.ovirt.engine.core.bll.gluster.ReplaceGlusterVolumeBrickCommand] (ajp-/127.0.0.1:8702-11) [7c63a1b5] Running command: ReplaceGlusterVolumeBrickCommand internal: false. Entities affected : ID: b6e2ed30-370d-46b1-9071-fe851aa57caf Type: GlusterVolume >2014-01-06 03:21:08,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.ReplaceGlusterVolumeBrickVDSCommand] (ajp-/127.0.0.1:8702-11) [7c63a1b5] START, ReplaceGlusterVolumeBrickVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f69e7a3 >2014-01-06 03:21:08,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.ReplaceGlusterVolumeBrickVDSCommand] (ajp-/127.0.0.1:8702-11) [7c63a1b5] FINISH, ReplaceGlusterVolumeBrickVDSCommand, log id: 4f69e7a3 >2014-01-06 03:21:08,611 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [7c63a1b5] Correlation ID: 7c63a1b5, Job ID: 1f4a6ecb-892e-45e2-a432-f318697cf826, Call Stack: null, Custom Event ID: -1, Message: Could not start Gluster Volume distrep Replace Brick. >2014-01-06 03:21:08,618 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (ajp-/127.0.0.1:8702-11) Operation Failed: [volume replace brick start failed >error: replace brick is already started for volume >return code: -1] >2014-01-06 03:21:11,250 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-46) START, GetIsoListVDSCommand( storagePoolId = ee718678-261f-4bad-ab5e-73b9697cb5f8, ignoreFailoverLimit = false), log id: 4b91659a >2014-01-06 03:21:11,251 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-46) START, HsmGetIsoListVDSCommand(HostName = rhs-client10, HostId = e80de893-f6c4-4b96-9ce1-92a74ca5869a, storagePoolId=ee718678-261f-4bad-ab5e-73b9697cb5f8), log id: 36a58838 >2014-01-06 03:21:11,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-46) FINISH, HsmGetIsoListVDSCommand, return: [en_windows_7_enterprise_with_sp1_x64_dvd_u_677651.iso], log id: 36a58838 >2014-01-06 03:21:11,269 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-46) FINISH, GetIsoListVDSCommand, return: [en_windows_7_enterprise_with_sp1_x64_dvd_u_677651.iso], log id: 4b91659a >2014-01-06 03:21:11,280 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (pool-4-thread-46) Finished automatic refresh process for ISO file type with success, for storage domain id cc1bba44-7b89-4b6e-acff-fb066601f8c7. >2014-01-06 03:21:11,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5318f4dc >2014-01-06 03:21:12,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5318f4dc >2014-01-06 03:21:12,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f1e03a5 >2014-01-06 03:21:12,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab18ebf0}, log id: 6f1e03a5 >2014-01-06 03:21:17,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 42569fb4 >2014-01-06 03:21:17,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 42569fb4 >2014-01-06 03:21:17,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23081763 >2014-01-06 03:21:17,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6e0116e}, log id: 23081763 >2014-01-06 03:21:22,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c05cd4c >2014-01-06 03:21:23,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3c05cd4c >2014-01-06 03:21:23,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35be3e2c >2014-01-06 03:21:23,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5c9ad79}, log id: 35be3e2c >2014-01-06 03:21:28,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12a7e158 >2014-01-06 03:21:28,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 12a7e158 >2014-01-06 03:21:28,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15be3825 >2014-01-06 03:21:28,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ade03c3b}, log id: 15be3825 >2014-01-06 03:21:33,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59ad6b21 >2014-01-06 03:21:33,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 59ad6b21 >2014-01-06 03:21:33,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36f7eb78 >2014-01-06 03:21:34,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fc66199}, log id: 36f7eb78 >2014-01-06 03:21:39,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17da5c87 >2014-01-06 03:21:39,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 17da5c87 >2014-01-06 03:21:39,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33e78334 >2014-01-06 03:21:39,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b56df89}, log id: 33e78334 >2014-01-06 03:21:44,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 507f52af >2014-01-06 03:21:44,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 507f52af >2014-01-06 03:21:44,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12ce78f4 >2014-01-06 03:21:45,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@290b6e07}, log id: 12ce78f4 >2014-01-06 03:21:50,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 67749885 >2014-01-06 03:21:50,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 67749885 >2014-01-06 03:21:50,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 595aeaaa >2014-01-06 03:21:50,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b68117b}, log id: 595aeaaa >2014-01-06 03:21:50,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: df9d0b6 >2014-01-06 03:21:51,064 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:21:51,064 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:21:51,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, log id: df9d0b6 >2014-01-06 03:21:51,064 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-70) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:21:55,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c4a4143 >2014-01-06 03:21:55,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6c4a4143 >2014-01-06 03:21:55,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 750ba88b >2014-01-06 03:21:55,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be357e5}, log id: 750ba88b >2014-01-06 03:22:00,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59802f4a >2014-01-06 03:22:01,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 59802f4a >2014-01-06 03:22:01,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 715b3c77 >2014-01-06 03:22:01,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57e998f8}, log id: 715b3c77 >2014-01-06 03:22:06,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 764195a >2014-01-06 03:22:06,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 764195a >2014-01-06 03:22:06,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64119023 >2014-01-06 03:22:06,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdb13ce6}, log id: 64119023 >2014-01-06 03:22:11,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 309d5079 >2014-01-06 03:22:12,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 309d5079 >2014-01-06 03:22:12,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c7df1df >2014-01-06 03:22:12,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fa623b7}, log id: 5c7df1df >2014-01-06 03:22:17,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78129aa9 >2014-01-06 03:22:17,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 78129aa9 >2014-01-06 03:22:17,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b82507d >2014-01-06 03:22:17,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8eba32a9}, log id: 7b82507d >2014-01-06 03:22:22,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 763c7bae >2014-01-06 03:22:23,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 763c7bae >2014-01-06 03:22:23,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e1ba7ca >2014-01-06 03:22:23,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1052fe2d}, log id: e1ba7ca >2014-01-06 03:22:28,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 561fdd26 >2014-01-06 03:22:28,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 561fdd26 >2014-01-06 03:22:28,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b4ac0ae >2014-01-06 03:22:28,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a37bf129}, log id: 1b4ac0ae >2014-01-06 03:22:33,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18d13be0 >2014-01-06 03:22:34,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 18d13be0 >2014-01-06 03:22:34,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58d7d70d >2014-01-06 03:22:34,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fab9c802}, log id: 58d7d70d >2014-01-06 03:22:39,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c51b789 >2014-01-06 03:22:39,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3c51b789 >2014-01-06 03:22:39,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35d69fef >2014-01-06 03:22:39,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30e8023e}, log id: 35d69fef >2014-01-06 03:22:44,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e6394b1 >2014-01-06 03:22:44,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e6394b1 >2014-01-06 03:22:44,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21377b16 >2014-01-06 03:22:45,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@700ef548}, log id: 21377b16 >2014-01-06 03:22:50,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5857e605 >2014-01-06 03:22:50,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5857e605 >2014-01-06 03:22:50,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72cf2ef0 >2014-01-06 03:22:50,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c488715a}, log id: 72cf2ef0 >2014-01-06 03:22:51,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 342e9dcf >2014-01-06 03:22:51,381 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:22:51,382 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:22:51,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, log id: 342e9dcf >2014-01-06 03:22:51,382 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-59) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:22:55,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 353b9002 >2014-01-06 03:22:55,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 353b9002 >2014-01-06 03:22:55,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3804d399 >2014-01-06 03:22:55,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eea8615f}, log id: 3804d399 >2014-01-06 03:23:00,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6423a6d8 >2014-01-06 03:23:01,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6423a6d8 >2014-01-06 03:23:01,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 554e0520 >2014-01-06 03:23:01,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d10b0386}, log id: 554e0520 >2014-01-06 03:23:06,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b33bd67 >2014-01-06 03:23:06,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3b33bd67 >2014-01-06 03:23:06,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35f66cc >2014-01-06 03:23:06,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a01b6f06}, log id: 35f66cc >2014-01-06 03:23:11,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 104e36f >2014-01-06 03:23:12,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 104e36f >2014-01-06 03:23:12,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 319439c1 >2014-01-06 03:23:12,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb4f7bde}, log id: 319439c1 >2014-01-06 03:23:17,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b776fda >2014-01-06 03:23:17,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b776fda >2014-01-06 03:23:17,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54ddca1f >2014-01-06 03:23:17,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a90da8e9}, log id: 54ddca1f >2014-01-06 03:23:22,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 43d3c25e >2014-01-06 03:23:23,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 43d3c25e >2014-01-06 03:23:23,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b58b692 >2014-01-06 03:23:23,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35585aea}, log id: 2b58b692 >2014-01-06 03:23:28,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2cf227f9 >2014-01-06 03:23:28,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2cf227f9 >2014-01-06 03:23:28,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51fca2d4 >2014-01-06 03:23:28,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bafbbc8}, log id: 51fca2d4 >2014-01-06 03:23:33,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e316b64 >2014-01-06 03:23:33,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7e316b64 >2014-01-06 03:23:34,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 788e827a >2014-01-06 03:23:34,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7e38808}, log id: 788e827a >2014-01-06 03:23:37,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2d0f8696 >2014-01-06 03:23:37,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@66f2cd14, log id: 2d0f8696 >2014-01-06 03:23:39,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 49740dc6 >2014-01-06 03:23:39,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 49740dc6 >2014-01-06 03:23:39,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ca0082f >2014-01-06 03:23:39,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80a66182}, log id: ca0082f >2014-01-06 03:23:44,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 55afc27f >2014-01-06 03:23:44,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 55afc27f >2014-01-06 03:23:44,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d2226a3 >2014-01-06 03:23:45,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2292e2a7}, log id: 3d2226a3 >2014-01-06 03:23:50,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 366be9c8 >2014-01-06 03:23:50,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 366be9c8 >2014-01-06 03:23:50,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d1a8097 >2014-01-06 03:23:50,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c8cf62d}, log id: 7d1a8097 >2014-01-06 03:23:51,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21df76a6 >2014-01-06 03:23:51,726 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:23:51,726 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:23:51,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterTasksListVDSCommand, log id: 21df76a6 >2014-01-06 03:23:51,726 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-18) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:23:55,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1cfe8281 >2014-01-06 03:23:55,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1cfe8281 >2014-01-06 03:23:55,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e7528b8 >2014-01-06 03:23:55,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f09d4494}, log id: 1e7528b8 >2014-01-06 03:24:01,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f3c51fc >2014-01-06 03:24:01,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5f3c51fc >2014-01-06 03:24:01,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 18e0b581 >2014-01-06 03:24:01,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@141f3929}, log id: 18e0b581 >2014-01-06 03:24:06,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 629208b3 >2014-01-06 03:24:06,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 629208b3 >2014-01-06 03:24:06,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47b1e1eb >2014-01-06 03:24:06,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c18051c}, log id: 47b1e1eb >2014-01-06 03:24:11,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3805fae1 >2014-01-06 03:24:12,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3805fae1 >2014-01-06 03:24:12,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c0e4f4a >2014-01-06 03:24:12,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c467ef2}, log id: 3c0e4f4a >2014-01-06 03:24:17,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: cd1d89e >2014-01-06 03:24:17,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: cd1d89e >2014-01-06 03:24:17,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 65b42434 >2014-01-06 03:24:17,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f80d4b8}, log id: 65b42434 >2014-01-06 03:24:22,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1cafab7f >2014-01-06 03:24:23,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1cafab7f >2014-01-06 03:24:23,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f57e369 >2014-01-06 03:24:23,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eab0921c}, log id: 5f57e369 >2014-01-06 03:24:28,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 210a2fba >2014-01-06 03:24:28,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 210a2fba >2014-01-06 03:24:28,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40d9117a >2014-01-06 03:24:28,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71a0c727}, log id: 40d9117a >2014-01-06 03:24:33,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f29e176 >2014-01-06 03:24:34,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f29e176 >2014-01-06 03:24:34,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67c11131 >2014-01-06 03:24:34,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ccf2d47}, log id: 67c11131 >2014-01-06 03:24:39,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ff09c46 >2014-01-06 03:24:39,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ff09c46 >2014-01-06 03:24:39,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c0b7ee >2014-01-06 03:24:39,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@309ae327}, log id: 6c0b7ee >2014-01-06 03:24:44,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 825ae84 >2014-01-06 03:24:44,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 825ae84 >2014-01-06 03:24:44,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 245635d6 >2014-01-06 03:24:45,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c461a094}, log id: 245635d6 >2014-01-06 03:24:50,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 199ac00 >2014-01-06 03:24:50,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 199ac00 >2014-01-06 03:24:50,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6838d465 >2014-01-06 03:24:50,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@804a66f3}, log id: 6838d465 >2014-01-06 03:24:51,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1abd13d6 >2014-01-06 03:24:52,051 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:24:52,051 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:24:52,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, log id: 1abd13d6 >2014-01-06 03:24:52,051 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-28) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:24:55,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: de8971c >2014-01-06 03:24:55,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: de8971c >2014-01-06 03:24:55,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 69cd01fc >2014-01-06 03:24:55,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69217535}, log id: 69cd01fc >2014-01-06 03:25:01,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44950793 >2014-01-06 03:25:01,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 44950793 >2014-01-06 03:25:01,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f0f2ef7 >2014-01-06 03:25:01,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f8848d1}, log id: 3f0f2ef7 >2014-01-06 03:25:06,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16b1fcbc >2014-01-06 03:25:06,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 16b1fcbc >2014-01-06 03:25:06,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d228251 >2014-01-06 03:25:06,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dde97134}, log id: 7d228251 >2014-01-06 03:25:11,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7dd14b8f >2014-01-06 03:25:12,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7dd14b8f >2014-01-06 03:25:12,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7357c2a5 >2014-01-06 03:25:12,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9981f942}, log id: 7357c2a5 >2014-01-06 03:25:17,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 509327a6 >2014-01-06 03:25:17,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 509327a6 >2014-01-06 03:25:17,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e5674b0 >2014-01-06 03:25:17,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44cae2a3}, log id: 1e5674b0 >2014-01-06 03:25:22,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e742581 >2014-01-06 03:25:23,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2e742581 >2014-01-06 03:25:23,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7294cd0a >2014-01-06 03:25:23,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0cbf87}, log id: 7294cd0a >2014-01-06 03:25:28,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 415c4e04 >2014-01-06 03:25:28,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 415c4e04 >2014-01-06 03:25:28,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a331efe >2014-01-06 03:25:28,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87150022}, log id: 7a331efe >2014-01-06 03:25:33,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 766a3064 >2014-01-06 03:25:34,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 766a3064 >2014-01-06 03:25:34,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3170931a >2014-01-06 03:25:34,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1aa4f829}, log id: 3170931a >2014-01-06 03:25:39,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3199df29 >2014-01-06 03:25:39,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3199df29 >2014-01-06 03:25:39,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6655f9e >2014-01-06 03:25:39,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af47f7ab}, log id: 6655f9e >2014-01-06 03:25:44,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ae2b85d >2014-01-06 03:25:44,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4ae2b85d >2014-01-06 03:25:44,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ba0d8be >2014-01-06 03:25:45,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a89f846}, log id: 1ba0d8be >2014-01-06 03:25:50,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ab50cb8 >2014-01-06 03:25:50,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6ab50cb8 >2014-01-06 03:25:50,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e44c0b9 >2014-01-06 03:25:50,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd8e7ffe}, log id: 7e44c0b9 >2014-01-06 03:25:52,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4862ab35 >2014-01-06 03:25:52,376 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:25:52,376 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:25:52,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, log id: 4862ab35 >2014-01-06 03:25:52,377 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-33) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:25:55,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38cbdc21 >2014-01-06 03:25:55,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 38cbdc21 >2014-01-06 03:25:55,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ab812a4 >2014-01-06 03:25:56,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5c135b3}, log id: 2ab812a4 >2014-01-06 03:26:01,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19e7f9d6 >2014-01-06 03:26:01,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 19e7f9d6 >2014-01-06 03:26:01,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9fc59ba >2014-01-06 03:26:01,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d07b4da6}, log id: 9fc59ba >2014-01-06 03:26:06,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47245095 >2014-01-06 03:26:06,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 47245095 >2014-01-06 03:26:06,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c217ca7 >2014-01-06 03:26:06,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69eead8f}, log id: 1c217ca7 >2014-01-06 03:26:11,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72340fd6 >2014-01-06 03:26:12,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 72340fd6 >2014-01-06 03:26:12,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33bed8a2 >2014-01-06 03:26:12,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a167ec15}, log id: 33bed8a2 >2014-01-06 03:26:17,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c769bf2 >2014-01-06 03:26:17,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3c769bf2 >2014-01-06 03:26:17,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27a86ec5 >2014-01-06 03:26:17,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c46a1837}, log id: 27a86ec5 >2014-01-06 03:26:22,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b61f7dd >2014-01-06 03:26:23,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b61f7dd >2014-01-06 03:26:23,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 276b8f4d >2014-01-06 03:26:23,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f52e15a1}, log id: 276b8f4d >2014-01-06 03:26:28,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51fe998e >2014-01-06 03:26:28,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 51fe998e >2014-01-06 03:26:28,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2420b224 >2014-01-06 03:26:28,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f276c4c}, log id: 2420b224 >2014-01-06 03:26:33,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9cba569 >2014-01-06 03:26:34,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 9cba569 >2014-01-06 03:26:34,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7042459c >2014-01-06 03:26:34,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88b1909d}, log id: 7042459c >2014-01-06 03:26:39,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52192edb >2014-01-06 03:26:39,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 52192edb >2014-01-06 03:26:39,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34572075 >2014-01-06 03:26:39,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f739378}, log id: 34572075 >2014-01-06 03:26:44,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3af201ff >2014-01-06 03:26:44,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3af201ff >2014-01-06 03:26:44,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4cf884d0 >2014-01-06 03:26:45,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8f695f9}, log id: 4cf884d0 >2014-01-06 03:26:50,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 362d7d35 >2014-01-06 03:26:50,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 362d7d35 >2014-01-06 03:26:50,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d25ebd4 >2014-01-06 03:26:50,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c970ac3d}, log id: 1d25ebd4 >2014-01-06 03:26:52,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c55153b >2014-01-06 03:26:52,706 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:26:52,706 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:26:52,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, log id: 4c55153b >2014-01-06 03:26:52,706 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-99) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:26:55,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 411abcf0 >2014-01-06 03:26:55,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 411abcf0 >2014-01-06 03:26:55,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5724519f >2014-01-06 03:26:56,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b27a6181}, log id: 5724519f >2014-01-06 03:27:01,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b09df5b >2014-01-06 03:27:01,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b09df5b >2014-01-06 03:27:01,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f06ea8 >2014-01-06 03:27:01,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74f8fa0e}, log id: 3f06ea8 >2014-01-06 03:27:06,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c56eadb >2014-01-06 03:27:06,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4c56eadb >2014-01-06 03:27:06,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a76b024 >2014-01-06 03:27:06,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68ad527c}, log id: 5a76b024 >2014-01-06 03:27:11,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28a47f5 >2014-01-06 03:27:12,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 28a47f5 >2014-01-06 03:27:12,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b0b48d8 >2014-01-06 03:27:12,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4833fbd5}, log id: 6b0b48d8 >2014-01-06 03:27:17,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b3078da >2014-01-06 03:27:17,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b3078da >2014-01-06 03:27:17,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7439b1ae >2014-01-06 03:27:17,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7277e3ca}, log id: 7439b1ae >2014-01-06 03:27:22,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 422d0eb5 >2014-01-06 03:27:23,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 422d0eb5 >2014-01-06 03:27:23,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 146750f2 >2014-01-06 03:27:23,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e30fac1}, log id: 146750f2 >2014-01-06 03:27:28,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 626ae790 >2014-01-06 03:27:28,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 626ae790 >2014-01-06 03:27:28,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a0365df >2014-01-06 03:27:28,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b6b9be8}, log id: 6a0365df >2014-01-06 03:27:33,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6547170 >2014-01-06 03:27:34,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6547170 >2014-01-06 03:27:34,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ad67c8d >2014-01-06 03:27:34,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e71c5ca}, log id: 7ad67c8d >2014-01-06 03:27:39,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 76f08659 >2014-01-06 03:27:39,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 76f08659 >2014-01-06 03:27:39,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67a1d1d7 >2014-01-06 03:27:39,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8f19781}, log id: 67a1d1d7 >2014-01-06 03:27:44,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49599688 >2014-01-06 03:27:44,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 49599688 >2014-01-06 03:27:44,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60f275ab >2014-01-06 03:27:45,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91065c57}, log id: 60f275ab >2014-01-06 03:27:50,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49ed7b07 >2014-01-06 03:27:50,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 49ed7b07 >2014-01-06 03:27:50,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 711464ba >2014-01-06 03:27:50,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac9888f9}, log id: 711464ba >2014-01-06 03:27:52,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22b353c >2014-01-06 03:27:53,039 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:27:53,040 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:27:53,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, log id: 22b353c >2014-01-06 03:27:53,040 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-59) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:27:55,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 580b7373 >2014-01-06 03:27:55,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 580b7373 >2014-01-06 03:27:55,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ee0a391 >2014-01-06 03:27:56,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a69361d5}, log id: 3ee0a391 >2014-01-06 03:28:01,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 391c7a7c >2014-01-06 03:28:01,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 391c7a7c >2014-01-06 03:28:01,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 704c6f93 >2014-01-06 03:28:01,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cf4be86}, log id: 704c6f93 >2014-01-06 03:28:06,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3baf4bba >2014-01-06 03:28:06,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3baf4bba >2014-01-06 03:28:06,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 621fdad6 >2014-01-06 03:28:06,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a398524d}, log id: 621fdad6 >2014-01-06 03:28:12,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 611fe710 >2014-01-06 03:28:12,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 611fe710 >2014-01-06 03:28:12,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73cdcc5 >2014-01-06 03:28:12,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4141722a}, log id: 73cdcc5 >2014-01-06 03:28:17,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d3a4509 >2014-01-06 03:28:17,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7d3a4509 >2014-01-06 03:28:17,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 687d5d47 >2014-01-06 03:28:17,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f11ff99c}, log id: 687d5d47 >2014-01-06 03:28:22,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a62edb3 >2014-01-06 03:28:23,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7a62edb3 >2014-01-06 03:28:23,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 498916b1 >2014-01-06 03:28:23,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87a39f99}, log id: 498916b1 >2014-01-06 03:28:28,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 327ae1d7 >2014-01-06 03:28:28,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 327ae1d7 >2014-01-06 03:28:28,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 686836c4 >2014-01-06 03:28:28,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6209292}, log id: 686836c4 >2014-01-06 03:28:33,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 457f3b71 >2014-01-06 03:28:34,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 457f3b71 >2014-01-06 03:28:34,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c69f886 >2014-01-06 03:28:34,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7677a6b}, log id: 7c69f886 >2014-01-06 03:28:37,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f344ccc >2014-01-06 03:28:37,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@360aa66, log id: 5f344ccc >2014-01-06 03:28:39,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 576f4d02 >2014-01-06 03:28:39,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 576f4d02 >2014-01-06 03:28:39,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1eafb4bd >2014-01-06 03:28:39,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@461df71f}, log id: 1eafb4bd >2014-01-06 03:28:44,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 49ed83c3 >2014-01-06 03:28:45,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 49ed83c3 >2014-01-06 03:28:45,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 370830f0 >2014-01-06 03:28:45,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b81ae6e}, log id: 370830f0 >2014-01-06 03:28:50,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29849a14 >2014-01-06 03:28:50,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29849a14 >2014-01-06 03:28:50,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36e9228d >2014-01-06 03:28:50,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e43635bc}, log id: 36e9228d >2014-01-06 03:28:53,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 230248c6 >2014-01-06 03:28:53,375 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:28:53,375 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:28:53,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, log id: 230248c6 >2014-01-06 03:28:53,375 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-14) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:28:55,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 689cb8ca >2014-01-06 03:28:56,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 689cb8ca >2014-01-06 03:28:56,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34796f2e >2014-01-06 03:28:56,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@916f4ba3}, log id: 34796f2e >2014-01-06 03:29:01,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 663e873c >2014-01-06 03:29:01,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 663e873c >2014-01-06 03:29:01,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20ecc253 >2014-01-06 03:29:01,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da7b70ac}, log id: 20ecc253 >2014-01-06 03:29:06,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 385df625 >2014-01-06 03:29:06,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 385df625 >2014-01-06 03:29:06,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4acc9340 >2014-01-06 03:29:07,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@897fad7f}, log id: 4acc9340 >2014-01-06 03:29:12,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e6e010d >2014-01-06 03:29:12,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1e6e010d >2014-01-06 03:29:12,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 32dfc7da >2014-01-06 03:29:12,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca46986b}, log id: 32dfc7da >2014-01-06 03:29:17,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1736dbe8 >2014-01-06 03:29:17,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1736dbe8 >2014-01-06 03:29:17,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ee46797 >2014-01-06 03:29:17,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cb4910b}, log id: 4ee46797 >2014-01-06 03:29:23,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e18062d >2014-01-06 03:29:23,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1e18062d >2014-01-06 03:29:23,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1eed518a >2014-01-06 03:29:23,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@595df30f}, log id: 1eed518a >2014-01-06 03:29:28,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ea9c8c >2014-01-06 03:29:28,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6ea9c8c >2014-01-06 03:29:28,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c45ad14 >2014-01-06 03:29:28,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44215c13}, log id: 2c45ad14 >2014-01-06 03:29:33,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 757bdb23 >2014-01-06 03:29:34,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 757bdb23 >2014-01-06 03:29:34,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ae925e5 >2014-01-06 03:29:34,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@382aa8f8}, log id: 5ae925e5 >2014-01-06 03:29:39,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 600a2db7 >2014-01-06 03:29:39,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 600a2db7 >2014-01-06 03:29:39,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fc722d0 >2014-01-06 03:29:39,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b357458}, log id: 3fc722d0 >2014-01-06 03:29:44,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77ba35c3 >2014-01-06 03:29:45,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 77ba35c3 >2014-01-06 03:29:45,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a43b2e8 >2014-01-06 03:29:45,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f9848fc}, log id: 6a43b2e8 >2014-01-06 03:29:50,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48ffd4cc >2014-01-06 03:29:50,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 48ffd4cc >2014-01-06 03:29:50,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f31936e >2014-01-06 03:29:50,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1c6daeb}, log id: 5f31936e >2014-01-06 03:29:53,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 302a2a44 >2014-01-06 03:29:53,703 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:29:53,703 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:29:53,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, log id: 302a2a44 >2014-01-06 03:29:53,703 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-50) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:29:55,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4dc753b4 >2014-01-06 03:29:56,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4dc753b4 >2014-01-06 03:29:56,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37679a44 >2014-01-06 03:29:56,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23e0bdd5}, log id: 37679a44 >2014-01-06 03:30:01,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71fd23a4 >2014-01-06 03:30:01,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 71fd23a4 >2014-01-06 03:30:01,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 394dafa1 >2014-01-06 03:30:01,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6f21eb6}, log id: 394dafa1 >2014-01-06 03:30:06,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 853765e >2014-01-06 03:30:06,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 853765e >2014-01-06 03:30:06,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d758a92 >2014-01-06 03:30:07,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5a1b0ff}, log id: 4d758a92 >2014-01-06 03:30:12,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6541daff >2014-01-06 03:30:12,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6541daff >2014-01-06 03:30:12,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 555b893f >2014-01-06 03:30:12,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0f75c23}, log id: 555b893f >2014-01-06 03:30:17,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f3680a1 >2014-01-06 03:30:17,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f3680a1 >2014-01-06 03:30:17,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 77ac5f6d >2014-01-06 03:30:18,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77eac68e}, log id: 77ac5f6d >2014-01-06 03:30:23,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ca09730 >2014-01-06 03:30:23,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5ca09730 >2014-01-06 03:30:23,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6aec279c >2014-01-06 03:30:23,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e107c22c}, log id: 6aec279c >2014-01-06 03:30:28,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4cf04c60 >2014-01-06 03:30:28,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4cf04c60 >2014-01-06 03:30:28,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ae27659 >2014-01-06 03:30:28,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@465890bf}, log id: 3ae27659 >2014-01-06 03:30:33,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49680c14 >2014-01-06 03:30:34,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 49680c14 >2014-01-06 03:30:34,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e8bd06 >2014-01-06 03:30:34,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff0d389a}, log id: 1e8bd06 >2014-01-06 03:30:39,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ff28692 >2014-01-06 03:30:39,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2ff28692 >2014-01-06 03:30:39,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d48002b >2014-01-06 03:30:39,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a65cd8cd}, log id: 5d48002b >2014-01-06 03:30:44,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7febaafe >2014-01-06 03:30:45,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7febaafe >2014-01-06 03:30:45,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3cd7699e >2014-01-06 03:30:45,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca6c4a90}, log id: 3cd7699e >2014-01-06 03:30:50,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 397aeb29 >2014-01-06 03:30:50,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 397aeb29 >2014-01-06 03:30:50,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20a34d61 >2014-01-06 03:30:50,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c58d5b8d}, log id: 20a34d61 >2014-01-06 03:30:53,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60bb9061 >2014-01-06 03:30:54,036 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:30:54,036 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:30:54,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, log id: 60bb9061 >2014-01-06 03:30:54,036 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-53) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:30:55,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6870e519 >2014-01-06 03:30:56,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6870e519 >2014-01-06 03:30:56,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79a581fa >2014-01-06 03:30:56,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39b5463c}, log id: 79a581fa >2014-01-06 03:31:01,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 368ff03 >2014-01-06 03:31:01,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 368ff03 >2014-01-06 03:31:01,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70acbb9f >2014-01-06 03:31:01,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eadc75cb}, log id: 70acbb9f >2014-01-06 03:31:06,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4cc9f8a4 >2014-01-06 03:31:06,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4cc9f8a4 >2014-01-06 03:31:07,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29e96a8c >2014-01-06 03:31:07,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93b54285}, log id: 29e96a8c >2014-01-06 03:31:12,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ae2f8cd >2014-01-06 03:31:12,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6ae2f8cd >2014-01-06 03:31:12,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4464035e >2014-01-06 03:31:12,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@397f5785}, log id: 4464035e >2014-01-06 03:31:17,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 366a4705 >2014-01-06 03:31:17,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 366a4705 >2014-01-06 03:31:17,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2afdbaa3 >2014-01-06 03:31:18,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34f968d5}, log id: 2afdbaa3 >2014-01-06 03:31:23,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1874d6cf >2014-01-06 03:31:23,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1874d6cf >2014-01-06 03:31:23,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8ce622e >2014-01-06 03:31:23,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f252a18a}, log id: 8ce622e >2014-01-06 03:31:28,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e87a163 >2014-01-06 03:31:28,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2e87a163 >2014-01-06 03:31:28,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 313ace28 >2014-01-06 03:31:28,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2138a0d2}, log id: 313ace28 >2014-01-06 03:31:33,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 314e0dc9 >2014-01-06 03:31:34,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 314e0dc9 >2014-01-06 03:31:34,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11e91ca6 >2014-01-06 03:31:34,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b069b3b9}, log id: 11e91ca6 >2014-01-06 03:31:39,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40b7bcd7 >2014-01-06 03:31:39,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 40b7bcd7 >2014-01-06 03:31:39,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3842c796 >2014-01-06 03:31:39,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8800492e}, log id: 3842c796 >2014-01-06 03:31:44,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ba2fb0f >2014-01-06 03:31:45,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2ba2fb0f >2014-01-06 03:31:45,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23572f34 >2014-01-06 03:31:45,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4ef5822}, log id: 23572f34 >2014-01-06 03:31:50,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a17a683 >2014-01-06 03:31:50,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7a17a683 >2014-01-06 03:31:50,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1aa00f9e >2014-01-06 03:31:50,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72bd4251}, log id: 1aa00f9e >2014-01-06 03:31:54,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7394d28d >2014-01-06 03:31:54,375 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:31:54,375 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:31:54,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, log id: 7394d28d >2014-01-06 03:31:54,375 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-25) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:31:55,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5fe8ead8 >2014-01-06 03:31:56,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5fe8ead8 >2014-01-06 03:31:56,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a63e6aa >2014-01-06 03:31:56,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f868ed4}, log id: 4a63e6aa >2014-01-06 03:32:01,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1fffa861 >2014-01-06 03:32:01,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1fffa861 >2014-01-06 03:32:01,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3193d85a >2014-01-06 03:32:01,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9daf483a}, log id: 3193d85a >2014-01-06 03:32:06,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41d86e4 >2014-01-06 03:32:07,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 41d86e4 >2014-01-06 03:32:07,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a6b3d5d >2014-01-06 03:32:07,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4cd24c9}, log id: 2a6b3d5d >2014-01-06 03:32:12,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47f1e4cd >2014-01-06 03:32:12,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 47f1e4cd >2014-01-06 03:32:12,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ce818b8 >2014-01-06 03:32:12,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50652035}, log id: ce818b8 >2014-01-06 03:32:17,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74fe101d >2014-01-06 03:32:17,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 74fe101d >2014-01-06 03:32:17,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f9ced9d >2014-01-06 03:32:18,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2261296}, log id: 7f9ced9d >2014-01-06 03:32:23,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3dcb7629 >2014-01-06 03:32:23,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3dcb7629 >2014-01-06 03:32:23,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33d1ed0e >2014-01-06 03:32:23,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8d53377}, log id: 33d1ed0e >2014-01-06 03:32:28,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f4356c7 >2014-01-06 03:32:28,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f4356c7 >2014-01-06 03:32:28,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b5c5f52 >2014-01-06 03:32:29,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5960e7ea}, log id: 4b5c5f52 >2014-01-06 03:32:34,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6bd576c8 >2014-01-06 03:32:34,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6bd576c8 >2014-01-06 03:32:34,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 433ef4ff >2014-01-06 03:32:34,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6db05158}, log id: 433ef4ff >2014-01-06 03:32:39,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7528b91c >2014-01-06 03:32:39,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7528b91c >2014-01-06 03:32:39,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 679619a1 >2014-01-06 03:32:39,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c1eb666}, log id: 679619a1 >2014-01-06 03:32:45,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ff2e9ef >2014-01-06 03:32:45,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ff2e9ef >2014-01-06 03:32:45,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 34add03c >2014-01-06 03:32:45,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4285a284}, log id: 34add03c >2014-01-06 03:32:50,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ff916da >2014-01-06 03:32:50,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5ff916da >2014-01-06 03:32:50,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15a3d530 >2014-01-06 03:32:50,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7ab5114}, log id: 15a3d530 >2014-01-06 03:32:54,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b982906 >2014-01-06 03:32:54,703 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:32:54,703 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:32:54,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, log id: 6b982906 >2014-01-06 03:32:54,703 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-100) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:32:55,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d2385f4 >2014-01-06 03:32:56,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: d2385f4 >2014-01-06 03:32:56,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4be80666 >2014-01-06 03:32:56,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6da341b7}, log id: 4be80666 >2014-01-06 03:33:01,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: fbd4cf0 >2014-01-06 03:33:01,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: fbd4cf0 >2014-01-06 03:33:01,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35659951 >2014-01-06 03:33:01,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8ac6f3a}, log id: 35659951 >2014-01-06 03:33:06,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7929c343 >2014-01-06 03:33:07,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7929c343 >2014-01-06 03:33:07,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 45c8dc44 >2014-01-06 03:33:07,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf71ba1f}, log id: 45c8dc44 >2014-01-06 03:33:12,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a8f33b >2014-01-06 03:33:12,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1a8f33b >2014-01-06 03:33:12,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63f74765 >2014-01-06 03:33:12,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@646fa97d}, log id: 63f74765 >2014-01-06 03:33:17,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b82dbfc >2014-01-06 03:33:17,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b82dbfc >2014-01-06 03:33:18,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3adc04fa >2014-01-06 03:33:18,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@890d9916}, log id: 3adc04fa >2014-01-06 03:33:23,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2cac7eb0 >2014-01-06 03:33:23,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2cac7eb0 >2014-01-06 03:33:23,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a4cfcf7 >2014-01-06 03:33:23,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aad717be}, log id: 1a4cfcf7 >2014-01-06 03:33:28,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56f1cd95 >2014-01-06 03:33:28,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56f1cd95 >2014-01-06 03:33:28,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c8202fb >2014-01-06 03:33:29,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60110591}, log id: 2c8202fb >2014-01-06 03:33:34,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3430f4bb >2014-01-06 03:33:34,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3430f4bb >2014-01-06 03:33:34,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c20ec3f >2014-01-06 03:33:34,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ae5e964}, log id: 5c20ec3f >2014-01-06 03:33:37,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 268e8c0a >2014-01-06 03:33:37,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@443b3033, log id: 268e8c0a >2014-01-06 03:33:39,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f715017 >2014-01-06 03:33:39,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7f715017 >2014-01-06 03:33:39,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 113018d8 >2014-01-06 03:33:39,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bc6bf21}, log id: 113018d8 >2014-01-06 03:33:44,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ded1a43 >2014-01-06 03:33:45,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1ded1a43 >2014-01-06 03:33:45,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ab82efe >2014-01-06 03:33:45,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@663ba362}, log id: 6ab82efe >2014-01-06 03:33:50,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4eb695f9 >2014-01-06 03:33:50,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4eb695f9 >2014-01-06 03:33:50,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23599be8 >2014-01-06 03:33:50,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab335210}, log id: 23599be8 >2014-01-06 03:33:54,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f62041 >2014-01-06 03:33:55,035 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:33:55,035 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:33:55,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterTasksListVDSCommand, log id: f62041 >2014-01-06 03:33:55,036 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-18) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:33:55,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66ddb7d0 >2014-01-06 03:33:56,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66ddb7d0 >2014-01-06 03:33:56,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f2d3462 >2014-01-06 03:33:56,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aff40e15}, log id: 1f2d3462 >2014-01-06 03:34:01,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f3f8f1b >2014-01-06 03:34:01,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6f3f8f1b >2014-01-06 03:34:01,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16a21b57 >2014-01-06 03:34:01,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a5d9a60}, log id: 16a21b57 >2014-01-06 03:34:06,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68a5af6b >2014-01-06 03:34:07,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 68a5af6b >2014-01-06 03:34:07,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fef9012 >2014-01-06 03:34:07,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c3d8c2f}, log id: fef9012 >2014-01-06 03:34:12,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 104cce60 >2014-01-06 03:34:12,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 104cce60 >2014-01-06 03:34:12,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f0fddb1 >2014-01-06 03:34:12,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97a1622d}, log id: 7f0fddb1 >2014-01-06 03:34:17,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1796ba21 >2014-01-06 03:34:18,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1796ba21 >2014-01-06 03:34:18,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a35b91d >2014-01-06 03:34:18,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84d939c2}, log id: 2a35b91d >2014-01-06 03:34:23,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 873ad1 >2014-01-06 03:34:23,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 873ad1 >2014-01-06 03:34:23,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4733d1ab >2014-01-06 03:34:23,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df2c9641}, log id: 4733d1ab >2014-01-06 03:34:28,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 793f93c9 >2014-01-06 03:34:29,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 793f93c9 >2014-01-06 03:34:29,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b23f85d >2014-01-06 03:34:29,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44e61384}, log id: 5b23f85d >2014-01-06 03:34:34,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a5e3583 >2014-01-06 03:34:34,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6a5e3583 >2014-01-06 03:34:34,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f9a7091 >2014-01-06 03:34:34,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc082da7}, log id: 3f9a7091 >2014-01-06 03:34:39,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e73e496 >2014-01-06 03:34:40,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3e73e496 >2014-01-06 03:34:40,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ffb804c >2014-01-06 03:34:40,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ef8e30d}, log id: 4ffb804c >2014-01-06 03:34:45,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b1658d8 >2014-01-06 03:34:45,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b1658d8 >2014-01-06 03:34:45,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21d0b20b >2014-01-06 03:34:45,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1fcd41b}, log id: 21d0b20b >2014-01-06 03:34:50,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 75bb7693 >2014-01-06 03:34:50,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 75bb7693 >2014-01-06 03:34:50,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10741a99 >2014-01-06 03:34:51,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5700307e}, log id: 10741a99 >2014-01-06 03:34:55,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 591ca9d5 >2014-01-06 03:34:55,370 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:34:55,370 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:34:55,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, log id: 591ca9d5 >2014-01-06 03:34:55,371 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-20) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:34:56,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c6a69ff >2014-01-06 03:34:56,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1c6a69ff >2014-01-06 03:34:56,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2bab4bcd >2014-01-06 03:34:56,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c518202d}, log id: 2bab4bcd >2014-01-06 03:35:01,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29eabe59 >2014-01-06 03:35:01,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 29eabe59 >2014-01-06 03:35:01,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3dc697e8 >2014-01-06 03:35:02,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69f70996}, log id: 3dc697e8 >2014-01-06 03:35:07,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fee961d >2014-01-06 03:35:07,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3fee961d >2014-01-06 03:35:07,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6929fc7a >2014-01-06 03:35:07,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66c900e5}, log id: 6929fc7a >2014-01-06 03:35:12,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4154ef45 >2014-01-06 03:35:12,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4154ef45 >2014-01-06 03:35:12,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5966c308 >2014-01-06 03:35:12,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b728ad4c}, log id: 5966c308 >2014-01-06 03:35:17,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3807eeb8 >2014-01-06 03:35:18,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3807eeb8 >2014-01-06 03:35:18,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 245cd953 >2014-01-06 03:35:18,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7b07dad}, log id: 245cd953 >2014-01-06 03:35:23,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a29ece2 >2014-01-06 03:35:23,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2a29ece2 >2014-01-06 03:35:23,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10c066a8 >2014-01-06 03:35:23,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a2cd95a}, log id: 10c066a8 >2014-01-06 03:35:28,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7423ca2f >2014-01-06 03:35:29,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7423ca2f >2014-01-06 03:35:29,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4996a3dd >2014-01-06 03:35:29,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@957381f0}, log id: 4996a3dd >2014-01-06 03:35:34,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11ab6f9c >2014-01-06 03:35:34,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 11ab6f9c >2014-01-06 03:35:34,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c8683b3 >2014-01-06 03:35:34,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e73cf5f0}, log id: 1c8683b3 >2014-01-06 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-22) Start deleteAgedOutAuditLogs >2014-01-06 03:35:35,006 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-22) Finished deleteAgedOutAuditLogs >2014-01-06 03:35:39,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3174f022 >2014-01-06 03:35:40,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3174f022 >2014-01-06 03:35:40,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46206e3d >2014-01-06 03:35:40,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d27e2ae}, log id: 46206e3d >2014-01-06 03:35:45,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3abacf47 >2014-01-06 03:35:45,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3abacf47 >2014-01-06 03:35:45,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2454c0b8 >2014-01-06 03:35:45,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc8461bf}, log id: 2454c0b8 >2014-01-06 03:35:50,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 541e02e4 >2014-01-06 03:35:50,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 541e02e4 >2014-01-06 03:35:50,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f17d904 >2014-01-06 03:35:51,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40521c24}, log id: 7f17d904 >2014-01-06 03:35:55,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c820dc7 >2014-01-06 03:35:55,697 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:35:55,697 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:35:55,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, log id: c820dc7 >2014-01-06 03:35:55,698 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-64) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:35:56,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 49e36d7e >2014-01-06 03:35:56,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 49e36d7e >2014-01-06 03:35:56,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52b59a63 >2014-01-06 03:35:56,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@592d03d7}, log id: 52b59a63 >2014-01-06 03:36:01,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21917680 >2014-01-06 03:36:01,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 21917680 >2014-01-06 03:36:01,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 67fae42b >2014-01-06 03:36:02,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47c71540}, log id: 67fae42b >2014-01-06 03:36:07,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 665e8f02 >2014-01-06 03:36:07,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 665e8f02 >2014-01-06 03:36:07,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 591edea >2014-01-06 03:36:07,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2028eb8}, log id: 591edea >2014-01-06 03:36:12,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 704b8f69 >2014-01-06 03:36:12,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 704b8f69 >2014-01-06 03:36:12,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c31ea7f >2014-01-06 03:36:12,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e448dbf}, log id: c31ea7f >2014-01-06 03:36:17,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51a821c7 >2014-01-06 03:36:18,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 51a821c7 >2014-01-06 03:36:18,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6cea265f >2014-01-06 03:36:18,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fb183ad}, log id: 6cea265f >2014-01-06 03:36:23,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 67138c3 >2014-01-06 03:36:23,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 67138c3 >2014-01-06 03:36:23,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ce2a2b4 >2014-01-06 03:36:23,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5050ce1}, log id: 3ce2a2b4 >2014-01-06 03:36:28,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 541b59a6 >2014-01-06 03:36:29,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 541b59a6 >2014-01-06 03:36:29,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2095c225 >2014-01-06 03:36:29,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@504cc13d}, log id: 2095c225 >2014-01-06 03:36:34,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60df857a >2014-01-06 03:36:34,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 60df857a >2014-01-06 03:36:34,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3404fd6e >2014-01-06 03:36:34,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b755fe13}, log id: 3404fd6e >2014-01-06 03:36:39,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1926c8cb >2014-01-06 03:36:40,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1926c8cb >2014-01-06 03:36:40,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 42ce3eeb >2014-01-06 03:36:40,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba69fd84}, log id: 42ce3eeb >2014-01-06 03:36:45,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3be84582 >2014-01-06 03:36:45,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3be84582 >2014-01-06 03:36:45,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5deb1018 >2014-01-06 03:36:45,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd1d4de4}, log id: 5deb1018 >2014-01-06 03:36:50,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43ef0821 >2014-01-06 03:36:51,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43ef0821 >2014-01-06 03:36:51,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 76a93c06 >2014-01-06 03:36:51,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1dcb0a0}, log id: 76a93c06 >2014-01-06 03:36:55,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a2210b3 >2014-01-06 03:36:56,032 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:36:56,032 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:36:56,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, log id: 7a2210b3 >2014-01-06 03:36:56,033 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-75) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:36:56,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58bce430 >2014-01-06 03:36:56,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 58bce430 >2014-01-06 03:36:56,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d0be366 >2014-01-06 03:36:56,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9399535}, log id: 4d0be366 >2014-01-06 03:37:01,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 38a1b91d >2014-01-06 03:37:01,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 38a1b91d >2014-01-06 03:37:01,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 560c0cee >2014-01-06 03:37:02,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a901fac2}, log id: 560c0cee >2014-01-06 03:37:07,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59a088f3 >2014-01-06 03:37:07,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 59a088f3 >2014-01-06 03:37:07,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7bdf151b >2014-01-06 03:37:07,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9de645b}, log id: 7bdf151b >2014-01-06 03:37:12,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 736b394f >2014-01-06 03:37:12,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 736b394f >2014-01-06 03:37:12,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3fa30d4d >2014-01-06 03:37:12,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e30b81e7}, log id: 3fa30d4d >2014-01-06 03:37:18,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 16e82097 >2014-01-06 03:37:18,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 16e82097 >2014-01-06 03:37:18,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50b2d2a6 >2014-01-06 03:37:18,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dbcaaca}, log id: 50b2d2a6 >2014-01-06 03:37:23,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43e4d446 >2014-01-06 03:37:23,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43e4d446 >2014-01-06 03:37:23,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9e9e02b >2014-01-06 03:37:23,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd3b2e51}, log id: 9e9e02b >2014-01-06 03:37:28,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e49b176 >2014-01-06 03:37:29,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5e49b176 >2014-01-06 03:37:29,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64a98d10 >2014-01-06 03:37:29,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32908431}, log id: 64a98d10 >2014-01-06 03:37:34,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 469ca6e0 >2014-01-06 03:37:34,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 469ca6e0 >2014-01-06 03:37:34,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7939cf99 >2014-01-06 03:37:34,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93bf3f1b}, log id: 7939cf99 >2014-01-06 03:37:39,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51d55386 >2014-01-06 03:37:40,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 51d55386 >2014-01-06 03:37:40,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5837434d >2014-01-06 03:37:40,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab7c28f4}, log id: 5837434d >2014-01-06 03:37:45,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 778eab29 >2014-01-06 03:37:45,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 778eab29 >2014-01-06 03:37:45,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 754c9125 >2014-01-06 03:37:45,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80257257}, log id: 754c9125 >2014-01-06 03:37:50,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5cfe1a72 >2014-01-06 03:37:51,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5cfe1a72 >2014-01-06 03:37:51,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19df40be >2014-01-06 03:37:51,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4267b537}, log id: 19df40be >2014-01-06 03:37:56,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 85f30 >2014-01-06 03:37:56,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fbc632a >2014-01-06 03:37:56,374 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:37:56,374 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:37:56,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, log id: 85f30 >2014-01-06 03:37:56,374 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-29) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:37:56,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: fbc632a >2014-01-06 03:37:56,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14b9991b >2014-01-06 03:37:56,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c131abe}, log id: 14b9991b >2014-01-06 03:38:01,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59a99d5a >2014-01-06 03:38:01,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 59a99d5a >2014-01-06 03:38:01,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 15f050b1 >2014-01-06 03:38:02,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d38454e}, log id: 15f050b1 >2014-01-06 03:38:07,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52a1284f >2014-01-06 03:38:07,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 52a1284f >2014-01-06 03:38:07,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37f2107f >2014-01-06 03:38:07,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a65c1b0b}, log id: 37f2107f >2014-01-06 03:38:12,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b19c168 >2014-01-06 03:38:12,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3b19c168 >2014-01-06 03:38:12,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48c1e975 >2014-01-06 03:38:13,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfa53f15}, log id: 48c1e975 >2014-01-06 03:38:18,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ef5561b >2014-01-06 03:38:18,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ef5561b >2014-01-06 03:38:18,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d21507a >2014-01-06 03:38:18,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e17b49fb}, log id: 4d21507a >2014-01-06 03:38:23,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 457b90e6 >2014-01-06 03:38:23,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 457b90e6 >2014-01-06 03:38:23,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 90aa113 >2014-01-06 03:38:23,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1130ddb4}, log id: 90aa113 >2014-01-06 03:38:28,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d91190c >2014-01-06 03:38:29,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4d91190c >2014-01-06 03:38:29,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1390269 >2014-01-06 03:38:29,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85e89c6b}, log id: 1390269 >2014-01-06 03:38:34,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23e41082 >2014-01-06 03:38:34,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 23e41082 >2014-01-06 03:38:34,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7eaf03dc >2014-01-06 03:38:34,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7477554}, log id: 7eaf03dc >2014-01-06 03:38:37,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5796866f >2014-01-06 03:38:38,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2beb2d52, log id: 5796866f >2014-01-06 03:38:39,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 626a9381 >2014-01-06 03:38:40,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 626a9381 >2014-01-06 03:38:40,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4106dd8e >2014-01-06 03:38:40,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b97e3dc9}, log id: 4106dd8e >2014-01-06 03:38:45,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20317313 >2014-01-06 03:38:45,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 20317313 >2014-01-06 03:38:45,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7873e8fa >2014-01-06 03:38:45,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48e21507}, log id: 7873e8fa >2014-01-06 03:38:50,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61bad66d >2014-01-06 03:38:51,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 61bad66d >2014-01-06 03:38:51,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 655caa1f >2014-01-06 03:38:51,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9138e2da}, log id: 655caa1f >2014-01-06 03:38:56,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42b9fedd >2014-01-06 03:38:56,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 448eaf90 >2014-01-06 03:38:56,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 42b9fedd >2014-01-06 03:38:56,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1fd8ea7 >2014-01-06 03:38:56,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9596e225}, log id: 1fd8ea7 >2014-01-06 03:38:56,712 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:38:56,712 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:38:56,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, log id: 448eaf90 >2014-01-06 03:38:56,713 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-17) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:39:01,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79dcfcc8 >2014-01-06 03:39:01,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 79dcfcc8 >2014-01-06 03:39:01,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7572c266 >2014-01-06 03:39:02,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1c84385}, log id: 7572c266 >2014-01-06 03:39:07,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c6a33c5 >2014-01-06 03:39:07,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6c6a33c5 >2014-01-06 03:39:07,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 330f734a >2014-01-06 03:39:07,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3bbd2b0}, log id: 330f734a >2014-01-06 03:39:12,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e3f4fdf >2014-01-06 03:39:12,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7e3f4fdf >2014-01-06 03:39:12,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 402723b1 >2014-01-06 03:39:12,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdc869f7}, log id: 402723b1 >2014-01-06 03:39:18,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2091aff5 >2014-01-06 03:39:18,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2091aff5 >2014-01-06 03:39:18,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 787b5f87 >2014-01-06 03:39:18,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e4a1d44}, log id: 787b5f87 >2014-01-06 03:39:23,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29384b55 >2014-01-06 03:39:23,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29384b55 >2014-01-06 03:39:23,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3236c3be >2014-01-06 03:39:23,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42eb0870}, log id: 3236c3be >2014-01-06 03:39:28,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d0e174 >2014-01-06 03:39:29,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3d0e174 >2014-01-06 03:39:29,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 473ab53f >2014-01-06 03:39:29,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a44d20d7}, log id: 473ab53f >2014-01-06 03:39:34,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 834ade7 >2014-01-06 03:39:34,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 834ade7 >2014-01-06 03:39:34,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7af5f446 >2014-01-06 03:39:34,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f725730}, log id: 7af5f446 >2014-01-06 03:39:39,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 153895df >2014-01-06 03:39:40,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 153895df >2014-01-06 03:39:40,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40e5c9f >2014-01-06 03:39:40,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e901f286}, log id: 40e5c9f >2014-01-06 03:39:45,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e860e8a >2014-01-06 03:39:45,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1e860e8a >2014-01-06 03:39:45,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6480ff65 >2014-01-06 03:39:45,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@337a6b8f}, log id: 6480ff65 >2014-01-06 03:39:50,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4dc88ef3 >2014-01-06 03:39:51,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4dc88ef3 >2014-01-06 03:39:51,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58eeeb91 >2014-01-06 03:39:51,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a42f8f1}, log id: 58eeeb91 >2014-01-06 03:39:56,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: d283e51 >2014-01-06 03:39:56,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: d283e51 >2014-01-06 03:39:56,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2bebf494 >2014-01-06 03:39:56,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bebdfa2}, log id: 2bebf494 >2014-01-06 03:39:56,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70e76755 >2014-01-06 03:39:57,049 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:39:57,049 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:39:57,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, log id: 70e76755 >2014-01-06 03:39:57,049 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-22) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:40:01,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 55b66abb >2014-01-06 03:40:01,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 55b66abb >2014-01-06 03:40:01,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21dcb3c2 >2014-01-06 03:40:02,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f640da3}, log id: 21dcb3c2 >2014-01-06 03:40:07,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 519de98a >2014-01-06 03:40:07,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 519de98a >2014-01-06 03:40:07,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 12d6cab2 >2014-01-06 03:40:07,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1f30e05}, log id: 12d6cab2 >2014-01-06 03:40:12,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a5d8518 >2014-01-06 03:40:12,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7a5d8518 >2014-01-06 03:40:12,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 297eb06b >2014-01-06 03:40:12,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bf64eb5}, log id: 297eb06b >2014-01-06 03:40:18,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ed9ad5e >2014-01-06 03:40:18,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2ed9ad5e >2014-01-06 03:40:18,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c3104ec >2014-01-06 03:40:18,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7a8947d}, log id: 6c3104ec >2014-01-06 03:40:23,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6715d85d >2014-01-06 03:40:23,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6715d85d >2014-01-06 03:40:23,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a9ae8d8 >2014-01-06 03:40:23,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@613560f9}, log id: 5a9ae8d8 >2014-01-06 03:40:28,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6fb58300 >2014-01-06 03:40:29,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6fb58300 >2014-01-06 03:40:29,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4cd87231 >2014-01-06 03:40:29,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1978f1}, log id: 4cd87231 >2014-01-06 03:40:34,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54f68e21 >2014-01-06 03:40:34,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 54f68e21 >2014-01-06 03:40:34,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1bef5ad1 >2014-01-06 03:40:34,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f2cfba4}, log id: 1bef5ad1 >2014-01-06 03:40:39,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d1370c8 >2014-01-06 03:40:40,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6d1370c8 >2014-01-06 03:40:40,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3aafe395 >2014-01-06 03:40:40,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7521cbf0}, log id: 3aafe395 >2014-01-06 03:40:45,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47d3317d >2014-01-06 03:40:45,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 47d3317d >2014-01-06 03:40:45,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1911f932 >2014-01-06 03:40:45,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12b79c74}, log id: 1911f932 >2014-01-06 03:40:50,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36783ca5 >2014-01-06 03:40:51,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 36783ca5 >2014-01-06 03:40:51,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4538f1b5 >2014-01-06 03:40:51,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1e8d25c}, log id: 4538f1b5 >2014-01-06 03:40:56,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cdd0cca >2014-01-06 03:40:56,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6cdd0cca >2014-01-06 03:40:56,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66e19636 >2014-01-06 03:40:56,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb7da0ab}, log id: 66e19636 >2014-01-06 03:40:57,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e4324f2 >2014-01-06 03:40:57,386 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:40:57,386 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:40:57,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, log id: 6e4324f2 >2014-01-06 03:40:57,386 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-98) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:41:01,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14a9ccfd >2014-01-06 03:41:01,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 14a9ccfd >2014-01-06 03:41:01,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78bb5546 >2014-01-06 03:41:02,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f0d84d}, log id: 78bb5546 >2014-01-06 03:41:07,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 359b9a23 >2014-01-06 03:41:07,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 359b9a23 >2014-01-06 03:41:07,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43bd42fe >2014-01-06 03:41:07,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ee27741}, log id: 43bd42fe >2014-01-06 03:41:12,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 726df2f8 >2014-01-06 03:41:12,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 726df2f8 >2014-01-06 03:41:12,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7cb2cd32 >2014-01-06 03:41:12,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21f93b69}, log id: 7cb2cd32 >2014-01-06 03:41:17,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48c1ef4c >2014-01-06 03:41:18,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 48c1ef4c >2014-01-06 03:41:18,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ec3b141 >2014-01-06 03:41:18,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b74adf8}, log id: 4ec3b141 >2014-01-06 03:41:23,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6491df56 >2014-01-06 03:41:23,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6491df56 >2014-01-06 03:41:23,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 727600c7 >2014-01-06 03:41:23,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@584f2058}, log id: 727600c7 >2014-01-06 03:41:28,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c5d6ba6 >2014-01-06 03:41:29,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7c5d6ba6 >2014-01-06 03:41:29,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79444c31 >2014-01-06 03:41:29,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3088b430}, log id: 79444c31 >2014-01-06 03:41:34,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b3218bc >2014-01-06 03:41:34,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b3218bc >2014-01-06 03:41:34,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b444d2e >2014-01-06 03:41:34,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc261ee4}, log id: 2b444d2e >2014-01-06 03:41:39,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 144c1972 >2014-01-06 03:41:40,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 144c1972 >2014-01-06 03:41:40,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 294a3121 >2014-01-06 03:41:40,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6570389}, log id: 294a3121 >2014-01-06 03:41:45,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 677e9dec >2014-01-06 03:41:45,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 677e9dec >2014-01-06 03:41:45,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d1510d5 >2014-01-06 03:41:45,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e019b89a}, log id: 6d1510d5 >2014-01-06 03:41:50,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34339fed >2014-01-06 03:41:51,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 34339fed >2014-01-06 03:41:51,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13f3d51f >2014-01-06 03:41:51,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@370639d8}, log id: 13f3d51f >2014-01-06 03:41:56,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54b0b49c >2014-01-06 03:41:56,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54b0b49c >2014-01-06 03:41:56,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ac9720a >2014-01-06 03:41:56,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22e228d}, log id: 7ac9720a >2014-01-06 03:41:57,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a79e25 >2014-01-06 03:41:57,710 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:41:57,710 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:41:57,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, log id: 7a79e25 >2014-01-06 03:41:57,710 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-41) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:42:01,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5363f6f >2014-01-06 03:42:01,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5363f6f >2014-01-06 03:42:01,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b49ed0a >2014-01-06 03:42:02,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c867d90}, log id: 2b49ed0a >2014-01-06 03:42:07,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71b81b7c >2014-01-06 03:42:07,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 71b81b7c >2014-01-06 03:42:07,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e89158f >2014-01-06 03:42:07,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6401a4d}, log id: 3e89158f >2014-01-06 03:42:12,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6bd27d55 >2014-01-06 03:42:12,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6bd27d55 >2014-01-06 03:42:12,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61f9297a >2014-01-06 03:42:12,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d6c7153}, log id: 61f9297a >2014-01-06 03:42:17,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 515c4655 >2014-01-06 03:42:18,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 515c4655 >2014-01-06 03:42:18,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 475a85ea >2014-01-06 03:42:18,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b5856de}, log id: 475a85ea >2014-01-06 03:42:23,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6aed9f91 >2014-01-06 03:42:23,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6aed9f91 >2014-01-06 03:42:23,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59768a04 >2014-01-06 03:42:23,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a588508e}, log id: 59768a04 >2014-01-06 03:42:28,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71235fd3 >2014-01-06 03:42:29,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 71235fd3 >2014-01-06 03:42:29,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 770efaad >2014-01-06 03:42:29,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@437b24bb}, log id: 770efaad >2014-01-06 03:42:34,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c172ac1 >2014-01-06 03:42:34,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2c172ac1 >2014-01-06 03:42:34,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 637ce8f6 >2014-01-06 03:42:34,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b875958}, log id: 637ce8f6 >2014-01-06 03:42:39,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5fb32e03 >2014-01-06 03:42:40,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5fb32e03 >2014-01-06 03:42:40,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5178b13f >2014-01-06 03:42:40,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d7b46bd}, log id: 5178b13f >2014-01-06 03:42:45,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39ef8ff7 >2014-01-06 03:42:45,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 39ef8ff7 >2014-01-06 03:42:45,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a019cc0 >2014-01-06 03:42:45,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c89b0fb2}, log id: 4a019cc0 >2014-01-06 03:42:50,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3436a6e6 >2014-01-06 03:42:51,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3436a6e6 >2014-01-06 03:42:51,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2384261b >2014-01-06 03:42:51,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8677b578}, log id: 2384261b >2014-01-06 03:42:56,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73c1c371 >2014-01-06 03:42:56,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73c1c371 >2014-01-06 03:42:56,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64007559 >2014-01-06 03:42:56,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b957415d}, log id: 64007559 >2014-01-06 03:42:57,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 225fde6a >2014-01-06 03:42:58,034 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:42:58,034 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:42:58,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterTasksListVDSCommand, log id: 225fde6a >2014-01-06 03:42:58,034 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-4) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:43:01,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6345bddf >2014-01-06 03:43:01,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6345bddf >2014-01-06 03:43:01,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b97a34a >2014-01-06 03:43:02,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b96b3a4}, log id: 1b97a34a >2014-01-06 03:43:07,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73624e62 >2014-01-06 03:43:07,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73624e62 >2014-01-06 03:43:07,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e6c5a2e >2014-01-06 03:43:07,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60b7aeb4}, log id: 6e6c5a2e >2014-01-06 03:43:12,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36245b9c >2014-01-06 03:43:12,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 36245b9c >2014-01-06 03:43:12,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17d01543 >2014-01-06 03:43:12,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d031f8d}, log id: 17d01543 >2014-01-06 03:43:18,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21c69c95 >2014-01-06 03:43:18,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 21c69c95 >2014-01-06 03:43:18,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37ebf002 >2014-01-06 03:43:18,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18b268be}, log id: 37ebf002 >2014-01-06 03:43:23,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b201552 >2014-01-06 03:43:23,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b201552 >2014-01-06 03:43:23,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 67d2c80a >2014-01-06 03:43:23,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@495fab39}, log id: 67d2c80a >2014-01-06 03:43:28,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 509b3652 >2014-01-06 03:43:29,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 509b3652 >2014-01-06 03:43:29,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33e7b6d5 >2014-01-06 03:43:29,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1900beee}, log id: 33e7b6d5 >2014-01-06 03:43:34,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5cd21841 >2014-01-06 03:43:34,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5cd21841 >2014-01-06 03:43:34,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4af89267 >2014-01-06 03:43:34,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1c88d62}, log id: 4af89267 >2014-01-06 03:43:38,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36fab970 >2014-01-06 03:43:38,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@651fb56d, log id: 36fab970 >2014-01-06 03:43:39,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 432b666 >2014-01-06 03:43:40,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 432b666 >2014-01-06 03:43:40,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 555efb5e >2014-01-06 03:43:40,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce140085}, log id: 555efb5e >2014-01-06 03:43:45,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 727c858c >2014-01-06 03:43:45,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 727c858c >2014-01-06 03:43:45,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 387b3e38 >2014-01-06 03:43:45,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb8489f4}, log id: 387b3e38 >2014-01-06 03:43:50,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5916fc4e >2014-01-06 03:43:51,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5916fc4e >2014-01-06 03:43:51,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14ad4735 >2014-01-06 03:43:51,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec3249bd}, log id: 14ad4735 >2014-01-06 03:43:56,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 601fd865 >2014-01-06 03:43:56,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 601fd865 >2014-01-06 03:43:56,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54bba5ea >2014-01-06 03:43:56,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fbccf93}, log id: 54bba5ea >2014-01-06 03:43:58,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ac61c6e >2014-01-06 03:43:58,370 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:43:58,370 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:43:58,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, log id: 6ac61c6e >2014-01-06 03:43:58,370 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-33) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:44:01,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4280b247 >2014-01-06 03:44:01,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4280b247 >2014-01-06 03:44:01,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78239839 >2014-01-06 03:44:02,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76392f5c}, log id: 78239839 >2014-01-06 03:44:07,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4cbd8b26 >2014-01-06 03:44:07,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4cbd8b26 >2014-01-06 03:44:07,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2141ff3a >2014-01-06 03:44:07,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25165f6b}, log id: 2141ff3a >2014-01-06 03:44:12,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1477b348 >2014-01-06 03:44:12,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1477b348 >2014-01-06 03:44:12,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4931649 >2014-01-06 03:44:13,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e0f9d10}, log id: 4931649 >2014-01-06 03:44:18,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48552de4 >2014-01-06 03:44:18,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 48552de4 >2014-01-06 03:44:18,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c023dcf >2014-01-06 03:44:18,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb956063}, log id: 3c023dcf >2014-01-06 03:44:23,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ea27e4b >2014-01-06 03:44:23,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ea27e4b >2014-01-06 03:44:23,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9de6449 >2014-01-06 03:44:23,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ede55757}, log id: 9de6449 >2014-01-06 03:44:28,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d353b30 >2014-01-06 03:44:29,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6d353b30 >2014-01-06 03:44:29,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ec2fa56 >2014-01-06 03:44:29,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14e2ee6a}, log id: 4ec2fa56 >2014-01-06 03:44:34,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 24fd6451 >2014-01-06 03:44:34,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 24fd6451 >2014-01-06 03:44:34,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 233f6987 >2014-01-06 03:44:34,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4dd41a0}, log id: 233f6987 >2014-01-06 03:44:39,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c1a2fa7 >2014-01-06 03:44:40,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5c1a2fa7 >2014-01-06 03:44:40,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 560f199f >2014-01-06 03:44:40,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc0aaa4b}, log id: 560f199f >2014-01-06 03:44:45,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70d85672 >2014-01-06 03:44:45,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 70d85672 >2014-01-06 03:44:45,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65927f77 >2014-01-06 03:44:45,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bd09e62}, log id: 65927f77 >2014-01-06 03:44:50,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6856b491 >2014-01-06 03:44:51,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6856b491 >2014-01-06 03:44:51,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4540714e >2014-01-06 03:44:51,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d97fffd}, log id: 4540714e >2014-01-06 03:44:56,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71333144 >2014-01-06 03:44:56,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71333144 >2014-01-06 03:44:56,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e8986a6 >2014-01-06 03:44:56,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57ba31d3}, log id: 6e8986a6 >2014-01-06 03:44:58,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a6671ab >2014-01-06 03:44:58,697 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:44:58,697 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:44:58,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, log id: 3a6671ab >2014-01-06 03:44:58,697 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-12) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:45:01,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 162ec5d5 >2014-01-06 03:45:01,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 162ec5d5 >2014-01-06 03:45:01,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b58bda9 >2014-01-06 03:45:02,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42293448}, log id: 3b58bda9 >2014-01-06 03:45:07,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59e26bad >2014-01-06 03:45:07,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 59e26bad >2014-01-06 03:45:07,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ca0c443 >2014-01-06 03:45:07,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8bf4fd2}, log id: 4ca0c443 >2014-01-06 03:45:12,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b22e701 >2014-01-06 03:45:12,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2b22e701 >2014-01-06 03:45:12,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 557242ee >2014-01-06 03:45:13,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28cf4087}, log id: 557242ee >2014-01-06 03:45:18,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79a0657 >2014-01-06 03:45:18,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 79a0657 >2014-01-06 03:45:18,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 440d2077 >2014-01-06 03:45:18,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1193411a}, log id: 440d2077 >2014-01-06 03:45:23,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4eb688da >2014-01-06 03:45:23,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4eb688da >2014-01-06 03:45:23,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4241803e >2014-01-06 03:45:23,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5c71aa5}, log id: 4241803e >2014-01-06 03:45:28,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5359ba4f >2014-01-06 03:45:29,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5359ba4f >2014-01-06 03:45:29,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a6a7ebc >2014-01-06 03:45:29,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f77dd80}, log id: 5a6a7ebc >2014-01-06 03:45:34,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 73a31e61 >2014-01-06 03:45:34,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 73a31e61 >2014-01-06 03:45:34,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4dc37a4d >2014-01-06 03:45:34,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc6953f6}, log id: 4dc37a4d >2014-01-06 03:45:39,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4fd95c47 >2014-01-06 03:45:40,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4fd95c47 >2014-01-06 03:45:40,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66deefb8 >2014-01-06 03:45:40,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3a9d097}, log id: 66deefb8 >2014-01-06 03:45:45,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1db17afb >2014-01-06 03:45:45,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1db17afb >2014-01-06 03:45:45,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5fcfc849 >2014-01-06 03:45:45,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17033ce6}, log id: 5fcfc849 >2014-01-06 03:45:50,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51c2f529 >2014-01-06 03:45:51,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 51c2f529 >2014-01-06 03:45:51,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39b0daf1 >2014-01-06 03:45:51,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62473d1a}, log id: 39b0daf1 >2014-01-06 03:45:56,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1cad7ace >2014-01-06 03:45:56,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1cad7ace >2014-01-06 03:45:56,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5edf2f5d >2014-01-06 03:45:56,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b17d1f52}, log id: 5edf2f5d >2014-01-06 03:45:58,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 595e6498 >2014-01-06 03:45:59,027 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:45:59,027 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:45:59,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, log id: 595e6498 >2014-01-06 03:45:59,027 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-86) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:46:01,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2cc2945b >2014-01-06 03:46:01,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2cc2945b >2014-01-06 03:46:01,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1fa4c1b >2014-01-06 03:46:02,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a60fe52}, log id: 1fa4c1b >2014-01-06 03:46:07,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 383d680f >2014-01-06 03:46:07,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 383d680f >2014-01-06 03:46:07,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c2e5ede >2014-01-06 03:46:07,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f816e2ef}, log id: 1c2e5ede >2014-01-06 03:46:12,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e9a31a4 >2014-01-06 03:46:12,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7e9a31a4 >2014-01-06 03:46:12,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c8d124b >2014-01-06 03:46:13,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a67d93f6}, log id: 7c8d124b >2014-01-06 03:46:18,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57f0b90e >2014-01-06 03:46:18,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 57f0b90e >2014-01-06 03:46:18,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17765ca3 >2014-01-06 03:46:18,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6dfd128}, log id: 17765ca3 >2014-01-06 03:46:23,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64773926 >2014-01-06 03:46:23,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 64773926 >2014-01-06 03:46:23,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39005bb1 >2014-01-06 03:46:23,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5236d50e}, log id: 39005bb1 >2014-01-06 03:46:28,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 141d2b54 >2014-01-06 03:46:29,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 141d2b54 >2014-01-06 03:46:29,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62103c98 >2014-01-06 03:46:29,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11cf518b}, log id: 62103c98 >2014-01-06 03:46:34,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a09bd46 >2014-01-06 03:46:34,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3a09bd46 >2014-01-06 03:46:34,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28a3654 >2014-01-06 03:46:34,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@839ef4c2}, log id: 28a3654 >2014-01-06 03:46:39,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a80d158 >2014-01-06 03:46:40,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1a80d158 >2014-01-06 03:46:40,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 192a1008 >2014-01-06 03:46:40,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7804c988}, log id: 192a1008 >2014-01-06 03:46:45,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b240d21 >2014-01-06 03:46:45,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b240d21 >2014-01-06 03:46:45,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b926b4d >2014-01-06 03:46:45,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64ef3167}, log id: 6b926b4d >2014-01-06 03:46:50,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 701b6ed1 >2014-01-06 03:46:51,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 701b6ed1 >2014-01-06 03:46:51,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33a8c0ce >2014-01-06 03:46:51,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd841d37}, log id: 33a8c0ce >2014-01-06 03:46:56,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5cae6fe3 >2014-01-06 03:46:56,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5cae6fe3 >2014-01-06 03:46:56,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 234421e9 >2014-01-06 03:46:56,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b815e03}, log id: 234421e9 >2014-01-06 03:46:59,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b25d8ee >2014-01-06 03:46:59,348 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:46:59,348 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:46:59,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, log id: 2b25d8ee >2014-01-06 03:46:59,348 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-15) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:47:01,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 404ce62d >2014-01-06 03:47:01,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 404ce62d >2014-01-06 03:47:01,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4dcc482 >2014-01-06 03:47:02,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c2e25d3}, log id: 4dcc482 >2014-01-06 03:47:07,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c05bb09 >2014-01-06 03:47:07,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5c05bb09 >2014-01-06 03:47:07,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b6ca407 >2014-01-06 03:47:07,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60d84dcb}, log id: 1b6ca407 >2014-01-06 03:47:12,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64fdc912 >2014-01-06 03:47:12,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 64fdc912 >2014-01-06 03:47:12,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63671be7 >2014-01-06 03:47:12,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f9f0e7b}, log id: 63671be7 >2014-01-06 03:47:18,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b91355a >2014-01-06 03:47:18,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b91355a >2014-01-06 03:47:18,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 530f6f37 >2014-01-06 03:47:18,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da90c763}, log id: 530f6f37 >2014-01-06 03:47:23,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4b91417 >2014-01-06 03:47:23,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4b91417 >2014-01-06 03:47:23,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 642184e2 >2014-01-06 03:47:23,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89fa6f9e}, log id: 642184e2 >2014-01-06 03:47:28,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3565b766 >2014-01-06 03:47:29,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3565b766 >2014-01-06 03:47:29,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a910e2 >2014-01-06 03:47:29,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74cd4116}, log id: 3a910e2 >2014-01-06 03:47:34,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 371e7017 >2014-01-06 03:47:34,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 371e7017 >2014-01-06 03:47:34,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4128fffa >2014-01-06 03:47:34,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78cd1c28}, log id: 4128fffa >2014-01-06 03:47:39,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1eaa007c >2014-01-06 03:47:40,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1eaa007c >2014-01-06 03:47:40,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 713d6c97 >2014-01-06 03:47:40,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@511c9f8b}, log id: 713d6c97 >2014-01-06 03:47:45,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 65c32651 >2014-01-06 03:47:45,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 65c32651 >2014-01-06 03:47:45,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e1f5403 >2014-01-06 03:47:45,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3daea6ac}, log id: 3e1f5403 >2014-01-06 03:47:50,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54370c79 >2014-01-06 03:47:51,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54370c79 >2014-01-06 03:47:51,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3bfbbb5a >2014-01-06 03:47:51,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f28d1b}, log id: 3bfbbb5a >2014-01-06 03:47:56,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 133c3ef5 >2014-01-06 03:47:56,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 133c3ef5 >2014-01-06 03:47:56,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4796c171 >2014-01-06 03:47:56,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0fdaf4e}, log id: 4796c171 >2014-01-06 03:47:59,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 15885c30 >2014-01-06 03:47:59,681 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:47:59,681 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:47:59,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, log id: 15885c30 >2014-01-06 03:47:59,681 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-69) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:48:01,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c429150 >2014-01-06 03:48:01,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7c429150 >2014-01-06 03:48:01,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7482f5e7 >2014-01-06 03:48:02,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f3125bb}, log id: 7482f5e7 >2014-01-06 03:48:07,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1774ee2c >2014-01-06 03:48:07,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1774ee2c >2014-01-06 03:48:07,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11744 >2014-01-06 03:48:07,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a897544}, log id: 11744 >2014-01-06 03:48:12,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78f1f580 >2014-01-06 03:48:12,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 78f1f580 >2014-01-06 03:48:12,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5fa8c3d0 >2014-01-06 03:48:13,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40b8f351}, log id: 5fa8c3d0 >2014-01-06 03:48:18,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72a5815f >2014-01-06 03:48:18,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 72a5815f >2014-01-06 03:48:18,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: a62d9f4 >2014-01-06 03:48:18,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a824dfb}, log id: a62d9f4 >2014-01-06 03:48:23,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56d1229b >2014-01-06 03:48:23,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56d1229b >2014-01-06 03:48:23,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36110f82 >2014-01-06 03:48:23,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24a99427}, log id: 36110f82 >2014-01-06 03:48:28,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54107f6b >2014-01-06 03:48:29,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54107f6b >2014-01-06 03:48:29,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37130d9b >2014-01-06 03:48:29,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bbc0a17}, log id: 37130d9b >2014-01-06 03:48:34,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 726d9d7a >2014-01-06 03:48:34,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 726d9d7a >2014-01-06 03:48:34,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7de10150 >2014-01-06 03:48:34,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba22cd74}, log id: 7de10150 >2014-01-06 03:48:38,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f76f45 >2014-01-06 03:48:38,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@12c739dc, log id: 6f76f45 >2014-01-06 03:48:39,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b0e0603 >2014-01-06 03:48:40,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b0e0603 >2014-01-06 03:48:40,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f579185 >2014-01-06 03:48:40,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9b65a98}, log id: 2f579185 >2014-01-06 03:48:45,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50a2e60e >2014-01-06 03:48:45,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 50a2e60e >2014-01-06 03:48:45,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3478282c >2014-01-06 03:48:45,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec4e9064}, log id: 3478282c >2014-01-06 03:48:50,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f5a2f34 >2014-01-06 03:48:51,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7f5a2f34 >2014-01-06 03:48:51,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17360a5b >2014-01-06 03:48:51,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9e816ab}, log id: 17360a5b >2014-01-06 03:48:56,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68dfe0d0 >2014-01-06 03:48:56,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 68dfe0d0 >2014-01-06 03:48:56,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5efe14bd >2014-01-06 03:48:56,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a41da970}, log id: 5efe14bd >2014-01-06 03:48:59,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 272ebefe >2014-01-06 03:49:00,261 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:49:00,261 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:49:00,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, log id: 272ebefe >2014-01-06 03:49:00,262 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-77) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:49:01,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2150261b >2014-01-06 03:49:01,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2150261b >2014-01-06 03:49:01,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71de3fad >2014-01-06 03:49:02,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a47baf21}, log id: 71de3fad >2014-01-06 03:49:07,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 276eb409 >2014-01-06 03:49:07,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 276eb409 >2014-01-06 03:49:07,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40bbbd3f >2014-01-06 03:49:07,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0050c6c}, log id: 40bbbd3f >2014-01-06 03:49:12,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24ea2d3a >2014-01-06 03:49:12,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 24ea2d3a >2014-01-06 03:49:12,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f862e95 >2014-01-06 03:49:13,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d35f8089}, log id: 4f862e95 >2014-01-06 03:49:18,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 297f02a4 >2014-01-06 03:49:18,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 297f02a4 >2014-01-06 03:49:18,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7451518b >2014-01-06 03:49:18,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a77f605}, log id: 7451518b >2014-01-06 03:49:23,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e3f209f >2014-01-06 03:49:23,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2e3f209f >2014-01-06 03:49:23,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f953e96 >2014-01-06 03:49:23,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b16e8993}, log id: 5f953e96 >2014-01-06 03:49:29,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c0967dd >2014-01-06 03:49:29,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6c0967dd >2014-01-06 03:49:29,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f757ce8 >2014-01-06 03:49:29,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39e0b1b9}, log id: 3f757ce8 >2014-01-06 03:49:34,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 322fd907 >2014-01-06 03:49:34,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 322fd907 >2014-01-06 03:49:34,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 502d2ddd >2014-01-06 03:49:34,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9148281d}, log id: 502d2ddd >2014-01-06 03:49:39,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24ded >2014-01-06 03:49:40,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 24ded >2014-01-06 03:49:40,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6021cce9 >2014-01-06 03:49:40,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c3d54db}, log id: 6021cce9 >2014-01-06 03:49:45,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b0a1ae4 >2014-01-06 03:49:45,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: b0a1ae4 >2014-01-06 03:49:45,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76016e42 >2014-01-06 03:49:45,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5a4181d}, log id: 76016e42 >2014-01-06 03:49:50,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 776087b1 >2014-01-06 03:49:51,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 776087b1 >2014-01-06 03:49:51,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61a0c69 >2014-01-06 03:49:51,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37d665}, log id: 61a0c69 >2014-01-06 03:49:56,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79054956 >2014-01-06 03:49:56,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 79054956 >2014-01-06 03:49:56,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61f263e3 >2014-01-06 03:49:56,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f36959a}, log id: 61f263e3 >2014-01-06 03:50:00,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47d6a542 >2014-01-06 03:50:00,603 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:50:00,603 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:50:00,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, log id: 47d6a542 >2014-01-06 03:50:00,604 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-85) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:50:01,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 557c1172 >2014-01-06 03:50:02,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 557c1172 >2014-01-06 03:50:02,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a356b5 >2014-01-06 03:50:02,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed913eda}, log id: 3a356b5 >2014-01-06 03:50:07,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 447658b >2014-01-06 03:50:07,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 447658b >2014-01-06 03:50:07,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 657a1abf >2014-01-06 03:50:07,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b023351}, log id: 657a1abf >2014-01-06 03:50:12,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ad377d5 >2014-01-06 03:50:12,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7ad377d5 >2014-01-06 03:50:12,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79bc5b8b >2014-01-06 03:50:13,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a6e5f83}, log id: 79bc5b8b >2014-01-06 03:50:18,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 57c3738b >2014-01-06 03:50:18,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 57c3738b >2014-01-06 03:50:18,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f4e4a75 >2014-01-06 03:50:18,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f661ae8}, log id: 3f4e4a75 >2014-01-06 03:50:23,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 224172b7 >2014-01-06 03:50:23,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 224172b7 >2014-01-06 03:50:23,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1bb1ab3 >2014-01-06 03:50:24,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a61db644}, log id: 1bb1ab3 >2014-01-06 03:50:29,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30e11561 >2014-01-06 03:50:29,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 30e11561 >2014-01-06 03:50:29,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2edcd615 >2014-01-06 03:50:29,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aca346ef}, log id: 2edcd615 >2014-01-06 03:50:34,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 592fbd8d >2014-01-06 03:50:34,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 592fbd8d >2014-01-06 03:50:34,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f02e1cc >2014-01-06 03:50:34,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4582df2}, log id: 5f02e1cc >2014-01-06 03:50:39,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68e6b479 >2014-01-06 03:50:40,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 68e6b479 >2014-01-06 03:50:40,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66c7134b >2014-01-06 03:50:40,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97669b1c}, log id: 66c7134b >2014-01-06 03:50:45,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6591f9a2 >2014-01-06 03:50:45,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6591f9a2 >2014-01-06 03:50:45,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ad2e808 >2014-01-06 03:50:45,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b5a69c8}, log id: 5ad2e808 >2014-01-06 03:50:50,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4026ba79 >2014-01-06 03:50:51,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4026ba79 >2014-01-06 03:50:51,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 570a2f88 >2014-01-06 03:50:51,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6cfbb4f}, log id: 570a2f88 >2014-01-06 03:50:56,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c7e9bc0 >2014-01-06 03:50:56,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2c7e9bc0 >2014-01-06 03:50:56,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d1a9143 >2014-01-06 03:50:56,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cfe1a5d}, log id: d1a9143 >2014-01-06 03:51:00,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 704e18ef >2014-01-06 03:51:00,934 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:51:00,934 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:51:00,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, log id: 704e18ef >2014-01-06 03:51:00,934 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-42) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:51:01,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1750d27a >2014-01-06 03:51:02,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1750d27a >2014-01-06 03:51:02,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 69c906bb >2014-01-06 03:51:02,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4930c69b}, log id: 69c906bb >2014-01-06 03:51:07,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ea304a3 >2014-01-06 03:51:07,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7ea304a3 >2014-01-06 03:51:07,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56e4c476 >2014-01-06 03:51:07,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35c28556}, log id: 56e4c476 >2014-01-06 03:51:12,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a401379 >2014-01-06 03:51:12,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2a401379 >2014-01-06 03:51:12,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d84ced9 >2014-01-06 03:51:13,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37ae767}, log id: 1d84ced9 >2014-01-06 03:51:18,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56a52331 >2014-01-06 03:51:18,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56a52331 >2014-01-06 03:51:18,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5995727a >2014-01-06 03:51:18,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ec5d08e}, log id: 5995727a >2014-01-06 03:51:23,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20543e1b >2014-01-06 03:51:23,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 20543e1b >2014-01-06 03:51:23,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ed2d8e1 >2014-01-06 03:51:24,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73ee06f5}, log id: 7ed2d8e1 >2014-01-06 03:51:29,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 359e9925 >2014-01-06 03:51:29,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 359e9925 >2014-01-06 03:51:29,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1beacb83 >2014-01-06 03:51:29,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f78e17cb}, log id: 1beacb83 >2014-01-06 03:51:34,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2020c575 >2014-01-06 03:51:34,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2020c575 >2014-01-06 03:51:34,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2cecdad5 >2014-01-06 03:51:34,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@775f1eaf}, log id: 2cecdad5 >2014-01-06 03:51:39,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2273ce22 >2014-01-06 03:51:40,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2273ce22 >2014-01-06 03:51:40,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a3dda3a >2014-01-06 03:51:40,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ac9705c}, log id: 7a3dda3a >2014-01-06 03:51:45,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44177359 >2014-01-06 03:51:45,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 44177359 >2014-01-06 03:51:45,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 399f8e06 >2014-01-06 03:51:45,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6c69024}, log id: 399f8e06 >2014-01-06 03:51:50,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: a1fbc2b >2014-01-06 03:51:51,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: a1fbc2b >2014-01-06 03:51:51,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 579dd108 >2014-01-06 03:51:51,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@825f0393}, log id: 579dd108 >2014-01-06 03:51:56,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c7693d6 >2014-01-06 03:51:56,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6c7693d6 >2014-01-06 03:51:56,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e730862 >2014-01-06 03:51:56,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dbc65fb}, log id: e730862 >2014-01-06 03:52:00,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 57a4e46f >2014-01-06 03:52:01,256 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:52:01,257 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:52:01,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterTasksListVDSCommand, log id: 57a4e46f >2014-01-06 03:52:01,257 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-18) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:52:01,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34389ccf >2014-01-06 03:52:02,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 34389ccf >2014-01-06 03:52:02,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 422f5b94 >2014-01-06 03:52:02,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b073b228}, log id: 422f5b94 >2014-01-06 03:52:07,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58a16725 >2014-01-06 03:52:07,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 58a16725 >2014-01-06 03:52:07,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f911b90 >2014-01-06 03:52:07,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ece4b89e}, log id: 5f911b90 >2014-01-06 03:52:12,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ad6d5ca >2014-01-06 03:52:12,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6ad6d5ca >2014-01-06 03:52:12,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d3a175d >2014-01-06 03:52:13,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87d38b3e}, log id: 3d3a175d >2014-01-06 03:52:18,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ef363c7 >2014-01-06 03:52:18,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6ef363c7 >2014-01-06 03:52:18,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b9bca5f >2014-01-06 03:52:18,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f3a436c}, log id: 4b9bca5f >2014-01-06 03:52:23,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d93ce6 >2014-01-06 03:52:23,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1d93ce6 >2014-01-06 03:52:23,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 625d3e31 >2014-01-06 03:52:23,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c881de1}, log id: 625d3e31 >2014-01-06 03:52:29,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: dc5055a >2014-01-06 03:52:29,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: dc5055a >2014-01-06 03:52:29,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8ded3f1 >2014-01-06 03:52:29,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@442ad76f}, log id: 8ded3f1 >2014-01-06 03:52:34,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4efdfee5 >2014-01-06 03:52:34,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4efdfee5 >2014-01-06 03:52:34,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e67e264 >2014-01-06 03:52:34,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1b3bf19}, log id: 6e67e264 >2014-01-06 03:52:39,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31de689 >2014-01-06 03:52:40,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 31de689 >2014-01-06 03:52:40,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 494645f2 >2014-01-06 03:52:40,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8753032c}, log id: 494645f2 >2014-01-06 03:52:45,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fd95cd8 >2014-01-06 03:52:45,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: fd95cd8 >2014-01-06 03:52:45,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7fa73680 >2014-01-06 03:52:45,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6ba250d}, log id: 7fa73680 >2014-01-06 03:52:50,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 416df5e2 >2014-01-06 03:52:51,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 416df5e2 >2014-01-06 03:52:51,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35da8ea8 >2014-01-06 03:52:51,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d28d377}, log id: 35da8ea8 >2014-01-06 03:52:56,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9e3696e >2014-01-06 03:52:56,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 9e3696e >2014-01-06 03:52:56,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3cc285ce >2014-01-06 03:52:56,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd81f19d}, log id: 3cc285ce >2014-01-06 03:53:01,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55a7ae5d >2014-01-06 03:53:01,593 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:53:01,593 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:53:01,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, log id: 55a7ae5d >2014-01-06 03:53:01,593 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-89) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:53:01,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f5ccb7a >2014-01-06 03:53:02,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1f5ccb7a >2014-01-06 03:53:02,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58a4eb71 >2014-01-06 03:53:02,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4758649}, log id: 58a4eb71 >2014-01-06 03:53:07,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37f91090 >2014-01-06 03:53:07,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 37f91090 >2014-01-06 03:53:07,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7abd81b4 >2014-01-06 03:53:07,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b79452c5}, log id: 7abd81b4 >2014-01-06 03:53:12,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ed00785 >2014-01-06 03:53:12,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1ed00785 >2014-01-06 03:53:12,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62a7c8b5 >2014-01-06 03:53:13,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da730f4f}, log id: 62a7c8b5 >2014-01-06 03:53:18,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 41a12301 >2014-01-06 03:53:18,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 41a12301 >2014-01-06 03:53:18,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62ff7281 >2014-01-06 03:53:18,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@163f48e9}, log id: 62ff7281 >2014-01-06 03:53:23,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d9fe41a >2014-01-06 03:53:23,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1d9fe41a >2014-01-06 03:53:23,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b009fbd >2014-01-06 03:53:24,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41413abf}, log id: 3b009fbd >2014-01-06 03:53:29,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: dbf2351 >2014-01-06 03:53:29,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: dbf2351 >2014-01-06 03:53:29,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72c8338d >2014-01-06 03:53:29,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbdc5bbc}, log id: 72c8338d >2014-01-06 03:53:34,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c763ee9 >2014-01-06 03:53:34,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3c763ee9 >2014-01-06 03:53:34,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f5d0a8 >2014-01-06 03:53:34,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ee31ec0}, log id: 5f5d0a8 >2014-01-06 03:53:38,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f52cebd >2014-01-06 03:53:38,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2ba463cd, log id: 4f52cebd >2014-01-06 03:53:39,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 34a7dc85 >2014-01-06 03:53:40,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 34a7dc85 >2014-01-06 03:53:40,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28808c5b >2014-01-06 03:53:40,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@386a32ee}, log id: 28808c5b >2014-01-06 03:53:45,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23a93283 >2014-01-06 03:53:45,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 23a93283 >2014-01-06 03:53:45,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e550db9 >2014-01-06 03:53:45,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7069580f}, log id: 6e550db9 >2014-01-06 03:53:50,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40bc04bc >2014-01-06 03:53:51,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 40bc04bc >2014-01-06 03:53:51,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 11921c06 >2014-01-06 03:53:51,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f744bb0}, log id: 11921c06 >2014-01-06 03:53:56,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7264600 >2014-01-06 03:53:56,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7264600 >2014-01-06 03:53:56,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e49cc5b >2014-01-06 03:53:56,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e81e9258}, log id: 1e49cc5b >2014-01-06 03:54:01,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 184de5d8 >2014-01-06 03:54:01,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 486d1095 >2014-01-06 03:54:02,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 486d1095 >2014-01-06 03:54:02,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d202151 >2014-01-06 03:54:02,221 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:54:02,221 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:54:02,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, log id: 184de5d8 >2014-01-06 03:54:02,222 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-53) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:54:02,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7894a4cd}, log id: d202151 >2014-01-06 03:54:07,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 464f5ab0 >2014-01-06 03:54:07,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 464f5ab0 >2014-01-06 03:54:07,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c166527 >2014-01-06 03:54:07,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5e0113a}, log id: 7c166527 >2014-01-06 03:54:12,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64a1a30e >2014-01-06 03:54:13,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 64a1a30e >2014-01-06 03:54:13,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20317b48 >2014-01-06 03:54:13,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbf7a208}, log id: 20317b48 >2014-01-06 03:54:18,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 612ac589 >2014-01-06 03:54:18,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 612ac589 >2014-01-06 03:54:18,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a89d3eb >2014-01-06 03:54:18,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf2379b4}, log id: 7a89d3eb >2014-01-06 03:54:23,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7da80a2c >2014-01-06 03:54:23,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7da80a2c >2014-01-06 03:54:23,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5956fc37 >2014-01-06 03:54:24,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a601523}, log id: 5956fc37 >2014-01-06 03:54:29,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34b41835 >2014-01-06 03:54:29,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 34b41835 >2014-01-06 03:54:29,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b994e89 >2014-01-06 03:54:29,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdadac41}, log id: 1b994e89 >2014-01-06 03:54:34,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71cfac3e >2014-01-06 03:54:34,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71cfac3e >2014-01-06 03:54:34,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36125b13 >2014-01-06 03:54:34,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2812fe8d}, log id: 36125b13 >2014-01-06 03:54:39,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5bd5ec6 >2014-01-06 03:54:40,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5bd5ec6 >2014-01-06 03:54:40,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 75a6027c >2014-01-06 03:54:40,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93d612bd}, log id: 75a6027c >2014-01-06 03:54:45,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8ea2c5 >2014-01-06 03:54:45,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 8ea2c5 >2014-01-06 03:54:45,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4482644d >2014-01-06 03:54:45,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7283f194}, log id: 4482644d >2014-01-06 03:54:50,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e23197a >2014-01-06 03:54:51,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e23197a >2014-01-06 03:54:51,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e2552fa >2014-01-06 03:54:51,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e376e95f}, log id: 5e2552fa >2014-01-06 03:54:56,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 108b42e6 >2014-01-06 03:54:56,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 108b42e6 >2014-01-06 03:54:56,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67996007 >2014-01-06 03:54:56,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@615aa12}, log id: 67996007 >2014-01-06 03:55:01,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54c497e5 >2014-01-06 03:55:02,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54c497e5 >2014-01-06 03:55:02,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 587c981c >2014-01-06 03:55:02,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 587f6872 >2014-01-06 03:55:02,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@134b2e2d}, log id: 587c981c >2014-01-06 03:55:02,551 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:55:02,551 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:55:02,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterTasksListVDSCommand, log id: 587f6872 >2014-01-06 03:55:02,551 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-5) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:55:07,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f1112c8 >2014-01-06 03:55:07,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: f1112c8 >2014-01-06 03:55:07,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5aa2f3ff >2014-01-06 03:55:07,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8351f426}, log id: 5aa2f3ff >2014-01-06 03:55:12,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64052960 >2014-01-06 03:55:12,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 64052960 >2014-01-06 03:55:12,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 292fe851 >2014-01-06 03:55:13,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5495a810}, log id: 292fe851 >2014-01-06 03:55:18,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77fcda0a >2014-01-06 03:55:18,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 77fcda0a >2014-01-06 03:55:18,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f048fb7 >2014-01-06 03:55:18,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b850804}, log id: 4f048fb7 >2014-01-06 03:55:23,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7fc170b5 >2014-01-06 03:55:23,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7fc170b5 >2014-01-06 03:55:23,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6254c06c >2014-01-06 03:55:24,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42f78d6}, log id: 6254c06c >2014-01-06 03:55:29,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b29ade3 >2014-01-06 03:55:29,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b29ade3 >2014-01-06 03:55:29,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 51e26967 >2014-01-06 03:55:29,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2abf427}, log id: 51e26967 >2014-01-06 03:55:34,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79efa360 >2014-01-06 03:55:34,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 79efa360 >2014-01-06 03:55:34,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 271aace6 >2014-01-06 03:55:34,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a83dbf12}, log id: 271aace6 >2014-01-06 03:55:39,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50e45d61 >2014-01-06 03:55:40,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 50e45d61 >2014-01-06 03:55:40,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ae5904d >2014-01-06 03:55:40,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62eabe64}, log id: 1ae5904d >2014-01-06 03:55:45,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e4532bf >2014-01-06 03:55:45,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5e4532bf >2014-01-06 03:55:45,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e976d8 >2014-01-06 03:55:45,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb805c53}, log id: e976d8 >2014-01-06 03:55:50,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7fcef0db >2014-01-06 03:55:51,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7fcef0db >2014-01-06 03:55:51,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ddaa498 >2014-01-06 03:55:51,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13a2271f}, log id: 1ddaa498 >2014-01-06 03:55:56,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24634265 >2014-01-06 03:55:56,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 24634265 >2014-01-06 03:55:56,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c9b7481 >2014-01-06 03:55:56,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d332c92b}, log id: 1c9b7481 >2014-01-06 03:56:01,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 507badf >2014-01-06 03:56:02,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 507badf >2014-01-06 03:56:02,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71d2c401 >2014-01-06 03:56:02,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc932711}, log id: 71d2c401 >2014-01-06 03:56:02,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c1f8438 >2014-01-06 03:56:02,876 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 03:56:02,876 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:56:02,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, log id: 4c1f8438 >2014-01-06 03:56:02,876 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-42) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:56:07,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23a1d1b6 >2014-01-06 03:56:07,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 23a1d1b6 >2014-01-06 03:56:07,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52d9053c >2014-01-06 03:56:07,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c207b90}, log id: 52d9053c >2014-01-06 03:56:12,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79b31d36 >2014-01-06 03:56:12,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 79b31d36 >2014-01-06 03:56:12,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30a596c2 >2014-01-06 03:56:13,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3562eac6}, log id: 30a596c2 >2014-01-06 03:56:18,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79a9737d >2014-01-06 03:56:18,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 79a9737d >2014-01-06 03:56:18,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d542bab >2014-01-06 03:56:18,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36db8141}, log id: 6d542bab >2014-01-06 03:56:23,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 166415 >2014-01-06 03:56:23,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 166415 >2014-01-06 03:56:23,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40d55c0d >2014-01-06 03:56:24,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dde4efcf}, log id: 40d55c0d >2014-01-06 03:56:29,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d23590b >2014-01-06 03:56:29,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d23590b >2014-01-06 03:56:29,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e092a96 >2014-01-06 03:56:29,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec8f7de}, log id: 4e092a96 >2014-01-06 03:56:34,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1603a90b >2014-01-06 03:56:34,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1603a90b >2014-01-06 03:56:34,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a5da0e5 >2014-01-06 03:56:34,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a1ff713}, log id: 2a5da0e5 >2014-01-06 03:56:39,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f5c34bf >2014-01-06 03:56:40,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6f5c34bf >2014-01-06 03:56:40,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d422e57 >2014-01-06 03:56:40,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa3118db}, log id: 7d422e57 >2014-01-06 03:56:45,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5fbd1794 >2014-01-06 03:56:45,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5fbd1794 >2014-01-06 03:56:45,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19ece744 >2014-01-06 03:56:45,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3e4a394}, log id: 19ece744 >2014-01-06 03:56:50,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 83c70e1 >2014-01-06 03:56:51,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 83c70e1 >2014-01-06 03:56:51,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ac83655 >2014-01-06 03:56:51,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21f6fd84}, log id: 5ac83655 >2014-01-06 03:56:56,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 696d552 >2014-01-06 03:56:56,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 696d552 >2014-01-06 03:56:56,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23641d76 >2014-01-06 03:56:56,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f2a6f98}, log id: 23641d76 >2014-01-06 03:57:01,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17359a40 >2014-01-06 03:57:02,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 17359a40 >2014-01-06 03:57:02,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 761fe81 >2014-01-06 03:57:02,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad283394}, log id: 761fe81 >2014-01-06 03:57:02,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19bd96e7 >2014-01-06 03:57:03,205 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:57:03,205 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:57:03,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, log id: 19bd96e7 >2014-01-06 03:57:03,205 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-93) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:57:07,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54c41b44 >2014-01-06 03:57:07,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54c41b44 >2014-01-06 03:57:07,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7299b8d0 >2014-01-06 03:57:07,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a409337}, log id: 7299b8d0 >2014-01-06 03:57:12,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49680685 >2014-01-06 03:57:13,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 49680685 >2014-01-06 03:57:13,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e5720e4 >2014-01-06 03:57:13,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c615c6e6}, log id: 1e5720e4 >2014-01-06 03:57:18,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4dcb8a86 >2014-01-06 03:57:18,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4dcb8a86 >2014-01-06 03:57:18,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64f1ac7d >2014-01-06 03:57:18,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6de10f56}, log id: 64f1ac7d >2014-01-06 03:57:23,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8c9d030 >2014-01-06 03:57:23,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 8c9d030 >2014-01-06 03:57:23,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2eb40db >2014-01-06 03:57:24,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7866cea8}, log id: 2eb40db >2014-01-06 03:57:29,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7b8ed977 >2014-01-06 03:57:29,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7b8ed977 >2014-01-06 03:57:29,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a166625 >2014-01-06 03:57:29,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14e6599}, log id: 7a166625 >2014-01-06 03:57:34,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 247dd9e7 >2014-01-06 03:57:34,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 247dd9e7 >2014-01-06 03:57:34,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c59e989 >2014-01-06 03:57:35,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38c47131}, log id: c59e989 >2014-01-06 03:57:40,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74f21790 >2014-01-06 03:57:40,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 74f21790 >2014-01-06 03:57:40,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6abe4254 >2014-01-06 03:57:40,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54b9635f}, log id: 6abe4254 >2014-01-06 03:57:45,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b0dc77f >2014-01-06 03:57:45,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b0dc77f >2014-01-06 03:57:45,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59130edf >2014-01-06 03:57:45,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f028683}, log id: 59130edf >2014-01-06 03:57:50,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ec42242 >2014-01-06 03:57:51,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1ec42242 >2014-01-06 03:57:51,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f5d220b >2014-01-06 03:57:51,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bbec8ea}, log id: 3f5d220b >2014-01-06 03:57:56,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 369c4f9e >2014-01-06 03:57:56,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 369c4f9e >2014-01-06 03:57:56,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 485b6a7 >2014-01-06 03:57:56,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66405ef9}, log id: 485b6a7 >2014-01-06 03:58:01,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5930d0c2 >2014-01-06 03:58:02,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5930d0c2 >2014-01-06 03:58:02,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67ecaa5a >2014-01-06 03:58:02,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6baf19f8}, log id: 67ecaa5a >2014-01-06 03:58:03,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50fe4bc7 >2014-01-06 03:58:03,527 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:58:03,527 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:58:03,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, log id: 50fe4bc7 >2014-01-06 03:58:03,527 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-7) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:58:07,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 307e8b15 >2014-01-06 03:58:07,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 307e8b15 >2014-01-06 03:58:07,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a03f262 >2014-01-06 03:58:07,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bda348b5}, log id: 1a03f262 >2014-01-06 03:58:12,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d4ad02d >2014-01-06 03:58:13,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3d4ad02d >2014-01-06 03:58:13,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 394b2d64 >2014-01-06 03:58:13,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca1893e3}, log id: 394b2d64 >2014-01-06 03:58:18,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65e1a2b4 >2014-01-06 03:58:18,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 65e1a2b4 >2014-01-06 03:58:18,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c64097e >2014-01-06 03:58:18,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82b0ad82}, log id: c64097e >2014-01-06 03:58:23,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2781513e >2014-01-06 03:58:24,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2781513e >2014-01-06 03:58:24,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 69cf4031 >2014-01-06 03:58:24,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ee1cc4f}, log id: 69cf4031 >2014-01-06 03:58:29,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66b237c9 >2014-01-06 03:58:29,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 66b237c9 >2014-01-06 03:58:29,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 383b331d >2014-01-06 03:58:29,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e1a529d}, log id: 383b331d >2014-01-06 03:58:34,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2122903e >2014-01-06 03:58:34,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2122903e >2014-01-06 03:58:34,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a56f225 >2014-01-06 03:58:35,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c15600f}, log id: 5a56f225 >2014-01-06 03:58:38,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64caec4d >2014-01-06 03:58:38,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@25b1297a, log id: 64caec4d >2014-01-06 03:58:40,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74695ddb >2014-01-06 03:58:40,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 74695ddb >2014-01-06 03:58:40,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 149df25a >2014-01-06 03:58:40,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2853f4a}, log id: 149df25a >2014-01-06 03:58:45,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6988fbd6 >2014-01-06 03:58:45,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6988fbd6 >2014-01-06 03:58:45,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d402588 >2014-01-06 03:58:45,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6342dd90}, log id: 6d402588 >2014-01-06 03:58:50,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 498e2999 >2014-01-06 03:58:51,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 498e2999 >2014-01-06 03:58:51,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e3e2fd7 >2014-01-06 03:58:51,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@641c2a7c}, log id: 2e3e2fd7 >2014-01-06 03:58:56,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e32478b >2014-01-06 03:58:56,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e32478b >2014-01-06 03:58:56,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 960a25f >2014-01-06 03:58:56,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d58a31f}, log id: 960a25f >2014-01-06 03:59:01,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 249f7bc3 >2014-01-06 03:59:02,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 249f7bc3 >2014-01-06 03:59:02,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c61b2ef >2014-01-06 03:59:02,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89224827}, log id: 6c61b2ef >2014-01-06 03:59:03,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6619f0a3 >2014-01-06 03:59:03,858 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 03:59:03,858 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 03:59:03,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, log id: 6619f0a3 >2014-01-06 03:59:03,859 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-1) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 03:59:07,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 746d1301 >2014-01-06 03:59:08,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 746d1301 >2014-01-06 03:59:08,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 499152a2 >2014-01-06 03:59:08,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@646e05c5}, log id: 499152a2 >2014-01-06 03:59:13,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7dc96cfd >2014-01-06 03:59:13,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7dc96cfd >2014-01-06 03:59:13,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 11e79822 >2014-01-06 03:59:13,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f469c17}, log id: 11e79822 >2014-01-06 03:59:18,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f15e678 >2014-01-06 03:59:18,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: f15e678 >2014-01-06 03:59:18,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59df6af9 >2014-01-06 03:59:19,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3977b68a}, log id: 59df6af9 >2014-01-06 03:59:24,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d0b0a24 >2014-01-06 03:59:24,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4d0b0a24 >2014-01-06 03:59:24,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b8d98fd >2014-01-06 03:59:24,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fbc5f44}, log id: 5b8d98fd >2014-01-06 03:59:29,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e5d5d6 >2014-01-06 03:59:29,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e5d5d6 >2014-01-06 03:59:29,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c249ccf >2014-01-06 03:59:29,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d7da9d6}, log id: c249ccf >2014-01-06 03:59:35,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b0d6f5b >2014-01-06 03:59:35,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b0d6f5b >2014-01-06 03:59:35,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78314341 >2014-01-06 03:59:35,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fa7996d}, log id: 78314341 >2014-01-06 03:59:40,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 41ae067f >2014-01-06 03:59:40,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 41ae067f >2014-01-06 03:59:40,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76f828e3 >2014-01-06 03:59:40,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6466305}, log id: 76f828e3 >2014-01-06 03:59:45,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b96eafd >2014-01-06 03:59:46,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b96eafd >2014-01-06 03:59:46,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d6e6bac >2014-01-06 03:59:46,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cffd041b}, log id: 7d6e6bac >2014-01-06 03:59:51,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 119b5b7f >2014-01-06 03:59:51,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 119b5b7f >2014-01-06 03:59:51,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14f4e7ba >2014-01-06 03:59:51,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2107e82}, log id: 14f4e7ba >2014-01-06 03:59:56,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53410560 >2014-01-06 03:59:57,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 53410560 >2014-01-06 03:59:57,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6df53efa >2014-01-06 03:59:57,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67c5c72d}, log id: 6df53efa >2014-01-06 04:00:02,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3cf80629 >2014-01-06 04:00:02,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3cf80629 >2014-01-06 04:00:02,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70f333e3 >2014-01-06 04:00:02,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d02710a9}, log id: 70f333e3 >2014-01-06 04:00:03,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 193370 >2014-01-06 04:00:04,198 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:00:04,198 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:00:04,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterTasksListVDSCommand, log id: 193370 >2014-01-06 04:00:04,199 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-6) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:00:07,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73b828e >2014-01-06 04:00:08,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73b828e >2014-01-06 04:00:08,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f43eacb >2014-01-06 04:00:08,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fce88e70}, log id: 7f43eacb >2014-01-06 04:00:13,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1526ea75 >2014-01-06 04:00:13,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1526ea75 >2014-01-06 04:00:13,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ec40fc4 >2014-01-06 04:00:13,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c84c5fe4}, log id: 4ec40fc4 >2014-01-06 04:00:18,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f2fef93 >2014-01-06 04:00:18,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6f2fef93 >2014-01-06 04:00:18,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6fdae5ba >2014-01-06 04:00:19,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a518a5e7}, log id: 6fdae5ba >2014-01-06 04:00:24,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 108ad12c >2014-01-06 04:00:24,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 108ad12c >2014-01-06 04:00:24,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28abdb1d >2014-01-06 04:00:24,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f12e0953}, log id: 28abdb1d >2014-01-06 04:00:29,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 842a81b >2014-01-06 04:00:29,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 842a81b >2014-01-06 04:00:29,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4cb18a16 >2014-01-06 04:00:29,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b0491d0}, log id: 4cb18a16 >2014-01-06 04:00:35,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 436199f5 >2014-01-06 04:00:35,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 436199f5 >2014-01-06 04:00:35,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b9fdd8b >2014-01-06 04:00:35,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cb10c0}, log id: 3b9fdd8b >2014-01-06 04:00:40,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b2da324 >2014-01-06 04:00:40,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b2da324 >2014-01-06 04:00:40,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e869b27 >2014-01-06 04:00:40,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36ff4f5e}, log id: e869b27 >2014-01-06 04:00:45,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78b46dad >2014-01-06 04:00:46,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 78b46dad >2014-01-06 04:00:46,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ea21a3b >2014-01-06 04:00:46,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b388d2f1}, log id: 3ea21a3b >2014-01-06 04:00:51,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50df65d3 >2014-01-06 04:00:51,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 50df65d3 >2014-01-06 04:00:51,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c8c3e13 >2014-01-06 04:00:51,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d6e9216}, log id: 6c8c3e13 >2014-01-06 04:00:56,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 162766cc >2014-01-06 04:00:57,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 162766cc >2014-01-06 04:00:57,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ada2028 >2014-01-06 04:00:57,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffc70a2}, log id: ada2028 >2014-01-06 04:01:02,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6159622b >2014-01-06 04:01:02,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6159622b >2014-01-06 04:01:02,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5228b1ef >2014-01-06 04:01:02,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be9c8f83}, log id: 5228b1ef >2014-01-06 04:01:04,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f7ca8dd >2014-01-06 04:01:04,537 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:01:04,537 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:01:04,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, log id: f7ca8dd >2014-01-06 04:01:04,538 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-37) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:01:07,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4db63c68 >2014-01-06 04:01:08,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4db63c68 >2014-01-06 04:01:08,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71f5e7b2 >2014-01-06 04:01:08,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f01830f7}, log id: 71f5e7b2 >2014-01-06 04:01:13,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 115ae929 >2014-01-06 04:01:13,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 115ae929 >2014-01-06 04:01:13,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21798729 >2014-01-06 04:01:13,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@971c04c4}, log id: 21798729 >2014-01-06 04:01:18,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5fca45da >2014-01-06 04:01:18,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5fca45da >2014-01-06 04:01:18,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f52afe9 >2014-01-06 04:01:19,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8792140b}, log id: f52afe9 >2014-01-06 04:01:24,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d698abf >2014-01-06 04:01:24,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6d698abf >2014-01-06 04:01:24,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 208a0958 >2014-01-06 04:01:24,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cacfd919}, log id: 208a0958 >2014-01-06 04:01:29,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 230c721a >2014-01-06 04:01:29,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 230c721a >2014-01-06 04:01:29,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d6475b6 >2014-01-06 04:01:30,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e08ad5d}, log id: 4d6475b6 >2014-01-06 04:01:35,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b52297b >2014-01-06 04:01:35,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b52297b >2014-01-06 04:01:35,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36ac68c >2014-01-06 04:01:35,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c1fcb57}, log id: 36ac68c >2014-01-06 04:01:40,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26fbcfdc >2014-01-06 04:01:40,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 26fbcfdc >2014-01-06 04:01:40,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41a4050d >2014-01-06 04:01:40,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51c0c63d}, log id: 41a4050d >2014-01-06 04:01:45,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5fd8dd68 >2014-01-06 04:01:46,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5fd8dd68 >2014-01-06 04:01:46,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fe6a733 >2014-01-06 04:01:46,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8618d191}, log id: 3fe6a733 >2014-01-06 04:01:51,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79ae4644 >2014-01-06 04:01:51,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 79ae4644 >2014-01-06 04:01:51,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63d02328 >2014-01-06 04:01:51,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be1b3229}, log id: 63d02328 >2014-01-06 04:01:56,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 312ec41b >2014-01-06 04:01:57,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 312ec41b >2014-01-06 04:01:57,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20487294 >2014-01-06 04:01:57,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be462132}, log id: 20487294 >2014-01-06 04:02:02,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 618234ef >2014-01-06 04:02:02,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 618234ef >2014-01-06 04:02:02,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c4d178d >2014-01-06 04:02:02,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@627b47e6}, log id: 7c4d178d >2014-01-06 04:02:04,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5cc1e4e0 >2014-01-06 04:02:04,866 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:02:04,866 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:02:04,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, log id: 5cc1e4e0 >2014-01-06 04:02:04,866 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-81) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:02:07,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c5f7e31 >2014-01-06 04:02:08,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2c5f7e31 >2014-01-06 04:02:08,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e8f5be6 >2014-01-06 04:02:08,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf10d200}, log id: 1e8f5be6 >2014-01-06 04:02:13,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39342144 >2014-01-06 04:02:13,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 39342144 >2014-01-06 04:02:13,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 263ad518 >2014-01-06 04:02:13,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c799ccce}, log id: 263ad518 >2014-01-06 04:02:18,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a608daf >2014-01-06 04:02:18,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3a608daf >2014-01-06 04:02:18,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 55d931a5 >2014-01-06 04:02:19,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ded88d0}, log id: 55d931a5 >2014-01-06 04:02:24,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 34a2ce89 >2014-01-06 04:02:24,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 34a2ce89 >2014-01-06 04:02:24,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2bd58c2 >2014-01-06 04:02:24,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d64a4b01}, log id: 2bd58c2 >2014-01-06 04:02:29,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a0e4c16 >2014-01-06 04:02:29,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5a0e4c16 >2014-01-06 04:02:29,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1bc1eab3 >2014-01-06 04:02:30,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6d25bf7}, log id: 1bc1eab3 >2014-01-06 04:02:35,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57863225 >2014-01-06 04:02:35,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 57863225 >2014-01-06 04:02:35,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f15cbf2 >2014-01-06 04:02:35,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a11d6de5}, log id: 1f15cbf2 >2014-01-06 04:02:40,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2574c1c5 >2014-01-06 04:02:40,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2574c1c5 >2014-01-06 04:02:40,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 472abe75 >2014-01-06 04:02:40,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73c14409}, log id: 472abe75 >2014-01-06 04:02:45,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2fb034c3 >2014-01-06 04:02:46,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2fb034c3 >2014-01-06 04:02:46,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 88a2945 >2014-01-06 04:02:46,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f093135}, log id: 88a2945 >2014-01-06 04:02:51,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e9d23c0 >2014-01-06 04:02:51,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: e9d23c0 >2014-01-06 04:02:51,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70b4bc28 >2014-01-06 04:02:51,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@361fe3bf}, log id: 70b4bc28 >2014-01-06 04:02:56,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e646769 >2014-01-06 04:02:57,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6e646769 >2014-01-06 04:02:57,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 755226ce >2014-01-06 04:02:57,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5c72271}, log id: 755226ce >2014-01-06 04:03:02,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30a58ecd >2014-01-06 04:03:02,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 30a58ecd >2014-01-06 04:03:02,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2904d2a6 >2014-01-06 04:03:02,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32f15f51}, log id: 2904d2a6 >2014-01-06 04:03:04,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b88d081 >2014-01-06 04:03:05,194 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:03:05,194 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:03:05,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, log id: 6b88d081 >2014-01-06 04:03:05,194 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-58) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:03:07,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c4c5b54 >2014-01-06 04:03:08,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6c4c5b54 >2014-01-06 04:03:08,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 376e8aa5 >2014-01-06 04:03:08,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca2f287c}, log id: 376e8aa5 >2014-01-06 04:03:13,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d29ed7e >2014-01-06 04:03:13,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5d29ed7e >2014-01-06 04:03:13,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b1ec28b >2014-01-06 04:03:13,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f9534f4}, log id: 3b1ec28b >2014-01-06 04:03:18,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12ccb9ed >2014-01-06 04:03:19,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 12ccb9ed >2014-01-06 04:03:19,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f204af2 >2014-01-06 04:03:19,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da2bddca}, log id: 3f204af2 >2014-01-06 04:03:24,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 531a705 >2014-01-06 04:03:24,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 531a705 >2014-01-06 04:03:24,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4653fd77 >2014-01-06 04:03:24,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e276b34e}, log id: 4653fd77 >2014-01-06 04:03:29,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f26d3e7 >2014-01-06 04:03:29,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4f26d3e7 >2014-01-06 04:03:29,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6dc490ff >2014-01-06 04:03:30,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9af61417}, log id: 6dc490ff >2014-01-06 04:03:35,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 321b4d9d >2014-01-06 04:03:35,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 321b4d9d >2014-01-06 04:03:35,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 300f873b >2014-01-06 04:03:35,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a109503}, log id: 300f873b >2014-01-06 04:03:38,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f59543c >2014-01-06 04:03:38,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@45f9bc75, log id: 5f59543c >2014-01-06 04:03:40,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e0e7f57 >2014-01-06 04:03:40,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5e0e7f57 >2014-01-06 04:03:40,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ba52732 >2014-01-06 04:03:40,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ee5f65f}, log id: ba52732 >2014-01-06 04:03:46,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2d230e4 >2014-01-06 04:03:46,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2d230e4 >2014-01-06 04:03:46,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f8ee24c >2014-01-06 04:03:46,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6ed86be}, log id: 7f8ee24c >2014-01-06 04:03:51,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5564ae1c >2014-01-06 04:03:51,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5564ae1c >2014-01-06 04:03:51,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 191b9ae2 >2014-01-06 04:03:51,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c155ea51}, log id: 191b9ae2 >2014-01-06 04:03:56,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1857b0ae >2014-01-06 04:03:57,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1857b0ae >2014-01-06 04:03:57,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3522501 >2014-01-06 04:03:57,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4535493}, log id: 3522501 >2014-01-06 04:04:02,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53c35d4e >2014-01-06 04:04:02,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 53c35d4e >2014-01-06 04:04:02,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7857fe7c >2014-01-06 04:04:03,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78883ed5}, log id: 7857fe7c >2014-01-06 04:04:05,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 70b4c06 >2014-01-06 04:04:05,514 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:04:05,514 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:04:05,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, log id: 70b4c06 >2014-01-06 04:04:05,514 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-86) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:04:08,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2094bf4a >2014-01-06 04:04:08,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2094bf4a >2014-01-06 04:04:08,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f96bac6 >2014-01-06 04:04:08,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@165dc59a}, log id: 2f96bac6 >2014-01-06 04:04:13,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f443ca0 >2014-01-06 04:04:13,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6f443ca0 >2014-01-06 04:04:13,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a10a962 >2014-01-06 04:04:13,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db264b64}, log id: 4a10a962 >2014-01-06 04:04:19,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74fe6b79 >2014-01-06 04:04:19,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 74fe6b79 >2014-01-06 04:04:19,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64de0afa >2014-01-06 04:04:19,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf7767ad}, log id: 64de0afa >2014-01-06 04:04:24,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47641ee5 >2014-01-06 04:04:24,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 47641ee5 >2014-01-06 04:04:24,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c9fb681 >2014-01-06 04:04:24,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abc2715f}, log id: 5c9fb681 >2014-01-06 04:04:29,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b2e4d5a >2014-01-06 04:04:30,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b2e4d5a >2014-01-06 04:04:30,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 100dd6 >2014-01-06 04:04:30,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f120c39c}, log id: 100dd6 >2014-01-06 04:04:35,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b47862e >2014-01-06 04:04:35,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b47862e >2014-01-06 04:04:35,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 91c3778 >2014-01-06 04:04:35,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72d5d8ee}, log id: 91c3778 >2014-01-06 04:04:40,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 705009a4 >2014-01-06 04:04:41,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 705009a4 >2014-01-06 04:04:41,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 525ac019 >2014-01-06 04:04:41,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b1498e1}, log id: 525ac019 >2014-01-06 04:04:46,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4894a12b >2014-01-06 04:04:46,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4894a12b >2014-01-06 04:04:46,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 279c54a4 >2014-01-06 04:04:46,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f126ce}, log id: 279c54a4 >2014-01-06 04:04:51,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63097b70 >2014-01-06 04:04:52,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 63097b70 >2014-01-06 04:04:52,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f67af9c >2014-01-06 04:04:52,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87d15794}, log id: 4f67af9c >2014-01-06 04:04:57,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72249256 >2014-01-06 04:04:57,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 72249256 >2014-01-06 04:04:57,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56fec897 >2014-01-06 04:04:57,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bb25dcf}, log id: 56fec897 >2014-01-06 04:05:02,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 247d5843 >2014-01-06 04:05:02,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 247d5843 >2014-01-06 04:05:02,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 411be208 >2014-01-06 04:05:03,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b767b3c8}, log id: 411be208 >2014-01-06 04:05:05,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 687b9448 >2014-01-06 04:05:05,850 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:05:05,851 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:05:05,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, log id: 687b9448 >2014-01-06 04:05:05,851 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-26) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:05:08,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ee9bc98 >2014-01-06 04:05:08,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ee9bc98 >2014-01-06 04:05:08,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 476e04a4 >2014-01-06 04:05:08,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cc88424}, log id: 476e04a4 >2014-01-06 04:05:13,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 18f72b14 >2014-01-06 04:05:13,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 18f72b14 >2014-01-06 04:05:13,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 18aedee1 >2014-01-06 04:05:13,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb7b1ea4}, log id: 18aedee1 >2014-01-06 04:05:18,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3059ed4c >2014-01-06 04:05:19,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3059ed4c >2014-01-06 04:05:19,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45d47a96 >2014-01-06 04:05:19,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73e9d49a}, log id: 45d47a96 >2014-01-06 04:05:24,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1dd5bf93 >2014-01-06 04:05:24,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1dd5bf93 >2014-01-06 04:05:24,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b57de2f >2014-01-06 04:05:24,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f468d36}, log id: 7b57de2f >2014-01-06 04:05:29,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 618bc579 >2014-01-06 04:05:30,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 618bc579 >2014-01-06 04:05:30,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21d13958 >2014-01-06 04:05:30,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@788e71ef}, log id: 21d13958 >2014-01-06 04:05:35,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16ec7016 >2014-01-06 04:05:35,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 16ec7016 >2014-01-06 04:05:35,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10394ff6 >2014-01-06 04:05:35,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b6e57cc}, log id: 10394ff6 >2014-01-06 04:05:40,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ac35c33 >2014-01-06 04:05:41,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5ac35c33 >2014-01-06 04:05:41,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4744c956 >2014-01-06 04:05:41,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2d8fd91}, log id: 4744c956 >2014-01-06 04:05:46,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ca929b7 >2014-01-06 04:05:46,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2ca929b7 >2014-01-06 04:05:46,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ec6328a >2014-01-06 04:05:46,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39e374b0}, log id: 7ec6328a >2014-01-06 04:05:51,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 131adae9 >2014-01-06 04:05:52,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 131adae9 >2014-01-06 04:05:52,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 69c47e08 >2014-01-06 04:05:52,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@581ea6d}, log id: 69c47e08 >2014-01-06 04:05:57,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ccae21f >2014-01-06 04:05:57,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6ccae21f >2014-01-06 04:05:57,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10c1f8dd >2014-01-06 04:05:57,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9346b22}, log id: 10c1f8dd >2014-01-06 04:06:02,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a91bef1 >2014-01-06 04:06:02,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5a91bef1 >2014-01-06 04:06:02,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 32ddbfc9 >2014-01-06 04:06:03,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a601dd7d}, log id: 32ddbfc9 >2014-01-06 04:06:05,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36e1c8d0 >2014-01-06 04:06:06,183 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:06:06,183 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:06:06,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, log id: 36e1c8d0 >2014-01-06 04:06:06,183 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-48) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:06:08,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 62f01046 >2014-01-06 04:06:08,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 62f01046 >2014-01-06 04:06:08,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55c7f317 >2014-01-06 04:06:08,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66092fe7}, log id: 55c7f317 >2014-01-06 04:06:13,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 11ac2829 >2014-01-06 04:06:13,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 11ac2829 >2014-01-06 04:06:13,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b316ad6 >2014-01-06 04:06:13,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d57406b}, log id: 5b316ad6 >2014-01-06 04:06:19,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e64f7db >2014-01-06 04:06:19,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2e64f7db >2014-01-06 04:06:19,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6820afee >2014-01-06 04:06:19,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fb3b2b4}, log id: 6820afee >2014-01-06 04:06:24,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54d805dc >2014-01-06 04:06:24,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54d805dc >2014-01-06 04:06:24,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2bc62023 >2014-01-06 04:06:24,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75000f2b}, log id: 2bc62023 >2014-01-06 04:06:29,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 714b3eeb >2014-01-06 04:06:30,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 714b3eeb >2014-01-06 04:06:30,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 360eb965 >2014-01-06 04:06:30,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a39e64d9}, log id: 360eb965 >2014-01-06 04:06:35,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 499dd567 >2014-01-06 04:06:35,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 499dd567 >2014-01-06 04:06:35,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44e92e65 >2014-01-06 04:06:35,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ce65bd7}, log id: 44e92e65 >2014-01-06 04:06:40,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: d850b4 >2014-01-06 04:06:41,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: d850b4 >2014-01-06 04:06:41,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6108a8f >2014-01-06 04:06:41,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba033db7}, log id: 6108a8f >2014-01-06 04:06:46,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9e44531 >2014-01-06 04:06:46,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 9e44531 >2014-01-06 04:06:46,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 385c8bfd >2014-01-06 04:06:46,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaa80483}, log id: 385c8bfd >2014-01-06 04:06:51,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: df26a38 >2014-01-06 04:06:51,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: df26a38 >2014-01-06 04:06:51,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e8a4b2a >2014-01-06 04:06:52,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68142778}, log id: 1e8a4b2a >2014-01-06 04:06:57,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 510a0758 >2014-01-06 04:06:57,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 510a0758 >2014-01-06 04:06:57,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7040bfde >2014-01-06 04:06:57,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2cc23ef}, log id: 7040bfde >2014-01-06 04:07:02,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 43298f0b >2014-01-06 04:07:02,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 43298f0b >2014-01-06 04:07:02,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 588ee4cc >2014-01-06 04:07:03,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@871654c2}, log id: 588ee4cc >2014-01-06 04:07:06,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22487a00 >2014-01-06 04:07:06,505 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:07:06,505 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:07:06,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, log id: 22487a00 >2014-01-06 04:07:06,506 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-94) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:07:08,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 113bbb93 >2014-01-06 04:07:08,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 113bbb93 >2014-01-06 04:07:08,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40c51509 >2014-01-06 04:07:08,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@235922d5}, log id: 40c51509 >2014-01-06 04:07:13,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e4ca064 >2014-01-06 04:07:13,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e4ca064 >2014-01-06 04:07:13,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b7c82bc >2014-01-06 04:07:13,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7b47c69}, log id: 7b7c82bc >2014-01-06 04:07:18,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 624c7d08 >2014-01-06 04:07:19,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 624c7d08 >2014-01-06 04:07:19,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3035c1bc >2014-01-06 04:07:19,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0ebee07}, log id: 3035c1bc >2014-01-06 04:07:24,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e77c91e >2014-01-06 04:07:24,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2e77c91e >2014-01-06 04:07:24,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20b31c58 >2014-01-06 04:07:24,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8169005}, log id: 20b31c58 >2014-01-06 04:07:29,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a37c2a0 >2014-01-06 04:07:30,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5a37c2a0 >2014-01-06 04:07:30,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64a37b8a >2014-01-06 04:07:30,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce9b173b}, log id: 64a37b8a >2014-01-06 04:07:35,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68642ed5 >2014-01-06 04:07:35,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 68642ed5 >2014-01-06 04:07:35,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19c97e69 >2014-01-06 04:07:35,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b06cc369}, log id: 19c97e69 >2014-01-06 04:07:40,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: a9869b5 >2014-01-06 04:07:41,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: a9869b5 >2014-01-06 04:07:41,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5afbce44 >2014-01-06 04:07:41,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9a52362}, log id: 5afbce44 >2014-01-06 04:07:46,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1fd32c41 >2014-01-06 04:07:46,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1fd32c41 >2014-01-06 04:07:46,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: d986e54 >2014-01-06 04:07:46,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a9c821}, log id: d986e54 >2014-01-06 04:07:51,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 70e36cdb >2014-01-06 04:07:52,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 70e36cdb >2014-01-06 04:07:52,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74eb4041 >2014-01-06 04:07:52,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f887b007}, log id: 74eb4041 >2014-01-06 04:07:57,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e8ef573 >2014-01-06 04:07:57,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7e8ef573 >2014-01-06 04:07:57,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 75ccb333 >2014-01-06 04:07:57,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32bed60b}, log id: 75ccb333 >2014-01-06 04:08:02,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7eecfb6d >2014-01-06 04:08:02,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7eecfb6d >2014-01-06 04:08:02,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e6c7efc >2014-01-06 04:08:03,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fa2f4f5}, log id: 1e6c7efc >2014-01-06 04:08:06,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18d90c41 >2014-01-06 04:08:06,827 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:08:06,827 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:08:06,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, log id: 18d90c41 >2014-01-06 04:08:06,827 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-24) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:08:08,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5410e930 >2014-01-06 04:08:08,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5410e930 >2014-01-06 04:08:08,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: bb41f55 >2014-01-06 04:08:08,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad00a77c}, log id: bb41f55 >2014-01-06 04:08:13,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 65e1bbb >2014-01-06 04:08:13,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 65e1bbb >2014-01-06 04:08:13,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 197ce9d1 >2014-01-06 04:08:13,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f8a34f6}, log id: 197ce9d1 >2014-01-06 04:08:19,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ddf2b39 >2014-01-06 04:08:19,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ddf2b39 >2014-01-06 04:08:19,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 225a658 >2014-01-06 04:08:19,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b34b372}, log id: 225a658 >2014-01-06 04:08:24,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5796680 >2014-01-06 04:08:24,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5796680 >2014-01-06 04:08:24,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a3bb585 >2014-01-06 04:08:24,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@555bb819}, log id: 3a3bb585 >2014-01-06 04:08:29,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b9f877 >2014-01-06 04:08:30,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b9f877 >2014-01-06 04:08:30,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55788b38 >2014-01-06 04:08:30,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d32fe9d}, log id: 55788b38 >2014-01-06 04:08:35,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6624f042 >2014-01-06 04:08:35,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6624f042 >2014-01-06 04:08:35,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78e3a2b0 >2014-01-06 04:08:35,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7e16fa7}, log id: 78e3a2b0 >2014-01-06 04:08:39,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6354695a >2014-01-06 04:08:39,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@718b6968, log id: 6354695a >2014-01-06 04:08:40,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ec8f7e9 >2014-01-06 04:08:41,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1ec8f7e9 >2014-01-06 04:08:41,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a8fc533 >2014-01-06 04:08:41,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b17eee17}, log id: 1a8fc533 >2014-01-06 04:08:46,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ee3eea5 >2014-01-06 04:08:46,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5ee3eea5 >2014-01-06 04:08:46,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e38dd38 >2014-01-06 04:08:46,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b76990bf}, log id: 3e38dd38 >2014-01-06 04:08:51,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 677d882e >2014-01-06 04:08:52,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 677d882e >2014-01-06 04:08:52,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1715fec2 >2014-01-06 04:08:52,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b442a57c}, log id: 1715fec2 >2014-01-06 04:08:57,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6bd9542c >2014-01-06 04:08:57,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6bd9542c >2014-01-06 04:08:57,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1aad3f91 >2014-01-06 04:08:57,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@225cb1ca}, log id: 1aad3f91 >2014-01-06 04:09:02,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48c85caa >2014-01-06 04:09:03,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 48c85caa >2014-01-06 04:09:03,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17be5744 >2014-01-06 04:09:03,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@505f1c7}, log id: 17be5744 >2014-01-06 04:09:06,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 648e9624 >2014-01-06 04:09:07,159 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:09:07,159 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:09:07,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, log id: 648e9624 >2014-01-06 04:09:07,159 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-61) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:09:08,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64c35506 >2014-01-06 04:09:08,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 64c35506 >2014-01-06 04:09:08,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c1b6181 >2014-01-06 04:09:08,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0e57190}, log id: 7c1b6181 >2014-01-06 04:09:13,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c42ce2e >2014-01-06 04:09:13,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2c42ce2e >2014-01-06 04:09:13,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c278e99 >2014-01-06 04:09:14,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdf749b}, log id: 7c278e99 >2014-01-06 04:09:19,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 201505aa >2014-01-06 04:09:19,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 201505aa >2014-01-06 04:09:19,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 134fc995 >2014-01-06 04:09:19,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46317a9f}, log id: 134fc995 >2014-01-06 04:09:24,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22b0c351 >2014-01-06 04:09:24,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 22b0c351 >2014-01-06 04:09:24,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1988cc97 >2014-01-06 04:09:25,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0ab9d91}, log id: 1988cc97 >2014-01-06 04:09:30,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5358648e >2014-01-06 04:09:30,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5358648e >2014-01-06 04:09:30,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15929349 >2014-01-06 04:09:30,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fbead9}, log id: 15929349 >2014-01-06 04:09:35,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: cc0cf6e >2014-01-06 04:09:35,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: cc0cf6e >2014-01-06 04:09:35,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ab181d7 >2014-01-06 04:09:35,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51fbfa3f}, log id: 7ab181d7 >2014-01-06 04:09:40,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 642c6a22 >2014-01-06 04:09:41,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 642c6a22 >2014-01-06 04:09:41,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5d580d45 >2014-01-06 04:09:41,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a59d5e2}, log id: 5d580d45 >2014-01-06 04:09:46,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 322ea707 >2014-01-06 04:09:46,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 322ea707 >2014-01-06 04:09:46,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 430805d9 >2014-01-06 04:09:46,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1f2f2be}, log id: 430805d9 >2014-01-06 04:09:51,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66f9ced1 >2014-01-06 04:09:52,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66f9ced1 >2014-01-06 04:09:52,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6582aaaa >2014-01-06 04:09:52,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d26a2634}, log id: 6582aaaa >2014-01-06 04:09:57,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f980979 >2014-01-06 04:09:57,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f980979 >2014-01-06 04:09:57,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e670155 >2014-01-06 04:09:57,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef3133e6}, log id: 7e670155 >2014-01-06 04:10:02,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f952b54 >2014-01-06 04:10:03,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6f952b54 >2014-01-06 04:10:03,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9e45411 >2014-01-06 04:10:03,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f9b6e9b}, log id: 9e45411 >2014-01-06 04:10:07,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: a0188e4 >2014-01-06 04:10:07,490 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:10:07,490 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:10:07,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, log id: a0188e4 >2014-01-06 04:10:07,490 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-11) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:10:08,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a2401d0 >2014-01-06 04:10:08,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1a2401d0 >2014-01-06 04:10:08,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e8ac442 >2014-01-06 04:10:08,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27261c51}, log id: 5e8ac442 >2014-01-06 04:10:13,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 725b3ea1 >2014-01-06 04:10:13,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 725b3ea1 >2014-01-06 04:10:13,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3373b767 >2014-01-06 04:10:14,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdb83bb7}, log id: 3373b767 >2014-01-06 04:10:19,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71021fe7 >2014-01-06 04:10:19,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 71021fe7 >2014-01-06 04:10:19,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e3a9eab >2014-01-06 04:10:19,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8edb3153}, log id: e3a9eab >2014-01-06 04:10:24,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c2b36b7 >2014-01-06 04:10:24,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4c2b36b7 >2014-01-06 04:10:24,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 416d2706 >2014-01-06 04:10:25,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d776142}, log id: 416d2706 >2014-01-06 04:10:30,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 558a1154 >2014-01-06 04:10:30,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 558a1154 >2014-01-06 04:10:30,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7261b562 >2014-01-06 04:10:30,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6548390}, log id: 7261b562 >2014-01-06 04:10:35,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 535d7917 >2014-01-06 04:10:35,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 535d7917 >2014-01-06 04:10:35,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7242dcd9 >2014-01-06 04:10:35,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a010f772}, log id: 7242dcd9 >2014-01-06 04:10:41,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27d799d5 >2014-01-06 04:10:41,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 27d799d5 >2014-01-06 04:10:41,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28359e4c >2014-01-06 04:10:41,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88478ea2}, log id: 28359e4c >2014-01-06 04:10:46,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5cd5be1a >2014-01-06 04:10:46,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5cd5be1a >2014-01-06 04:10:46,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78b04188 >2014-01-06 04:10:46,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8535b6cf}, log id: 78b04188 >2014-01-06 04:10:51,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c767d45 >2014-01-06 04:10:52,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: c767d45 >2014-01-06 04:10:52,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b8de202 >2014-01-06 04:10:52,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@336690a1}, log id: 7b8de202 >2014-01-06 04:10:57,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 516465d8 >2014-01-06 04:10:57,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 516465d8 >2014-01-06 04:10:57,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2df01c10 >2014-01-06 04:10:57,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55a0aaa0}, log id: 2df01c10 >2014-01-06 04:11:02,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7268354f >2014-01-06 04:11:03,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7268354f >2014-01-06 04:11:03,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54b8bfaf >2014-01-06 04:11:03,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc6d0647}, log id: 54b8bfaf >2014-01-06 04:11:07,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67ebddea >2014-01-06 04:11:07,818 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:11:07,818 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:11:07,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterTasksListVDSCommand, log id: 67ebddea >2014-01-06 04:11:07,818 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-4) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:11:08,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41032c88 >2014-01-06 04:11:08,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 41032c88 >2014-01-06 04:11:08,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 168ac68f >2014-01-06 04:11:08,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a92e0ce}, log id: 168ac68f >2014-01-06 04:11:13,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 716b31c >2014-01-06 04:11:14,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 716b31c >2014-01-06 04:11:14,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2da82510 >2014-01-06 04:11:14,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4f5e968}, log id: 2da82510 >2014-01-06 04:11:19,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14187fee >2014-01-06 04:11:19,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 14187fee >2014-01-06 04:11:19,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c8d98cf >2014-01-06 04:11:19,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4f644cd}, log id: 4c8d98cf >2014-01-06 04:11:24,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7b3c5a91 >2014-01-06 04:11:24,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7b3c5a91 >2014-01-06 04:11:24,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e5acfa7 >2014-01-06 04:11:25,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32b99b5f}, log id: e5acfa7 >2014-01-06 04:11:30,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c8683b >2014-01-06 04:11:30,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1c8683b >2014-01-06 04:11:30,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f5edf7a >2014-01-06 04:11:30,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0286bfc}, log id: 5f5edf7a >2014-01-06 04:11:35,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 199b6757 >2014-01-06 04:11:35,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 199b6757 >2014-01-06 04:11:35,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1422f1c7 >2014-01-06 04:11:36,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8d2f181}, log id: 1422f1c7 >2014-01-06 04:11:41,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 457a0e2f >2014-01-06 04:11:41,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 457a0e2f >2014-01-06 04:11:41,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e4cbf1c >2014-01-06 04:11:41,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41892e0c}, log id: 3e4cbf1c >2014-01-06 04:11:46,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3a628495 >2014-01-06 04:11:46,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3a628495 >2014-01-06 04:11:46,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67d80551 >2014-01-06 04:11:46,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b2edb4d}, log id: 67d80551 >2014-01-06 04:11:51,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e0e72c5 >2014-01-06 04:11:52,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2e0e72c5 >2014-01-06 04:11:52,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49641138 >2014-01-06 04:11:52,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f08b881}, log id: 49641138 >2014-01-06 04:11:57,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7572c197 >2014-01-06 04:11:57,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7572c197 >2014-01-06 04:11:57,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 420dc560 >2014-01-06 04:11:57,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a5a9a6b}, log id: 420dc560 >2014-01-06 04:12:02,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3eb4c2d8 >2014-01-06 04:12:03,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3eb4c2d8 >2014-01-06 04:12:03,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 246661d2 >2014-01-06 04:12:03,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d73f589}, log id: 246661d2 >2014-01-06 04:12:07,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34503352 >2014-01-06 04:12:08,146 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:12:08,146 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:12:08,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, log id: 34503352 >2014-01-06 04:12:08,147 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-72) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:12:08,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ba4932 >2014-01-06 04:12:08,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3ba4932 >2014-01-06 04:12:08,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2318cd43 >2014-01-06 04:12:08,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e9ba54}, log id: 2318cd43 >2014-01-06 04:12:13,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29145636 >2014-01-06 04:12:14,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 29145636 >2014-01-06 04:12:14,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 277451d4 >2014-01-06 04:12:14,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a9a0b77}, log id: 277451d4 >2014-01-06 04:12:19,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 475c85d8 >2014-01-06 04:12:19,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 475c85d8 >2014-01-06 04:12:19,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51ff1758 >2014-01-06 04:12:19,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eae69efd}, log id: 51ff1758 >2014-01-06 04:12:24,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3bce6b0c >2014-01-06 04:12:24,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3bce6b0c >2014-01-06 04:12:24,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1658ec9d >2014-01-06 04:12:25,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dea8ec28}, log id: 1658ec9d >2014-01-06 04:12:30,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6361948 >2014-01-06 04:12:30,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6361948 >2014-01-06 04:12:30,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6698fbae >2014-01-06 04:12:30,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c39bdddc}, log id: 6698fbae >2014-01-06 04:12:35,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e4b42d5 >2014-01-06 04:12:35,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e4b42d5 >2014-01-06 04:12:35,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 564bc7db >2014-01-06 04:12:36,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84b6e89b}, log id: 564bc7db >2014-01-06 04:12:41,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ee16875 >2014-01-06 04:12:41,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: ee16875 >2014-01-06 04:12:41,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d7bd66a >2014-01-06 04:12:41,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27a45ff9}, log id: 6d7bd66a >2014-01-06 04:12:46,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41dc14ef >2014-01-06 04:12:46,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 41dc14ef >2014-01-06 04:12:46,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3950ded3 >2014-01-06 04:12:46,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e21ee51}, log id: 3950ded3 >2014-01-06 04:12:51,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 419e8b50 >2014-01-06 04:12:52,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 419e8b50 >2014-01-06 04:12:52,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6372a1eb >2014-01-06 04:12:52,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8313c03}, log id: 6372a1eb >2014-01-06 04:12:57,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23c0a53d >2014-01-06 04:12:57,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 23c0a53d >2014-01-06 04:12:57,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b0590ff >2014-01-06 04:12:57,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73c5542d}, log id: 1b0590ff >2014-01-06 04:13:02,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 629f1a8b >2014-01-06 04:13:03,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 629f1a8b >2014-01-06 04:13:03,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 207f71a7 >2014-01-06 04:13:03,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2990199}, log id: 207f71a7 >2014-01-06 04:13:08,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 636a7bbe >2014-01-06 04:13:08,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d918027 >2014-01-06 04:13:08,483 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:13:08,483 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:13:08,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, log id: 636a7bbe >2014-01-06 04:13:08,484 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-25) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:13:08,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4d918027 >2014-01-06 04:13:08,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d40d1e7 >2014-01-06 04:13:08,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74bb234}, log id: 1d40d1e7 >2014-01-06 04:13:13,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b71c808 >2014-01-06 04:13:14,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b71c808 >2014-01-06 04:13:14,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 643fdd45 >2014-01-06 04:13:14,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e995178}, log id: 643fdd45 >2014-01-06 04:13:19,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7660ac8e >2014-01-06 04:13:19,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7660ac8e >2014-01-06 04:13:19,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1963aefa >2014-01-06 04:13:19,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54de266f}, log id: 1963aefa >2014-01-06 04:13:24,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5adaeef7 >2014-01-06 04:13:25,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5adaeef7 >2014-01-06 04:13:25,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7bbdb204 >2014-01-06 04:13:25,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f3f2760}, log id: 7bbdb204 >2014-01-06 04:13:30,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39ac1267 >2014-01-06 04:13:30,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 39ac1267 >2014-01-06 04:13:30,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 69ef047e >2014-01-06 04:13:30,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37b5026a}, log id: 69ef047e >2014-01-06 04:13:35,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 421d5413 >2014-01-06 04:13:35,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 421d5413 >2014-01-06 04:13:35,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 57caace7 >2014-01-06 04:13:36,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e258416e}, log id: 57caace7 >2014-01-06 04:13:39,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3eaf9a98 >2014-01-06 04:13:39,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1927955c, log id: 3eaf9a98 >2014-01-06 04:13:41,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 278bd14b >2014-01-06 04:13:41,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 278bd14b >2014-01-06 04:13:41,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38812ef >2014-01-06 04:13:41,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67098dbd}, log id: 38812ef >2014-01-06 04:13:46,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e533339 >2014-01-06 04:13:46,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1e533339 >2014-01-06 04:13:46,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2d2e77b9 >2014-01-06 04:13:46,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b057c45e}, log id: 2d2e77b9 >2014-01-06 04:13:52,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2862130b >2014-01-06 04:13:52,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2862130b >2014-01-06 04:13:52,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77ed3a31 >2014-01-06 04:13:52,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f581bbea}, log id: 77ed3a31 >2014-01-06 04:13:57,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 128179ba >2014-01-06 04:13:57,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 128179ba >2014-01-06 04:13:57,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 194c9aa0 >2014-01-06 04:13:57,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5399265}, log id: 194c9aa0 >2014-01-06 04:14:02,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ec9130a >2014-01-06 04:14:03,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2ec9130a >2014-01-06 04:14:03,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ae9c4e8 >2014-01-06 04:14:03,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6f8e975}, log id: 3ae9c4e8 >2014-01-06 04:14:08,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 211c82ad >2014-01-06 04:14:08,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21e351fa >2014-01-06 04:14:08,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 211c82ad >2014-01-06 04:14:08,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 187c52cd >2014-01-06 04:14:08,820 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:14:08,820 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:14:08,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, log id: 21e351fa >2014-01-06 04:14:08,820 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-59) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:14:08,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@772f771c}, log id: 187c52cd >2014-01-06 04:14:13,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25a50f88 >2014-01-06 04:14:14,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25a50f88 >2014-01-06 04:14:14,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b8fd6d5 >2014-01-06 04:14:14,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58d231d1}, log id: 2b8fd6d5 >2014-01-06 04:14:19,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 168028a >2014-01-06 04:14:19,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 168028a >2014-01-06 04:14:19,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35e32347 >2014-01-06 04:14:19,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a2c1b06}, log id: 35e32347 >2014-01-06 04:14:24,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ea0d536 >2014-01-06 04:14:25,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5ea0d536 >2014-01-06 04:14:25,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2bfc0b6 >2014-01-06 04:14:25,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@def4f5e0}, log id: 2bfc0b6 >2014-01-06 04:14:30,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ccca82b >2014-01-06 04:14:30,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3ccca82b >2014-01-06 04:14:30,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d8f6d89 >2014-01-06 04:14:30,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be22b859}, log id: 6d8f6d89 >2014-01-06 04:14:35,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 406981df >2014-01-06 04:14:35,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 406981df >2014-01-06 04:14:35,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e5de97e >2014-01-06 04:14:36,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bf63f85}, log id: 5e5de97e >2014-01-06 04:14:41,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ca46e8a >2014-01-06 04:14:41,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1ca46e8a >2014-01-06 04:14:41,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 209c5e26 >2014-01-06 04:14:41,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf75f5eb}, log id: 209c5e26 >2014-01-06 04:14:46,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25a84008 >2014-01-06 04:14:46,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25a84008 >2014-01-06 04:14:46,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1310bc55 >2014-01-06 04:14:47,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be72c766}, log id: 1310bc55 >2014-01-06 04:14:52,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f1ab664 >2014-01-06 04:14:52,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6f1ab664 >2014-01-06 04:14:52,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11cb9f9b >2014-01-06 04:14:52,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22c9a5c7}, log id: 11cb9f9b >2014-01-06 04:14:57,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ce86e73 >2014-01-06 04:14:57,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1ce86e73 >2014-01-06 04:14:57,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b9ca90d >2014-01-06 04:14:57,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37f8214a}, log id: 3b9ca90d >2014-01-06 04:15:02,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4864580a >2014-01-06 04:15:03,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4864580a >2014-01-06 04:15:03,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27a0afdb >2014-01-06 04:15:03,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a082ed76}, log id: 27a0afdb >2014-01-06 04:15:08,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c83b3d0 >2014-01-06 04:15:08,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2c83b3d0 >2014-01-06 04:15:08,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6cb2b299 >2014-01-06 04:15:08,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6288c3 >2014-01-06 04:15:08,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae683727}, log id: 6cb2b299 >2014-01-06 04:15:09,141 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:15:09,141 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:15:09,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterTasksListVDSCommand, log id: 6288c3 >2014-01-06 04:15:09,142 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-18) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:15:13,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2572d2c0 >2014-01-06 04:15:14,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2572d2c0 >2014-01-06 04:15:14,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74d5200e >2014-01-06 04:15:14,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd860fcd}, log id: 74d5200e >2014-01-06 04:15:19,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b96a21c >2014-01-06 04:15:19,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b96a21c >2014-01-06 04:15:19,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d851798 >2014-01-06 04:15:19,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c75e4948}, log id: 7d851798 >2014-01-06 04:15:24,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ea23055 >2014-01-06 04:15:25,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5ea23055 >2014-01-06 04:15:25,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5171e97c >2014-01-06 04:15:25,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f629dcf7}, log id: 5171e97c >2014-01-06 04:15:30,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7de76978 >2014-01-06 04:15:30,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7de76978 >2014-01-06 04:15:30,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4acf11e0 >2014-01-06 04:15:30,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18fafd5f}, log id: 4acf11e0 >2014-01-06 04:15:35,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f9b1008 >2014-01-06 04:15:35,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1f9b1008 >2014-01-06 04:15:35,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79f2211c >2014-01-06 04:15:36,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1006dd62}, log id: 79f2211c >2014-01-06 04:15:41,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d9bd863 >2014-01-06 04:15:41,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1d9bd863 >2014-01-06 04:15:41,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5902e2db >2014-01-06 04:15:41,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49c7de23}, log id: 5902e2db >2014-01-06 04:15:46,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 142b9ad4 >2014-01-06 04:15:46,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 142b9ad4 >2014-01-06 04:15:46,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30825ac2 >2014-01-06 04:15:47,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@889233de}, log id: 30825ac2 >2014-01-06 04:15:52,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e6d73fa >2014-01-06 04:15:52,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7e6d73fa >2014-01-06 04:15:52,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 350f8c81 >2014-01-06 04:15:52,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e7b51a5}, log id: 350f8c81 >2014-01-06 04:15:57,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2767b225 >2014-01-06 04:15:57,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2767b225 >2014-01-06 04:15:57,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 70820eee >2014-01-06 04:15:57,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb3ba024}, log id: 70820eee >2014-01-06 04:16:02,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23675455 >2014-01-06 04:16:03,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 23675455 >2014-01-06 04:16:03,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47b5aa43 >2014-01-06 04:16:03,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c06a9a1}, log id: 47b5aa43 >2014-01-06 04:16:08,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 544dc23f >2014-01-06 04:16:08,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 544dc23f >2014-01-06 04:16:08,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a94ba00 >2014-01-06 04:16:08,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6933bd9}, log id: 1a94ba00 >2014-01-06 04:16:09,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49f4441d >2014-01-06 04:16:09,460 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:16:09,461 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:16:09,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, log id: 49f4441d >2014-01-06 04:16:09,461 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-78) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:16:09,578 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-69) Start refreshing all users data >2014-01-06 04:16:10,543 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VMs/Templates Ovf. >2014-01-06 04:16:10,544 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VM OVFs in Data Center Posixfs-DC-1 >2014-01-06 04:16:10,545 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated VM OVFs in Data Center Posixfs-DC-1 >2014-01-06 04:16:10,546 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update template OVFs in Data Center Posixfs-DC-1 >2014-01-06 04:16:10,547 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated templates OVFs in Data Center Posixfs-DC-1 >2014-01-06 04:16:10,547 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to remove unneeded template/vm OVFs in Data Center Posixfs-DC-1 >2014-01-06 04:16:10,548 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully removed unneeded template/vm OVFs in Data Center Posixfs-DC-1 >2014-01-06 04:16:10,548 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VM OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 04:16:10,549 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated VM OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 04:16:10,549 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update template OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 04:16:10,551 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated templates OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 04:16:10,551 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to remove unneeded template/vm OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 04:16:10,552 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully removed unneeded template/vm OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 04:16:13,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a8881df >2014-01-06 04:16:14,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1a8881df >2014-01-06 04:16:14,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 11bf749b >2014-01-06 04:16:14,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd14391f}, log id: 11bf749b >2014-01-06 04:16:19,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f25c147 >2014-01-06 04:16:19,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1f25c147 >2014-01-06 04:16:19,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64f94176 >2014-01-06 04:16:19,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64128038}, log id: 64f94176 >2014-01-06 04:16:24,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 342724a3 >2014-01-06 04:16:25,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 342724a3 >2014-01-06 04:16:25,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a83c8fe >2014-01-06 04:16:25,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5850c52}, log id: 3a83c8fe >2014-01-06 04:16:30,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54b4fbfb >2014-01-06 04:16:30,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 54b4fbfb >2014-01-06 04:16:30,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9d21a08 >2014-01-06 04:16:30,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@521c9ac0}, log id: 9d21a08 >2014-01-06 04:16:35,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f92fa42 >2014-01-06 04:16:35,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5f92fa42 >2014-01-06 04:16:35,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 275eb5fa >2014-01-06 04:16:36,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5449541e}, log id: 275eb5fa >2014-01-06 04:16:41,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7744ce6a >2014-01-06 04:16:41,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7744ce6a >2014-01-06 04:16:41,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53c20a2e >2014-01-06 04:16:41,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdcfd2c2}, log id: 53c20a2e >2014-01-06 04:16:46,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 230fcf08 >2014-01-06 04:16:46,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 230fcf08 >2014-01-06 04:16:46,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c3e5e63 >2014-01-06 04:16:47,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f03fdfc}, log id: 6c3e5e63 >2014-01-06 04:16:52,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a865a44 >2014-01-06 04:16:52,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3a865a44 >2014-01-06 04:16:52,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a161c7a >2014-01-06 04:16:52,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6952c1f}, log id: 5a161c7a >2014-01-06 04:16:57,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 680e7850 >2014-01-06 04:16:57,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 680e7850 >2014-01-06 04:16:57,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1279ab64 >2014-01-06 04:16:57,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9a409bc}, log id: 1279ab64 >2014-01-06 04:17:02,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f2ad811 >2014-01-06 04:17:03,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1f2ad811 >2014-01-06 04:17:03,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cd357f3 >2014-01-06 04:17:03,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b224f0c9}, log id: 6cd357f3 >2014-01-06 04:17:08,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 75b9aef3 >2014-01-06 04:17:08,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 75b9aef3 >2014-01-06 04:17:08,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c2b123d >2014-01-06 04:17:08,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49f1318c}, log id: 1c2b123d >2014-01-06 04:17:09,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17949af8 >2014-01-06 04:17:09,797 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:17:09,797 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:17:09,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, log id: 17949af8 >2014-01-06 04:17:09,798 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-64) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:17:13,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c209c5b >2014-01-06 04:17:14,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2c209c5b >2014-01-06 04:17:14,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68cb4fff >2014-01-06 04:17:14,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@707f9750}, log id: 68cb4fff >2014-01-06 04:17:19,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f0a149e >2014-01-06 04:17:19,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3f0a149e >2014-01-06 04:17:19,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ed1ba >2014-01-06 04:17:19,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ab7e415}, log id: 7ed1ba >2014-01-06 04:17:24,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 42a1f22e >2014-01-06 04:17:25,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 42a1f22e >2014-01-06 04:17:25,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 583e80b8 >2014-01-06 04:17:25,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dab30e8c}, log id: 583e80b8 >2014-01-06 04:17:30,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c60ff12 >2014-01-06 04:17:30,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2c60ff12 >2014-01-06 04:17:30,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 61b33cc8 >2014-01-06 04:17:30,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0489add}, log id: 61b33cc8 >2014-01-06 04:17:35,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c6f3a06 >2014-01-06 04:17:35,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: c6f3a06 >2014-01-06 04:17:35,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 396b4df2 >2014-01-06 04:17:36,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a1a780c}, log id: 396b4df2 >2014-01-06 04:17:41,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 65d21804 >2014-01-06 04:17:41,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 65d21804 >2014-01-06 04:17:41,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2aa56f7a >2014-01-06 04:17:41,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c299de0a}, log id: 2aa56f7a >2014-01-06 04:17:46,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29bd107b >2014-01-06 04:17:46,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29bd107b >2014-01-06 04:17:46,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2beb9454 >2014-01-06 04:17:47,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@432d58f}, log id: 2beb9454 >2014-01-06 04:17:52,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b0f501b >2014-01-06 04:17:52,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b0f501b >2014-01-06 04:17:52,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3338efd0 >2014-01-06 04:17:52,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80203332}, log id: 3338efd0 >2014-01-06 04:17:57,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3719f77a >2014-01-06 04:17:57,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3719f77a >2014-01-06 04:17:57,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 544472ee >2014-01-06 04:17:57,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d83bebf}, log id: 544472ee >2014-01-06 04:18:02,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58694e0e >2014-01-06 04:18:03,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 58694e0e >2014-01-06 04:18:03,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47f58eb2 >2014-01-06 04:18:03,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2ca0c53}, log id: 47f58eb2 >2014-01-06 04:18:08,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2fa34968 >2014-01-06 04:18:08,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2fa34968 >2014-01-06 04:18:08,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c698d56 >2014-01-06 04:18:08,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dba11167}, log id: 6c698d56 >2014-01-06 04:18:09,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62955f00 >2014-01-06 04:18:10,126 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:18:10,126 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:18:10,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, log id: 62955f00 >2014-01-06 04:18:10,126 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-40) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:18:13,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: be98fb9 >2014-01-06 04:18:14,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: be98fb9 >2014-01-06 04:18:14,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2686f9b2 >2014-01-06 04:18:14,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d22a0c2}, log id: 2686f9b2 >2014-01-06 04:18:19,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7977f6ea >2014-01-06 04:18:19,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7977f6ea >2014-01-06 04:18:19,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e6219b9 >2014-01-06 04:18:19,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3525ed5b}, log id: 4e6219b9 >2014-01-06 04:18:24,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 294d92b8 >2014-01-06 04:18:25,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 294d92b8 >2014-01-06 04:18:25,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f4437e5 >2014-01-06 04:18:25,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed4788d}, log id: 4f4437e5 >2014-01-06 04:18:30,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 674b9779 >2014-01-06 04:18:30,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 674b9779 >2014-01-06 04:18:30,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 692b168a >2014-01-06 04:18:30,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@421230fa}, log id: 692b168a >2014-01-06 04:18:35,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f552805 >2014-01-06 04:18:36,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1f552805 >2014-01-06 04:18:36,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 553c8a49 >2014-01-06 04:18:36,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3530abe9}, log id: 553c8a49 >2014-01-06 04:18:39,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a7403e4 >2014-01-06 04:18:39,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@11516b5b, log id: 6a7403e4 >2014-01-06 04:18:41,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59e886e6 >2014-01-06 04:18:41,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 59e886e6 >2014-01-06 04:18:41,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f762c53 >2014-01-06 04:18:41,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fef61b1}, log id: 3f762c53 >2014-01-06 04:18:46,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1838e498 >2014-01-06 04:18:46,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1838e498 >2014-01-06 04:18:46,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e886d46 >2014-01-06 04:18:47,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66d66886}, log id: 4e886d46 >2014-01-06 04:18:52,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2616c368 >2014-01-06 04:18:52,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2616c368 >2014-01-06 04:18:52,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 512b4495 >2014-01-06 04:18:52,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bacea415}, log id: 512b4495 >2014-01-06 04:18:57,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d5aca8d >2014-01-06 04:18:57,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3d5aca8d >2014-01-06 04:18:57,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 400eafb9 >2014-01-06 04:18:58,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f85271e1}, log id: 400eafb9 >2014-01-06 04:19:03,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a3b9e69 >2014-01-06 04:19:03,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2a3b9e69 >2014-01-06 04:19:03,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d34de30 >2014-01-06 04:19:03,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@764e0c8}, log id: 3d34de30 >2014-01-06 04:19:08,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31cb1ff3 >2014-01-06 04:19:08,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 31cb1ff3 >2014-01-06 04:19:08,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35010a2 >2014-01-06 04:19:08,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d326a66b}, log id: 35010a2 >2014-01-06 04:19:10,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 250eee69 >2014-01-06 04:19:10,455 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:19:10,456 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:19:10,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, log id: 250eee69 >2014-01-06 04:19:10,456 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-30) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:19:13,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4be644c3 >2014-01-06 04:19:14,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4be644c3 >2014-01-06 04:19:14,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66331029 >2014-01-06 04:19:14,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28c65739}, log id: 66331029 >2014-01-06 04:19:19,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 594dcf22 >2014-01-06 04:19:19,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 594dcf22 >2014-01-06 04:19:19,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1510bf55 >2014-01-06 04:19:19,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec4b60ab}, log id: 1510bf55 >2014-01-06 04:19:24,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33f8abe6 >2014-01-06 04:19:25,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 33f8abe6 >2014-01-06 04:19:25,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e671459 >2014-01-06 04:19:25,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@966c7c47}, log id: 3e671459 >2014-01-06 04:19:30,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c7e9872 >2014-01-06 04:19:30,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: c7e9872 >2014-01-06 04:19:30,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f2b56a2 >2014-01-06 04:19:30,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a39ffe47}, log id: 6f2b56a2 >2014-01-06 04:19:35,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45e48b10 >2014-01-06 04:19:36,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 45e48b10 >2014-01-06 04:19:36,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ad950fd >2014-01-06 04:19:36,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a0062c8}, log id: 4ad950fd >2014-01-06 04:19:41,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 57130491 >2014-01-06 04:19:41,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 57130491 >2014-01-06 04:19:41,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6fc0c183 >2014-01-06 04:19:41,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c40e1b0}, log id: 6fc0c183 >2014-01-06 04:19:46,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1358f7e5 >2014-01-06 04:19:46,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1358f7e5 >2014-01-06 04:19:46,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 96ba4fc >2014-01-06 04:19:47,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b45c46a8}, log id: 96ba4fc >2014-01-06 04:19:52,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d755212 >2014-01-06 04:19:52,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3d755212 >2014-01-06 04:19:52,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c8bca18 >2014-01-06 04:19:52,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2fb67b9}, log id: 7c8bca18 >2014-01-06 04:19:57,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7aa9b6fc >2014-01-06 04:19:57,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7aa9b6fc >2014-01-06 04:19:57,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5bfeef7c >2014-01-06 04:19:58,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be2b6912}, log id: 5bfeef7c >2014-01-06 04:20:03,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 210c5cf3 >2014-01-06 04:20:03,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 210c5cf3 >2014-01-06 04:20:03,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29f30bda >2014-01-06 04:20:03,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b028e0d1}, log id: 29f30bda >2014-01-06 04:20:08,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 62311f7b >2014-01-06 04:20:08,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 62311f7b >2014-01-06 04:20:08,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d7e181 >2014-01-06 04:20:08,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8c3413f}, log id: d7e181 >2014-01-06 04:20:10,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d1cdb15 >2014-01-06 04:20:10,786 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:20:10,786 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:20:10,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterTasksListVDSCommand, log id: 4d1cdb15 >2014-01-06 04:20:10,786 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-18) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:20:13,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2eca8034 >2014-01-06 04:20:14,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2eca8034 >2014-01-06 04:20:14,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4fef1842 >2014-01-06 04:20:14,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d909e0ba}, log id: 4fef1842 >2014-01-06 04:20:19,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6555f86b >2014-01-06 04:20:19,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6555f86b >2014-01-06 04:20:19,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13012ab1 >2014-01-06 04:20:19,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7919fd81}, log id: 13012ab1 >2014-01-06 04:20:24,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f7d6356 >2014-01-06 04:20:25,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2f7d6356 >2014-01-06 04:20:25,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7bfa578 >2014-01-06 04:20:25,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92ef6ae7}, log id: 7bfa578 >2014-01-06 04:20:30,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 69654134 >2014-01-06 04:20:30,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 69654134 >2014-01-06 04:20:30,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c4c9c89 >2014-01-06 04:20:30,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4366f25}, log id: 1c4c9c89 >2014-01-06 04:20:35,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7aa35c3c >2014-01-06 04:20:36,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7aa35c3c >2014-01-06 04:20:36,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d871da8 >2014-01-06 04:20:36,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f990e9f1}, log id: 4d871da8 >2014-01-06 04:20:41,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40e18c9c >2014-01-06 04:20:41,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 40e18c9c >2014-01-06 04:20:41,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2053e9b6 >2014-01-06 04:20:41,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30929c3d}, log id: 2053e9b6 >2014-01-06 04:20:46,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5cd1741b >2014-01-06 04:20:46,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5cd1741b >2014-01-06 04:20:46,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75de018b >2014-01-06 04:20:47,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5abfe98}, log id: 75de018b >2014-01-06 04:20:52,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46adb036 >2014-01-06 04:20:52,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 46adb036 >2014-01-06 04:20:52,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49582605 >2014-01-06 04:20:52,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f22ed13e}, log id: 49582605 >2014-01-06 04:20:57,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 757a62ea >2014-01-06 04:20:57,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 757a62ea >2014-01-06 04:20:57,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5111b919 >2014-01-06 04:20:58,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b726603d}, log id: 5111b919 >2014-01-06 04:21:03,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 756e6d65 >2014-01-06 04:21:03,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 756e6d65 >2014-01-06 04:21:03,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2acaa6bb >2014-01-06 04:21:03,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fbb4e41}, log id: 2acaa6bb >2014-01-06 04:21:08,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6de438f6 >2014-01-06 04:21:08,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6de438f6 >2014-01-06 04:21:08,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ba797b >2014-01-06 04:21:08,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77ec66c2}, log id: 3ba797b >2014-01-06 04:21:10,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b21e836 >2014-01-06 04:21:11,117 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:21:11,118 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:21:11,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, log id: 3b21e836 >2014-01-06 04:21:11,118 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-32) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:21:11,283 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-47) START, GetIsoListVDSCommand( storagePoolId = ee718678-261f-4bad-ab5e-73b9697cb5f8, ignoreFailoverLimit = false), log id: 7ab363a >2014-01-06 04:21:11,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-47) START, HsmGetIsoListVDSCommand(HostName = rhs-client10, HostId = e80de893-f6c4-4b96-9ce1-92a74ca5869a, storagePoolId=ee718678-261f-4bad-ab5e-73b9697cb5f8), log id: 79751dc4 >2014-01-06 04:21:11,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-47) FINISH, HsmGetIsoListVDSCommand, return: [en_windows_7_enterprise_with_sp1_x64_dvd_u_677651.iso], log id: 79751dc4 >2014-01-06 04:21:11,299 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-47) FINISH, GetIsoListVDSCommand, return: [en_windows_7_enterprise_with_sp1_x64_dvd_u_677651.iso], log id: 7ab363a >2014-01-06 04:21:11,304 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (pool-4-thread-47) Finished automatic refresh process for ISO file type with success, for storage domain id cc1bba44-7b89-4b6e-acff-fb066601f8c7. >2014-01-06 04:21:14,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3bf09699 >2014-01-06 04:21:14,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3bf09699 >2014-01-06 04:21:14,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28108db6 >2014-01-06 04:21:14,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95d6ba9}, log id: 28108db6 >2014-01-06 04:21:19,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ddd6517 >2014-01-06 04:21:19,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6ddd6517 >2014-01-06 04:21:19,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 655621ca >2014-01-06 04:21:19,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@270a9dba}, log id: 655621ca >2014-01-06 04:21:24,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10bbfccf >2014-01-06 04:21:25,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 10bbfccf >2014-01-06 04:21:25,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35be7cb7 >2014-01-06 04:21:25,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d81656e4}, log id: 35be7cb7 >2014-01-06 04:21:30,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 417ac2aa >2014-01-06 04:21:30,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 417ac2aa >2014-01-06 04:21:30,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b277878 >2014-01-06 04:21:30,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3756b10f}, log id: 5b277878 >2014-01-06 04:21:35,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4518afe7 >2014-01-06 04:21:36,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4518afe7 >2014-01-06 04:21:36,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b8a74e2 >2014-01-06 04:21:36,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57ce233}, log id: 2b8a74e2 >2014-01-06 04:21:41,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7bae71a4 >2014-01-06 04:21:41,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7bae71a4 >2014-01-06 04:21:41,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9e45262 >2014-01-06 04:21:41,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96a8200}, log id: 9e45262 >2014-01-06 04:21:46,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 121ff234 >2014-01-06 04:21:47,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 121ff234 >2014-01-06 04:21:47,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 43f9aba4 >2014-01-06 04:21:47,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8109e26}, log id: 43f9aba4 >2014-01-06 04:21:52,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73e6a72 >2014-01-06 04:21:52,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73e6a72 >2014-01-06 04:21:52,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d3d1b76 >2014-01-06 04:21:52,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7df0931}, log id: 5d3d1b76 >2014-01-06 04:21:57,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4cfb175a >2014-01-06 04:21:57,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4cfb175a >2014-01-06 04:21:57,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 277f8214 >2014-01-06 04:21:58,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9dc7e45}, log id: 277f8214 >2014-01-06 04:22:03,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61e2a6c2 >2014-01-06 04:22:03,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 61e2a6c2 >2014-01-06 04:22:03,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b4faaba >2014-01-06 04:22:03,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ecfdfa1}, log id: 6b4faaba >2014-01-06 04:22:08,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7cec6728 >2014-01-06 04:22:08,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7cec6728 >2014-01-06 04:22:08,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6508a090 >2014-01-06 04:22:09,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72699667}, log id: 6508a090 >2014-01-06 04:22:11,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4b9c455e >2014-01-06 04:22:11,451 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:22:11,451 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:22:11,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, log id: 4b9c455e >2014-01-06 04:22:11,452 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-68) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:22:14,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 292a7e9c >2014-01-06 04:22:14,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 292a7e9c >2014-01-06 04:22:14,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39055500 >2014-01-06 04:22:14,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4805db7f}, log id: 39055500 >2014-01-06 04:22:19,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46d309f1 >2014-01-06 04:22:19,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 46d309f1 >2014-01-06 04:22:19,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4138b581 >2014-01-06 04:22:19,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef0a6287}, log id: 4138b581 >2014-01-06 04:22:24,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 77103928 >2014-01-06 04:22:25,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 77103928 >2014-01-06 04:22:25,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35af76f5 >2014-01-06 04:22:25,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19195a2}, log id: 35af76f5 >2014-01-06 04:22:30,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 118fb8e4 >2014-01-06 04:22:30,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 118fb8e4 >2014-01-06 04:22:30,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5984b34 >2014-01-06 04:22:30,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2d6ce6}, log id: 5984b34 >2014-01-06 04:22:35,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f687036 >2014-01-06 04:22:36,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5f687036 >2014-01-06 04:22:36,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 230cfd87 >2014-01-06 04:22:36,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@762444d1}, log id: 230cfd87 >2014-01-06 04:22:41,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6dd6bad >2014-01-06 04:22:41,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6dd6bad >2014-01-06 04:22:41,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 183667a6 >2014-01-06 04:22:41,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88f160a}, log id: 183667a6 >2014-01-06 04:22:46,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47ba89a2 >2014-01-06 04:22:47,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 47ba89a2 >2014-01-06 04:22:47,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a154318 >2014-01-06 04:22:47,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a129c69}, log id: 3a154318 >2014-01-06 04:22:52,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4b763ae9 >2014-01-06 04:22:52,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4b763ae9 >2014-01-06 04:22:52,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e47f8de >2014-01-06 04:22:52,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8364fd16}, log id: 5e47f8de >2014-01-06 04:22:57,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2910ac55 >2014-01-06 04:22:57,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2910ac55 >2014-01-06 04:22:57,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c8b4886 >2014-01-06 04:22:58,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db3686af}, log id: 2c8b4886 >2014-01-06 04:23:03,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 69c4ebac >2014-01-06 04:23:03,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 69c4ebac >2014-01-06 04:23:03,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3acf2602 >2014-01-06 04:23:03,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a84aa0e}, log id: 3acf2602 >2014-01-06 04:23:08,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 525fde79 >2014-01-06 04:23:08,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 525fde79 >2014-01-06 04:23:08,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 57d27cd3 >2014-01-06 04:23:08,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6713dcb0}, log id: 57d27cd3 >2014-01-06 04:23:11,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b42366 >2014-01-06 04:23:11,784 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:23:11,784 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:23:11,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, log id: 5b42366 >2014-01-06 04:23:11,784 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-36) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:23:14,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1090b105 >2014-01-06 04:23:14,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1090b105 >2014-01-06 04:23:14,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a2806db >2014-01-06 04:23:14,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39606364}, log id: 2a2806db >2014-01-06 04:23:19,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 685127d0 >2014-01-06 04:23:19,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 685127d0 >2014-01-06 04:23:19,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37c95810 >2014-01-06 04:23:19,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8738305e}, log id: 37c95810 >2014-01-06 04:23:24,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 55412484 >2014-01-06 04:23:25,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 55412484 >2014-01-06 04:23:25,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3969d9fb >2014-01-06 04:23:25,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f176c31}, log id: 3969d9fb >2014-01-06 04:23:30,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54658a7 >2014-01-06 04:23:30,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54658a7 >2014-01-06 04:23:30,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f78750b >2014-01-06 04:23:30,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9dbc0cc}, log id: 3f78750b >2014-01-06 04:23:35,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5debaa18 >2014-01-06 04:23:36,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5debaa18 >2014-01-06 04:23:36,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 779a28d1 >2014-01-06 04:23:36,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d63d488c}, log id: 779a28d1 >2014-01-06 04:23:39,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29c62bea >2014-01-06 04:23:39,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@41b314f, log id: 29c62bea >2014-01-06 04:23:41,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11d2b551 >2014-01-06 04:23:41,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 11d2b551 >2014-01-06 04:23:41,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79a83cde >2014-01-06 04:23:41,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8040fd3}, log id: 79a83cde >2014-01-06 04:23:46,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1739740f >2014-01-06 04:23:47,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1739740f >2014-01-06 04:23:47,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a6950cd >2014-01-06 04:23:47,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9100aed9}, log id: 4a6950cd >2014-01-06 04:23:52,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1dd88e0 >2014-01-06 04:23:52,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1dd88e0 >2014-01-06 04:23:52,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57040487 >2014-01-06 04:23:52,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ab65559}, log id: 57040487 >2014-01-06 04:23:57,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3008918e >2014-01-06 04:23:57,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3008918e >2014-01-06 04:23:57,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e871744 >2014-01-06 04:23:58,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@799b0df}, log id: 6e871744 >2014-01-06 04:24:03,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 26ed0167 >2014-01-06 04:24:03,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 26ed0167 >2014-01-06 04:24:03,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1057d3de >2014-01-06 04:24:03,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18b08a70}, log id: 1057d3de >2014-01-06 04:24:08,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 183cbade >2014-01-06 04:24:08,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 183cbade >2014-01-06 04:24:08,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c0f3120 >2014-01-06 04:24:09,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@452c9e2c}, log id: 3c0f3120 >2014-01-06 04:24:11,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40693438 >2014-01-06 04:24:12,123 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:24:12,123 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:24:12,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterTasksListVDSCommand, log id: 40693438 >2014-01-06 04:24:12,123 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-21) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:24:14,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 76a10343 >2014-01-06 04:24:14,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 76a10343 >2014-01-06 04:24:14,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2331785 >2014-01-06 04:24:14,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed090a5d}, log id: 2331785 >2014-01-06 04:24:19,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47688466 >2014-01-06 04:24:19,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 47688466 >2014-01-06 04:24:19,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a981615 >2014-01-06 04:24:20,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7652e5ef}, log id: 1a981615 >2014-01-06 04:24:25,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6830044 >2014-01-06 04:24:25,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6830044 >2014-01-06 04:24:25,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36ef5790 >2014-01-06 04:24:25,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@463fa0f7}, log id: 36ef5790 >2014-01-06 04:24:30,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 286f52c9 >2014-01-06 04:24:30,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 286f52c9 >2014-01-06 04:24:30,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74eac8a5 >2014-01-06 04:24:30,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4823b3f0}, log id: 74eac8a5 >2014-01-06 04:24:35,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22bd4e02 >2014-01-06 04:24:36,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 22bd4e02 >2014-01-06 04:24:36,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6fe900d6 >2014-01-06 04:24:36,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf01711d}, log id: 6fe900d6 >2014-01-06 04:24:41,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: d394313 >2014-01-06 04:24:41,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: d394313 >2014-01-06 04:24:41,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8ec0d75 >2014-01-06 04:24:41,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4d34f24}, log id: 8ec0d75 >2014-01-06 04:24:46,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43c5d072 >2014-01-06 04:24:47,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43c5d072 >2014-01-06 04:24:47,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 402239ce >2014-01-06 04:24:47,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ce0aecb}, log id: 402239ce >2014-01-06 04:24:52,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 153fdb82 >2014-01-06 04:24:52,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 153fdb82 >2014-01-06 04:24:52,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20c41b09 >2014-01-06 04:24:52,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf044338}, log id: 20c41b09 >2014-01-06 04:24:57,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60360613 >2014-01-06 04:24:58,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 60360613 >2014-01-06 04:24:58,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 460c63a9 >2014-01-06 04:24:58,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f2f1f4a}, log id: 460c63a9 >2014-01-06 04:25:03,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 432f330c >2014-01-06 04:25:03,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 432f330c >2014-01-06 04:25:03,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 665e5643 >2014-01-06 04:25:03,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8de47650}, log id: 665e5643 >2014-01-06 04:25:08,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 775f3511 >2014-01-06 04:25:09,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 775f3511 >2014-01-06 04:25:09,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39eeb372 >2014-01-06 04:25:09,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4230f9a}, log id: 39eeb372 >2014-01-06 04:25:12,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 474a5da9 >2014-01-06 04:25:12,451 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:25:12,451 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:25:12,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, log id: 474a5da9 >2014-01-06 04:25:12,452 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-9) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:25:14,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7665c150 >2014-01-06 04:25:14,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7665c150 >2014-01-06 04:25:14,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23afb2ed >2014-01-06 04:25:14,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34b08d9c}, log id: 23afb2ed >2014-01-06 04:25:19,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1677e195 >2014-01-06 04:25:19,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1677e195 >2014-01-06 04:25:19,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d096be3 >2014-01-06 04:25:20,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae46cebf}, log id: 7d096be3 >2014-01-06 04:25:25,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b3cd083 >2014-01-06 04:25:25,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b3cd083 >2014-01-06 04:25:25,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: fab3c92 >2014-01-06 04:25:25,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea5caf1c}, log id: fab3c92 >2014-01-06 04:25:30,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 323133ef >2014-01-06 04:25:30,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 323133ef >2014-01-06 04:25:30,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6aa269e5 >2014-01-06 04:25:31,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2214972d}, log id: 6aa269e5 >2014-01-06 04:25:36,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 136363f7 >2014-01-06 04:25:36,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 136363f7 >2014-01-06 04:25:36,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4fd02c39 >2014-01-06 04:25:36,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0563a73}, log id: 4fd02c39 >2014-01-06 04:25:41,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f058999 >2014-01-06 04:25:41,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4f058999 >2014-01-06 04:25:41,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1567ee4f >2014-01-06 04:25:41,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35822c01}, log id: 1567ee4f >2014-01-06 04:25:46,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36c3d2c5 >2014-01-06 04:25:47,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 36c3d2c5 >2014-01-06 04:25:47,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5495b3f1 >2014-01-06 04:25:47,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@735203ab}, log id: 5495b3f1 >2014-01-06 04:25:52,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9d7389b >2014-01-06 04:25:52,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 9d7389b >2014-01-06 04:25:52,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20c00f80 >2014-01-06 04:25:52,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@631edc8f}, log id: 20c00f80 >2014-01-06 04:25:57,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2537cfb5 >2014-01-06 04:25:58,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2537cfb5 >2014-01-06 04:25:58,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66c5e14d >2014-01-06 04:25:58,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28a4a23}, log id: 66c5e14d >2014-01-06 04:26:03,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 347915fb >2014-01-06 04:26:03,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 347915fb >2014-01-06 04:26:03,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d7fc361 >2014-01-06 04:26:03,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf256b8a}, log id: 1d7fc361 >2014-01-06 04:26:08,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d4f3a38 >2014-01-06 04:26:09,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7d4f3a38 >2014-01-06 04:26:09,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7dbc9694 >2014-01-06 04:26:09,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1025433}, log id: 7dbc9694 >2014-01-06 04:26:12,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6817fc8d >2014-01-06 04:26:12,781 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:26:12,781 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:26:12,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, log id: 6817fc8d >2014-01-06 04:26:12,782 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-24) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:26:14,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38a335d4 >2014-01-06 04:26:14,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 38a335d4 >2014-01-06 04:26:14,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 781eaf4d >2014-01-06 04:26:14,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@907dfb42}, log id: 781eaf4d >2014-01-06 04:26:19,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ca03a0e >2014-01-06 04:26:19,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7ca03a0e >2014-01-06 04:26:19,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5d233031 >2014-01-06 04:26:20,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b2f989a}, log id: 5d233031 >2014-01-06 04:26:25,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13df31da >2014-01-06 04:26:25,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 13df31da >2014-01-06 04:26:25,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f245d8d >2014-01-06 04:26:25,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0b7f682}, log id: 4f245d8d >2014-01-06 04:26:30,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 563285ff >2014-01-06 04:26:30,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 563285ff >2014-01-06 04:26:30,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6837b5e7 >2014-01-06 04:26:31,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfe6d0be}, log id: 6837b5e7 >2014-01-06 04:26:36,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c905887 >2014-01-06 04:26:36,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1c905887 >2014-01-06 04:26:36,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36848fce >2014-01-06 04:26:36,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37d2034}, log id: 36848fce >2014-01-06 04:26:41,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c8415f6 >2014-01-06 04:26:41,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: c8415f6 >2014-01-06 04:26:41,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28bca80 >2014-01-06 04:26:41,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e004697}, log id: 28bca80 >2014-01-06 04:26:46,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66f4284e >2014-01-06 04:26:47,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 66f4284e >2014-01-06 04:26:47,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7063dbbf >2014-01-06 04:26:47,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9ec1578}, log id: 7063dbbf >2014-01-06 04:26:52,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 751e3e5b >2014-01-06 04:26:52,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 751e3e5b >2014-01-06 04:26:52,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2095caa >2014-01-06 04:26:52,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0ac0cd8}, log id: 2095caa >2014-01-06 04:26:57,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 604be55c >2014-01-06 04:26:58,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 604be55c >2014-01-06 04:26:58,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 335b6062 >2014-01-06 04:26:58,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34c72e11}, log id: 335b6062 >2014-01-06 04:27:03,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4348eb7 >2014-01-06 04:27:03,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4348eb7 >2014-01-06 04:27:03,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ff81cda >2014-01-06 04:27:03,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cce8025c}, log id: 5ff81cda >2014-01-06 04:27:08,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66d00829 >2014-01-06 04:27:09,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66d00829 >2014-01-06 04:27:09,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56103dea >2014-01-06 04:27:09,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1c9f1f0}, log id: 56103dea >2014-01-06 04:27:12,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 308c0407 >2014-01-06 04:27:13,108 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:27:13,109 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:27:13,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, log id: 308c0407 >2014-01-06 04:27:13,109 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-96) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:27:14,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1812ec02 >2014-01-06 04:27:14,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1812ec02 >2014-01-06 04:27:14,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4aa7f8c0 >2014-01-06 04:27:14,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c99cc9f}, log id: 4aa7f8c0 >2014-01-06 04:27:19,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3de94b8b >2014-01-06 04:27:20,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3de94b8b >2014-01-06 04:27:20,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5adbf48 >2014-01-06 04:27:20,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b5b1dfb}, log id: 5adbf48 >2014-01-06 04:27:25,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 479b67e5 >2014-01-06 04:27:25,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 479b67e5 >2014-01-06 04:27:25,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c000ffd >2014-01-06 04:27:25,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21d14d55}, log id: 3c000ffd >2014-01-06 04:27:30,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e3219dd >2014-01-06 04:27:30,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e3219dd >2014-01-06 04:27:30,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6752002f >2014-01-06 04:27:31,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f83dc203}, log id: 6752002f >2014-01-06 04:27:36,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d5c79d2 >2014-01-06 04:27:36,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d5c79d2 >2014-01-06 04:27:36,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 446c881e >2014-01-06 04:27:36,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5e0222a}, log id: 446c881e >2014-01-06 04:27:41,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4218d866 >2014-01-06 04:27:41,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4218d866 >2014-01-06 04:27:41,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f93c3df >2014-01-06 04:27:42,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@790b0254}, log id: 3f93c3df >2014-01-06 04:27:47,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 197e5464 >2014-01-06 04:27:47,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 197e5464 >2014-01-06 04:27:47,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d15d62e >2014-01-06 04:27:47,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f028c720}, log id: 4d15d62e >2014-01-06 04:27:52,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17e388f6 >2014-01-06 04:27:52,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 17e388f6 >2014-01-06 04:27:52,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b802fa7 >2014-01-06 04:27:52,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2eff85}, log id: 6b802fa7 >2014-01-06 04:27:57,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3defc125 >2014-01-06 04:27:58,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3defc125 >2014-01-06 04:27:58,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8b9eef6 >2014-01-06 04:27:58,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46175286}, log id: 8b9eef6 >2014-01-06 04:28:03,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ba2851b >2014-01-06 04:28:03,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ba2851b >2014-01-06 04:28:03,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2adcd282 >2014-01-06 04:28:03,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@117f3bdf}, log id: 2adcd282 >2014-01-06 04:28:08,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 535ef754 >2014-01-06 04:28:09,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 535ef754 >2014-01-06 04:28:09,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b2ad2ae >2014-01-06 04:28:09,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28a09b7f}, log id: 5b2ad2ae >2014-01-06 04:28:13,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7442b75e >2014-01-06 04:28:13,436 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:28:13,436 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:28:13,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, log id: 7442b75e >2014-01-06 04:28:13,436 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-49) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:28:14,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37d3020b >2014-01-06 04:28:14,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 37d3020b >2014-01-06 04:28:14,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57ec391b >2014-01-06 04:28:14,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd40c95e}, log id: 57ec391b >2014-01-06 04:28:19,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2032f099 >2014-01-06 04:28:20,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2032f099 >2014-01-06 04:28:20,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a31600c >2014-01-06 04:28:20,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7d2bb8d}, log id: 5a31600c >2014-01-06 04:28:25,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17e25a03 >2014-01-06 04:28:25,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 17e25a03 >2014-01-06 04:28:25,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f0d4019 >2014-01-06 04:28:25,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44b3498a}, log id: 7f0d4019 >2014-01-06 04:28:30,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 396c9527 >2014-01-06 04:28:30,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 396c9527 >2014-01-06 04:28:30,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ba60072 >2014-01-06 04:28:31,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a2e76ec}, log id: 5ba60072 >2014-01-06 04:28:36,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e53c6b3 >2014-01-06 04:28:36,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2e53c6b3 >2014-01-06 04:28:36,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6946cf76 >2014-01-06 04:28:36,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a29aee1}, log id: 6946cf76 >2014-01-06 04:28:39,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21c2ce7 >2014-01-06 04:28:39,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1510aca5, log id: 21c2ce7 >2014-01-06 04:28:41,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ea1fb62 >2014-01-06 04:28:41,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: ea1fb62 >2014-01-06 04:28:41,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f1c6d8a >2014-01-06 04:28:42,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12eca31e}, log id: 3f1c6d8a >2014-01-06 04:28:47,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33ad43bd >2014-01-06 04:28:47,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 33ad43bd >2014-01-06 04:28:47,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5343ff8f >2014-01-06 04:28:47,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebe31a91}, log id: 5343ff8f >2014-01-06 04:28:52,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d1e59e8 >2014-01-06 04:28:52,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3d1e59e8 >2014-01-06 04:28:52,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 549334f >2014-01-06 04:28:52,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28d7cf47}, log id: 549334f >2014-01-06 04:28:57,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2359c0c9 >2014-01-06 04:28:58,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2359c0c9 >2014-01-06 04:28:58,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19d0dddf >2014-01-06 04:28:58,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9503e025}, log id: 19d0dddf >2014-01-06 04:29:03,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7700a97c >2014-01-06 04:29:03,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7700a97c >2014-01-06 04:29:03,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c10b94d >2014-01-06 04:29:03,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bf86a20}, log id: 6c10b94d >2014-01-06 04:29:08,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d33b577 >2014-01-06 04:29:09,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7d33b577 >2014-01-06 04:29:09,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72be4c96 >2014-01-06 04:29:09,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4d7a659}, log id: 72be4c96 >2014-01-06 04:29:13,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 248a664d >2014-01-06 04:29:13,765 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:29:13,765 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:29:13,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, log id: 248a664d >2014-01-06 04:29:13,765 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-88) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:29:14,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 513d1b60 >2014-01-06 04:29:14,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 513d1b60 >2014-01-06 04:29:14,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2fe2a91a >2014-01-06 04:29:14,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27ef79ea}, log id: 2fe2a91a >2014-01-06 04:29:19,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37ad5702 >2014-01-06 04:29:20,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 37ad5702 >2014-01-06 04:29:20,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 53d1b274 >2014-01-06 04:29:20,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20377be5}, log id: 53d1b274 >2014-01-06 04:29:25,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1bf6773f >2014-01-06 04:29:25,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1bf6773f >2014-01-06 04:29:25,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: a7dd189 >2014-01-06 04:29:25,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11655dce}, log id: a7dd189 >2014-01-06 04:29:30,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3631befe >2014-01-06 04:29:30,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3631befe >2014-01-06 04:29:30,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33521b85 >2014-01-06 04:29:31,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ac2f0e1}, log id: 33521b85 >2014-01-06 04:29:36,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d218e59 >2014-01-06 04:29:36,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1d218e59 >2014-01-06 04:29:36,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4912a6e4 >2014-01-06 04:29:36,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e97d10b}, log id: 4912a6e4 >2014-01-06 04:29:41,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e4513fa >2014-01-06 04:29:41,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e4513fa >2014-01-06 04:29:41,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2aa13e51 >2014-01-06 04:29:41,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc1468c8}, log id: 2aa13e51 >2014-01-06 04:29:47,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 194268e8 >2014-01-06 04:29:47,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 194268e8 >2014-01-06 04:29:47,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46d9493f >2014-01-06 04:29:47,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3b31f28}, log id: 46d9493f >2014-01-06 04:29:52,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c36c9ee >2014-01-06 04:29:52,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4c36c9ee >2014-01-06 04:29:52,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d570d14 >2014-01-06 04:29:52,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@404c8d26}, log id: d570d14 >2014-01-06 04:29:57,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f5464f2 >2014-01-06 04:29:58,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f5464f2 >2014-01-06 04:29:58,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25523f48 >2014-01-06 04:29:58,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d1f790f}, log id: 25523f48 >2014-01-06 04:30:03,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ad85f43 >2014-01-06 04:30:03,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: ad85f43 >2014-01-06 04:30:03,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3595dc80 >2014-01-06 04:30:03,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce79a898}, log id: 3595dc80 >2014-01-06 04:30:08,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 729ecb0f >2014-01-06 04:30:09,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 729ecb0f >2014-01-06 04:30:09,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 577ea467 >2014-01-06 04:30:09,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56acf93e}, log id: 577ea467 >2014-01-06 04:30:13,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65c85fa7 >2014-01-06 04:30:14,085 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:30:14,085 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:30:14,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, log id: 65c85fa7 >2014-01-06 04:30:14,085 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-73) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:30:14,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ad442b9 >2014-01-06 04:30:14,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4ad442b9 >2014-01-06 04:30:14,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56582e26 >2014-01-06 04:30:14,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba503f59}, log id: 56582e26 >2014-01-06 04:30:19,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ffb3566 >2014-01-06 04:30:20,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ffb3566 >2014-01-06 04:30:20,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 657eafdf >2014-01-06 04:30:20,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3b494b7}, log id: 657eafdf >2014-01-06 04:30:25,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 376abaa4 >2014-01-06 04:30:25,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 376abaa4 >2014-01-06 04:30:25,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56e0ef74 >2014-01-06 04:30:25,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0a4718a}, log id: 56e0ef74 >2014-01-06 04:30:30,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5575435e >2014-01-06 04:30:30,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5575435e >2014-01-06 04:30:30,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 353438bc >2014-01-06 04:30:31,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77835846}, log id: 353438bc >2014-01-06 04:30:36,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2cd9d011 >2014-01-06 04:30:36,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2cd9d011 >2014-01-06 04:30:36,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63c20de0 >2014-01-06 04:30:36,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86b7890c}, log id: 63c20de0 >2014-01-06 04:30:41,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 65c4a899 >2014-01-06 04:30:41,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 65c4a899 >2014-01-06 04:30:41,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d30ba98 >2014-01-06 04:30:41,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@426edcc0}, log id: 3d30ba98 >2014-01-06 04:30:47,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ecb17eb >2014-01-06 04:30:47,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ecb17eb >2014-01-06 04:30:47,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59b3243e >2014-01-06 04:30:47,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5adf4c5}, log id: 59b3243e >2014-01-06 04:30:52,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6826b579 >2014-01-06 04:30:52,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6826b579 >2014-01-06 04:30:52,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5057eb34 >2014-01-06 04:30:52,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1add3ddc}, log id: 5057eb34 >2014-01-06 04:30:57,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2920f9ce >2014-01-06 04:30:58,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2920f9ce >2014-01-06 04:30:58,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3168678 >2014-01-06 04:30:58,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86176ce0}, log id: 3168678 >2014-01-06 04:31:03,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2577e03f >2014-01-06 04:31:03,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2577e03f >2014-01-06 04:31:03,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: a416abb >2014-01-06 04:31:03,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4b12d5c}, log id: a416abb >2014-01-06 04:31:08,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63fa6d32 >2014-01-06 04:31:09,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 63fa6d32 >2014-01-06 04:31:09,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b828dc7 >2014-01-06 04:31:09,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91f83ca2}, log id: b828dc7 >2014-01-06 04:31:14,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4790d994 >2014-01-06 04:31:14,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60bf62bb >2014-01-06 04:31:14,422 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:31:14,423 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:31:14,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, log id: 4790d994 >2014-01-06 04:31:14,423 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-10) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:31:14,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 60bf62bb >2014-01-06 04:31:14,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 57df0a87 >2014-01-06 04:31:14,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3301a3c}, log id: 57df0a87 >2014-01-06 04:31:19,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 355323e >2014-01-06 04:31:20,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 355323e >2014-01-06 04:31:20,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a3e8ea0 >2014-01-06 04:31:20,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c269876e}, log id: 5a3e8ea0 >2014-01-06 04:31:25,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e3d87c5 >2014-01-06 04:31:25,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e3d87c5 >2014-01-06 04:31:25,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 718f4470 >2014-01-06 04:31:25,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c74c8e9}, log id: 718f4470 >2014-01-06 04:31:30,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20e31dc3 >2014-01-06 04:31:30,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 20e31dc3 >2014-01-06 04:31:30,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 588a7b1a >2014-01-06 04:31:31,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a36763c}, log id: 588a7b1a >2014-01-06 04:31:36,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 67455bcc >2014-01-06 04:31:36,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 67455bcc >2014-01-06 04:31:36,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28829c0a >2014-01-06 04:31:36,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6cba752}, log id: 28829c0a >2014-01-06 04:31:41,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 770e51bf >2014-01-06 04:31:41,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 770e51bf >2014-01-06 04:31:41,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a8c141c >2014-01-06 04:31:42,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d383f45}, log id: 4a8c141c >2014-01-06 04:31:47,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 51d44ff >2014-01-06 04:31:47,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 51d44ff >2014-01-06 04:31:47,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40058084 >2014-01-06 04:31:47,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3707ed5}, log id: 40058084 >2014-01-06 04:31:52,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 833f223 >2014-01-06 04:31:52,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 833f223 >2014-01-06 04:31:52,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 327f2e78 >2014-01-06 04:31:52,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54d9a8f}, log id: 327f2e78 >2014-01-06 04:31:57,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 769deb49 >2014-01-06 04:31:58,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 769deb49 >2014-01-06 04:31:58,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3dcfb805 >2014-01-06 04:31:58,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c13d6bff}, log id: 3dcfb805 >2014-01-06 04:32:03,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ac40cdd >2014-01-06 04:32:03,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2ac40cdd >2014-01-06 04:32:03,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 480e658f >2014-01-06 04:32:03,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@634d8659}, log id: 480e658f >2014-01-06 04:32:08,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e19b010 >2014-01-06 04:32:09,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3e19b010 >2014-01-06 04:32:09,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8c5a97f >2014-01-06 04:32:09,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@608fca3c}, log id: 8c5a97f >2014-01-06 04:32:14,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61a48c18 >2014-01-06 04:32:14,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33529b92 >2014-01-06 04:32:14,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 61a48c18 >2014-01-06 04:32:14,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71c7a31c >2014-01-06 04:32:14,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1733d9b3}, log id: 71c7a31c >2014-01-06 04:32:14,763 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:32:14,763 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:32:14,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, log id: 33529b92 >2014-01-06 04:32:14,763 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-71) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:32:19,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 560f6c46 >2014-01-06 04:32:20,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 560f6c46 >2014-01-06 04:32:20,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 579d465e >2014-01-06 04:32:20,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@575be2c0}, log id: 579d465e >2014-01-06 04:32:25,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 761e3eeb >2014-01-06 04:32:25,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 761e3eeb >2014-01-06 04:32:25,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a0811e6 >2014-01-06 04:32:25,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a25cff38}, log id: 7a0811e6 >2014-01-06 04:32:30,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 69659dac >2014-01-06 04:32:30,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 69659dac >2014-01-06 04:32:30,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22baa30f >2014-01-06 04:32:31,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21b653f9}, log id: 22baa30f >2014-01-06 04:32:36,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 389debf6 >2014-01-06 04:32:36,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 389debf6 >2014-01-06 04:32:36,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37b32e9a >2014-01-06 04:32:36,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c68a6c76}, log id: 37b32e9a >2014-01-06 04:32:41,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e3afb52 >2014-01-06 04:32:41,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e3afb52 >2014-01-06 04:32:41,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45faf6a1 >2014-01-06 04:32:42,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73e73a75}, log id: 45faf6a1 >2014-01-06 04:32:47,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64a45f33 >2014-01-06 04:32:47,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 64a45f33 >2014-01-06 04:32:47,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66ab34d4 >2014-01-06 04:32:47,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7868f3ca}, log id: 66ab34d4 >2014-01-06 04:32:52,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5517eca0 >2014-01-06 04:32:52,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5517eca0 >2014-01-06 04:32:52,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3dedf3a0 >2014-01-06 04:32:52,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f80d8e43}, log id: 3dedf3a0 >2014-01-06 04:32:57,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48ebe4f1 >2014-01-06 04:32:58,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 48ebe4f1 >2014-01-06 04:32:58,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14146006 >2014-01-06 04:32:58,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba51380d}, log id: 14146006 >2014-01-06 04:33:03,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ace2dd2 >2014-01-06 04:33:03,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5ace2dd2 >2014-01-06 04:33:03,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 249b4fe3 >2014-01-06 04:33:03,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5037dff7}, log id: 249b4fe3 >2014-01-06 04:33:08,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 677af076 >2014-01-06 04:33:09,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 677af076 >2014-01-06 04:33:09,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60e423c7 >2014-01-06 04:33:09,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fafb9cb}, log id: 60e423c7 >2014-01-06 04:33:14,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a907758 >2014-01-06 04:33:14,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1a907758 >2014-01-06 04:33:14,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34859e69 >2014-01-06 04:33:14,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e05cfd1 >2014-01-06 04:33:14,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@309a34c6}, log id: 34859e69 >2014-01-06 04:33:15,092 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:33:15,092 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:33:15,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, log id: 5e05cfd1 >2014-01-06 04:33:15,092 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-92) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:33:19,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 121d1d50 >2014-01-06 04:33:20,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 121d1d50 >2014-01-06 04:33:20,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 750ad835 >2014-01-06 04:33:20,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c512695c}, log id: 750ad835 >2014-01-06 04:33:25,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13951a2f >2014-01-06 04:33:25,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 13951a2f >2014-01-06 04:33:25,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e83d25d >2014-01-06 04:33:25,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ed48ab1}, log id: 5e83d25d >2014-01-06 04:33:30,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 361d8139 >2014-01-06 04:33:31,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 361d8139 >2014-01-06 04:33:31,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36fd87e7 >2014-01-06 04:33:31,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28e5e049}, log id: 36fd87e7 >2014-01-06 04:33:36,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: de233dc >2014-01-06 04:33:36,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: de233dc >2014-01-06 04:33:36,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b98369 >2014-01-06 04:33:36,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2807d2a0}, log id: 5b98369 >2014-01-06 04:33:39,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2498fb1d >2014-01-06 04:33:40,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4d1e579, log id: 2498fb1d >2014-01-06 04:33:41,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2246c782 >2014-01-06 04:33:41,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2246c782 >2014-01-06 04:33:41,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11c043a5 >2014-01-06 04:33:42,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd4f7af3}, log id: 11c043a5 >2014-01-06 04:33:47,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 542fce68 >2014-01-06 04:33:47,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 542fce68 >2014-01-06 04:33:47,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7bbd4fc5 >2014-01-06 04:33:47,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b83db79e}, log id: 7bbd4fc5 >2014-01-06 04:33:52,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ef41e3f >2014-01-06 04:33:52,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1ef41e3f >2014-01-06 04:33:52,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b2dc7e7 >2014-01-06 04:33:52,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89840ea4}, log id: 3b2dc7e7 >2014-01-06 04:33:58,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6539eb13 >2014-01-06 04:33:58,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6539eb13 >2014-01-06 04:33:58,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25e18edf >2014-01-06 04:33:58,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf3b0a56}, log id: 25e18edf >2014-01-06 04:34:03,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a02c341 >2014-01-06 04:34:03,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4a02c341 >2014-01-06 04:34:03,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f27bdbb >2014-01-06 04:34:03,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f15c8478}, log id: 4f27bdbb >2014-01-06 04:34:08,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 161331c3 >2014-01-06 04:34:09,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 161331c3 >2014-01-06 04:34:09,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b1b2540 >2014-01-06 04:34:09,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d47175}, log id: b1b2540 >2014-01-06 04:34:14,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e4ed114 >2014-01-06 04:34:14,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e4ed114 >2014-01-06 04:34:14,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 525a57db >2014-01-06 04:34:14,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb087153}, log id: 525a57db >2014-01-06 04:34:15,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5be73051 >2014-01-06 04:34:15,419 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:34:15,419 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:34:15,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, log id: 5be73051 >2014-01-06 04:34:15,420 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-7) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:34:19,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fd31aa4 >2014-01-06 04:34:20,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: fd31aa4 >2014-01-06 04:34:20,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7034e713 >2014-01-06 04:34:20,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b75e26b}, log id: 7034e713 >2014-01-06 04:34:25,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5255ef4d >2014-01-06 04:34:25,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5255ef4d >2014-01-06 04:34:25,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2717542d >2014-01-06 04:34:25,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7504ff65}, log id: 2717542d >2014-01-06 04:34:30,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b1146c8 >2014-01-06 04:34:31,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b1146c8 >2014-01-06 04:34:31,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f97aa9e >2014-01-06 04:34:31,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebe992b}, log id: 6f97aa9e >2014-01-06 04:34:36,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70b3595b >2014-01-06 04:34:36,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 70b3595b >2014-01-06 04:34:36,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27fa7306 >2014-01-06 04:34:36,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9769970b}, log id: 27fa7306 >2014-01-06 04:34:41,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c7347d4 >2014-01-06 04:34:41,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3c7347d4 >2014-01-06 04:34:41,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 321f511d >2014-01-06 04:34:42,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba3bbe6a}, log id: 321f511d >2014-01-06 04:34:47,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b8b70c1 >2014-01-06 04:34:47,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b8b70c1 >2014-01-06 04:34:47,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3186c606 >2014-01-06 04:34:47,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d87d2269}, log id: 3186c606 >2014-01-06 04:34:52,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c3cf8a0 >2014-01-06 04:34:52,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1c3cf8a0 >2014-01-06 04:34:52,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 331e2656 >2014-01-06 04:34:53,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f7043}, log id: 331e2656 >2014-01-06 04:34:58,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: cb3cfa2 >2014-01-06 04:34:58,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: cb3cfa2 >2014-01-06 04:34:58,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7efb6d91 >2014-01-06 04:34:58,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3990e862}, log id: 7efb6d91 >2014-01-06 04:35:03,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 208c487d >2014-01-06 04:35:03,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 208c487d >2014-01-06 04:35:03,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54b1d0c2 >2014-01-06 04:35:03,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15037653}, log id: 54b1d0c2 >2014-01-06 04:35:08,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 82851f9 >2014-01-06 04:35:09,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 82851f9 >2014-01-06 04:35:09,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5084f36a >2014-01-06 04:35:09,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea63e97b}, log id: 5084f36a >2014-01-06 04:35:14,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 543639aa >2014-01-06 04:35:14,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 543639aa >2014-01-06 04:35:14,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72d4520c >2014-01-06 04:35:14,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28f1d877}, log id: 72d4520c >2014-01-06 04:35:15,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6fb86c9 >2014-01-06 04:35:15,748 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:35:15,749 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:35:15,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, log id: 6fb86c9 >2014-01-06 04:35:15,749 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-72) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:35:19,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 638e3cdc >2014-01-06 04:35:20,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 638e3cdc >2014-01-06 04:35:20,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 282d4b3a >2014-01-06 04:35:20,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ca7a2f8}, log id: 282d4b3a >2014-01-06 04:35:25,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 439b9d29 >2014-01-06 04:35:25,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 439b9d29 >2014-01-06 04:35:25,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3439db6e >2014-01-06 04:35:25,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d37d964d}, log id: 3439db6e >2014-01-06 04:35:30,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4920b1c7 >2014-01-06 04:35:31,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4920b1c7 >2014-01-06 04:35:31,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a72ae7b >2014-01-06 04:35:31,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97e55478}, log id: 2a72ae7b >2014-01-06 04:35:36,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 359fa899 >2014-01-06 04:35:36,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 359fa899 >2014-01-06 04:35:36,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72cb3f20 >2014-01-06 04:35:36,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97f69422}, log id: 72cb3f20 >2014-01-06 04:35:41,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2382f5db >2014-01-06 04:35:41,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2382f5db >2014-01-06 04:35:41,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 736b2a1f >2014-01-06 04:35:42,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ee1dc38}, log id: 736b2a1f >2014-01-06 04:35:47,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7df0b25e >2014-01-06 04:35:47,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7df0b25e >2014-01-06 04:35:47,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5bc76623 >2014-01-06 04:35:47,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daef6955}, log id: 5bc76623 >2014-01-06 04:35:52,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d520822 >2014-01-06 04:35:52,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1d520822 >2014-01-06 04:35:52,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38fccfe0 >2014-01-06 04:35:53,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5192804b}, log id: 38fccfe0 >2014-01-06 04:35:58,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f6a5f56 >2014-01-06 04:35:58,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5f6a5f56 >2014-01-06 04:35:58,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c7e441 >2014-01-06 04:35:58,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa7449cf}, log id: 1c7e441 >2014-01-06 04:36:03,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d99a658 >2014-01-06 04:36:03,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5d99a658 >2014-01-06 04:36:03,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e31ffb7 >2014-01-06 04:36:03,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af5c9e22}, log id: e31ffb7 >2014-01-06 04:36:08,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31a0d6c8 >2014-01-06 04:36:09,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 31a0d6c8 >2014-01-06 04:36:09,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72f4cd4a >2014-01-06 04:36:09,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a6a8a45}, log id: 72f4cd4a >2014-01-06 04:36:14,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a3af784 >2014-01-06 04:36:14,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3a3af784 >2014-01-06 04:36:14,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 713d5898 >2014-01-06 04:36:14,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56356918}, log id: 713d5898 >2014-01-06 04:36:15,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f3e6d2a >2014-01-06 04:36:16,078 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:36:16,078 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:36:16,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterTasksListVDSCommand, log id: 7f3e6d2a >2014-01-06 04:36:16,078 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-66) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:36:19,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1611e93b >2014-01-06 04:36:20,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1611e93b >2014-01-06 04:36:20,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56750144 >2014-01-06 04:36:20,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1794d281}, log id: 56750144 >2014-01-06 04:36:25,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c062bde >2014-01-06 04:36:25,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2c062bde >2014-01-06 04:36:25,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3070e2d6 >2014-01-06 04:36:25,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32e4bdd4}, log id: 3070e2d6 >2014-01-06 04:36:30,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 62fe59d6 >2014-01-06 04:36:31,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 62fe59d6 >2014-01-06 04:36:31,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2387ae1a >2014-01-06 04:36:31,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f347741}, log id: 2387ae1a >2014-01-06 04:36:36,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4fc5311b >2014-01-06 04:36:36,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4fc5311b >2014-01-06 04:36:36,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: cb10c88 >2014-01-06 04:36:36,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9644f652}, log id: cb10c88 >2014-01-06 04:36:41,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 500eb0d8 >2014-01-06 04:36:41,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 500eb0d8 >2014-01-06 04:36:41,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 417646d9 >2014-01-06 04:36:42,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cbc2558}, log id: 417646d9 >2014-01-06 04:36:47,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6222b53f >2014-01-06 04:36:47,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6222b53f >2014-01-06 04:36:47,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 505b8438 >2014-01-06 04:36:47,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0da7043}, log id: 505b8438 >2014-01-06 04:36:52,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 682adfa7 >2014-01-06 04:36:52,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 682adfa7 >2014-01-06 04:36:52,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 130c7ffb >2014-01-06 04:36:53,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a47e11d1}, log id: 130c7ffb >2014-01-06 04:36:58,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e851fe1 >2014-01-06 04:36:58,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3e851fe1 >2014-01-06 04:36:58,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10488536 >2014-01-06 04:36:58,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1ffb6ea}, log id: 10488536 >2014-01-06 04:37:03,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4782baf8 >2014-01-06 04:37:03,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4782baf8 >2014-01-06 04:37:03,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 461d818c >2014-01-06 04:37:03,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e64c27}, log id: 461d818c >2014-01-06 04:37:08,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e019e64 >2014-01-06 04:37:09,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2e019e64 >2014-01-06 04:37:09,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42f7a60 >2014-01-06 04:37:09,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7c6585a}, log id: 42f7a60 >2014-01-06 04:37:14,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4164fa5d >2014-01-06 04:37:14,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4164fa5d >2014-01-06 04:37:14,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1afc6e4f >2014-01-06 04:37:14,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2adc154}, log id: 1afc6e4f >2014-01-06 04:37:16,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: bee718 >2014-01-06 04:37:16,411 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:37:16,412 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:37:16,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterTasksListVDSCommand, log id: bee718 >2014-01-06 04:37:16,412 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-19) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:37:19,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d85bf0d >2014-01-06 04:37:20,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4d85bf0d >2014-01-06 04:37:20,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2000587f >2014-01-06 04:37:20,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d9603a2}, log id: 2000587f >2014-01-06 04:37:25,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1faadd3a >2014-01-06 04:37:25,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1faadd3a >2014-01-06 04:37:25,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 516195a7 >2014-01-06 04:37:25,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ab0d80b}, log id: 516195a7 >2014-01-06 04:37:30,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d09385a >2014-01-06 04:37:31,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6d09385a >2014-01-06 04:37:31,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4639a4f0 >2014-01-06 04:37:31,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eaebb568}, log id: 4639a4f0 >2014-01-06 04:37:36,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 115d4661 >2014-01-06 04:37:36,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 115d4661 >2014-01-06 04:37:36,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ba365cd >2014-01-06 04:37:36,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25f2efae}, log id: 3ba365cd >2014-01-06 04:37:41,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a1add71 >2014-01-06 04:37:41,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7a1add71 >2014-01-06 04:37:41,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4bc71464 >2014-01-06 04:37:42,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f064ff4}, log id: 4bc71464 >2014-01-06 04:37:47,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7be051fd >2014-01-06 04:37:47,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7be051fd >2014-01-06 04:37:47,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 589de4e5 >2014-01-06 04:37:47,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6800d6c}, log id: 589de4e5 >2014-01-06 04:37:52,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47ba49f8 >2014-01-06 04:37:52,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 47ba49f8 >2014-01-06 04:37:52,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a1b3974 >2014-01-06 04:37:53,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@399d4724}, log id: 6a1b3974 >2014-01-06 04:37:58,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8cb6463 >2014-01-06 04:37:58,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 8cb6463 >2014-01-06 04:37:58,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 358b1d62 >2014-01-06 04:37:58,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aff82dd4}, log id: 358b1d62 >2014-01-06 04:38:03,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: bc3e88f >2014-01-06 04:38:03,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: bc3e88f >2014-01-06 04:38:03,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f3757d9 >2014-01-06 04:38:03,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cd4a6b}, log id: 1f3757d9 >2014-01-06 04:38:08,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8ef07b1 >2014-01-06 04:38:09,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 8ef07b1 >2014-01-06 04:38:09,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4dfc1821 >2014-01-06 04:38:09,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8addfce5}, log id: 4dfc1821 >2014-01-06 04:38:14,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 356b623c >2014-01-06 04:38:14,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 356b623c >2014-01-06 04:38:14,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4333c4c1 >2014-01-06 04:38:14,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb8125b}, log id: 4333c4c1 >2014-01-06 04:38:16,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71318e78 >2014-01-06 04:38:16,738 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:38:16,739 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:38:16,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, log id: 71318e78 >2014-01-06 04:38:16,739 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-54) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:38:19,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56d6dbbb >2014-01-06 04:38:20,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 56d6dbbb >2014-01-06 04:38:20,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c0609bb >2014-01-06 04:38:20,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@284e912f}, log id: 7c0609bb >2014-01-06 04:38:25,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 668c4c39 >2014-01-06 04:38:25,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 668c4c39 >2014-01-06 04:38:25,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40b57166 >2014-01-06 04:38:25,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b6eae27}, log id: 40b57166 >2014-01-06 04:38:30,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38233455 >2014-01-06 04:38:31,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 38233455 >2014-01-06 04:38:31,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66cf3497 >2014-01-06 04:38:31,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@761e152}, log id: 66cf3497 >2014-01-06 04:38:36,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 335bfec5 >2014-01-06 04:38:36,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 335bfec5 >2014-01-06 04:38:36,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5bdc0bb4 >2014-01-06 04:38:36,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cb0b8ca}, log id: 5bdc0bb4 >2014-01-06 04:38:40,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44fcb225 >2014-01-06 04:38:40,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4cba73fe, log id: 44fcb225 >2014-01-06 04:38:41,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e909afd >2014-01-06 04:38:41,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6e909afd >2014-01-06 04:38:41,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: dc3b1cc >2014-01-06 04:38:42,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cd1ccb2}, log id: dc3b1cc >2014-01-06 04:38:47,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63e43b4f >2014-01-06 04:38:47,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 63e43b4f >2014-01-06 04:38:47,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6be8144a >2014-01-06 04:38:47,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@563caf35}, log id: 6be8144a >2014-01-06 04:38:52,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 572e671d >2014-01-06 04:38:52,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 572e671d >2014-01-06 04:38:52,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 378a7367 >2014-01-06 04:38:53,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a875af1}, log id: 378a7367 >2014-01-06 04:38:58,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d7de4b9 >2014-01-06 04:38:58,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: d7de4b9 >2014-01-06 04:38:58,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1891040a >2014-01-06 04:38:58,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef3ec3f9}, log id: 1891040a >2014-01-06 04:39:03,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4eb1bd93 >2014-01-06 04:39:03,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4eb1bd93 >2014-01-06 04:39:03,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 34164e68 >2014-01-06 04:39:03,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87554bd9}, log id: 34164e68 >2014-01-06 04:39:08,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1018929d >2014-01-06 04:39:09,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1018929d >2014-01-06 04:39:09,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a284575 >2014-01-06 04:39:09,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9f92e94}, log id: 5a284575 >2014-01-06 04:39:14,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c8ffc5c >2014-01-06 04:39:14,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2c8ffc5c >2014-01-06 04:39:14,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fd74e44 >2014-01-06 04:39:14,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5152129c}, log id: 3fd74e44 >2014-01-06 04:39:16,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48933164 >2014-01-06 04:39:17,066 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:39:17,066 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:39:17,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, log id: 48933164 >2014-01-06 04:39:17,066 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-78) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:39:19,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53a4ff6d >2014-01-06 04:39:20,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 53a4ff6d >2014-01-06 04:39:20,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b8f6cb1 >2014-01-06 04:39:20,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f707bc89}, log id: 2b8f6cb1 >2014-01-06 04:39:25,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 38c6ffd2 >2014-01-06 04:39:25,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 38c6ffd2 >2014-01-06 04:39:25,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d48bf82 >2014-01-06 04:39:25,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ff082b7}, log id: 1d48bf82 >2014-01-06 04:39:30,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 119982d4 >2014-01-06 04:39:31,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 119982d4 >2014-01-06 04:39:31,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7fc5d09e >2014-01-06 04:39:31,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@725567bf}, log id: 7fc5d09e >2014-01-06 04:39:36,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3a28948e >2014-01-06 04:39:36,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3a28948e >2014-01-06 04:39:36,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c8d1e97 >2014-01-06 04:39:36,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20dbb64f}, log id: 1c8d1e97 >2014-01-06 04:39:41,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 347e4458 >2014-01-06 04:39:42,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 347e4458 >2014-01-06 04:39:42,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5724c12 >2014-01-06 04:39:42,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15403b0a}, log id: 5724c12 >2014-01-06 04:39:47,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f8d7a9 >2014-01-06 04:39:47,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7f8d7a9 >2014-01-06 04:39:47,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74febf98 >2014-01-06 04:39:47,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@662ff9c1}, log id: 74febf98 >2014-01-06 04:39:52,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c5f37e9 >2014-01-06 04:39:53,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3c5f37e9 >2014-01-06 04:39:53,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e355716 >2014-01-06 04:39:53,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8a48ee4}, log id: 7e355716 >2014-01-06 04:39:58,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b9ab06f >2014-01-06 04:39:58,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b9ab06f >2014-01-06 04:39:58,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: eb2397f >2014-01-06 04:39:58,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e923501}, log id: eb2397f >2014-01-06 04:40:03,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 62658f5 >2014-01-06 04:40:04,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 62658f5 >2014-01-06 04:40:04,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3cc29028 >2014-01-06 04:40:04,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30e56cf}, log id: 3cc29028 >2014-01-06 04:40:09,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11e27a7d >2014-01-06 04:40:09,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 11e27a7d >2014-01-06 04:40:09,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ed44440 >2014-01-06 04:40:09,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9e8f6d}, log id: ed44440 >2014-01-06 04:40:14,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28b0071e >2014-01-06 04:40:15,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 28b0071e >2014-01-06 04:40:15,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 244e658b >2014-01-06 04:40:15,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c64d63c1}, log id: 244e658b >2014-01-06 04:40:17,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54dff322 >2014-01-06 04:40:17,397 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:40:17,398 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:40:17,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, log id: 54dff322 >2014-01-06 04:40:17,398 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-76) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:40:20,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b26b6a9 >2014-01-06 04:40:20,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b26b6a9 >2014-01-06 04:40:20,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ceadfda >2014-01-06 04:40:20,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d4973ef}, log id: 4ceadfda >2014-01-06 04:40:25,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 704cb432 >2014-01-06 04:40:25,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 704cb432 >2014-01-06 04:40:25,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10e2309e >2014-01-06 04:40:26,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@592410c8}, log id: 10e2309e >2014-01-06 04:40:31,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42bb6d6 >2014-01-06 04:40:31,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 42bb6d6 >2014-01-06 04:40:31,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: eff527f >2014-01-06 04:40:31,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b2f62b0}, log id: eff527f >2014-01-06 04:40:36,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39ded02f >2014-01-06 04:40:36,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 39ded02f >2014-01-06 04:40:36,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17a6c061 >2014-01-06 04:40:36,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9339ec9e}, log id: 17a6c061 >2014-01-06 04:40:42,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ec0473b >2014-01-06 04:40:42,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2ec0473b >2014-01-06 04:40:42,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b7153bb >2014-01-06 04:40:42,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38f14920}, log id: b7153bb >2014-01-06 04:40:47,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9ddb9bc >2014-01-06 04:40:47,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 9ddb9bc >2014-01-06 04:40:47,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6fe363f9 >2014-01-06 04:40:47,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88ebb779}, log id: 6fe363f9 >2014-01-06 04:40:52,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35429cab >2014-01-06 04:40:53,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 35429cab >2014-01-06 04:40:53,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1bcff839 >2014-01-06 04:40:53,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d888b1aa}, log id: 1bcff839 >2014-01-06 04:40:58,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 135fccc9 >2014-01-06 04:40:58,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 135fccc9 >2014-01-06 04:40:58,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e3a03d >2014-01-06 04:40:58,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@107c9a1e}, log id: 4e3a03d >2014-01-06 04:41:03,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2d7e8772 >2014-01-06 04:41:04,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2d7e8772 >2014-01-06 04:41:04,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 163fe5cf >2014-01-06 04:41:04,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42370035}, log id: 163fe5cf >2014-01-06 04:41:09,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 224a7c04 >2014-01-06 04:41:09,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 224a7c04 >2014-01-06 04:41:09,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a509b56 >2014-01-06 04:41:09,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@602838d9}, log id: 6a509b56 >2014-01-06 04:41:14,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34709178 >2014-01-06 04:41:14,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 34709178 >2014-01-06 04:41:15,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f0fc09c >2014-01-06 04:41:15,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e59d5bca}, log id: 6f0fc09c >2014-01-06 04:41:17,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 482a2581 >2014-01-06 04:41:17,724 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:41:17,724 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:41:17,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, log id: 482a2581 >2014-01-06 04:41:17,724 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-75) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:41:20,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13434641 >2014-01-06 04:41:20,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 13434641 >2014-01-06 04:41:20,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22fa5fb5 >2014-01-06 04:41:20,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b044d94}, log id: 22fa5fb5 >2014-01-06 04:41:25,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b7add6c >2014-01-06 04:41:25,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b7add6c >2014-01-06 04:41:25,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31103c5f >2014-01-06 04:41:26,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@579ae6a1}, log id: 31103c5f >2014-01-06 04:41:31,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4452a022 >2014-01-06 04:41:31,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4452a022 >2014-01-06 04:41:31,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25df7e07 >2014-01-06 04:41:31,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e1a6977}, log id: 25df7e07 >2014-01-06 04:41:36,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a8512e8 >2014-01-06 04:41:36,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1a8512e8 >2014-01-06 04:41:36,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a3eb950 >2014-01-06 04:41:36,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@988ef6b5}, log id: 6a3eb950 >2014-01-06 04:41:41,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6348d76e >2014-01-06 04:41:42,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6348d76e >2014-01-06 04:41:42,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71432238 >2014-01-06 04:41:42,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bc2dec9}, log id: 71432238 >2014-01-06 04:41:47,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 179d7f9d >2014-01-06 04:41:47,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 179d7f9d >2014-01-06 04:41:47,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62048573 >2014-01-06 04:41:47,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8da43130}, log id: 62048573 >2014-01-06 04:41:52,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c99771e >2014-01-06 04:41:53,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: c99771e >2014-01-06 04:41:53,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b35b4c9 >2014-01-06 04:41:53,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11075a69}, log id: 3b35b4c9 >2014-01-06 04:41:58,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1bb7e9c2 >2014-01-06 04:41:58,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1bb7e9c2 >2014-01-06 04:41:58,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3297c9f1 >2014-01-06 04:41:58,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bf9e66a}, log id: 3297c9f1 >2014-01-06 04:42:03,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 693f3cae >2014-01-06 04:42:04,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 693f3cae >2014-01-06 04:42:04,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ea404d6 >2014-01-06 04:42:04,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51713f68}, log id: 1ea404d6 >2014-01-06 04:42:09,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b392e4c >2014-01-06 04:42:09,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b392e4c >2014-01-06 04:42:09,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5643905f >2014-01-06 04:42:09,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3ee6e9f}, log id: 5643905f >2014-01-06 04:42:14,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 440b8057 >2014-01-06 04:42:14,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 440b8057 >2014-01-06 04:42:14,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: dccd882 >2014-01-06 04:42:15,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e1dd116}, log id: dccd882 >2014-01-06 04:42:17,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: cc016e4 >2014-01-06 04:42:18,058 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:42:18,058 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:42:18,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterTasksListVDSCommand, log id: cc016e4 >2014-01-06 04:42:18,058 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-19) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:42:20,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6634e051 >2014-01-06 04:42:20,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6634e051 >2014-01-06 04:42:20,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 12b73fa >2014-01-06 04:42:20,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@187d836a}, log id: 12b73fa >2014-01-06 04:42:25,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1cba8f87 >2014-01-06 04:42:25,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1cba8f87 >2014-01-06 04:42:25,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62da862e >2014-01-06 04:42:26,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0b4e7aa}, log id: 62da862e >2014-01-06 04:42:31,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c3c92ad >2014-01-06 04:42:31,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: c3c92ad >2014-01-06 04:42:31,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2af0a396 >2014-01-06 04:42:31,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9445e82}, log id: 2af0a396 >2014-01-06 04:42:36,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29b3880e >2014-01-06 04:42:36,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29b3880e >2014-01-06 04:42:36,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60b8e92f >2014-01-06 04:42:36,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c0257ee}, log id: 60b8e92f >2014-01-06 04:42:41,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 217dc2bc >2014-01-06 04:42:42,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 217dc2bc >2014-01-06 04:42:42,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a98364d >2014-01-06 04:42:42,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6f33ce0}, log id: 5a98364d >2014-01-06 04:42:47,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 129f3598 >2014-01-06 04:42:47,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 129f3598 >2014-01-06 04:42:47,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20d70b3d >2014-01-06 04:42:47,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca79f8a9}, log id: 20d70b3d >2014-01-06 04:42:52,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 258dffa8 >2014-01-06 04:42:53,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 258dffa8 >2014-01-06 04:42:53,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66ea869 >2014-01-06 04:42:53,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6d1a44c}, log id: 66ea869 >2014-01-06 04:42:58,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: d39df61 >2014-01-06 04:42:58,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: d39df61 >2014-01-06 04:42:58,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38d84e2c >2014-01-06 04:42:58,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11c12bcb}, log id: 38d84e2c >2014-01-06 04:43:03,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 453d5098 >2014-01-06 04:43:04,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 453d5098 >2014-01-06 04:43:04,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52cb5788 >2014-01-06 04:43:04,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@874ac52}, log id: 52cb5788 >2014-01-06 04:43:09,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10c6b18c >2014-01-06 04:43:09,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 10c6b18c >2014-01-06 04:43:09,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2af1ae63 >2014-01-06 04:43:09,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e71777b}, log id: 2af1ae63 >2014-01-06 04:43:14,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66c3d393 >2014-01-06 04:43:14,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66c3d393 >2014-01-06 04:43:14,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 796abcf0 >2014-01-06 04:43:15,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7466c87a}, log id: 796abcf0 >2014-01-06 04:43:18,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71401c19 >2014-01-06 04:43:18,396 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:43:18,396 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:43:18,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, log id: 71401c19 >2014-01-06 04:43:18,396 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-80) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:43:20,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8757cbf >2014-01-06 04:43:20,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 8757cbf >2014-01-06 04:43:20,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c8d923d >2014-01-06 04:43:20,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@507f724}, log id: 1c8d923d >2014-01-06 04:43:25,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34a1b44c >2014-01-06 04:43:25,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 34a1b44c >2014-01-06 04:43:25,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a741ffc >2014-01-06 04:43:26,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45c17778}, log id: 4a741ffc >2014-01-06 04:43:31,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48e97776 >2014-01-06 04:43:31,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 48e97776 >2014-01-06 04:43:31,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39d54122 >2014-01-06 04:43:31,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6bbfd9b}, log id: 39d54122 >2014-01-06 04:43:36,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1bf827b1 >2014-01-06 04:43:36,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1bf827b1 >2014-01-06 04:43:36,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b0afe05 >2014-01-06 04:43:36,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95045985}, log id: b0afe05 >2014-01-06 04:43:40,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f55e955 >2014-01-06 04:43:40,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@31893540, log id: 6f55e955 >2014-01-06 04:43:42,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1bfae21b >2014-01-06 04:43:42,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1bfae21b >2014-01-06 04:43:42,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42c24c6b >2014-01-06 04:43:42,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d2b3852}, log id: 42c24c6b >2014-01-06 04:43:47,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 724ea6e4 >2014-01-06 04:43:47,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 724ea6e4 >2014-01-06 04:43:47,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d2b5a59 >2014-01-06 04:43:47,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8aaa56a}, log id: 6d2b5a59 >2014-01-06 04:43:52,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60b6c9b9 >2014-01-06 04:43:53,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 60b6c9b9 >2014-01-06 04:43:53,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60b6da2 >2014-01-06 04:43:53,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b944f17f}, log id: 60b6da2 >2014-01-06 04:43:58,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e6761da >2014-01-06 04:43:58,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: e6761da >2014-01-06 04:43:58,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5be687c >2014-01-06 04:43:58,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@842f2675}, log id: 5be687c >2014-01-06 04:44:03,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50290b58 >2014-01-06 04:44:04,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 50290b58 >2014-01-06 04:44:04,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24b5c807 >2014-01-06 04:44:04,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f9a837e}, log id: 24b5c807 >2014-01-06 04:44:09,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b6254e1 >2014-01-06 04:44:09,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1b6254e1 >2014-01-06 04:44:09,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39ed88af >2014-01-06 04:44:09,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9bc30a2}, log id: 39ed88af >2014-01-06 04:44:14,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a09d23d >2014-01-06 04:44:15,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6a09d23d >2014-01-06 04:44:15,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 796e31f3 >2014-01-06 04:44:15,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4cfdbda}, log id: 796e31f3 >2014-01-06 04:44:18,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9a3a9dc >2014-01-06 04:44:18,725 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:44:18,725 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:44:18,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, log id: 9a3a9dc >2014-01-06 04:44:18,725 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-58) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:44:20,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52803171 >2014-01-06 04:44:20,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 52803171 >2014-01-06 04:44:20,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51d587f9 >2014-01-06 04:44:20,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@636a9985}, log id: 51d587f9 >2014-01-06 04:44:25,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72c23b3c >2014-01-06 04:44:26,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 72c23b3c >2014-01-06 04:44:26,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7837667 >2014-01-06 04:44:26,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0310b9f}, log id: 7837667 >2014-01-06 04:44:31,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78721813 >2014-01-06 04:44:31,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 78721813 >2014-01-06 04:44:31,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3471f254 >2014-01-06 04:44:31,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e953d6ec}, log id: 3471f254 >2014-01-06 04:44:36,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d255058 >2014-01-06 04:44:36,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3d255058 >2014-01-06 04:44:36,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58b638f5 >2014-01-06 04:44:37,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7850825c}, log id: 58b638f5 >2014-01-06 04:44:42,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e7ec2be >2014-01-06 04:44:42,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e7ec2be >2014-01-06 04:44:42,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e155f60 >2014-01-06 04:44:42,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@769d52d6}, log id: 4e155f60 >2014-01-06 04:44:47,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29bea7cf >2014-01-06 04:44:47,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29bea7cf >2014-01-06 04:44:47,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 699872f3 >2014-01-06 04:44:47,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dbce120}, log id: 699872f3 >2014-01-06 04:44:52,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56c3b403 >2014-01-06 04:44:53,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56c3b403 >2014-01-06 04:44:53,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2fb24feb >2014-01-06 04:44:53,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21f74a94}, log id: 2fb24feb >2014-01-06 04:44:58,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23ee8e0f >2014-01-06 04:44:58,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 23ee8e0f >2014-01-06 04:44:58,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ffbe2c1 >2014-01-06 04:44:58,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fcbee8}, log id: 2ffbe2c1 >2014-01-06 04:45:03,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3871e304 >2014-01-06 04:45:04,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3871e304 >2014-01-06 04:45:04,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b7bfed0 >2014-01-06 04:45:04,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f6c0aa}, log id: 6b7bfed0 >2014-01-06 04:45:09,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5fc657d9 >2014-01-06 04:45:09,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5fc657d9 >2014-01-06 04:45:09,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66103168 >2014-01-06 04:45:09,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44ac7cfa}, log id: 66103168 >2014-01-06 04:45:14,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 53282e65 >2014-01-06 04:45:15,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 53282e65 >2014-01-06 04:45:15,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d3d71ca >2014-01-06 04:45:15,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c64be34c}, log id: 1d3d71ca >2014-01-06 04:45:18,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31a2ffed >2014-01-06 04:45:19,069 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:45:19,069 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:45:19,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, log id: 31a2ffed >2014-01-06 04:45:19,069 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-64) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:45:20,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19c2899a >2014-01-06 04:45:20,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 19c2899a >2014-01-06 04:45:20,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e65a95d >2014-01-06 04:45:20,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79f0a025}, log id: 1e65a95d >2014-01-06 04:45:25,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ac603f4 >2014-01-06 04:45:25,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: ac603f4 >2014-01-06 04:45:25,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e64a4a9 >2014-01-06 04:45:26,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a774939}, log id: e64a4a9 >2014-01-06 04:45:31,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 15a7eb54 >2014-01-06 04:45:31,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 15a7eb54 >2014-01-06 04:45:31,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55194b5e >2014-01-06 04:45:31,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c570684}, log id: 55194b5e >2014-01-06 04:45:36,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d035e46 >2014-01-06 04:45:36,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1d035e46 >2014-01-06 04:45:36,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e025d00 >2014-01-06 04:45:37,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@794f380}, log id: 6e025d00 >2014-01-06 04:45:42,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 73469c0e >2014-01-06 04:45:42,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 73469c0e >2014-01-06 04:45:42,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e769ee5 >2014-01-06 04:45:42,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba209fa1}, log id: 5e769ee5 >2014-01-06 04:45:47,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 916b62a >2014-01-06 04:45:47,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 916b62a >2014-01-06 04:45:47,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58143564 >2014-01-06 04:45:48,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dd1dfa8}, log id: 58143564 >2014-01-06 04:45:53,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7738837b >2014-01-06 04:45:53,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7738837b >2014-01-06 04:45:53,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e06b9d0 >2014-01-06 04:45:53,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71cd8a3e}, log id: 1e06b9d0 >2014-01-06 04:45:58,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71fb8050 >2014-01-06 04:45:58,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71fb8050 >2014-01-06 04:45:58,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 470b76c >2014-01-06 04:45:58,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94b76acf}, log id: 470b76c >2014-01-06 04:46:03,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33d7978a >2014-01-06 04:46:04,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 33d7978a >2014-01-06 04:46:04,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1daa434f >2014-01-06 04:46:04,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a86d3806}, log id: 1daa434f >2014-01-06 04:46:09,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13329f9f >2014-01-06 04:46:09,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 13329f9f >2014-01-06 04:46:09,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 719f5ab3 >2014-01-06 04:46:09,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@932948f8}, log id: 719f5ab3 >2014-01-06 04:46:14,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4125d161 >2014-01-06 04:46:15,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4125d161 >2014-01-06 04:46:15,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68df8ae2 >2014-01-06 04:46:15,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af8863ca}, log id: 68df8ae2 >2014-01-06 04:46:19,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b799dea >2014-01-06 04:46:19,405 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:46:19,405 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:46:19,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, log id: 7b799dea >2014-01-06 04:46:19,406 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-8) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:46:20,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52bd1d99 >2014-01-06 04:46:20,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 52bd1d99 >2014-01-06 04:46:20,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6196bfff >2014-01-06 04:46:20,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18b8a69e}, log id: 6196bfff >2014-01-06 04:46:25,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5adbd7f1 >2014-01-06 04:46:26,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5adbd7f1 >2014-01-06 04:46:26,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75d086f9 >2014-01-06 04:46:26,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9555b604}, log id: 75d086f9 >2014-01-06 04:46:31,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a903bed >2014-01-06 04:46:31,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2a903bed >2014-01-06 04:46:31,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44ee5c3a >2014-01-06 04:46:31,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e5d13af}, log id: 44ee5c3a >2014-01-06 04:46:36,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 643542a9 >2014-01-06 04:46:36,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 643542a9 >2014-01-06 04:46:36,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 107a4ed8 >2014-01-06 04:46:37,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b80f468e}, log id: 107a4ed8 >2014-01-06 04:46:42,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23d8be2e >2014-01-06 04:46:42,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 23d8be2e >2014-01-06 04:46:42,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 281fe379 >2014-01-06 04:46:42,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8830942}, log id: 281fe379 >2014-01-06 04:46:47,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1964798 >2014-01-06 04:46:47,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1964798 >2014-01-06 04:46:47,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52ec0091 >2014-01-06 04:46:48,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd7f2ba8}, log id: 52ec0091 >2014-01-06 04:46:53,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 126f0de8 >2014-01-06 04:46:53,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 126f0de8 >2014-01-06 04:46:53,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1979ac9e >2014-01-06 04:46:53,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48006169}, log id: 1979ac9e >2014-01-06 04:46:58,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47778e0d >2014-01-06 04:46:58,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 47778e0d >2014-01-06 04:46:58,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b4ea78e >2014-01-06 04:46:58,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83f3ec2e}, log id: 2b4ea78e >2014-01-06 04:47:03,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77a5077 >2014-01-06 04:47:04,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 77a5077 >2014-01-06 04:47:04,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b47049e >2014-01-06 04:47:04,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1e636b1}, log id: b47049e >2014-01-06 04:47:09,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26be5a0e >2014-01-06 04:47:09,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 26be5a0e >2014-01-06 04:47:09,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d4b3fd2 >2014-01-06 04:47:09,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9303138b}, log id: 5d4b3fd2 >2014-01-06 04:47:14,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 418faed4 >2014-01-06 04:47:15,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 418faed4 >2014-01-06 04:47:15,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a83dd36 >2014-01-06 04:47:15,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b06ba00}, log id: 5a83dd36 >2014-01-06 04:47:19,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52c3f4f4 >2014-01-06 04:47:19,728 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:47:19,728 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:47:19,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, log id: 52c3f4f4 >2014-01-06 04:47:19,728 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-87) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:47:20,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d10085b >2014-01-06 04:47:20,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3d10085b >2014-01-06 04:47:20,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e5315bb >2014-01-06 04:47:20,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@482f45e6}, log id: 7e5315bb >2014-01-06 04:47:25,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b17841e >2014-01-06 04:47:26,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1b17841e >2014-01-06 04:47:26,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 412a2131 >2014-01-06 04:47:26,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da764ee}, log id: 412a2131 >2014-01-06 04:47:31,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e341d74 >2014-01-06 04:47:31,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2e341d74 >2014-01-06 04:47:31,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ba25399 >2014-01-06 04:47:31,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52a5e008}, log id: 2ba25399 >2014-01-06 04:47:36,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 458942aa >2014-01-06 04:47:36,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 458942aa >2014-01-06 04:47:36,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34aa3fb >2014-01-06 04:47:37,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54a24256}, log id: 34aa3fb >2014-01-06 04:47:42,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 100fef23 >2014-01-06 04:47:42,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 100fef23 >2014-01-06 04:47:42,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52971d14 >2014-01-06 04:47:42,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64590322}, log id: 52971d14 >2014-01-06 04:47:47,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 509b254a >2014-01-06 04:47:47,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 509b254a >2014-01-06 04:47:47,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ffee56a >2014-01-06 04:47:48,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b017b5aa}, log id: 3ffee56a >2014-01-06 04:47:53,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e26c8a5 >2014-01-06 04:47:53,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2e26c8a5 >2014-01-06 04:47:53,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fc8f74e >2014-01-06 04:47:53,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9b43abc}, log id: fc8f74e >2014-01-06 04:47:58,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e44b3a4 >2014-01-06 04:47:58,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e44b3a4 >2014-01-06 04:47:58,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3bdebfd7 >2014-01-06 04:47:58,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c408f90c}, log id: 3bdebfd7 >2014-01-06 04:48:03,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 278c2ca8 >2014-01-06 04:48:04,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 278c2ca8 >2014-01-06 04:48:04,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e730cf9 >2014-01-06 04:48:04,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60712e32}, log id: 6e730cf9 >2014-01-06 04:48:09,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e7b8bb6 >2014-01-06 04:48:09,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e7b8bb6 >2014-01-06 04:48:09,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79b8945d >2014-01-06 04:48:09,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1061473f}, log id: 79b8945d >2014-01-06 04:48:14,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37875fc8 >2014-01-06 04:48:15,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 37875fc8 >2014-01-06 04:48:15,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 593df184 >2014-01-06 04:48:15,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d6b05af}, log id: 593df184 >2014-01-06 04:48:19,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ac07ab2 >2014-01-06 04:48:20,059 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:48:20,059 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:48:20,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, log id: 6ac07ab2 >2014-01-06 04:48:20,059 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-17) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:48:20,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 942a245 >2014-01-06 04:48:20,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 942a245 >2014-01-06 04:48:20,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55950506 >2014-01-06 04:48:20,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3626a2f7}, log id: 55950506 >2014-01-06 04:48:25,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4958e86c >2014-01-06 04:48:26,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4958e86c >2014-01-06 04:48:26,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 511e3cf1 >2014-01-06 04:48:26,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@702b3c23}, log id: 511e3cf1 >2014-01-06 04:48:31,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 508eccfb >2014-01-06 04:48:31,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 508eccfb >2014-01-06 04:48:31,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f3f8fbc >2014-01-06 04:48:31,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4bdc65}, log id: 3f3f8fbc >2014-01-06 04:48:36,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2397a404 >2014-01-06 04:48:36,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2397a404 >2014-01-06 04:48:36,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b7d6f58 >2014-01-06 04:48:37,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20976fc3}, log id: 7b7d6f58 >2014-01-06 04:48:40,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ae7b5b0 >2014-01-06 04:48:40,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2b81a257, log id: 3ae7b5b0 >2014-01-06 04:48:42,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51dbbf32 >2014-01-06 04:48:42,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 51dbbf32 >2014-01-06 04:48:42,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24cd9333 >2014-01-06 04:48:42,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3457b98}, log id: 24cd9333 >2014-01-06 04:48:47,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 707f6593 >2014-01-06 04:48:47,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 707f6593 >2014-01-06 04:48:47,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ce8cbc0 >2014-01-06 04:48:48,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@314b4531}, log id: 4ce8cbc0 >2014-01-06 04:48:53,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a4cb9c4 >2014-01-06 04:48:53,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5a4cb9c4 >2014-01-06 04:48:53,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4df1f9ff >2014-01-06 04:48:53,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4adfc7fe}, log id: 4df1f9ff >2014-01-06 04:48:58,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e1b8ea2 >2014-01-06 04:48:58,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5e1b8ea2 >2014-01-06 04:48:58,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4242a3cd >2014-01-06 04:48:58,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2dc4073}, log id: 4242a3cd >2014-01-06 04:49:03,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27d07e08 >2014-01-06 04:49:04,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 27d07e08 >2014-01-06 04:49:04,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5604e20b >2014-01-06 04:49:04,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c3e67c2}, log id: 5604e20b >2014-01-06 04:49:09,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b347c50 >2014-01-06 04:49:09,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b347c50 >2014-01-06 04:49:09,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7aa0333d >2014-01-06 04:49:09,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee648df1}, log id: 7aa0333d >2014-01-06 04:49:14,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59e94587 >2014-01-06 04:49:15,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 59e94587 >2014-01-06 04:49:15,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21e7f561 >2014-01-06 04:49:15,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9a0f267}, log id: 21e7f561 >2014-01-06 04:49:20,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ece153b >2014-01-06 04:49:20,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c1cb8ff >2014-01-06 04:49:20,392 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:49:20,392 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:49:20,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, log id: 4ece153b >2014-01-06 04:49:20,393 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-99) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:49:20,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7c1cb8ff >2014-01-06 04:49:20,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47e55da9 >2014-01-06 04:49:20,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc975a6e}, log id: 47e55da9 >2014-01-06 04:49:25,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f328825 >2014-01-06 04:49:26,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f328825 >2014-01-06 04:49:26,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 61b8925f >2014-01-06 04:49:26,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b8039a8}, log id: 61b8925f >2014-01-06 04:49:31,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: cef2cb >2014-01-06 04:49:31,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: cef2cb >2014-01-06 04:49:31,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c603ec8 >2014-01-06 04:49:31,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98250c4d}, log id: 1c603ec8 >2014-01-06 04:49:36,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 651ea9e9 >2014-01-06 04:49:37,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 651ea9e9 >2014-01-06 04:49:37,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 427678d2 >2014-01-06 04:49:37,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c68ec640}, log id: 427678d2 >2014-01-06 04:49:42,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5779971b >2014-01-06 04:49:42,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5779971b >2014-01-06 04:49:42,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e9dd4eb >2014-01-06 04:49:42,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34f5ca0c}, log id: 3e9dd4eb >2014-01-06 04:49:47,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29eb641a >2014-01-06 04:49:47,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 29eb641a >2014-01-06 04:49:47,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 273411e3 >2014-01-06 04:49:48,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbd260cd}, log id: 273411e3 >2014-01-06 04:49:53,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e7339dc >2014-01-06 04:49:53,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e7339dc >2014-01-06 04:49:53,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 794eea7a >2014-01-06 04:49:53,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61718410}, log id: 794eea7a >2014-01-06 04:49:58,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2703287c >2014-01-06 04:49:58,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2703287c >2014-01-06 04:49:58,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46495540 >2014-01-06 04:49:58,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87e70ba0}, log id: 46495540 >2014-01-06 04:50:03,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: a1937c5 >2014-01-06 04:50:04,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: a1937c5 >2014-01-06 04:50:04,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15b91261 >2014-01-06 04:50:04,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bdf4ecc}, log id: 15b91261 >2014-01-06 04:50:09,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4da14d95 >2014-01-06 04:50:09,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4da14d95 >2014-01-06 04:50:09,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1dbe1939 >2014-01-06 04:50:09,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6ccf4ce}, log id: 1dbe1939 >2014-01-06 04:50:14,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 494a0ae8 >2014-01-06 04:50:15,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 494a0ae8 >2014-01-06 04:50:15,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7afdd4ee >2014-01-06 04:50:15,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36d5b55c}, log id: 7afdd4ee >2014-01-06 04:50:20,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18cece3b >2014-01-06 04:50:20,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53690147 >2014-01-06 04:50:20,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 18cece3b >2014-01-06 04:50:20,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b0cfee2 >2014-01-06 04:50:20,738 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:50:20,738 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:50:20,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, log id: 53690147 >2014-01-06 04:50:20,738 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-61) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:50:20,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0ecfe05}, log id: 5b0cfee2 >2014-01-06 04:50:25,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b7ad3cb >2014-01-06 04:50:26,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b7ad3cb >2014-01-06 04:50:26,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7fa45947 >2014-01-06 04:50:26,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ea4a32e}, log id: 7fa45947 >2014-01-06 04:50:31,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4741cab0 >2014-01-06 04:50:31,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4741cab0 >2014-01-06 04:50:31,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e2be997 >2014-01-06 04:50:31,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fefeb1b8}, log id: 5e2be997 >2014-01-06 04:50:36,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59289d95 >2014-01-06 04:50:37,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 59289d95 >2014-01-06 04:50:37,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58821e69 >2014-01-06 04:50:37,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a02b614b}, log id: 58821e69 >2014-01-06 04:50:42,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41e58beb >2014-01-06 04:50:42,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 41e58beb >2014-01-06 04:50:42,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78cd9695 >2014-01-06 04:50:42,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a6da3c3}, log id: 78cd9695 >2014-01-06 04:50:47,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56f2c3b6 >2014-01-06 04:50:47,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 56f2c3b6 >2014-01-06 04:50:47,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3df0d1a8 >2014-01-06 04:50:48,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@739f6f25}, log id: 3df0d1a8 >2014-01-06 04:50:53,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 425c2a73 >2014-01-06 04:50:53,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 425c2a73 >2014-01-06 04:50:53,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4b15485f >2014-01-06 04:50:53,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff8c110f}, log id: 4b15485f >2014-01-06 04:50:58,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19402d2b >2014-01-06 04:50:58,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 19402d2b >2014-01-06 04:50:58,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d284700 >2014-01-06 04:50:59,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12351dfe}, log id: 1d284700 >2014-01-06 04:51:04,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b0ba662 >2014-01-06 04:51:04,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1b0ba662 >2014-01-06 04:51:04,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f2a0fff >2014-01-06 04:51:04,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0824d1d}, log id: f2a0fff >2014-01-06 04:51:09,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64ece9a9 >2014-01-06 04:51:09,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 64ece9a9 >2014-01-06 04:51:09,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8b3ab53 >2014-01-06 04:51:09,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d5ba5a5}, log id: 8b3ab53 >2014-01-06 04:51:14,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a2fde0 >2014-01-06 04:51:15,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7a2fde0 >2014-01-06 04:51:15,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22a12d7d >2014-01-06 04:51:15,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@996ce7e8}, log id: 22a12d7d >2014-01-06 04:51:20,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ee052d6 >2014-01-06 04:51:20,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6ee052d6 >2014-01-06 04:51:20,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d7ee285 >2014-01-06 04:51:20,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35779c6 >2014-01-06 04:51:20,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d68a02}, log id: 4d7ee285 >2014-01-06 04:51:21,069 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:51:21,069 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:51:21,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterTasksListVDSCommand, log id: 35779c6 >2014-01-06 04:51:21,069 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-65) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:51:25,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25f9c445 >2014-01-06 04:51:26,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25f9c445 >2014-01-06 04:51:26,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5303a33e >2014-01-06 04:51:26,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec629b4e}, log id: 5303a33e >2014-01-06 04:51:31,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3da5158d >2014-01-06 04:51:31,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3da5158d >2014-01-06 04:51:31,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31f02708 >2014-01-06 04:51:31,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b85a4cfd}, log id: 31f02708 >2014-01-06 04:51:36,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5caa3003 >2014-01-06 04:51:37,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5caa3003 >2014-01-06 04:51:37,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d77527 >2014-01-06 04:51:37,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2deb437e}, log id: 3d77527 >2014-01-06 04:51:42,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c703467 >2014-01-06 04:51:42,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2c703467 >2014-01-06 04:51:42,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56421b0 >2014-01-06 04:51:42,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a46d0a6e}, log id: 56421b0 >2014-01-06 04:51:47,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 476d5d31 >2014-01-06 04:51:47,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 476d5d31 >2014-01-06 04:51:47,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e80fee6 >2014-01-06 04:51:48,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6c41f18}, log id: 6e80fee6 >2014-01-06 04:51:53,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 425dd92f >2014-01-06 04:51:53,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 425dd92f >2014-01-06 04:51:53,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26c35986 >2014-01-06 04:51:53,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a6632b}, log id: 26c35986 >2014-01-06 04:51:58,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 193f8f0d >2014-01-06 04:51:58,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 193f8f0d >2014-01-06 04:51:58,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d47ac2f >2014-01-06 04:51:59,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab9b9b1b}, log id: 5d47ac2f >2014-01-06 04:52:04,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4606c590 >2014-01-06 04:52:04,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4606c590 >2014-01-06 04:52:04,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e25aa43 >2014-01-06 04:52:04,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c5038a9}, log id: 2e25aa43 >2014-01-06 04:52:09,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 525c0926 >2014-01-06 04:52:09,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 525c0926 >2014-01-06 04:52:09,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 92671a0 >2014-01-06 04:52:09,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76a5490c}, log id: 92671a0 >2014-01-06 04:52:14,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3dd2360b >2014-01-06 04:52:15,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3dd2360b >2014-01-06 04:52:15,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56e712f6 >2014-01-06 04:52:15,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93049813}, log id: 56e712f6 >2014-01-06 04:52:20,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fc0f3e8 >2014-01-06 04:52:20,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: fc0f3e8 >2014-01-06 04:52:20,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64e7d1b0 >2014-01-06 04:52:20,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5dcf90d}, log id: 64e7d1b0 >2014-01-06 04:52:21,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 405af70b >2014-01-06 04:52:21,409 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:52:21,409 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:52:21,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, log id: 405af70b >2014-01-06 04:52:21,409 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-89) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:52:25,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a430817 >2014-01-06 04:52:26,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4a430817 >2014-01-06 04:52:26,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76f44d2 >2014-01-06 04:52:26,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fc315a1}, log id: 76f44d2 >2014-01-06 04:52:31,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24c127e9 >2014-01-06 04:52:31,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 24c127e9 >2014-01-06 04:52:31,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6128cdf3 >2014-01-06 04:52:31,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4dab13a2}, log id: 6128cdf3 >2014-01-06 04:52:36,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f937f79 >2014-01-06 04:52:37,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7f937f79 >2014-01-06 04:52:37,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76982163 >2014-01-06 04:52:37,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94affc00}, log id: 76982163 >2014-01-06 04:52:42,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 382f7b56 >2014-01-06 04:52:42,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 382f7b56 >2014-01-06 04:52:42,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2991abcf >2014-01-06 04:52:42,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad499792}, log id: 2991abcf >2014-01-06 04:52:47,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: cbd66a1 >2014-01-06 04:52:47,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: cbd66a1 >2014-01-06 04:52:47,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7bcd687d >2014-01-06 04:52:48,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abc36a4}, log id: 7bcd687d >2014-01-06 04:52:53,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 73c79e91 >2014-01-06 04:52:53,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 73c79e91 >2014-01-06 04:52:53,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3da348af >2014-01-06 04:52:53,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6082b69a}, log id: 3da348af >2014-01-06 04:52:58,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a2eec76 >2014-01-06 04:52:58,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4a2eec76 >2014-01-06 04:52:58,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26bda5f1 >2014-01-06 04:52:59,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@931744aa}, log id: 26bda5f1 >2014-01-06 04:53:04,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2472edc3 >2014-01-06 04:53:04,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2472edc3 >2014-01-06 04:53:04,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a461d2c >2014-01-06 04:53:04,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a842499}, log id: 5a461d2c >2014-01-06 04:53:09,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 745669df >2014-01-06 04:53:09,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 745669df >2014-01-06 04:53:09,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 403ebd21 >2014-01-06 04:53:09,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdc4d5df}, log id: 403ebd21 >2014-01-06 04:53:15,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70f84d80 >2014-01-06 04:53:15,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 70f84d80 >2014-01-06 04:53:15,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c4f3333 >2014-01-06 04:53:15,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f535d512}, log id: 3c4f3333 >2014-01-06 04:53:20,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1fa62328 >2014-01-06 04:53:20,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1fa62328 >2014-01-06 04:53:20,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c7ed51b >2014-01-06 04:53:20,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1058114e}, log id: 2c7ed51b >2014-01-06 04:53:21,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 383efa76 >2014-01-06 04:53:21,753 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:53:21,753 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:53:21,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, log id: 383efa76 >2014-01-06 04:53:21,753 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-73) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:53:25,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10d877a2 >2014-01-06 04:53:26,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 10d877a2 >2014-01-06 04:53:26,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a45362 >2014-01-06 04:53:26,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d81d3e22}, log id: 6a45362 >2014-01-06 04:53:31,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fee8232 >2014-01-06 04:53:31,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3fee8232 >2014-01-06 04:53:31,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 568f99d1 >2014-01-06 04:53:31,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2aff565c}, log id: 568f99d1 >2014-01-06 04:53:36,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47bae905 >2014-01-06 04:53:37,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 47bae905 >2014-01-06 04:53:37,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5305b9e6 >2014-01-06 04:53:37,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84463460}, log id: 5305b9e6 >2014-01-06 04:53:40,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20a275f0 >2014-01-06 04:53:40,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4a0af928, log id: 20a275f0 >2014-01-06 04:53:42,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33270198 >2014-01-06 04:53:42,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 33270198 >2014-01-06 04:53:42,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 662b0e32 >2014-01-06 04:53:42,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41b1b06e}, log id: 662b0e32 >2014-01-06 04:53:47,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3878566 >2014-01-06 04:53:48,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3878566 >2014-01-06 04:53:48,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2864713c >2014-01-06 04:53:48,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce4058b0}, log id: 2864713c >2014-01-06 04:53:53,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 633742fc >2014-01-06 04:53:53,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 633742fc >2014-01-06 04:53:53,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ed79836 >2014-01-06 04:53:53,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86171857}, log id: 1ed79836 >2014-01-06 04:53:58,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56b16923 >2014-01-06 04:53:58,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56b16923 >2014-01-06 04:53:58,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4975317e >2014-01-06 04:53:59,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a83814e}, log id: 4975317e >2014-01-06 04:54:04,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 351a7e20 >2014-01-06 04:54:04,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 351a7e20 >2014-01-06 04:54:04,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 41131c9c >2014-01-06 04:54:04,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf2d1c80}, log id: 41131c9c >2014-01-06 04:54:09,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7aa2ff4b >2014-01-06 04:54:09,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7aa2ff4b >2014-01-06 04:54:09,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ab0a3dd >2014-01-06 04:54:10,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0d4d39}, log id: 4ab0a3dd >2014-01-06 04:54:15,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2bfff2f >2014-01-06 04:54:15,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2bfff2f >2014-01-06 04:54:15,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78127c2e >2014-01-06 04:54:15,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35b3dabf}, log id: 78127c2e >2014-01-06 04:54:20,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d5d862b >2014-01-06 04:54:20,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7d5d862b >2014-01-06 04:54:20,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10f39db6 >2014-01-06 04:54:20,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc00680b}, log id: 10f39db6 >2014-01-06 04:54:21,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d96ec53 >2014-01-06 04:54:22,087 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:54:22,087 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:54:22,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, log id: 7d96ec53 >2014-01-06 04:54:22,087 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-10) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:54:25,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 663a3722 >2014-01-06 04:54:26,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 663a3722 >2014-01-06 04:54:26,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7cadeae7 >2014-01-06 04:54:26,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6034d8f}, log id: 7cadeae7 >2014-01-06 04:54:31,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3a6ef12 >2014-01-06 04:54:31,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3a6ef12 >2014-01-06 04:54:31,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3de410ae >2014-01-06 04:54:31,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bea8e7b5}, log id: 3de410ae >2014-01-06 04:54:36,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1bf527fb >2014-01-06 04:54:37,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1bf527fb >2014-01-06 04:54:37,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 124bdc8c >2014-01-06 04:54:37,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d227344c}, log id: 124bdc8c >2014-01-06 04:54:42,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3deb50e1 >2014-01-06 04:54:42,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3deb50e1 >2014-01-06 04:54:42,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ba34484 >2014-01-06 04:54:42,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7830fda}, log id: 7ba34484 >2014-01-06 04:54:47,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 462acd36 >2014-01-06 04:54:48,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 462acd36 >2014-01-06 04:54:48,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 18424539 >2014-01-06 04:54:48,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8e7bff0}, log id: 18424539 >2014-01-06 04:54:53,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57ba7d36 >2014-01-06 04:54:53,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 57ba7d36 >2014-01-06 04:54:53,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6fa44b89 >2014-01-06 04:54:53,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e63451c}, log id: 6fa44b89 >2014-01-06 04:54:58,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60f16cf1 >2014-01-06 04:54:59,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 60f16cf1 >2014-01-06 04:54:59,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a52345b >2014-01-06 04:54:59,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87c58818}, log id: 1a52345b >2014-01-06 04:55:04,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ac38f0 >2014-01-06 04:55:04,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6ac38f0 >2014-01-06 04:55:04,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 764e88ab >2014-01-06 04:55:04,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e5e27ed}, log id: 764e88ab >2014-01-06 04:55:09,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2cbcb87a >2014-01-06 04:55:09,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2cbcb87a >2014-01-06 04:55:09,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 32ae8bbf >2014-01-06 04:55:10,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4852b74}, log id: 32ae8bbf >2014-01-06 04:55:15,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28cf5de9 >2014-01-06 04:55:15,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 28cf5de9 >2014-01-06 04:55:15,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 223ff773 >2014-01-06 04:55:15,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9f87f94}, log id: 223ff773 >2014-01-06 04:55:20,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3de2d7cd >2014-01-06 04:55:20,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3de2d7cd >2014-01-06 04:55:20,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cc64e02 >2014-01-06 04:55:21,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b625e4e}, log id: 6cc64e02 >2014-01-06 04:55:22,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47a17bfa >2014-01-06 04:55:22,416 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:55:22,417 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:55:22,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, log id: 47a17bfa >2014-01-06 04:55:22,417 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-42) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:55:26,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f210653 >2014-01-06 04:55:26,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7f210653 >2014-01-06 04:55:26,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 418d7799 >2014-01-06 04:55:26,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@246d48ff}, log id: 418d7799 >2014-01-06 04:55:31,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73711207 >2014-01-06 04:55:31,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73711207 >2014-01-06 04:55:31,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36ad939e >2014-01-06 04:55:31,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f8db964}, log id: 36ad939e >2014-01-06 04:55:36,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d288373 >2014-01-06 04:55:37,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5d288373 >2014-01-06 04:55:37,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ad3d277 >2014-01-06 04:55:37,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40c3ed31}, log id: ad3d277 >2014-01-06 04:55:42,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49e8329c >2014-01-06 04:55:42,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 49e8329c >2014-01-06 04:55:42,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 76a0aca3 >2014-01-06 04:55:42,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc351dab}, log id: 76a0aca3 >2014-01-06 04:55:47,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ff2e11 >2014-01-06 04:55:48,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ff2e11 >2014-01-06 04:55:48,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1445a16a >2014-01-06 04:55:48,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f6c006b}, log id: 1445a16a >2014-01-06 04:55:53,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 742e695b >2014-01-06 04:55:53,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 742e695b >2014-01-06 04:55:53,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 637f21b0 >2014-01-06 04:55:53,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f4c5cf7}, log id: 637f21b0 >2014-01-06 04:55:58,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1aac5236 >2014-01-06 04:55:59,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1aac5236 >2014-01-06 04:55:59,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14a3f45b >2014-01-06 04:55:59,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4744ed37}, log id: 14a3f45b >2014-01-06 04:56:04,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 179b2f2c >2014-01-06 04:56:04,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 179b2f2c >2014-01-06 04:56:04,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: eb9b2bd >2014-01-06 04:56:04,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3269963f}, log id: eb9b2bd >2014-01-06 04:56:09,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e86b49f >2014-01-06 04:56:09,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e86b49f >2014-01-06 04:56:09,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a331281 >2014-01-06 04:56:10,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba713847}, log id: 6a331281 >2014-01-06 04:56:15,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15ad75d9 >2014-01-06 04:56:15,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 15ad75d9 >2014-01-06 04:56:15,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5bf788a8 >2014-01-06 04:56:15,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eab3c7ac}, log id: 5bf788a8 >2014-01-06 04:56:20,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10f7ead9 >2014-01-06 04:56:20,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 10f7ead9 >2014-01-06 04:56:20,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c1d41d1 >2014-01-06 04:56:21,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84a0e975}, log id: 5c1d41d1 >2014-01-06 04:56:22,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22552ff >2014-01-06 04:56:22,742 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:56:22,743 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:56:22,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, log id: 22552ff >2014-01-06 04:56:22,743 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-14) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:56:26,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ed7b4fd >2014-01-06 04:56:26,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ed7b4fd >2014-01-06 04:56:26,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 782f0061 >2014-01-06 04:56:26,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7836f66}, log id: 782f0061 >2014-01-06 04:56:31,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b328b5f >2014-01-06 04:56:31,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1b328b5f >2014-01-06 04:56:31,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a93ed2 >2014-01-06 04:56:31,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e42820c}, log id: 3a93ed2 >2014-01-06 04:56:36,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e5936a0 >2014-01-06 04:56:37,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6e5936a0 >2014-01-06 04:56:37,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 12733d8c >2014-01-06 04:56:37,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc85b01}, log id: 12733d8c >2014-01-06 04:56:42,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1633959c >2014-01-06 04:56:42,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1633959c >2014-01-06 04:56:42,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f9825df >2014-01-06 04:56:42,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8697ac4}, log id: 4f9825df >2014-01-06 04:56:47,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43b1f5ea >2014-01-06 04:56:48,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43b1f5ea >2014-01-06 04:56:48,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 338cd04b >2014-01-06 04:56:48,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfecd8ef}, log id: 338cd04b >2014-01-06 04:56:53,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 41a50a5f >2014-01-06 04:56:53,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 41a50a5f >2014-01-06 04:56:53,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 51aff946 >2014-01-06 04:56:53,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1d07b6b}, log id: 51aff946 >2014-01-06 04:56:58,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64d96d2c >2014-01-06 04:56:59,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 64d96d2c >2014-01-06 04:56:59,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d8de3b2 >2014-01-06 04:56:59,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cc4f23}, log id: 7d8de3b2 >2014-01-06 04:57:04,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37704289 >2014-01-06 04:57:04,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 37704289 >2014-01-06 04:57:04,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 645d8a9c >2014-01-06 04:57:04,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad5786a9}, log id: 645d8a9c >2014-01-06 04:57:09,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 766db53d >2014-01-06 04:57:10,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 766db53d >2014-01-06 04:57:10,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7af0db88 >2014-01-06 04:57:10,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13087bd0}, log id: 7af0db88 >2014-01-06 04:57:15,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 497ee26c >2014-01-06 04:57:15,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 497ee26c >2014-01-06 04:57:15,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63dd3ee0 >2014-01-06 04:57:15,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50d18344}, log id: 63dd3ee0 >2014-01-06 04:57:20,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5d4cb34 >2014-01-06 04:57:20,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5d4cb34 >2014-01-06 04:57:20,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28872e0e >2014-01-06 04:57:21,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@619c760a}, log id: 28872e0e >2014-01-06 04:57:22,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40c8a9e1 >2014-01-06 04:57:23,068 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:57:23,068 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:57:23,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, log id: 40c8a9e1 >2014-01-06 04:57:23,068 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-88) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:57:26,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 51763d12 >2014-01-06 04:57:26,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 51763d12 >2014-01-06 04:57:26,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 442fd021 >2014-01-06 04:57:26,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91f7bfc4}, log id: 442fd021 >2014-01-06 04:57:31,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2cfc5e5d >2014-01-06 04:57:31,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2cfc5e5d >2014-01-06 04:57:31,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b10c8e5 >2014-01-06 04:57:31,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dd8f283}, log id: 3b10c8e5 >2014-01-06 04:57:37,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67915d86 >2014-01-06 04:57:37,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 67915d86 >2014-01-06 04:57:37,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27d0415b >2014-01-06 04:57:37,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72518db6}, log id: 27d0415b >2014-01-06 04:57:42,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 512fe927 >2014-01-06 04:57:42,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 512fe927 >2014-01-06 04:57:42,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6139f4fb >2014-01-06 04:57:42,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f19d909}, log id: 6139f4fb >2014-01-06 04:57:47,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 624cc1c0 >2014-01-06 04:57:48,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 624cc1c0 >2014-01-06 04:57:48,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17d956b2 >2014-01-06 04:57:48,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f982d6f}, log id: 17d956b2 >2014-01-06 04:57:53,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3bd831a1 >2014-01-06 04:57:53,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3bd831a1 >2014-01-06 04:57:53,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ae11e93 >2014-01-06 04:57:53,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3402a6a5}, log id: 3ae11e93 >2014-01-06 04:57:58,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30a123d0 >2014-01-06 04:57:59,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 30a123d0 >2014-01-06 04:57:59,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d159c66 >2014-01-06 04:57:59,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf0b217}, log id: 7d159c66 >2014-01-06 04:58:04,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 263d45d2 >2014-01-06 04:58:04,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 263d45d2 >2014-01-06 04:58:04,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71cb3edd >2014-01-06 04:58:04,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@601fc750}, log id: 71cb3edd >2014-01-06 04:58:09,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72749d95 >2014-01-06 04:58:10,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 72749d95 >2014-01-06 04:58:10,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60f8cd94 >2014-01-06 04:58:10,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6821ca4e}, log id: 60f8cd94 >2014-01-06 04:58:15,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 134130de >2014-01-06 04:58:15,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 134130de >2014-01-06 04:58:15,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 61967260 >2014-01-06 04:58:15,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86bdcdf0}, log id: 61967260 >2014-01-06 04:58:20,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36d78bf1 >2014-01-06 04:58:20,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 36d78bf1 >2014-01-06 04:58:20,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3dab859a >2014-01-06 04:58:21,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e5a3a48}, log id: 3dab859a >2014-01-06 04:58:23,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1da63fee >2014-01-06 04:58:23,394 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 04:58:23,394 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:58:23,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, log id: 1da63fee >2014-01-06 04:58:23,395 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-45) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:58:26,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48020c40 >2014-01-06 04:58:26,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 48020c40 >2014-01-06 04:58:26,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4eb67631 >2014-01-06 04:58:26,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba0fe13b}, log id: 4eb67631 >2014-01-06 04:58:31,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e5b43e >2014-01-06 04:58:31,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5e5b43e >2014-01-06 04:58:31,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c234ab9 >2014-01-06 04:58:32,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9444ed39}, log id: 2c234ab9 >2014-01-06 04:58:37,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6489da20 >2014-01-06 04:58:37,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6489da20 >2014-01-06 04:58:37,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7de4ccdc >2014-01-06 04:58:37,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abedf7bb}, log id: 7de4ccdc >2014-01-06 04:58:40,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5db7adf2 >2014-01-06 04:58:40,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6309fa14, log id: 5db7adf2 >2014-01-06 04:58:42,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 278819e6 >2014-01-06 04:58:42,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 278819e6 >2014-01-06 04:58:42,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75a7c9d7 >2014-01-06 04:58:42,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe2e06e0}, log id: 75a7c9d7 >2014-01-06 04:58:48,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16e39b1a >2014-01-06 04:58:48,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 16e39b1a >2014-01-06 04:58:48,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78eefd67 >2014-01-06 04:58:48,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f069750}, log id: 78eefd67 >2014-01-06 04:58:53,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e8e5c3 >2014-01-06 04:58:53,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5e8e5c3 >2014-01-06 04:58:53,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1fabb3af >2014-01-06 04:58:53,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26ff43c4}, log id: 1fabb3af >2014-01-06 04:58:58,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31b23427 >2014-01-06 04:58:59,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 31b23427 >2014-01-06 04:58:59,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 73d9a635 >2014-01-06 04:58:59,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7761b38f}, log id: 73d9a635 >2014-01-06 04:59:04,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11c83ebd >2014-01-06 04:59:04,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 11c83ebd >2014-01-06 04:59:04,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a2b9df9 >2014-01-06 04:59:04,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ba3df3f}, log id: 1a2b9df9 >2014-01-06 04:59:09,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 342fa1e0 >2014-01-06 04:59:10,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 342fa1e0 >2014-01-06 04:59:10,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 752257a6 >2014-01-06 04:59:10,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f14a4449}, log id: 752257a6 >2014-01-06 04:59:15,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ae8a3b5 >2014-01-06 04:59:15,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4ae8a3b5 >2014-01-06 04:59:15,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73805639 >2014-01-06 04:59:15,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0ae2a3b}, log id: 73805639 >2014-01-06 04:59:20,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 380ccf8c >2014-01-06 04:59:21,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 380ccf8c >2014-01-06 04:59:21,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d2c585c >2014-01-06 04:59:21,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3d623e5}, log id: 4d2c585c >2014-01-06 04:59:23,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7b417eb2 >2014-01-06 04:59:23,729 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 04:59:23,730 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 04:59:23,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterTasksListVDSCommand, log id: 7b417eb2 >2014-01-06 04:59:23,730 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-3) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 04:59:26,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7953e301 >2014-01-06 04:59:26,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7953e301 >2014-01-06 04:59:26,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35ebe215 >2014-01-06 04:59:26,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f057d2b0}, log id: 35ebe215 >2014-01-06 04:59:31,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16c2ecad >2014-01-06 04:59:31,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 16c2ecad >2014-01-06 04:59:31,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61305a9a >2014-01-06 04:59:32,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce2ff5d1}, log id: 61305a9a >2014-01-06 04:59:37,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4eb062da >2014-01-06 04:59:37,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4eb062da >2014-01-06 04:59:37,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 32c55eb2 >2014-01-06 04:59:37,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@729d4210}, log id: 32c55eb2 >2014-01-06 04:59:42,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63e791ca >2014-01-06 04:59:42,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 63e791ca >2014-01-06 04:59:42,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 584a57ed >2014-01-06 04:59:42,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36db57bf}, log id: 584a57ed >2014-01-06 04:59:47,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: a4e503a >2014-01-06 04:59:48,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: a4e503a >2014-01-06 04:59:48,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a10f530 >2014-01-06 04:59:48,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a68c9203}, log id: 6a10f530 >2014-01-06 04:59:53,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 212e4676 >2014-01-06 04:59:53,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 212e4676 >2014-01-06 04:59:53,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50a09367 >2014-01-06 04:59:53,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51fbcf8}, log id: 50a09367 >2014-01-06 04:59:58,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22c1f18c >2014-01-06 04:59:59,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 22c1f18c >2014-01-06 04:59:59,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e48af54 >2014-01-06 04:59:59,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69ad9c73}, log id: 6e48af54 >2014-01-06 05:00:04,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f197cbb >2014-01-06 05:00:04,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f197cbb >2014-01-06 05:00:04,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57307243 >2014-01-06 05:00:04,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@456bef57}, log id: 57307243 >2014-01-06 05:00:09,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f5aeace >2014-01-06 05:00:10,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2f5aeace >2014-01-06 05:00:10,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16fd2b12 >2014-01-06 05:00:10,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@109855db}, log id: 16fd2b12 >2014-01-06 05:00:15,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25a06ee7 >2014-01-06 05:00:15,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25a06ee7 >2014-01-06 05:00:15,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 208df3d >2014-01-06 05:00:15,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba8d32ae}, log id: 208df3d >2014-01-06 05:00:20,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ae4361f >2014-01-06 05:00:20,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ae4361f >2014-01-06 05:00:20,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7258e48d >2014-01-06 05:00:21,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1d1c358}, log id: 7258e48d >2014-01-06 05:00:23,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35b08f93 >2014-01-06 05:00:24,053 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:00:24,053 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:00:24,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, log id: 35b08f93 >2014-01-06 05:00:24,053 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-16) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:00:26,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f48fd4b >2014-01-06 05:00:26,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f48fd4b >2014-01-06 05:00:26,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1cac5a05 >2014-01-06 05:00:26,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9888631}, log id: 1cac5a05 >2014-01-06 05:00:31,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5fcbe56d >2014-01-06 05:00:31,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5fcbe56d >2014-01-06 05:00:31,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e48058a >2014-01-06 05:00:32,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5098ecb3}, log id: 7e48058a >2014-01-06 05:00:37,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 568c0bfb >2014-01-06 05:00:37,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 568c0bfb >2014-01-06 05:00:37,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63009ffa >2014-01-06 05:00:37,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2fcdb46}, log id: 63009ffa >2014-01-06 05:00:42,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a787b17 >2014-01-06 05:00:42,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7a787b17 >2014-01-06 05:00:42,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2de584e5 >2014-01-06 05:00:42,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92325402}, log id: 2de584e5 >2014-01-06 05:00:48,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c7de066 >2014-01-06 05:00:48,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7c7de066 >2014-01-06 05:00:48,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 267bf683 >2014-01-06 05:00:48,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed79d2b}, log id: 267bf683 >2014-01-06 05:00:53,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c9bd499 >2014-01-06 05:00:53,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6c9bd499 >2014-01-06 05:00:53,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 798c6dfd >2014-01-06 05:00:53,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d552b6e}, log id: 798c6dfd >2014-01-06 05:00:58,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: af08cd9 >2014-01-06 05:00:59,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: af08cd9 >2014-01-06 05:00:59,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 30cb68c9 >2014-01-06 05:00:59,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cf8f5da}, log id: 30cb68c9 >2014-01-06 05:01:04,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2847b929 >2014-01-06 05:01:04,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2847b929 >2014-01-06 05:01:04,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 719bd3b4 >2014-01-06 05:01:04,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3a8819e}, log id: 719bd3b4 >2014-01-06 05:01:09,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 458433d1 >2014-01-06 05:01:10,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 458433d1 >2014-01-06 05:01:10,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 240a1ce4 >2014-01-06 05:01:10,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ab38b29}, log id: 240a1ce4 >2014-01-06 05:01:15,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 167cca7d >2014-01-06 05:01:15,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 167cca7d >2014-01-06 05:01:15,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 81ccdfc >2014-01-06 05:01:15,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8095237c}, log id: 81ccdfc >2014-01-06 05:01:20,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 61676d68 >2014-01-06 05:01:21,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 61676d68 >2014-01-06 05:01:21,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1239428d >2014-01-06 05:01:21,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f617bee}, log id: 1239428d >2014-01-06 05:01:24,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3652a07f >2014-01-06 05:01:24,387 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:01:24,387 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:01:24,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterTasksListVDSCommand, log id: 3652a07f >2014-01-06 05:01:24,387 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-83) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:01:26,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68d1579e >2014-01-06 05:01:26,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 68d1579e >2014-01-06 05:01:26,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22249a41 >2014-01-06 05:01:26,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8fb8ddc}, log id: 22249a41 >2014-01-06 05:01:31,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13a8ec54 >2014-01-06 05:01:31,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 13a8ec54 >2014-01-06 05:01:31,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 11b0a212 >2014-01-06 05:01:32,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d6067b0}, log id: 11b0a212 >2014-01-06 05:01:37,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79a7cd07 >2014-01-06 05:01:37,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 79a7cd07 >2014-01-06 05:01:37,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45e1a3b2 >2014-01-06 05:01:37,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ff33f1}, log id: 45e1a3b2 >2014-01-06 05:01:42,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a5ffc29 >2014-01-06 05:01:42,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5a5ffc29 >2014-01-06 05:01:42,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36c34abc >2014-01-06 05:01:43,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82f6d47d}, log id: 36c34abc >2014-01-06 05:01:48,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5193874 >2014-01-06 05:01:48,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5193874 >2014-01-06 05:01:48,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49e2e482 >2014-01-06 05:01:48,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@597d6e01}, log id: 49e2e482 >2014-01-06 05:01:53,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10c70d04 >2014-01-06 05:01:53,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 10c70d04 >2014-01-06 05:01:53,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a5187e6 >2014-01-06 05:01:53,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48362104}, log id: 6a5187e6 >2014-01-06 05:01:58,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 544c7b80 >2014-01-06 05:01:59,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 544c7b80 >2014-01-06 05:01:59,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79ba4524 >2014-01-06 05:01:59,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea7b303b}, log id: 79ba4524 >2014-01-06 05:02:04,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 304909ce >2014-01-06 05:02:04,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 304909ce >2014-01-06 05:02:04,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e9770d7 >2014-01-06 05:02:04,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6600bca}, log id: e9770d7 >2014-01-06 05:02:09,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1202dd93 >2014-01-06 05:02:10,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1202dd93 >2014-01-06 05:02:10,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a31cd1e >2014-01-06 05:02:10,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e33b0de0}, log id: 6a31cd1e >2014-01-06 05:02:15,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b8f0bd1 >2014-01-06 05:02:15,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b8f0bd1 >2014-01-06 05:02:15,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 523a6e1b >2014-01-06 05:02:15,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98fcd43}, log id: 523a6e1b >2014-01-06 05:02:20,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31c4ab94 >2014-01-06 05:02:21,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 31c4ab94 >2014-01-06 05:02:21,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 702a88af >2014-01-06 05:02:21,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7b339fb}, log id: 702a88af >2014-01-06 05:02:24,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 682f7302 >2014-01-06 05:02:24,726 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:02:24,726 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:02:24,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, log id: 682f7302 >2014-01-06 05:02:24,726 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-78) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:02:26,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 930f737 >2014-01-06 05:02:26,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 930f737 >2014-01-06 05:02:26,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14c74bb6 >2014-01-06 05:02:26,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b857da2}, log id: 14c74bb6 >2014-01-06 05:02:31,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a654c00 >2014-01-06 05:02:31,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6a654c00 >2014-01-06 05:02:31,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 291a5e05 >2014-01-06 05:02:32,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54ef06dc}, log id: 291a5e05 >2014-01-06 05:02:37,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1492d1e0 >2014-01-06 05:02:37,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1492d1e0 >2014-01-06 05:02:37,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 245593d4 >2014-01-06 05:02:37,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4a57b83}, log id: 245593d4 >2014-01-06 05:02:42,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f5a744d >2014-01-06 05:02:42,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3f5a744d >2014-01-06 05:02:42,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5842fd52 >2014-01-06 05:02:42,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41722430}, log id: 5842fd52 >2014-01-06 05:02:48,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a809d78 >2014-01-06 05:02:48,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1a809d78 >2014-01-06 05:02:48,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7debe2a3 >2014-01-06 05:02:48,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2a35856}, log id: 7debe2a3 >2014-01-06 05:02:53,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 726c1c6 >2014-01-06 05:02:53,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 726c1c6 >2014-01-06 05:02:53,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 75369299 >2014-01-06 05:02:53,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3792eb2}, log id: 75369299 >2014-01-06 05:02:58,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 75a93ec9 >2014-01-06 05:02:59,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 75a93ec9 >2014-01-06 05:02:59,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ea123a1 >2014-01-06 05:02:59,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2cf003a}, log id: 1ea123a1 >2014-01-06 05:03:04,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c826c3d >2014-01-06 05:03:04,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: c826c3d >2014-01-06 05:03:04,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 38330a37 >2014-01-06 05:03:04,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0066d54}, log id: 38330a37 >2014-01-06 05:03:09,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f839f53 >2014-01-06 05:03:10,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4f839f53 >2014-01-06 05:03:10,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b814656 >2014-01-06 05:03:10,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bbfbcea}, log id: 6b814656 >2014-01-06 05:03:15,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8019cc2 >2014-01-06 05:03:15,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 8019cc2 >2014-01-06 05:03:15,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10b2f06c >2014-01-06 05:03:15,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc0aee92}, log id: 10b2f06c >2014-01-06 05:03:20,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 182f7f95 >2014-01-06 05:03:21,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 182f7f95 >2014-01-06 05:03:21,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1956da19 >2014-01-06 05:03:21,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a8e738f}, log id: 1956da19 >2014-01-06 05:03:24,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8f85ae8 >2014-01-06 05:03:25,062 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:03:25,063 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:03:25,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, log id: 8f85ae8 >2014-01-06 05:03:25,063 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-98) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:03:26,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b5d9107 >2014-01-06 05:03:26,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b5d9107 >2014-01-06 05:03:26,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 186fb816 >2014-01-06 05:03:26,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d349f764}, log id: 186fb816 >2014-01-06 05:03:31,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41a63bd5 >2014-01-06 05:03:31,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 41a63bd5 >2014-01-06 05:03:31,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6dbeb5b5 >2014-01-06 05:03:32,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64ac7596}, log id: 6dbeb5b5 >2014-01-06 05:03:37,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78619385 >2014-01-06 05:03:37,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 78619385 >2014-01-06 05:03:37,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 606b38 >2014-01-06 05:03:37,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bee71154}, log id: 606b38 >2014-01-06 05:03:40,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 311b0c9d >2014-01-06 05:03:41,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@775cde08, log id: 311b0c9d >2014-01-06 05:03:42,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59672a55 >2014-01-06 05:03:42,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 59672a55 >2014-01-06 05:03:42,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2909174 >2014-01-06 05:03:42,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d57a996c}, log id: 2909174 >2014-01-06 05:03:48,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1141cac0 >2014-01-06 05:03:48,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1141cac0 >2014-01-06 05:03:48,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14fb115c >2014-01-06 05:03:48,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cb3cebc}, log id: 14fb115c >2014-01-06 05:03:53,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6061b4e9 >2014-01-06 05:03:53,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6061b4e9 >2014-01-06 05:03:53,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f3cff6 >2014-01-06 05:03:53,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@795230b4}, log id: 1f3cff6 >2014-01-06 05:03:58,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7796acda >2014-01-06 05:03:59,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7796acda >2014-01-06 05:03:59,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4871e90d >2014-01-06 05:03:59,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5eb03165}, log id: 4871e90d >2014-01-06 05:04:04,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 493b6a89 >2014-01-06 05:04:04,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 493b6a89 >2014-01-06 05:04:04,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 649b58ed >2014-01-06 05:04:04,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cca41de}, log id: 649b58ed >2014-01-06 05:04:09,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60a4efeb >2014-01-06 05:04:10,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 60a4efeb >2014-01-06 05:04:10,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ba6709a >2014-01-06 05:04:10,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a328f038}, log id: 2ba6709a >2014-01-06 05:04:15,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 672bd6ee >2014-01-06 05:04:15,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 672bd6ee >2014-01-06 05:04:15,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a72530a >2014-01-06 05:04:15,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@469b3eed}, log id: 6a72530a >2014-01-06 05:04:20,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e801486 >2014-01-06 05:04:21,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7e801486 >2014-01-06 05:04:21,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72ed6fbd >2014-01-06 05:04:21,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebc21bcc}, log id: 72ed6fbd >2014-01-06 05:04:25,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76e80f3f >2014-01-06 05:04:25,394 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:04:25,394 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:04:25,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, log id: 76e80f3f >2014-01-06 05:04:25,394 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-91) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:04:26,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1acbd4bb >2014-01-06 05:04:26,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1acbd4bb >2014-01-06 05:04:26,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48a0c469 >2014-01-06 05:04:26,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db3f4b39}, log id: 48a0c469 >2014-01-06 05:04:31,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54ef6bb >2014-01-06 05:04:31,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54ef6bb >2014-01-06 05:04:31,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 565d58fa >2014-01-06 05:04:32,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70818339}, log id: 565d58fa >2014-01-06 05:04:37,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b1704ca >2014-01-06 05:04:37,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b1704ca >2014-01-06 05:04:37,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2cf01721 >2014-01-06 05:04:37,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5c752a}, log id: 2cf01721 >2014-01-06 05:04:42,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50976bbd >2014-01-06 05:04:42,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 50976bbd >2014-01-06 05:04:42,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 61033446 >2014-01-06 05:04:43,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a30c1bb1}, log id: 61033446 >2014-01-06 05:04:48,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 49756531 >2014-01-06 05:04:48,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 49756531 >2014-01-06 05:04:48,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4cf178b2 >2014-01-06 05:04:48,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f0bcfa2}, log id: 4cf178b2 >2014-01-06 05:04:53,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39d271fc >2014-01-06 05:04:53,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 39d271fc >2014-01-06 05:04:53,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 349fcb1 >2014-01-06 05:04:53,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@100301b5}, log id: 349fcb1 >2014-01-06 05:04:58,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b46dd6b >2014-01-06 05:04:59,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: b46dd6b >2014-01-06 05:04:59,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1fdc9a35 >2014-01-06 05:04:59,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83983490}, log id: 1fdc9a35 >2014-01-06 05:05:04,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6444ec7a >2014-01-06 05:05:04,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6444ec7a >2014-01-06 05:05:04,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79fe8b18 >2014-01-06 05:05:04,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d672a527}, log id: 79fe8b18 >2014-01-06 05:05:09,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f06553e >2014-01-06 05:05:10,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f06553e >2014-01-06 05:05:10,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: cb3d25 >2014-01-06 05:05:10,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d33a34a}, log id: cb3d25 >2014-01-06 05:05:15,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 222d3ad1 >2014-01-06 05:05:15,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 222d3ad1 >2014-01-06 05:05:15,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 715bcca4 >2014-01-06 05:05:15,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d822ab4}, log id: 715bcca4 >2014-01-06 05:05:20,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 614a90bb >2014-01-06 05:05:21,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 614a90bb >2014-01-06 05:05:21,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d6c719b >2014-01-06 05:05:21,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46cddbff}, log id: 6d6c719b >2014-01-06 05:05:25,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e953626 >2014-01-06 05:05:25,723 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:05:25,724 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:05:25,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, log id: 5e953626 >2014-01-06 05:05:25,724 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-71) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:05:26,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d6a79d7 >2014-01-06 05:05:26,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3d6a79d7 >2014-01-06 05:05:26,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: eef94bd >2014-01-06 05:05:26,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4af12ca5}, log id: eef94bd >2014-01-06 05:05:31,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19712128 >2014-01-06 05:05:31,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 19712128 >2014-01-06 05:05:31,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2d62cdf1 >2014-01-06 05:05:32,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d819d35d}, log id: 2d62cdf1 >2014-01-06 05:05:37,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2fbde4a0 >2014-01-06 05:05:37,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2fbde4a0 >2014-01-06 05:05:37,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ce140bf >2014-01-06 05:05:37,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a1a4d9b}, log id: 7ce140bf >2014-01-06 05:05:42,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5598090d >2014-01-06 05:05:42,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5598090d >2014-01-06 05:05:42,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72a10178 >2014-01-06 05:05:43,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86e7afd8}, log id: 72a10178 >2014-01-06 05:05:48,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37535e74 >2014-01-06 05:05:48,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 37535e74 >2014-01-06 05:05:48,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13939f61 >2014-01-06 05:05:48,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5539efe9}, log id: 13939f61 >2014-01-06 05:05:53,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 689e388e >2014-01-06 05:05:53,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 689e388e >2014-01-06 05:05:53,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f3a6187 >2014-01-06 05:05:53,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a725d30}, log id: f3a6187 >2014-01-06 05:05:58,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31698f59 >2014-01-06 05:05:59,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 31698f59 >2014-01-06 05:05:59,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2d324110 >2014-01-06 05:05:59,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d14f12a3}, log id: 2d324110 >2014-01-06 05:06:04,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78658cb0 >2014-01-06 05:06:04,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 78658cb0 >2014-01-06 05:06:04,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a7a90a9 >2014-01-06 05:06:04,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@deabbcc5}, log id: 1a7a90a9 >2014-01-06 05:06:09,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18cd531f >2014-01-06 05:06:10,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 18cd531f >2014-01-06 05:06:10,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c4e10c5 >2014-01-06 05:06:10,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a413e2b9}, log id: c4e10c5 >2014-01-06 05:06:15,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 329cc224 >2014-01-06 05:06:15,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 329cc224 >2014-01-06 05:06:15,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 768d8bdd >2014-01-06 05:06:15,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14b9f6d9}, log id: 768d8bdd >2014-01-06 05:06:20,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 716042fa >2014-01-06 05:06:21,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 716042fa >2014-01-06 05:06:21,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2320d29c >2014-01-06 05:06:21,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dffa43}, log id: 2320d29c >2014-01-06 05:06:25,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ac2f88a >2014-01-06 05:06:26,058 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:06:26,058 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:06:26,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, log id: ac2f88a >2014-01-06 05:06:26,059 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-80) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:06:26,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51248405 >2014-01-06 05:06:26,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 51248405 >2014-01-06 05:06:26,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c7eca5a >2014-01-06 05:06:26,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7c509d9}, log id: 3c7eca5a >2014-01-06 05:06:31,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a7b5e3d >2014-01-06 05:06:31,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7a7b5e3d >2014-01-06 05:06:31,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4b38df43 >2014-01-06 05:06:32,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6caffd34}, log id: 4b38df43 >2014-01-06 05:06:37,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5500f7ca >2014-01-06 05:06:37,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5500f7ca >2014-01-06 05:06:37,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8058239 >2014-01-06 05:06:37,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc7cbe7c}, log id: 8058239 >2014-01-06 05:06:42,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7b05c7af >2014-01-06 05:06:42,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7b05c7af >2014-01-06 05:06:42,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1600bf18 >2014-01-06 05:06:43,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cab6a05}, log id: 1600bf18 >2014-01-06 05:06:48,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f4b3412 >2014-01-06 05:06:48,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4f4b3412 >2014-01-06 05:06:48,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 511712c7 >2014-01-06 05:06:48,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0e480ee}, log id: 511712c7 >2014-01-06 05:06:53,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28759771 >2014-01-06 05:06:53,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 28759771 >2014-01-06 05:06:53,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 32f17bce >2014-01-06 05:06:53,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be86edd8}, log id: 32f17bce >2014-01-06 05:06:58,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 166939bc >2014-01-06 05:06:59,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 166939bc >2014-01-06 05:06:59,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74e1546a >2014-01-06 05:06:59,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@303964bf}, log id: 74e1546a >2014-01-06 05:07:04,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 285b88f5 >2014-01-06 05:07:04,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 285b88f5 >2014-01-06 05:07:04,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5758d5a7 >2014-01-06 05:07:04,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29df29e2}, log id: 5758d5a7 >2014-01-06 05:07:09,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7df4109b >2014-01-06 05:07:10,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7df4109b >2014-01-06 05:07:10,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52daa6d5 >2014-01-06 05:07:10,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2746df87}, log id: 52daa6d5 >2014-01-06 05:07:15,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3fc39b24 >2014-01-06 05:07:15,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3fc39b24 >2014-01-06 05:07:15,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: d2abd43 >2014-01-06 05:07:15,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@907a31}, log id: d2abd43 >2014-01-06 05:07:20,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71151eb2 >2014-01-06 05:07:21,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 71151eb2 >2014-01-06 05:07:21,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 298f8cf0 >2014-01-06 05:07:21,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb1e5ef9}, log id: 298f8cf0 >2014-01-06 05:07:26,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3aca941e >2014-01-06 05:07:26,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50f39ec5 >2014-01-06 05:07:26,396 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:07:26,396 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:07:26,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, log id: 3aca941e >2014-01-06 05:07:26,396 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-32) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:07:26,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 50f39ec5 >2014-01-06 05:07:26,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a092c4d >2014-01-06 05:07:26,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcb0dffd}, log id: 4a092c4d >2014-01-06 05:07:31,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2842d3d4 >2014-01-06 05:07:32,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2842d3d4 >2014-01-06 05:07:32,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14e95dbf >2014-01-06 05:07:32,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fe87d99}, log id: 14e95dbf >2014-01-06 05:07:37,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b76a76c >2014-01-06 05:07:37,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b76a76c >2014-01-06 05:07:37,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49070db2 >2014-01-06 05:07:37,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc6ca216}, log id: 49070db2 >2014-01-06 05:07:42,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 190f1712 >2014-01-06 05:07:42,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 190f1712 >2014-01-06 05:07:42,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 738e4573 >2014-01-06 05:07:43,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2ab08a8}, log id: 738e4573 >2014-01-06 05:07:48,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a39298f >2014-01-06 05:07:48,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6a39298f >2014-01-06 05:07:48,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ddabbfa >2014-01-06 05:07:48,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9e93383}, log id: 4ddabbfa >2014-01-06 05:07:53,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: a6b5292 >2014-01-06 05:07:53,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: a6b5292 >2014-01-06 05:07:53,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5161192b >2014-01-06 05:07:53,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a23d871}, log id: 5161192b >2014-01-06 05:07:58,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5819d379 >2014-01-06 05:07:59,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5819d379 >2014-01-06 05:07:59,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22a4bb7f >2014-01-06 05:07:59,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1a22778}, log id: 22a4bb7f >2014-01-06 05:08:04,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3dd2d692 >2014-01-06 05:08:04,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3dd2d692 >2014-01-06 05:08:04,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71160d9c >2014-01-06 05:08:04,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f35044f}, log id: 71160d9c >2014-01-06 05:08:09,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60c28a08 >2014-01-06 05:08:10,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 60c28a08 >2014-01-06 05:08:10,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5832a021 >2014-01-06 05:08:10,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c251da4}, log id: 5832a021 >2014-01-06 05:08:15,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27096d2d >2014-01-06 05:08:15,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 27096d2d >2014-01-06 05:08:15,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b55e12b >2014-01-06 05:08:15,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41517ccb}, log id: 7b55e12b >2014-01-06 05:08:20,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63779fb0 >2014-01-06 05:08:21,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 63779fb0 >2014-01-06 05:08:21,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ef3284e >2014-01-06 05:08:21,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e69b6c0}, log id: 4ef3284e >2014-01-06 05:08:26,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ab441dc >2014-01-06 05:08:26,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ce97253 >2014-01-06 05:08:26,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ab441dc >2014-01-06 05:08:26,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7eedc68d >2014-01-06 05:08:26,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e60c5584}, log id: 7eedc68d >2014-01-06 05:08:26,747 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:08:26,747 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:08:26,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, log id: 7ce97253 >2014-01-06 05:08:26,747 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-44) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:08:31,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fc5f657 >2014-01-06 05:08:32,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: fc5f657 >2014-01-06 05:08:32,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c4b3db2 >2014-01-06 05:08:32,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b243b54b}, log id: 1c4b3db2 >2014-01-06 05:08:37,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 38afe4f5 >2014-01-06 05:08:37,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 38afe4f5 >2014-01-06 05:08:37,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78b91e47 >2014-01-06 05:08:37,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5b388af}, log id: 78b91e47 >2014-01-06 05:08:41,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f1b8afc >2014-01-06 05:08:41,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@17707b4a, log id: 6f1b8afc >2014-01-06 05:08:42,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 619f3c39 >2014-01-06 05:08:42,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 619f3c39 >2014-01-06 05:08:42,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7dc74d4d >2014-01-06 05:08:43,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@648623bd}, log id: 7dc74d4d >2014-01-06 05:08:48,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c44d4a2 >2014-01-06 05:08:48,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6c44d4a2 >2014-01-06 05:08:48,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7709eba5 >2014-01-06 05:08:48,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab4429b6}, log id: 7709eba5 >2014-01-06 05:08:53,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6844c28b >2014-01-06 05:08:53,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6844c28b >2014-01-06 05:08:53,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f3a3847 >2014-01-06 05:08:54,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e05407d}, log id: f3a3847 >2014-01-06 05:08:59,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3025f28d >2014-01-06 05:08:59,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3025f28d >2014-01-06 05:08:59,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2d892225 >2014-01-06 05:08:59,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4fafcb8}, log id: 2d892225 >2014-01-06 05:09:04,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2937504e >2014-01-06 05:09:04,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2937504e >2014-01-06 05:09:04,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d629c60 >2014-01-06 05:09:04,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e87ef3}, log id: 1d629c60 >2014-01-06 05:09:09,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76717a4 >2014-01-06 05:09:10,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 76717a4 >2014-01-06 05:09:10,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e5c00a4 >2014-01-06 05:09:10,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15bfe86b}, log id: 3e5c00a4 >2014-01-06 05:09:15,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4af35e68 >2014-01-06 05:09:15,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4af35e68 >2014-01-06 05:09:15,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 715b5162 >2014-01-06 05:09:15,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ce52c8}, log id: 715b5162 >2014-01-06 05:09:20,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1caf1195 >2014-01-06 05:09:21,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1caf1195 >2014-01-06 05:09:21,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 376ec017 >2014-01-06 05:09:21,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@163d9251}, log id: 376ec017 >2014-01-06 05:09:26,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54e01322 >2014-01-06 05:09:26,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 54e01322 >2014-01-06 05:09:26,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79c4218a >2014-01-06 05:09:26,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62e8c8}, log id: 79c4218a >2014-01-06 05:09:26,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7148ded5 >2014-01-06 05:09:27,071 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:09:27,071 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:09:27,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, log id: 7148ded5 >2014-01-06 05:09:27,071 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-34) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:09:31,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 30246c79 >2014-01-06 05:09:32,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 30246c79 >2014-01-06 05:09:32,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d81ff71 >2014-01-06 05:09:32,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eea28d7c}, log id: d81ff71 >2014-01-06 05:09:37,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3792e929 >2014-01-06 05:09:37,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3792e929 >2014-01-06 05:09:37,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 240a9032 >2014-01-06 05:09:37,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73d24c71}, log id: 240a9032 >2014-01-06 05:09:42,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b184ac4 >2014-01-06 05:09:42,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b184ac4 >2014-01-06 05:09:42,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 237105f4 >2014-01-06 05:09:43,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbf4d7d2}, log id: 237105f4 >2014-01-06 05:09:48,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7707dc9b >2014-01-06 05:09:48,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7707dc9b >2014-01-06 05:09:48,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c5d9bca >2014-01-06 05:09:48,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3db20270}, log id: 3c5d9bca >2014-01-06 05:09:53,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 774c6a4c >2014-01-06 05:09:53,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 774c6a4c >2014-01-06 05:09:53,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6fd71199 >2014-01-06 05:09:53,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32da120}, log id: 6fd71199 >2014-01-06 05:09:59,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6042258a >2014-01-06 05:09:59,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6042258a >2014-01-06 05:09:59,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8dc4965 >2014-01-06 05:09:59,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d95853bb}, log id: 8dc4965 >2014-01-06 05:10:04,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a34ced0 >2014-01-06 05:10:04,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7a34ced0 >2014-01-06 05:10:04,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7bf7d49e >2014-01-06 05:10:04,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9765bcda}, log id: 7bf7d49e >2014-01-06 05:10:09,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5cda7130 >2014-01-06 05:10:10,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5cda7130 >2014-01-06 05:10:10,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 102dbab >2014-01-06 05:10:10,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c82cc744}, log id: 102dbab >2014-01-06 05:10:15,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 210900d3 >2014-01-06 05:10:15,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 210900d3 >2014-01-06 05:10:15,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ec53ee0 >2014-01-06 05:10:15,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@faf6fa8}, log id: 4ec53ee0 >2014-01-06 05:10:20,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6787b661 >2014-01-06 05:10:21,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6787b661 >2014-01-06 05:10:21,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10943418 >2014-01-06 05:10:21,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15c5cc}, log id: 10943418 >2014-01-06 05:10:26,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2cdce9a3 >2014-01-06 05:10:26,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2cdce9a3 >2014-01-06 05:10:26,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 576082c4 >2014-01-06 05:10:26,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d5bd233}, log id: 576082c4 >2014-01-06 05:10:27,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19cfdb14 >2014-01-06 05:10:27,406 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:10:27,406 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:10:27,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, log id: 19cfdb14 >2014-01-06 05:10:27,406 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-30) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:10:31,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 622a217e >2014-01-06 05:10:32,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 622a217e >2014-01-06 05:10:32,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e6347d2 >2014-01-06 05:10:32,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70746c1e}, log id: 4e6347d2 >2014-01-06 05:10:37,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 81906a8 >2014-01-06 05:10:37,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 81906a8 >2014-01-06 05:10:37,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36d3450e >2014-01-06 05:10:37,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b3bec77}, log id: 36d3450e >2014-01-06 05:10:42,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4fd2a30f >2014-01-06 05:10:42,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4fd2a30f >2014-01-06 05:10:42,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ebead55 >2014-01-06 05:10:43,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26f2cf63}, log id: ebead55 >2014-01-06 05:10:48,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 673d58e7 >2014-01-06 05:10:48,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 673d58e7 >2014-01-06 05:10:48,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3852ac34 >2014-01-06 05:10:48,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52d0c370}, log id: 3852ac34 >2014-01-06 05:10:53,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 65d4b11e >2014-01-06 05:10:53,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 65d4b11e >2014-01-06 05:10:53,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45575cef >2014-01-06 05:10:54,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c58b059}, log id: 45575cef >2014-01-06 05:10:59,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a72474 >2014-01-06 05:10:59,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4a72474 >2014-01-06 05:10:59,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50305af0 >2014-01-06 05:10:59,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e4aba1b}, log id: 50305af0 >2014-01-06 05:11:04,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d8d8af8 >2014-01-06 05:11:04,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1d8d8af8 >2014-01-06 05:11:04,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43e2223 >2014-01-06 05:11:04,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20666131}, log id: 43e2223 >2014-01-06 05:11:09,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19d9b533 >2014-01-06 05:11:10,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 19d9b533 >2014-01-06 05:11:10,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c7481a8 >2014-01-06 05:11:10,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb6548a2}, log id: 6c7481a8 >2014-01-06 05:11:15,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d7a93a2 >2014-01-06 05:11:15,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3d7a93a2 >2014-01-06 05:11:15,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36bac19 >2014-01-06 05:11:15,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9df96791}, log id: 36bac19 >2014-01-06 05:11:20,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21c09d49 >2014-01-06 05:11:21,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 21c09d49 >2014-01-06 05:11:21,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4922872c >2014-01-06 05:11:21,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89d13055}, log id: 4922872c >2014-01-06 05:11:26,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52d9e276 >2014-01-06 05:11:26,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 52d9e276 >2014-01-06 05:11:26,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27583a8d >2014-01-06 05:11:26,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@382f8d1b}, log id: 27583a8d >2014-01-06 05:11:27,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 189313d4 >2014-01-06 05:11:27,733 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:11:27,733 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:11:27,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, log id: 189313d4 >2014-01-06 05:11:27,733 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-17) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:11:31,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58549f14 >2014-01-06 05:11:32,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 58549f14 >2014-01-06 05:11:32,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3612a411 >2014-01-06 05:11:32,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16c85d95}, log id: 3612a411 >2014-01-06 05:11:37,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 997742d >2014-01-06 05:11:37,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 997742d >2014-01-06 05:11:37,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72dd83f4 >2014-01-06 05:11:37,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5092856a}, log id: 72dd83f4 >2014-01-06 05:11:42,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2db5c999 >2014-01-06 05:11:42,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2db5c999 >2014-01-06 05:11:42,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 427c953 >2014-01-06 05:11:43,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d628e602}, log id: 427c953 >2014-01-06 05:11:48,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a76d2a4 >2014-01-06 05:11:48,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6a76d2a4 >2014-01-06 05:11:48,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 719acefa >2014-01-06 05:11:48,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@385be877}, log id: 719acefa >2014-01-06 05:11:53,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f6ab2ce >2014-01-06 05:11:53,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f6ab2ce >2014-01-06 05:11:53,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1552c42d >2014-01-06 05:11:53,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a98766b}, log id: 1552c42d >2014-01-06 05:11:59,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 530edfd5 >2014-01-06 05:11:59,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 530edfd5 >2014-01-06 05:11:59,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f4518b0 >2014-01-06 05:11:59,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45986e94}, log id: 3f4518b0 >2014-01-06 05:12:04,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71bee19 >2014-01-06 05:12:04,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71bee19 >2014-01-06 05:12:04,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f963ad4 >2014-01-06 05:12:04,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd8c59ff}, log id: 1f963ad4 >2014-01-06 05:12:09,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 275dc27c >2014-01-06 05:12:10,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 275dc27c >2014-01-06 05:12:10,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46973c7a >2014-01-06 05:12:10,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be8fb7c1}, log id: 46973c7a >2014-01-06 05:12:15,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7adecfcc >2014-01-06 05:12:15,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7adecfcc >2014-01-06 05:12:15,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55cc4727 >2014-01-06 05:12:15,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65ca8ac}, log id: 55cc4727 >2014-01-06 05:12:20,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d38ee09 >2014-01-06 05:12:21,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5d38ee09 >2014-01-06 05:12:21,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5fa7e483 >2014-01-06 05:12:21,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ba43ab6}, log id: 5fa7e483 >2014-01-06 05:12:26,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 158d81bd >2014-01-06 05:12:26,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 158d81bd >2014-01-06 05:12:26,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 321418bc >2014-01-06 05:12:26,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbb7f3d3}, log id: 321418bc >2014-01-06 05:12:27,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74528b47 >2014-01-06 05:12:28,062 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:12:28,062 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:12:28,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, log id: 74528b47 >2014-01-06 05:12:28,062 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-99) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:12:31,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4dff430 >2014-01-06 05:12:32,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4dff430 >2014-01-06 05:12:32,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15e11073 >2014-01-06 05:12:32,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78b485a3}, log id: 15e11073 >2014-01-06 05:12:37,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3109ef1d >2014-01-06 05:12:37,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3109ef1d >2014-01-06 05:12:37,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21327c7c >2014-01-06 05:12:37,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d025d56f}, log id: 21327c7c >2014-01-06 05:12:42,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 440e6d54 >2014-01-06 05:12:42,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 440e6d54 >2014-01-06 05:12:42,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 778d0ae >2014-01-06 05:12:43,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3e18b16}, log id: 778d0ae >2014-01-06 05:12:48,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31b5dbcc >2014-01-06 05:12:48,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 31b5dbcc >2014-01-06 05:12:48,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ba05f2d >2014-01-06 05:12:48,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a93f6c72}, log id: 4ba05f2d >2014-01-06 05:12:53,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e25d8b0 >2014-01-06 05:12:53,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e25d8b0 >2014-01-06 05:12:53,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6be3d5b >2014-01-06 05:12:54,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fec71b2}, log id: 6be3d5b >2014-01-06 05:12:59,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d2ae4f7 >2014-01-06 05:12:59,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7d2ae4f7 >2014-01-06 05:12:59,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 534c1dfe >2014-01-06 05:12:59,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc14670f}, log id: 534c1dfe >2014-01-06 05:13:04,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30bbd7aa >2014-01-06 05:13:04,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 30bbd7aa >2014-01-06 05:13:04,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4121927 >2014-01-06 05:13:04,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d711914b}, log id: 4121927 >2014-01-06 05:13:09,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c2e5c25 >2014-01-06 05:13:10,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3c2e5c25 >2014-01-06 05:13:10,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46568237 >2014-01-06 05:13:10,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c11be6}, log id: 46568237 >2014-01-06 05:13:15,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60f1fc6a >2014-01-06 05:13:15,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 60f1fc6a >2014-01-06 05:13:15,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7be50c50 >2014-01-06 05:13:15,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4243296c}, log id: 7be50c50 >2014-01-06 05:13:20,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 326b5196 >2014-01-06 05:13:21,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 326b5196 >2014-01-06 05:13:21,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2bd2b6a9 >2014-01-06 05:13:21,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcd114a5}, log id: 2bd2b6a9 >2014-01-06 05:13:26,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f15fd9f >2014-01-06 05:13:26,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1f15fd9f >2014-01-06 05:13:26,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e73b177 >2014-01-06 05:13:26,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6825a3cf}, log id: 1e73b177 >2014-01-06 05:13:28,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1aeacadd >2014-01-06 05:13:28,394 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:13:28,394 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:13:28,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, log id: 1aeacadd >2014-01-06 05:13:28,394 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-61) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:13:31,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1dcfc3e7 >2014-01-06 05:13:32,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1dcfc3e7 >2014-01-06 05:13:32,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: cfa58c0 >2014-01-06 05:13:32,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f17e915}, log id: cfa58c0 >2014-01-06 05:13:37,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71c847eb >2014-01-06 05:13:37,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71c847eb >2014-01-06 05:13:37,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14434cfb >2014-01-06 05:13:37,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3c87a12}, log id: 14434cfb >2014-01-06 05:13:41,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a913b01 >2014-01-06 05:13:41,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3b77f32c, log id: 3a913b01 >2014-01-06 05:13:42,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 313eed44 >2014-01-06 05:13:43,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 313eed44 >2014-01-06 05:13:43,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5db87487 >2014-01-06 05:13:43,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@449d64bc}, log id: 5db87487 >2014-01-06 05:13:48,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60ea953e >2014-01-06 05:13:48,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 60ea953e >2014-01-06 05:13:48,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44660d3c >2014-01-06 05:13:48,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64702fa7}, log id: 44660d3c >2014-01-06 05:13:53,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f0c1de6 >2014-01-06 05:13:53,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f0c1de6 >2014-01-06 05:13:53,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 146e2315 >2014-01-06 05:13:54,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb10323d}, log id: 146e2315 >2014-01-06 05:13:59,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2375b0d2 >2014-01-06 05:13:59,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2375b0d2 >2014-01-06 05:13:59,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 788cb5eb >2014-01-06 05:13:59,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36ea6121}, log id: 788cb5eb >2014-01-06 05:14:04,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47783485 >2014-01-06 05:14:04,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 47783485 >2014-01-06 05:14:04,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1afb353f >2014-01-06 05:14:04,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11ca22b}, log id: 1afb353f >2014-01-06 05:14:09,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47af838c >2014-01-06 05:14:10,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 47af838c >2014-01-06 05:14:10,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a89c8b1 >2014-01-06 05:14:10,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@673d266f}, log id: 6a89c8b1 >2014-01-06 05:14:15,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 441c8a0d >2014-01-06 05:14:15,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 441c8a0d >2014-01-06 05:14:15,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1bf415b6 >2014-01-06 05:14:15,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@460d1d3a}, log id: 1bf415b6 >2014-01-06 05:14:20,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 596896a1 >2014-01-06 05:14:21,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 596896a1 >2014-01-06 05:14:21,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30859f79 >2014-01-06 05:14:21,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cf0879d}, log id: 30859f79 >2014-01-06 05:14:26,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 139da3b9 >2014-01-06 05:14:26,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 139da3b9 >2014-01-06 05:14:26,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54ebd4c7 >2014-01-06 05:14:26,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@935189d4}, log id: 54ebd4c7 >2014-01-06 05:14:28,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a154e71 >2014-01-06 05:14:28,724 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:14:28,724 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:14:28,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, log id: 2a154e71 >2014-01-06 05:14:28,724 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-26) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:14:31,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 45d542ee >2014-01-06 05:14:32,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 45d542ee >2014-01-06 05:14:32,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19ee9966 >2014-01-06 05:14:32,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eac97be9}, log id: 19ee9966 >2014-01-06 05:14:37,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73ccb89e >2014-01-06 05:14:37,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73ccb89e >2014-01-06 05:14:37,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2aeab55a >2014-01-06 05:14:37,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae75bb9b}, log id: 2aeab55a >2014-01-06 05:14:42,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63b52a8b >2014-01-06 05:14:42,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 63b52a8b >2014-01-06 05:14:42,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40f9792c >2014-01-06 05:14:43,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40db9feb}, log id: 40f9792c >2014-01-06 05:14:48,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 313a6e21 >2014-01-06 05:14:48,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 313a6e21 >2014-01-06 05:14:48,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6267f483 >2014-01-06 05:14:48,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bbe7d3d}, log id: 6267f483 >2014-01-06 05:14:53,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1cd17e81 >2014-01-06 05:14:53,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1cd17e81 >2014-01-06 05:14:53,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12449a15 >2014-01-06 05:14:54,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfbdaf74}, log id: 12449a15 >2014-01-06 05:14:59,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9d5011d >2014-01-06 05:14:59,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 9d5011d >2014-01-06 05:14:59,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c4530f7 >2014-01-06 05:14:59,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65418a4b}, log id: 4c4530f7 >2014-01-06 05:15:04,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1312fac8 >2014-01-06 05:15:04,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1312fac8 >2014-01-06 05:15:04,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3a94a443 >2014-01-06 05:15:04,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d64c02c}, log id: 3a94a443 >2014-01-06 05:15:09,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b647c96 >2014-01-06 05:15:10,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b647c96 >2014-01-06 05:15:10,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4da4d94d >2014-01-06 05:15:10,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d68eb22}, log id: 4da4d94d >2014-01-06 05:15:15,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 174e392f >2014-01-06 05:15:15,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 174e392f >2014-01-06 05:15:15,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47f114f4 >2014-01-06 05:15:15,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8981ac84}, log id: 47f114f4 >2014-01-06 05:15:20,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20c31ada >2014-01-06 05:15:21,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 20c31ada >2014-01-06 05:15:21,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78b7712c >2014-01-06 05:15:21,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfc946ac}, log id: 78b7712c >2014-01-06 05:15:26,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7b730566 >2014-01-06 05:15:26,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7b730566 >2014-01-06 05:15:26,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31eb23b6 >2014-01-06 05:15:26,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d89a5300}, log id: 31eb23b6 >2014-01-06 05:15:28,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48882507 >2014-01-06 05:15:29,060 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:15:29,061 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:15:29,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterTasksListVDSCommand, log id: 48882507 >2014-01-06 05:15:29,061 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-4) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:15:31,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3806cb3f >2014-01-06 05:15:32,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3806cb3f >2014-01-06 05:15:32,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26f2397e >2014-01-06 05:15:32,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7ea5b71}, log id: 26f2397e >2014-01-06 05:15:37,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36769403 >2014-01-06 05:15:37,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 36769403 >2014-01-06 05:15:37,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 69744aad >2014-01-06 05:15:37,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91de001f}, log id: 69744aad >2014-01-06 05:15:42,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b918e05 >2014-01-06 05:15:42,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b918e05 >2014-01-06 05:15:42,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74ca731b >2014-01-06 05:15:43,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56196155}, log id: 74ca731b >2014-01-06 05:15:48,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 428d258a >2014-01-06 05:15:48,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 428d258a >2014-01-06 05:15:48,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29a6f27d >2014-01-06 05:15:48,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4bb149b}, log id: 29a6f27d >2014-01-06 05:15:53,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a64a707 >2014-01-06 05:15:53,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6a64a707 >2014-01-06 05:15:53,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37d040ed >2014-01-06 05:15:54,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1671e2f}, log id: 37d040ed >2014-01-06 05:15:59,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1855cf54 >2014-01-06 05:15:59,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1855cf54 >2014-01-06 05:15:59,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53e0b81 >2014-01-06 05:15:59,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c0bc0cf}, log id: 53e0b81 >2014-01-06 05:16:04,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23280123 >2014-01-06 05:16:04,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 23280123 >2014-01-06 05:16:04,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 76136c9e >2014-01-06 05:16:04,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb8059db}, log id: 76136c9e >2014-01-06 05:16:09,580 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-12) Start refreshing all users data >2014-01-06 05:16:09,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17e80f72 >2014-01-06 05:16:10,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 17e80f72 >2014-01-06 05:16:10,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a6acdc7 >2014-01-06 05:16:10,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b36cc43d}, log id: 4a6acdc7 >2014-01-06 05:16:10,553 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-01-06 05:16:10,554 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VM OVFs in Data Center Posixfs-DC-1 >2014-01-06 05:16:10,554 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated VM OVFs in Data Center Posixfs-DC-1 >2014-01-06 05:16:10,555 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update template OVFs in Data Center Posixfs-DC-1 >2014-01-06 05:16:10,555 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated templates OVFs in Data Center Posixfs-DC-1 >2014-01-06 05:16:10,555 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to remove unneeded template/vm OVFs in Data Center Posixfs-DC-1 >2014-01-06 05:16:10,556 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully removed unneeded template/vm OVFs in Data Center Posixfs-DC-1 >2014-01-06 05:16:10,556 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VM OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 05:16:10,557 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated VM OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 05:16:10,557 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update template OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 05:16:10,558 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated templates OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 05:16:10,558 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to remove unneeded template/vm OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 05:16:10,559 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully removed unneeded template/vm OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 05:16:11,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) START, GlusterHooksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 157ab1b9 >2014-01-06 05:16:11,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-46) START, GlusterHooksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a29f3b3 >2014-01-06 05:16:11,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b20974c4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e9199f79, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@91654ee4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5a6a6ee1, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@426fe85e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@776e188e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@cf34a4a4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d22549e9, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2e69117f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c8f21ebc, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6f05ba4b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@70d8ac71, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@58a0eab3], log id: 157ab1b9 >2014-01-06 05:16:11,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-46) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8ec482ac, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5f58c7d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@aa5e4757, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bb2ce879, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@56af870f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@886246a8, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2a219d24, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a061b89a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@aba2e4f2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@990f3f1d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b4502ffd, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1dc1cb6, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@22657cd3], log id: 2a29f3b3 >2014-01-06 05:16:15,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 550e5cec >2014-01-06 05:16:15,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 550e5cec >2014-01-06 05:16:15,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4b67e4d1 >2014-01-06 05:16:15,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e1be90f}, log id: 4b67e4d1 >2014-01-06 05:16:20,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c655a3c >2014-01-06 05:16:21,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7c655a3c >2014-01-06 05:16:21,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43576b2c >2014-01-06 05:16:21,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@777082e}, log id: 43576b2c >2014-01-06 05:16:26,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 486d41c >2014-01-06 05:16:26,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 486d41c >2014-01-06 05:16:26,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e94e995 >2014-01-06 05:16:26,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@485f76c2}, log id: 1e94e995 >2014-01-06 05:16:29,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36322ba4 >2014-01-06 05:16:29,407 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:16:29,407 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:16:29,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, log id: 36322ba4 >2014-01-06 05:16:29,407 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-77) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:16:31,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 435c0085 >2014-01-06 05:16:32,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 435c0085 >2014-01-06 05:16:32,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44e93a33 >2014-01-06 05:16:32,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c12365a3}, log id: 44e93a33 >2014-01-06 05:16:37,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11a442a4 >2014-01-06 05:16:37,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 11a442a4 >2014-01-06 05:16:37,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5cffec55 >2014-01-06 05:16:37,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8af80878}, log id: 5cffec55 >2014-01-06 05:16:42,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fbcf12d >2014-01-06 05:16:43,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: fbcf12d >2014-01-06 05:16:43,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a23115d >2014-01-06 05:16:43,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee0833b}, log id: 2a23115d >2014-01-06 05:16:48,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d9082c5 >2014-01-06 05:16:48,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1d9082c5 >2014-01-06 05:16:48,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b58a4fa >2014-01-06 05:16:48,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2847830}, log id: 1b58a4fa >2014-01-06 05:16:53,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f579e7 >2014-01-06 05:16:53,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: f579e7 >2014-01-06 05:16:53,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f652077 >2014-01-06 05:16:54,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41d045ec}, log id: 4f652077 >2014-01-06 05:16:59,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 371e6764 >2014-01-06 05:16:59,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 371e6764 >2014-01-06 05:16:59,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36c01955 >2014-01-06 05:16:59,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@498fe02d}, log id: 36c01955 >2014-01-06 05:17:04,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24405599 >2014-01-06 05:17:04,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 24405599 >2014-01-06 05:17:04,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f96663e >2014-01-06 05:17:04,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81f2a4e4}, log id: 7f96663e >2014-01-06 05:17:10,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 100b6c51 >2014-01-06 05:17:10,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 100b6c51 >2014-01-06 05:17:10,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b04063d >2014-01-06 05:17:10,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90639f18}, log id: 1b04063d >2014-01-06 05:17:15,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 32be962a >2014-01-06 05:17:15,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 32be962a >2014-01-06 05:17:15,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1955a0f7 >2014-01-06 05:17:15,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff405aaf}, log id: 1955a0f7 >2014-01-06 05:17:20,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 269a8f74 >2014-01-06 05:17:21,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 269a8f74 >2014-01-06 05:17:21,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d201e95 >2014-01-06 05:17:21,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38fb1315}, log id: 7d201e95 >2014-01-06 05:17:26,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56e9fd3 >2014-01-06 05:17:26,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56e9fd3 >2014-01-06 05:17:26,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4302533a >2014-01-06 05:17:26,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18ef05b7}, log id: 4302533a >2014-01-06 05:17:29,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3689425c >2014-01-06 05:17:29,739 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:17:29,740 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:17:29,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterTasksListVDSCommand, log id: 3689425c >2014-01-06 05:17:29,740 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-5) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:17:31,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6cd67762 >2014-01-06 05:17:32,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6cd67762 >2014-01-06 05:17:32,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e249e9 >2014-01-06 05:17:32,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fbf049c}, log id: 4e249e9 >2014-01-06 05:17:37,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 377710e >2014-01-06 05:17:37,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 377710e >2014-01-06 05:17:37,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ae6b577 >2014-01-06 05:17:37,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c104a23}, log id: 5ae6b577 >2014-01-06 05:17:42,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 747fbd77 >2014-01-06 05:17:43,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 747fbd77 >2014-01-06 05:17:43,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50a04985 >2014-01-06 05:17:43,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e05630f}, log id: 50a04985 >2014-01-06 05:17:48,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 742527b5 >2014-01-06 05:17:48,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 742527b5 >2014-01-06 05:17:48,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34f23de >2014-01-06 05:17:48,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6615d1be}, log id: 34f23de >2014-01-06 05:17:53,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2476e913 >2014-01-06 05:17:53,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2476e913 >2014-01-06 05:17:53,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2565973 >2014-01-06 05:17:54,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57addf08}, log id: 2565973 >2014-01-06 05:17:59,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 400aaf71 >2014-01-06 05:17:59,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 400aaf71 >2014-01-06 05:17:59,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1724e21 >2014-01-06 05:17:59,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a78b08a9}, log id: 1724e21 >2014-01-06 05:18:04,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1926bab8 >2014-01-06 05:18:04,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1926bab8 >2014-01-06 05:18:04,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68f34566 >2014-01-06 05:18:05,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a149b008}, log id: 68f34566 >2014-01-06 05:18:10,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a678d73 >2014-01-06 05:18:10,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4a678d73 >2014-01-06 05:18:10,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50005c1a >2014-01-06 05:18:10,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff39f0e2}, log id: 50005c1a >2014-01-06 05:18:15,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 111a0ff6 >2014-01-06 05:18:15,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 111a0ff6 >2014-01-06 05:18:15,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9c68001 >2014-01-06 05:18:15,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74cd3d39}, log id: 9c68001 >2014-01-06 05:18:20,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 640f89ba >2014-01-06 05:18:21,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 640f89ba >2014-01-06 05:18:21,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6581fe42 >2014-01-06 05:18:21,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b6fcbd}, log id: 6581fe42 >2014-01-06 05:18:26,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2bae6a99 >2014-01-06 05:18:26,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2bae6a99 >2014-01-06 05:18:26,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 49d4f303 >2014-01-06 05:18:26,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71c7d335}, log id: 49d4f303 >2014-01-06 05:18:29,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 70976d05 >2014-01-06 05:18:30,069 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:18:30,069 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:18:30,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, log id: 70976d05 >2014-01-06 05:18:30,069 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-95) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:18:31,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 629ae497 >2014-01-06 05:18:32,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 629ae497 >2014-01-06 05:18:32,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 120f77b5 >2014-01-06 05:18:32,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab2d0c6d}, log id: 120f77b5 >2014-01-06 05:18:37,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: af4147e >2014-01-06 05:18:37,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: af4147e >2014-01-06 05:18:37,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1dee77ab >2014-01-06 05:18:37,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bdaed37}, log id: 1dee77ab >2014-01-06 05:18:41,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 304bff2f >2014-01-06 05:18:41,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@194f21e5, log id: 304bff2f >2014-01-06 05:18:42,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3aff8c34 >2014-01-06 05:18:43,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3aff8c34 >2014-01-06 05:18:43,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71832963 >2014-01-06 05:18:43,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a294e836}, log id: 71832963 >2014-01-06 05:18:48,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17b58228 >2014-01-06 05:18:48,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 17b58228 >2014-01-06 05:18:48,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 769e664 >2014-01-06 05:18:48,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d1ed4c5}, log id: 769e664 >2014-01-06 05:18:53,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d03d162 >2014-01-06 05:18:54,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3d03d162 >2014-01-06 05:18:54,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48cc4bd8 >2014-01-06 05:18:54,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5547a9e}, log id: 48cc4bd8 >2014-01-06 05:18:59,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38a624ac >2014-01-06 05:18:59,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 38a624ac >2014-01-06 05:18:59,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 49aec49a >2014-01-06 05:18:59,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7d1b086}, log id: 49aec49a >2014-01-06 05:19:04,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12ec63e5 >2014-01-06 05:19:04,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 12ec63e5 >2014-01-06 05:19:04,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13bf0385 >2014-01-06 05:19:05,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61c28d18}, log id: 13bf0385 >2014-01-06 05:19:10,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25052ef3 >2014-01-06 05:19:10,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25052ef3 >2014-01-06 05:19:10,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 62912c9f >2014-01-06 05:19:10,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a804d27}, log id: 62912c9f >2014-01-06 05:19:15,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41a8db26 >2014-01-06 05:19:15,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 41a8db26 >2014-01-06 05:19:15,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ff5eaf9 >2014-01-06 05:19:15,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec2eeb24}, log id: 1ff5eaf9 >2014-01-06 05:19:21,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4314812f >2014-01-06 05:19:21,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4314812f >2014-01-06 05:19:21,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52128e28 >2014-01-06 05:19:21,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99e0fded}, log id: 52128e28 >2014-01-06 05:19:26,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3220074f >2014-01-06 05:19:26,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3220074f >2014-01-06 05:19:26,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a4420ad >2014-01-06 05:19:26,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cfd0ca2}, log id: 6a4420ad >2014-01-06 05:19:30,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e07955e >2014-01-06 05:19:30,405 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:19:30,406 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:19:30,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, log id: 7e07955e >2014-01-06 05:19:30,406 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-25) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:19:31,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6572c1e7 >2014-01-06 05:19:32,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6572c1e7 >2014-01-06 05:19:32,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 465a9d31 >2014-01-06 05:19:32,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e59d0bd}, log id: 465a9d31 >2014-01-06 05:19:37,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 628fe1c1 >2014-01-06 05:19:37,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 628fe1c1 >2014-01-06 05:19:37,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e3ee4fc >2014-01-06 05:19:37,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4501d57}, log id: 1e3ee4fc >2014-01-06 05:19:42,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5fa50e6b >2014-01-06 05:19:43,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5fa50e6b >2014-01-06 05:19:43,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2bd10448 >2014-01-06 05:19:43,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc1da275}, log id: 2bd10448 >2014-01-06 05:19:48,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66d530a3 >2014-01-06 05:19:48,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 66d530a3 >2014-01-06 05:19:48,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c034536 >2014-01-06 05:19:48,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6212381b}, log id: 7c034536 >2014-01-06 05:19:53,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72298013 >2014-01-06 05:19:54,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 72298013 >2014-01-06 05:19:54,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 485cafcb >2014-01-06 05:19:54,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15ce2482}, log id: 485cafcb >2014-01-06 05:19:59,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 560ecc48 >2014-01-06 05:19:59,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 560ecc48 >2014-01-06 05:19:59,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 680787c7 >2014-01-06 05:19:59,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0bc96f6}, log id: 680787c7 >2014-01-06 05:20:04,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4310aca3 >2014-01-06 05:20:04,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4310aca3 >2014-01-06 05:20:04,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 639b32c7 >2014-01-06 05:20:05,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8194aef}, log id: 639b32c7 >2014-01-06 05:20:10,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74f3e30b >2014-01-06 05:20:10,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 74f3e30b >2014-01-06 05:20:10,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a440fcc >2014-01-06 05:20:10,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77a0f7fc}, log id: 7a440fcc >2014-01-06 05:20:15,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 372d79b5 >2014-01-06 05:20:15,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 372d79b5 >2014-01-06 05:20:15,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6530a93a >2014-01-06 05:20:15,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67972452}, log id: 6530a93a >2014-01-06 05:20:21,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e9544e3 >2014-01-06 05:20:21,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6e9544e3 >2014-01-06 05:20:21,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25c1bd4a >2014-01-06 05:20:21,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c28a8dca}, log id: 25c1bd4a >2014-01-06 05:20:26,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 594e3bcc >2014-01-06 05:20:26,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 594e3bcc >2014-01-06 05:20:26,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 302349b0 >2014-01-06 05:20:26,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@928ed07e}, log id: 302349b0 >2014-01-06 05:20:30,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 482089fc >2014-01-06 05:20:30,737 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:20:30,738 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:20:30,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, log id: 482089fc >2014-01-06 05:20:30,738 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-12) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:20:31,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e3af135 >2014-01-06 05:20:32,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4e3af135 >2014-01-06 05:20:32,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1571a772 >2014-01-06 05:20:32,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f4b45b0}, log id: 1571a772 >2014-01-06 05:20:37,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 629f3231 >2014-01-06 05:20:37,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 629f3231 >2014-01-06 05:20:37,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 713d3caf >2014-01-06 05:20:37,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be9f54f}, log id: 713d3caf >2014-01-06 05:20:42,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7984da85 >2014-01-06 05:20:43,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7984da85 >2014-01-06 05:20:43,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 429ac6ef >2014-01-06 05:20:43,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f87e213}, log id: 429ac6ef >2014-01-06 05:20:48,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5bdce64 >2014-01-06 05:20:48,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5bdce64 >2014-01-06 05:20:48,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6abe7556 >2014-01-06 05:20:48,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c589d2c}, log id: 6abe7556 >2014-01-06 05:20:53,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22b4ffba >2014-01-06 05:20:54,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 22b4ffba >2014-01-06 05:20:54,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 654fa228 >2014-01-06 05:20:54,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16e8f90f}, log id: 654fa228 >2014-01-06 05:20:59,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e333180 >2014-01-06 05:20:59,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e333180 >2014-01-06 05:20:59,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5143afbd >2014-01-06 05:20:59,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bb58d64}, log id: 5143afbd >2014-01-06 05:21:04,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c647bec >2014-01-06 05:21:04,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4c647bec >2014-01-06 05:21:04,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ac04481 >2014-01-06 05:21:05,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d253a9a}, log id: 6ac04481 >2014-01-06 05:21:10,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c5cc4a6 >2014-01-06 05:21:10,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4c5cc4a6 >2014-01-06 05:21:10,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 632e981a >2014-01-06 05:21:10,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c57777c0}, log id: 632e981a >2014-01-06 05:21:11,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-47) START, GetIsoListVDSCommand( storagePoolId = ee718678-261f-4bad-ab5e-73b9697cb5f8, ignoreFailoverLimit = false), log id: 945f012 >2014-01-06 05:21:11,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-47) START, HsmGetIsoListVDSCommand(HostName = rhs-client10, HostId = e80de893-f6c4-4b96-9ce1-92a74ca5869a, storagePoolId=ee718678-261f-4bad-ab5e-73b9697cb5f8), log id: 4e94327f >2014-01-06 05:21:11,329 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-47) FINISH, HsmGetIsoListVDSCommand, return: [en_windows_7_enterprise_with_sp1_x64_dvd_u_677651.iso], log id: 4e94327f >2014-01-06 05:21:11,329 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-47) FINISH, GetIsoListVDSCommand, return: [en_windows_7_enterprise_with_sp1_x64_dvd_u_677651.iso], log id: 945f012 >2014-01-06 05:21:11,333 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (pool-4-thread-47) Finished automatic refresh process for ISO file type with success, for storage domain id cc1bba44-7b89-4b6e-acff-fb066601f8c7. >2014-01-06 05:21:15,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66644f5a >2014-01-06 05:21:15,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66644f5a >2014-01-06 05:21:15,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76defe1a >2014-01-06 05:21:15,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@446d6b8c}, log id: 76defe1a >2014-01-06 05:21:21,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 769beab0 >2014-01-06 05:21:21,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 769beab0 >2014-01-06 05:21:21,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 645c3f60 >2014-01-06 05:21:21,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f95bfab8}, log id: 645c3f60 >2014-01-06 05:21:26,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72aeba3 >2014-01-06 05:21:26,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 72aeba3 >2014-01-06 05:21:26,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13da5462 >2014-01-06 05:21:26,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36a9e0b7}, log id: 13da5462 >2014-01-06 05:21:30,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b61d386 >2014-01-06 05:21:31,074 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:21:31,074 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:21:31,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, log id: 5b61d386 >2014-01-06 05:21:31,074 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-72) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:21:31,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ed03dea >2014-01-06 05:21:32,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ed03dea >2014-01-06 05:21:32,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50385ddd >2014-01-06 05:21:32,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@301520c6}, log id: 50385ddd >2014-01-06 05:21:37,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7380bbee >2014-01-06 05:21:37,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7380bbee >2014-01-06 05:21:37,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d436afa >2014-01-06 05:21:37,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5fe589d}, log id: 1d436afa >2014-01-06 05:21:42,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2bcf0c02 >2014-01-06 05:21:43,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2bcf0c02 >2014-01-06 05:21:43,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31b14484 >2014-01-06 05:21:43,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbba4327}, log id: 31b14484 >2014-01-06 05:21:48,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4756021c >2014-01-06 05:21:48,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4756021c >2014-01-06 05:21:48,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35aa60c2 >2014-01-06 05:21:48,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97525159}, log id: 35aa60c2 >2014-01-06 05:21:53,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b8bacad >2014-01-06 05:21:54,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b8bacad >2014-01-06 05:21:54,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 38264c11 >2014-01-06 05:21:54,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@408893a0}, log id: 38264c11 >2014-01-06 05:21:59,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ac05cae >2014-01-06 05:21:59,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6ac05cae >2014-01-06 05:21:59,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 428e388d >2014-01-06 05:21:59,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3df7ed64}, log id: 428e388d >2014-01-06 05:22:04,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40e15b1 >2014-01-06 05:22:04,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 40e15b1 >2014-01-06 05:22:04,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10480a06 >2014-01-06 05:22:05,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@848096db}, log id: 10480a06 >2014-01-06 05:22:10,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3063b625 >2014-01-06 05:22:10,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3063b625 >2014-01-06 05:22:10,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 141cd197 >2014-01-06 05:22:10,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab4e0d97}, log id: 141cd197 >2014-01-06 05:22:15,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 640ecfba >2014-01-06 05:22:15,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 640ecfba >2014-01-06 05:22:15,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34432c2f >2014-01-06 05:22:16,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ada52f0}, log id: 34432c2f >2014-01-06 05:22:21,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6784fc2 >2014-01-06 05:22:21,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6784fc2 >2014-01-06 05:22:21,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1fc329de >2014-01-06 05:22:21,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74ea6d67}, log id: 1fc329de >2014-01-06 05:22:26,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54b367f8 >2014-01-06 05:22:26,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 54b367f8 >2014-01-06 05:22:26,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f8dd21c >2014-01-06 05:22:26,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@122f1797}, log id: 5f8dd21c >2014-01-06 05:22:31,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a30bd4f >2014-01-06 05:22:31,400 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:22:31,400 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:22:31,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, log id: 7a30bd4f >2014-01-06 05:22:31,400 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-36) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:22:31,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42fd57a >2014-01-06 05:22:32,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 42fd57a >2014-01-06 05:22:32,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 115eb178 >2014-01-06 05:22:32,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f611b61f}, log id: 115eb178 >2014-01-06 05:22:37,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7df1f8dc >2014-01-06 05:22:37,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7df1f8dc >2014-01-06 05:22:37,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 508c7e84 >2014-01-06 05:22:37,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aec47efe}, log id: 508c7e84 >2014-01-06 05:22:42,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68ffebfb >2014-01-06 05:22:43,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 68ffebfb >2014-01-06 05:22:43,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b9855a3 >2014-01-06 05:22:43,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be8e5a37}, log id: 5b9855a3 >2014-01-06 05:22:48,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60e28a4d >2014-01-06 05:22:48,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 60e28a4d >2014-01-06 05:22:48,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d2f8f3f >2014-01-06 05:22:48,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fe47bd3}, log id: 6d2f8f3f >2014-01-06 05:22:53,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c5f244 >2014-01-06 05:22:54,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2c5f244 >2014-01-06 05:22:54,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f7a8365 >2014-01-06 05:22:54,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a014d92}, log id: 3f7a8365 >2014-01-06 05:22:59,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 34315a95 >2014-01-06 05:22:59,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 34315a95 >2014-01-06 05:22:59,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 737f5604 >2014-01-06 05:22:59,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d6f6c56}, log id: 737f5604 >2014-01-06 05:23:04,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36b4b65e >2014-01-06 05:23:04,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 36b4b65e >2014-01-06 05:23:04,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6da49b8d >2014-01-06 05:23:05,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98a4bf7e}, log id: 6da49b8d >2014-01-06 05:23:10,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: a326340 >2014-01-06 05:23:10,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: a326340 >2014-01-06 05:23:10,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 393cc36c >2014-01-06 05:23:10,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64c3d0e7}, log id: 393cc36c >2014-01-06 05:23:15,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4adf1912 >2014-01-06 05:23:15,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4adf1912 >2014-01-06 05:23:15,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 322dad57 >2014-01-06 05:23:16,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4306536a}, log id: 322dad57 >2014-01-06 05:23:21,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54a5c53c >2014-01-06 05:23:21,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 54a5c53c >2014-01-06 05:23:21,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a7fd7a7 >2014-01-06 05:23:21,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5efcafe}, log id: 1a7fd7a7 >2014-01-06 05:23:26,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b1ced2e >2014-01-06 05:23:26,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b1ced2e >2014-01-06 05:23:26,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c8d887e >2014-01-06 05:23:26,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b949238}, log id: 1c8d887e >2014-01-06 05:23:31,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 595ed95e >2014-01-06 05:23:31,722 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:23:31,722 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:23:31,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, log id: 595ed95e >2014-01-06 05:23:31,723 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-96) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:23:31,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 612cf54f >2014-01-06 05:23:32,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 612cf54f >2014-01-06 05:23:32,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28cb55b1 >2014-01-06 05:23:32,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f30c6dc6}, log id: 28cb55b1 >2014-01-06 05:23:37,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e5fad79 >2014-01-06 05:23:37,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6e5fad79 >2014-01-06 05:23:37,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 792b72f7 >2014-01-06 05:23:37,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c6e3373}, log id: 792b72f7 >2014-01-06 05:23:41,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 51dafff1 >2014-01-06 05:23:41,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2bff6eab, log id: 51dafff1 >2014-01-06 05:23:42,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 453acf12 >2014-01-06 05:23:43,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 453acf12 >2014-01-06 05:23:43,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37bea6eb >2014-01-06 05:23:43,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83661b67}, log id: 37bea6eb >2014-01-06 05:23:48,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c3b778f >2014-01-06 05:23:48,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4c3b778f >2014-01-06 05:23:48,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 339e29eb >2014-01-06 05:23:48,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ddebc9}, log id: 339e29eb >2014-01-06 05:23:53,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b54ad8f >2014-01-06 05:23:54,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b54ad8f >2014-01-06 05:23:54,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 281cb178 >2014-01-06 05:23:54,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b209dbb}, log id: 281cb178 >2014-01-06 05:23:59,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 780661ca >2014-01-06 05:23:59,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 780661ca >2014-01-06 05:23:59,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f0a4ce2 >2014-01-06 05:23:59,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b2ba4d7}, log id: 2f0a4ce2 >2014-01-06 05:24:04,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62251b63 >2014-01-06 05:24:04,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 62251b63 >2014-01-06 05:24:04,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5bf0b15 >2014-01-06 05:24:05,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82de5686}, log id: 5bf0b15 >2014-01-06 05:24:10,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 187d3fcb >2014-01-06 05:24:10,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 187d3fcb >2014-01-06 05:24:10,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5de19a47 >2014-01-06 05:24:10,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b837499}, log id: 5de19a47 >2014-01-06 05:24:15,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a1b71e6 >2014-01-06 05:24:15,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6a1b71e6 >2014-01-06 05:24:15,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59b48d03 >2014-01-06 05:24:16,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17f4fdd4}, log id: 59b48d03 >2014-01-06 05:24:21,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b91193c >2014-01-06 05:24:21,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b91193c >2014-01-06 05:24:21,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 330fc17e >2014-01-06 05:24:21,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8fad679}, log id: 330fc17e >2014-01-06 05:24:26,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1fcf48e4 >2014-01-06 05:24:26,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1fcf48e4 >2014-01-06 05:24:26,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 528dfe6b >2014-01-06 05:24:26,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d78403f}, log id: 528dfe6b >2014-01-06 05:24:31,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c39aa7d >2014-01-06 05:24:32,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48dd7920 >2014-01-06 05:24:32,054 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:24:32,055 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:24:32,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, log id: 6c39aa7d >2014-01-06 05:24:32,055 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-62) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:24:32,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 48dd7920 >2014-01-06 05:24:32,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d1d3372 >2014-01-06 05:24:32,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b31e7cc}, log id: 1d1d3372 >2014-01-06 05:24:37,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3769283e >2014-01-06 05:24:37,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3769283e >2014-01-06 05:24:37,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1cc4d6a8 >2014-01-06 05:24:37,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@933374ca}, log id: 1cc4d6a8 >2014-01-06 05:24:42,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c11be2b >2014-01-06 05:24:43,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2c11be2b >2014-01-06 05:24:43,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78a301d3 >2014-01-06 05:24:43,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4803e9}, log id: 78a301d3 >2014-01-06 05:24:48,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 43c259bc >2014-01-06 05:24:48,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 43c259bc >2014-01-06 05:24:48,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: aa17043 >2014-01-06 05:24:48,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@555e9624}, log id: aa17043 >2014-01-06 05:24:53,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33495437 >2014-01-06 05:24:54,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 33495437 >2014-01-06 05:24:54,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6415cb82 >2014-01-06 05:24:54,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94e9dc7d}, log id: 6415cb82 >2014-01-06 05:24:59,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 16df7c2e >2014-01-06 05:24:59,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 16df7c2e >2014-01-06 05:24:59,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 115038ab >2014-01-06 05:24:59,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66fdedd8}, log id: 115038ab >2014-01-06 05:25:04,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d550396 >2014-01-06 05:25:05,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5d550396 >2014-01-06 05:25:05,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43f50d83 >2014-01-06 05:25:05,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c3135ae}, log id: 43f50d83 >2014-01-06 05:25:10,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75470a6e >2014-01-06 05:25:10,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 75470a6e >2014-01-06 05:25:10,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 209e2dbf >2014-01-06 05:25:10,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef572b1a}, log id: 209e2dbf >2014-01-06 05:25:15,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37f6290 >2014-01-06 05:25:15,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 37f6290 >2014-01-06 05:25:15,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7280061b >2014-01-06 05:25:16,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f96aa25}, log id: 7280061b >2014-01-06 05:25:21,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ba21a90 >2014-01-06 05:25:21,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7ba21a90 >2014-01-06 05:25:21,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e69cb3c >2014-01-06 05:25:21,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b33fa12}, log id: 1e69cb3c >2014-01-06 05:25:26,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1fcdfca9 >2014-01-06 05:25:26,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1fcdfca9 >2014-01-06 05:25:26,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 596dda13 >2014-01-06 05:25:26,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@756830f4}, log id: 596dda13 >2014-01-06 05:25:31,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3359793a >2014-01-06 05:25:32,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26f55983 >2014-01-06 05:25:32,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3359793a >2014-01-06 05:25:32,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e87fd48 >2014-01-06 05:25:32,387 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:25:32,388 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:25:32,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, log id: 26f55983 >2014-01-06 05:25:32,388 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-7) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:25:32,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f3704ef}, log id: 6e87fd48 >2014-01-06 05:25:37,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d955924 >2014-01-06 05:25:37,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5d955924 >2014-01-06 05:25:37,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29d92333 >2014-01-06 05:25:37,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f242a70f}, log id: 29d92333 >2014-01-06 05:25:42,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43bf2b83 >2014-01-06 05:25:43,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43bf2b83 >2014-01-06 05:25:43,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 616cac11 >2014-01-06 05:25:43,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e6221c4}, log id: 616cac11 >2014-01-06 05:25:48,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2be8adc3 >2014-01-06 05:25:48,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2be8adc3 >2014-01-06 05:25:48,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7cacba6c >2014-01-06 05:25:48,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ab60356}, log id: 7cacba6c >2014-01-06 05:25:53,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 370ea55f >2014-01-06 05:25:54,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 370ea55f >2014-01-06 05:25:54,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55aa4251 >2014-01-06 05:25:54,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14edd771}, log id: 55aa4251 >2014-01-06 05:25:59,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e69e657 >2014-01-06 05:25:59,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e69e657 >2014-01-06 05:25:59,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 77a92a2 >2014-01-06 05:25:59,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf5ab5f9}, log id: 77a92a2 >2014-01-06 05:26:04,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29d69140 >2014-01-06 05:26:05,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29d69140 >2014-01-06 05:26:05,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63e9c79b >2014-01-06 05:26:05,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4ab4c92}, log id: 63e9c79b >2014-01-06 05:26:10,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ba17790 >2014-01-06 05:26:10,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ba17790 >2014-01-06 05:26:10,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 356bbc5a >2014-01-06 05:26:10,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a86f6996}, log id: 356bbc5a >2014-01-06 05:26:15,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e954e81 >2014-01-06 05:26:15,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7e954e81 >2014-01-06 05:26:15,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19bc8e5d >2014-01-06 05:26:16,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2796bb87}, log id: 19bc8e5d >2014-01-06 05:26:21,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e5015be >2014-01-06 05:26:21,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e5015be >2014-01-06 05:26:21,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 680f56ff >2014-01-06 05:26:21,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7c29d38}, log id: 680f56ff >2014-01-06 05:26:26,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2deb640f >2014-01-06 05:26:26,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2deb640f >2014-01-06 05:26:26,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f5f18be >2014-01-06 05:26:26,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9167fec7}, log id: 5f5f18be >2014-01-06 05:26:32,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e81e7be >2014-01-06 05:26:32,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3e81e7be >2014-01-06 05:26:32,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 69013ede >2014-01-06 05:26:32,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74b91658 >2014-01-06 05:26:32,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f7397da}, log id: 69013ede >2014-01-06 05:26:32,724 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:26:32,724 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:26:32,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, log id: 74b91658 >2014-01-06 05:26:32,725 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-86) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:26:37,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a354913 >2014-01-06 05:26:37,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5a354913 >2014-01-06 05:26:37,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31b48943 >2014-01-06 05:26:37,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e42731ed}, log id: 31b48943 >2014-01-06 05:26:42,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ce18d3a >2014-01-06 05:26:43,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4ce18d3a >2014-01-06 05:26:43,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d109750 >2014-01-06 05:26:43,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@227d5ad1}, log id: 5d109750 >2014-01-06 05:26:48,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39d04514 >2014-01-06 05:26:48,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 39d04514 >2014-01-06 05:26:48,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 530fb1d7 >2014-01-06 05:26:48,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aec763ac}, log id: 530fb1d7 >2014-01-06 05:26:53,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 724c9709 >2014-01-06 05:26:54,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 724c9709 >2014-01-06 05:26:54,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5bc0c435 >2014-01-06 05:26:54,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba601236}, log id: 5bc0c435 >2014-01-06 05:26:59,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63c1d8ef >2014-01-06 05:26:59,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 63c1d8ef >2014-01-06 05:26:59,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c8a6786 >2014-01-06 05:26:59,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd570d34}, log id: 2c8a6786 >2014-01-06 05:27:04,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78fe38bd >2014-01-06 05:27:05,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 78fe38bd >2014-01-06 05:27:05,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 575dd2c8 >2014-01-06 05:27:05,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edd7f8a2}, log id: 575dd2c8 >2014-01-06 05:27:10,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f63cb18 >2014-01-06 05:27:10,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5f63cb18 >2014-01-06 05:27:10,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5cb97819 >2014-01-06 05:27:10,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b80257e}, log id: 5cb97819 >2014-01-06 05:27:15,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 778f6d7a >2014-01-06 05:27:15,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 778f6d7a >2014-01-06 05:27:15,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7bc26142 >2014-01-06 05:27:16,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac90869a}, log id: 7bc26142 >2014-01-06 05:27:21,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: efaec4a >2014-01-06 05:27:21,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: efaec4a >2014-01-06 05:27:21,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4092b3ee >2014-01-06 05:27:21,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff63df6e}, log id: 4092b3ee >2014-01-06 05:27:26,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78faaa20 >2014-01-06 05:27:26,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 78faaa20 >2014-01-06 05:27:26,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 660565b4 >2014-01-06 05:27:27,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcaf3885}, log id: 660565b4 >2014-01-06 05:27:32,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46b191a1 >2014-01-06 05:27:32,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 46b191a1 >2014-01-06 05:27:32,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 387c90bd >2014-01-06 05:27:32,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61d96bda}, log id: 387c90bd >2014-01-06 05:27:32,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46c4c23 >2014-01-06 05:27:33,048 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:27:33,048 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:27:33,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterTasksListVDSCommand, log id: 46c4c23 >2014-01-06 05:27:33,048 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-66) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:27:37,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54707e95 >2014-01-06 05:27:37,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54707e95 >2014-01-06 05:27:37,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 51312f78 >2014-01-06 05:27:37,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43930644}, log id: 51312f78 >2014-01-06 05:27:42,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f20c867 >2014-01-06 05:27:43,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f20c867 >2014-01-06 05:27:43,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f06c0e1 >2014-01-06 05:27:43,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cd2c898}, log id: 1f06c0e1 >2014-01-06 05:27:48,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5acb8528 >2014-01-06 05:27:48,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5acb8528 >2014-01-06 05:27:48,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31a4312c >2014-01-06 05:27:48,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eca875cc}, log id: 31a4312c >2014-01-06 05:27:53,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5745803b >2014-01-06 05:27:54,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5745803b >2014-01-06 05:27:54,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68fa4999 >2014-01-06 05:27:54,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba43ae47}, log id: 68fa4999 >2014-01-06 05:27:59,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6593c060 >2014-01-06 05:27:59,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6593c060 >2014-01-06 05:27:59,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18e3e272 >2014-01-06 05:27:59,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cacc1e0}, log id: 18e3e272 >2014-01-06 05:28:04,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b28ff95 >2014-01-06 05:28:05,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b28ff95 >2014-01-06 05:28:05,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8359e55 >2014-01-06 05:28:05,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e48a0741}, log id: 8359e55 >2014-01-06 05:28:10,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b4fd567 >2014-01-06 05:28:10,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b4fd567 >2014-01-06 05:28:10,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47e7830b >2014-01-06 05:28:10,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dfc24d2}, log id: 47e7830b >2014-01-06 05:28:15,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71597dad >2014-01-06 05:28:15,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71597dad >2014-01-06 05:28:15,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 55a7f258 >2014-01-06 05:28:16,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7405b31e}, log id: 55a7f258 >2014-01-06 05:28:21,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5de6a941 >2014-01-06 05:28:21,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5de6a941 >2014-01-06 05:28:21,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 556eb098 >2014-01-06 05:28:21,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2278974}, log id: 556eb098 >2014-01-06 05:28:26,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c0f7c20 >2014-01-06 05:28:26,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4c0f7c20 >2014-01-06 05:28:26,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a30b16b >2014-01-06 05:28:27,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f40f88c6}, log id: 4a30b16b >2014-01-06 05:28:32,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24779528 >2014-01-06 05:28:32,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 24779528 >2014-01-06 05:28:32,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e026424 >2014-01-06 05:28:32,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68a46d70}, log id: 1e026424 >2014-01-06 05:28:33,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 32cd68c3 >2014-01-06 05:28:33,387 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:28:33,388 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:28:33,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, log id: 32cd68c3 >2014-01-06 05:28:33,388 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-87) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:28:37,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f407f61 >2014-01-06 05:28:37,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4f407f61 >2014-01-06 05:28:37,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 539b57e6 >2014-01-06 05:28:37,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dad11f30}, log id: 539b57e6 >2014-01-06 05:28:41,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f69bf46 >2014-01-06 05:28:41,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@40085daf, log id: 2f69bf46 >2014-01-06 05:28:42,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72f6f920 >2014-01-06 05:28:43,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 72f6f920 >2014-01-06 05:28:43,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64262897 >2014-01-06 05:28:43,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@383553e4}, log id: 64262897 >2014-01-06 05:28:48,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20fb2e8b >2014-01-06 05:28:48,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 20fb2e8b >2014-01-06 05:28:48,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 148f2c4f >2014-01-06 05:28:48,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@772c43a9}, log id: 148f2c4f >2014-01-06 05:28:53,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c26fce >2014-01-06 05:28:54,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1c26fce >2014-01-06 05:28:54,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a4af5bd >2014-01-06 05:28:54,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fd1cb87}, log id: 1a4af5bd >2014-01-06 05:28:59,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76650c5d >2014-01-06 05:28:59,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 76650c5d >2014-01-06 05:28:59,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45d3d2ea >2014-01-06 05:28:59,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cbc9730}, log id: 45d3d2ea >2014-01-06 05:29:04,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 284b7104 >2014-01-06 05:29:05,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 284b7104 >2014-01-06 05:29:05,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 459c3f1e >2014-01-06 05:29:05,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9641ede7}, log id: 459c3f1e >2014-01-06 05:29:10,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ef036e7 >2014-01-06 05:29:10,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7ef036e7 >2014-01-06 05:29:10,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f7f358a >2014-01-06 05:29:10,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22a4a7be}, log id: 1f7f358a >2014-01-06 05:29:15,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 530a9102 >2014-01-06 05:29:15,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 530a9102 >2014-01-06 05:29:15,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6df27f9a >2014-01-06 05:29:16,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b9390db}, log id: 6df27f9a >2014-01-06 05:29:21,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23235b1f >2014-01-06 05:29:21,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 23235b1f >2014-01-06 05:29:21,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8c2c985 >2014-01-06 05:29:21,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f6285fa}, log id: 8c2c985 >2014-01-06 05:29:26,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b0cce96 >2014-01-06 05:29:26,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: b0cce96 >2014-01-06 05:29:26,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23342a04 >2014-01-06 05:29:27,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9271f6f}, log id: 23342a04 >2014-01-06 05:29:32,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d922d68 >2014-01-06 05:29:32,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1d922d68 >2014-01-06 05:29:32,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f9428f5 >2014-01-06 05:29:32,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecc58f81}, log id: 3f9428f5 >2014-01-06 05:29:33,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4673e687 >2014-01-06 05:29:33,714 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:29:33,714 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:29:33,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, log id: 4673e687 >2014-01-06 05:29:33,714 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-9) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:29:37,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4480645d >2014-01-06 05:29:37,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4480645d >2014-01-06 05:29:37,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 67d821f3 >2014-01-06 05:29:37,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58f419ee}, log id: 67d821f3 >2014-01-06 05:29:42,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b9602e2 >2014-01-06 05:29:43,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b9602e2 >2014-01-06 05:29:43,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 626a64d >2014-01-06 05:29:43,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ee984b6}, log id: 626a64d >2014-01-06 05:29:48,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46ae27bc >2014-01-06 05:29:48,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 46ae27bc >2014-01-06 05:29:48,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6810907e >2014-01-06 05:29:48,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@168190d8}, log id: 6810907e >2014-01-06 05:29:53,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43fdbd32 >2014-01-06 05:29:54,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43fdbd32 >2014-01-06 05:29:54,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2dba8c3b >2014-01-06 05:29:54,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a10060e2}, log id: 2dba8c3b >2014-01-06 05:29:59,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 67d270d7 >2014-01-06 05:29:59,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 67d270d7 >2014-01-06 05:29:59,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f017e5e >2014-01-06 05:29:59,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc49af48}, log id: f017e5e >2014-01-06 05:30:04,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b3c21f8 >2014-01-06 05:30:05,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b3c21f8 >2014-01-06 05:30:05,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f69ade7 >2014-01-06 05:30:05,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e51e57d5}, log id: 5f69ade7 >2014-01-06 05:30:10,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b9a3890 >2014-01-06 05:30:10,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2b9a3890 >2014-01-06 05:30:10,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b4682f5 >2014-01-06 05:30:10,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22995e5a}, log id: 5b4682f5 >2014-01-06 05:30:15,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c65c00 >2014-01-06 05:30:15,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1c65c00 >2014-01-06 05:30:16,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34171baf >2014-01-06 05:30:16,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8146380c}, log id: 34171baf >2014-01-06 05:30:21,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: df801aa >2014-01-06 05:30:21,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: df801aa >2014-01-06 05:30:21,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37959fe8 >2014-01-06 05:30:21,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31a30623}, log id: 37959fe8 >2014-01-06 05:30:26,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 980d7cd >2014-01-06 05:30:26,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 980d7cd >2014-01-06 05:30:26,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a18366d >2014-01-06 05:30:27,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46d1411}, log id: 4a18366d >2014-01-06 05:30:32,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39baa7b8 >2014-01-06 05:30:32,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 39baa7b8 >2014-01-06 05:30:32,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7798d35c >2014-01-06 05:30:32,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f2d56c5}, log id: 7798d35c >2014-01-06 05:30:33,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 61a83a2f >2014-01-06 05:30:34,038 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:30:34,039 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:30:34,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, log id: 61a83a2f >2014-01-06 05:30:34,039 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-58) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:30:37,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3734f769 >2014-01-06 05:30:37,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3734f769 >2014-01-06 05:30:37,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70aa0a50 >2014-01-06 05:30:37,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68cc09cd}, log id: 70aa0a50 >2014-01-06 05:30:42,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3213a012 >2014-01-06 05:30:43,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3213a012 >2014-01-06 05:30:43,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 281a0ad >2014-01-06 05:30:43,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee303723}, log id: 281a0ad >2014-01-06 05:30:48,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 408303d2 >2014-01-06 05:30:48,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 408303d2 >2014-01-06 05:30:48,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ad0428c >2014-01-06 05:30:48,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f07e0f}, log id: ad0428c >2014-01-06 05:30:53,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c4f0a9c >2014-01-06 05:30:54,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5c4f0a9c >2014-01-06 05:30:54,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7164d372 >2014-01-06 05:30:54,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adbe4eb5}, log id: 7164d372 >2014-01-06 05:30:59,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a00b28a >2014-01-06 05:30:59,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6a00b28a >2014-01-06 05:30:59,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f578300 >2014-01-06 05:30:59,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d19c0}, log id: 7f578300 >2014-01-06 05:31:04,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78ca1be2 >2014-01-06 05:31:05,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 78ca1be2 >2014-01-06 05:31:05,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58e897e9 >2014-01-06 05:31:05,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a61e799c}, log id: 58e897e9 >2014-01-06 05:31:10,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3bd8c522 >2014-01-06 05:31:10,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3bd8c522 >2014-01-06 05:31:10,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 694a0592 >2014-01-06 05:31:10,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bac6fb2}, log id: 694a0592 >2014-01-06 05:31:15,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a8d52be >2014-01-06 05:31:15,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4a8d52be >2014-01-06 05:31:15,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b33c5a6 >2014-01-06 05:31:16,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5a34d04}, log id: 3b33c5a6 >2014-01-06 05:31:21,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c8c9c86 >2014-01-06 05:31:21,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4c8c9c86 >2014-01-06 05:31:21,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 520f3518 >2014-01-06 05:31:21,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f239301f}, log id: 520f3518 >2014-01-06 05:31:26,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74f60cdb >2014-01-06 05:31:26,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 74f60cdb >2014-01-06 05:31:26,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4baed40e >2014-01-06 05:31:27,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9adcd4fd}, log id: 4baed40e >2014-01-06 05:31:32,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 426c2e14 >2014-01-06 05:31:32,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 426c2e14 >2014-01-06 05:31:32,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a27dbb1 >2014-01-06 05:31:32,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ff3e934}, log id: 3a27dbb1 >2014-01-06 05:31:34,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 664338ff >2014-01-06 05:31:34,359 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:31:34,359 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:31:34,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, log id: 664338ff >2014-01-06 05:31:34,360 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-79) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:31:37,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 475a3c7d >2014-01-06 05:31:37,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 475a3c7d >2014-01-06 05:31:37,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f586d5d >2014-01-06 05:31:37,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c9b8001}, log id: 4f586d5d >2014-01-06 05:31:42,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48ca5ef2 >2014-01-06 05:31:43,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 48ca5ef2 >2014-01-06 05:31:43,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 236bc0cb >2014-01-06 05:31:43,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fe365a}, log id: 236bc0cb >2014-01-06 05:31:48,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 467e4e6e >2014-01-06 05:31:48,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 467e4e6e >2014-01-06 05:31:48,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33207b17 >2014-01-06 05:31:48,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@213ddb86}, log id: 33207b17 >2014-01-06 05:31:53,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ac4d2b6 >2014-01-06 05:31:54,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5ac4d2b6 >2014-01-06 05:31:54,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 528551d2 >2014-01-06 05:31:54,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9298923d}, log id: 528551d2 >2014-01-06 05:31:59,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cbfef90 >2014-01-06 05:31:59,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6cbfef90 >2014-01-06 05:31:59,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 376bf6d3 >2014-01-06 05:31:59,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4132d0}, log id: 376bf6d3 >2014-01-06 05:32:04,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4563ddde >2014-01-06 05:32:05,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4563ddde >2014-01-06 05:32:05,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 394f654 >2014-01-06 05:32:05,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2b5f70f}, log id: 394f654 >2014-01-06 05:32:10,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 69393d1 >2014-01-06 05:32:10,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 69393d1 >2014-01-06 05:32:10,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27bc5a97 >2014-01-06 05:32:10,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6d52897}, log id: 27bc5a97 >2014-01-06 05:32:15,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2fdcf7a3 >2014-01-06 05:32:16,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2fdcf7a3 >2014-01-06 05:32:16,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f7dcaf9 >2014-01-06 05:32:16,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b30dfaec}, log id: 6f7dcaf9 >2014-01-06 05:32:21,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a674519 >2014-01-06 05:32:21,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4a674519 >2014-01-06 05:32:21,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d916c5d >2014-01-06 05:32:21,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6f182c5}, log id: 4d916c5d >2014-01-06 05:32:26,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 75c3e11 >2014-01-06 05:32:26,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 75c3e11 >2014-01-06 05:32:26,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 407f5603 >2014-01-06 05:32:27,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@750b4a88}, log id: 407f5603 >2014-01-06 05:32:32,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5fad5761 >2014-01-06 05:32:32,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5fad5761 >2014-01-06 05:32:32,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67128cb8 >2014-01-06 05:32:32,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a55026e}, log id: 67128cb8 >2014-01-06 05:32:34,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d09959b >2014-01-06 05:32:34,681 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:32:34,682 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:32:34,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, log id: 6d09959b >2014-01-06 05:32:34,682 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-47) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:32:37,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 213e6a08 >2014-01-06 05:32:37,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 213e6a08 >2014-01-06 05:32:37,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3da0a411 >2014-01-06 05:32:37,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1ce8065}, log id: 3da0a411 >2014-01-06 05:32:43,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d639689 >2014-01-06 05:32:43,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4d639689 >2014-01-06 05:32:43,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c682b5b >2014-01-06 05:32:43,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46ec65ac}, log id: 3c682b5b >2014-01-06 05:32:48,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74364ee5 >2014-01-06 05:32:48,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 74364ee5 >2014-01-06 05:32:48,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 61d84e26 >2014-01-06 05:32:48,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89a2e779}, log id: 61d84e26 >2014-01-06 05:32:53,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a6c00c6 >2014-01-06 05:32:54,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5a6c00c6 >2014-01-06 05:32:54,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f549ce2 >2014-01-06 05:32:54,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@382020d9}, log id: 5f549ce2 >2014-01-06 05:32:59,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f0699cc >2014-01-06 05:32:59,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3f0699cc >2014-01-06 05:32:59,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24fc57eb >2014-01-06 05:32:59,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3fd98f2}, log id: 24fc57eb >2014-01-06 05:33:04,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 51f9fcbe >2014-01-06 05:33:05,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 51f9fcbe >2014-01-06 05:33:05,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 26333a97 >2014-01-06 05:33:05,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34d5f565}, log id: 26333a97 >2014-01-06 05:33:10,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 452e19a >2014-01-06 05:33:10,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 452e19a >2014-01-06 05:33:10,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3327bfb3 >2014-01-06 05:33:10,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef616147}, log id: 3327bfb3 >2014-01-06 05:33:15,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2806ca54 >2014-01-06 05:33:16,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2806ca54 >2014-01-06 05:33:16,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 51560044 >2014-01-06 05:33:16,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47d0f750}, log id: 51560044 >2014-01-06 05:33:21,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 247d945d >2014-01-06 05:33:21,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 247d945d >2014-01-06 05:33:21,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76ca3214 >2014-01-06 05:33:21,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf0a3ac9}, log id: 76ca3214 >2014-01-06 05:33:26,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6bfa4114 >2014-01-06 05:33:26,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6bfa4114 >2014-01-06 05:33:26,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4506e7c9 >2014-01-06 05:33:27,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36a81c62}, log id: 4506e7c9 >2014-01-06 05:33:32,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a745eb0 >2014-01-06 05:33:32,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1a745eb0 >2014-01-06 05:33:32,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5dcd3fa8 >2014-01-06 05:33:32,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1ee5409}, log id: 5dcd3fa8 >2014-01-06 05:33:34,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31c4585e >2014-01-06 05:33:35,010 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:33:35,010 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:33:35,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterTasksListVDSCommand, log id: 31c4585e >2014-01-06 05:33:35,010 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-4) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:33:37,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a9c3092 >2014-01-06 05:33:37,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7a9c3092 >2014-01-06 05:33:37,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fdf354f >2014-01-06 05:33:38,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e886b6}, log id: 3fdf354f >2014-01-06 05:33:42,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57ca24bb >2014-01-06 05:33:42,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@12f035ac, log id: 57ca24bb >2014-01-06 05:33:43,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75cc99b8 >2014-01-06 05:33:43,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 75cc99b8 >2014-01-06 05:33:43,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47779254 >2014-01-06 05:33:43,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6e0f806}, log id: 47779254 >2014-01-06 05:33:48,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79443fff >2014-01-06 05:33:48,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 79443fff >2014-01-06 05:33:48,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 583a9f9c >2014-01-06 05:33:48,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6107452f}, log id: 583a9f9c >2014-01-06 05:33:53,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25d5d265 >2014-01-06 05:33:54,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25d5d265 >2014-01-06 05:33:54,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17ab2136 >2014-01-06 05:33:54,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f5490da}, log id: 17ab2136 >2014-01-06 05:33:59,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 689b0031 >2014-01-06 05:33:59,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 689b0031 >2014-01-06 05:33:59,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c699697 >2014-01-06 05:33:59,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f5c0dc4}, log id: c699697 >2014-01-06 05:34:04,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a86bd73 >2014-01-06 05:34:05,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7a86bd73 >2014-01-06 05:34:05,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5995d4e6 >2014-01-06 05:34:05,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60e1696e}, log id: 5995d4e6 >2014-01-06 05:34:10,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67e85c08 >2014-01-06 05:34:10,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 67e85c08 >2014-01-06 05:34:10,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ea75838 >2014-01-06 05:34:10,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95cf38}, log id: 6ea75838 >2014-01-06 05:34:15,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57bebe95 >2014-01-06 05:34:16,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 57bebe95 >2014-01-06 05:34:16,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: bd16b57 >2014-01-06 05:34:16,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62bc7b7c}, log id: bd16b57 >2014-01-06 05:34:21,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20f3ca2c >2014-01-06 05:34:21,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 20f3ca2c >2014-01-06 05:34:21,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c9a4a5f >2014-01-06 05:34:21,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d59e4b4f}, log id: 5c9a4a5f >2014-01-06 05:34:26,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f0a5f58 >2014-01-06 05:34:27,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f0a5f58 >2014-01-06 05:34:27,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a4d6bb5 >2014-01-06 05:34:27,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c7135b6}, log id: 6a4d6bb5 >2014-01-06 05:34:32,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 458371f4 >2014-01-06 05:34:32,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 458371f4 >2014-01-06 05:34:32,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 615e346c >2014-01-06 05:34:32,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec7a86f6}, log id: 615e346c >2014-01-06 05:34:35,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f195ebf >2014-01-06 05:34:35,339 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:34:35,339 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:34:35,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, log id: 3f195ebf >2014-01-06 05:34:35,339 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-93) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:34:37,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26aea9cf >2014-01-06 05:34:37,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 26aea9cf >2014-01-06 05:34:37,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3a87471c >2014-01-06 05:34:38,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49d45f29}, log id: 3a87471c >2014-01-06 05:34:43,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c5bbe31 >2014-01-06 05:34:43,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5c5bbe31 >2014-01-06 05:34:43,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b489c35 >2014-01-06 05:34:43,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b4096ad}, log id: 2b489c35 >2014-01-06 05:34:48,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6479503c >2014-01-06 05:34:48,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6479503c >2014-01-06 05:34:48,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 614ab512 >2014-01-06 05:34:48,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10f6213b}, log id: 614ab512 >2014-01-06 05:34:54,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e486d11 >2014-01-06 05:34:54,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6e486d11 >2014-01-06 05:34:54,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a75b803 >2014-01-06 05:34:54,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69c1b3bc}, log id: 7a75b803 >2014-01-06 05:34:59,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4173cb6b >2014-01-06 05:34:59,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4173cb6b >2014-01-06 05:34:59,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 49bb60dc >2014-01-06 05:34:59,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f02ea16}, log id: 49bb60dc >2014-01-06 05:35:04,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 15ae9ff1 >2014-01-06 05:35:05,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 15ae9ff1 >2014-01-06 05:35:05,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51ae00a6 >2014-01-06 05:35:05,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b4d652d}, log id: 51ae00a6 >2014-01-06 05:35:10,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6255e5fd >2014-01-06 05:35:10,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6255e5fd >2014-01-06 05:35:10,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 386bfe47 >2014-01-06 05:35:10,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@804b956a}, log id: 386bfe47 >2014-01-06 05:35:15,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b26828a >2014-01-06 05:35:16,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b26828a >2014-01-06 05:35:16,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 38be37c1 >2014-01-06 05:35:16,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e774f133}, log id: 38be37c1 >2014-01-06 05:35:21,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e4746f7 >2014-01-06 05:35:21,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2e4746f7 >2014-01-06 05:35:21,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 221c402a >2014-01-06 05:35:21,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5ab6503}, log id: 221c402a >2014-01-06 05:35:26,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f2f0bc1 >2014-01-06 05:35:27,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f2f0bc1 >2014-01-06 05:35:27,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a2abec4 >2014-01-06 05:35:27,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93bdbf74}, log id: 1a2abec4 >2014-01-06 05:35:32,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 580102a2 >2014-01-06 05:35:32,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 580102a2 >2014-01-06 05:35:32,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c62076d >2014-01-06 05:35:32,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e5121f9}, log id: 4c62076d >2014-01-06 05:35:35,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23f69adc >2014-01-06 05:35:35,668 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:35:35,669 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:35:35,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, log id: 23f69adc >2014-01-06 05:35:35,669 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-99) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:35:37,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64a2a505 >2014-01-06 05:35:37,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 64a2a505 >2014-01-06 05:35:37,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37c3dfb1 >2014-01-06 05:35:38,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@609fb669}, log id: 37c3dfb1 >2014-01-06 05:35:43,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66859040 >2014-01-06 05:35:43,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66859040 >2014-01-06 05:35:43,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f01562a >2014-01-06 05:35:43,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1346a345}, log id: 6f01562a >2014-01-06 05:35:48,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c551001 >2014-01-06 05:35:48,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1c551001 >2014-01-06 05:35:48,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b8cddb5 >2014-01-06 05:35:49,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0f1d655}, log id: 4b8cddb5 >2014-01-06 05:35:54,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2bfd8ad >2014-01-06 05:35:54,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2bfd8ad >2014-01-06 05:35:54,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f7cc15f >2014-01-06 05:35:54,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e12ed193}, log id: f7cc15f >2014-01-06 05:35:59,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3dfe37b6 >2014-01-06 05:35:59,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3dfe37b6 >2014-01-06 05:35:59,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22df6156 >2014-01-06 05:35:59,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f68d4cf}, log id: 22df6156 >2014-01-06 05:36:04,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 572fddf2 >2014-01-06 05:36:05,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 572fddf2 >2014-01-06 05:36:05,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7763c263 >2014-01-06 05:36:05,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@534af09b}, log id: 7763c263 >2014-01-06 05:36:10,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2128712d >2014-01-06 05:36:10,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2128712d >2014-01-06 05:36:10,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25c0d4af >2014-01-06 05:36:10,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e21aa588}, log id: 25c0d4af >2014-01-06 05:36:15,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3039611b >2014-01-06 05:36:16,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3039611b >2014-01-06 05:36:16,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b2fad7c >2014-01-06 05:36:16,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75ffaf42}, log id: 5b2fad7c >2014-01-06 05:36:21,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f52b4a6 >2014-01-06 05:36:21,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5f52b4a6 >2014-01-06 05:36:21,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19fd5d61 >2014-01-06 05:36:21,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f1e6ea9}, log id: 19fd5d61 >2014-01-06 05:36:26,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5d2417df >2014-01-06 05:36:27,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5d2417df >2014-01-06 05:36:27,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f2591a4 >2014-01-06 05:36:27,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b90ad4b3}, log id: 5f2591a4 >2014-01-06 05:36:32,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71ffbcc6 >2014-01-06 05:36:32,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71ffbcc6 >2014-01-06 05:36:32,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4cf4b184 >2014-01-06 05:36:32,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37a01496}, log id: 4cf4b184 >2014-01-06 05:36:35,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7bfaa323 >2014-01-06 05:36:35,997 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:36:35,997 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:36:35,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, log id: 7bfaa323 >2014-01-06 05:36:35,997 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-31) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:36:37,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43794b71 >2014-01-06 05:36:37,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43794b71 >2014-01-06 05:36:37,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b1eaecd >2014-01-06 05:36:38,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12f5d293}, log id: 4b1eaecd >2014-01-06 05:36:43,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48f828e6 >2014-01-06 05:36:43,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 48f828e6 >2014-01-06 05:36:43,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ef0d17a >2014-01-06 05:36:43,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be5188a5}, log id: ef0d17a >2014-01-06 05:36:48,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f2c80a9 >2014-01-06 05:36:48,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3f2c80a9 >2014-01-06 05:36:48,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1dfa9c17 >2014-01-06 05:36:49,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8345bab2}, log id: 1dfa9c17 >2014-01-06 05:36:54,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62a9dc1f >2014-01-06 05:36:54,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 62a9dc1f >2014-01-06 05:36:54,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d9c08eb >2014-01-06 05:36:54,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf2dcd90}, log id: 1d9c08eb >2014-01-06 05:36:59,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e69f403 >2014-01-06 05:36:59,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e69f403 >2014-01-06 05:36:59,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 688f1a3e >2014-01-06 05:36:59,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96e87db5}, log id: 688f1a3e >2014-01-06 05:37:05,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52b0d021 >2014-01-06 05:37:05,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 52b0d021 >2014-01-06 05:37:05,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1bdd74be >2014-01-06 05:37:05,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c727eb8}, log id: 1bdd74be >2014-01-06 05:37:10,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10b104ed >2014-01-06 05:37:10,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 10b104ed >2014-01-06 05:37:10,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2750aee9 >2014-01-06 05:37:10,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f286fe9d}, log id: 2750aee9 >2014-01-06 05:37:15,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 262d3f73 >2014-01-06 05:37:16,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 262d3f73 >2014-01-06 05:37:16,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 44efe6a1 >2014-01-06 05:37:16,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90a55220}, log id: 44efe6a1 >2014-01-06 05:37:21,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f4f3bdb >2014-01-06 05:37:21,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2f4f3bdb >2014-01-06 05:37:21,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 633a535c >2014-01-06 05:37:21,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ed4fe11}, log id: 633a535c >2014-01-06 05:37:26,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a676856 >2014-01-06 05:37:27,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1a676856 >2014-01-06 05:37:27,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5cd43a66 >2014-01-06 05:37:27,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63e472cb}, log id: 5cd43a66 >2014-01-06 05:37:32,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78e6ef98 >2014-01-06 05:37:32,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 78e6ef98 >2014-01-06 05:37:32,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71deccce >2014-01-06 05:37:32,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9292dbc}, log id: 71deccce >2014-01-06 05:37:36,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 659928c >2014-01-06 05:37:36,381 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:37:36,381 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:37:36,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, log id: 659928c >2014-01-06 05:37:36,382 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-41) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:37:37,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f3c5b0 >2014-01-06 05:37:38,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5f3c5b0 >2014-01-06 05:37:38,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2213cc3a >2014-01-06 05:37:38,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53d14fdd}, log id: 2213cc3a >2014-01-06 05:37:43,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c93f96e >2014-01-06 05:37:43,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: c93f96e >2014-01-06 05:37:43,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10a16dfe >2014-01-06 05:37:43,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53712fa5}, log id: 10a16dfe >2014-01-06 05:37:48,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 663974f5 >2014-01-06 05:37:48,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 663974f5 >2014-01-06 05:37:48,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35981966 >2014-01-06 05:37:49,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1044e439}, log id: 35981966 >2014-01-06 05:37:54,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 44bf2685 >2014-01-06 05:37:54,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 44bf2685 >2014-01-06 05:37:54,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3de5ce0c >2014-01-06 05:37:54,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25727010}, log id: 3de5ce0c >2014-01-06 05:37:59,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a304f2b >2014-01-06 05:37:59,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4a304f2b >2014-01-06 05:37:59,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ba875ed >2014-01-06 05:37:59,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@366b7398}, log id: ba875ed >2014-01-06 05:38:05,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 45cc6483 >2014-01-06 05:38:05,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 45cc6483 >2014-01-06 05:38:05,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f31e27d >2014-01-06 05:38:05,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@732fab33}, log id: 4f31e27d >2014-01-06 05:38:10,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6964bc1a >2014-01-06 05:38:10,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6964bc1a >2014-01-06 05:38:10,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f67af4e >2014-01-06 05:38:10,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f452bd24}, log id: 3f67af4e >2014-01-06 05:38:15,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59be2ede >2014-01-06 05:38:16,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 59be2ede >2014-01-06 05:38:16,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e797909 >2014-01-06 05:38:16,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c3f0953}, log id: 6e797909 >2014-01-06 05:38:21,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 136bbca9 >2014-01-06 05:38:21,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 136bbca9 >2014-01-06 05:38:21,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6bb3a4e2 >2014-01-06 05:38:21,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49c5cb74}, log id: 6bb3a4e2 >2014-01-06 05:38:26,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16f19617 >2014-01-06 05:38:27,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 16f19617 >2014-01-06 05:38:27,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a3080c2 >2014-01-06 05:38:27,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@617905e0}, log id: 1a3080c2 >2014-01-06 05:38:32,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58ad4cba >2014-01-06 05:38:32,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 58ad4cba >2014-01-06 05:38:32,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28791b2c >2014-01-06 05:38:32,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bca59737}, log id: 28791b2c >2014-01-06 05:38:36,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e431615 >2014-01-06 05:38:36,711 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:38:36,711 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:38:36,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, log id: 4e431615 >2014-01-06 05:38:36,711 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-84) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:38:37,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f773a04 >2014-01-06 05:38:38,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2f773a04 >2014-01-06 05:38:38,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56b22d7e >2014-01-06 05:38:38,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@627dfbf6}, log id: 56b22d7e >2014-01-06 05:38:42,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10997d82 >2014-01-06 05:38:42,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3cb9d618, log id: 10997d82 >2014-01-06 05:38:43,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a4c2b65 >2014-01-06 05:38:43,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1a4c2b65 >2014-01-06 05:38:43,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71df2432 >2014-01-06 05:38:43,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4031ee6}, log id: 71df2432 >2014-01-06 05:38:48,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 288f4fe7 >2014-01-06 05:38:48,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 288f4fe7 >2014-01-06 05:38:48,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 109d1c80 >2014-01-06 05:38:49,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c47e9f47}, log id: 109d1c80 >2014-01-06 05:38:54,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20de7632 >2014-01-06 05:38:54,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 20de7632 >2014-01-06 05:38:54,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 731e0990 >2014-01-06 05:38:54,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ea9fffd}, log id: 731e0990 >2014-01-06 05:38:59,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64ecdee8 >2014-01-06 05:38:59,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 64ecdee8 >2014-01-06 05:38:59,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23f2f274 >2014-01-06 05:39:00,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c95dd1c}, log id: 23f2f274 >2014-01-06 05:39:05,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 616d31ff >2014-01-06 05:39:05,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 616d31ff >2014-01-06 05:39:05,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e0c615c >2014-01-06 05:39:05,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59852945}, log id: 6e0c615c >2014-01-06 05:39:10,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37c870dc >2014-01-06 05:39:10,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 37c870dc >2014-01-06 05:39:10,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e2135c9 >2014-01-06 05:39:10,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa2c27b1}, log id: 2e2135c9 >2014-01-06 05:39:15,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5fd1186a >2014-01-06 05:39:16,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5fd1186a >2014-01-06 05:39:16,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59bd2bb4 >2014-01-06 05:39:16,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e7834df}, log id: 59bd2bb4 >2014-01-06 05:39:21,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59b5db95 >2014-01-06 05:39:21,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 59b5db95 >2014-01-06 05:39:21,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 440954e0 >2014-01-06 05:39:21,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5e1aeb8}, log id: 440954e0 >2014-01-06 05:39:26,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71247eb0 >2014-01-06 05:39:27,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 71247eb0 >2014-01-06 05:39:27,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c75c347 >2014-01-06 05:39:27,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5e672b1}, log id: 7c75c347 >2014-01-06 05:39:32,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59cacdf3 >2014-01-06 05:39:32,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 59cacdf3 >2014-01-06 05:39:32,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65d1586b >2014-01-06 05:39:32,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f66a6800}, log id: 65d1586b >2014-01-06 05:39:36,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e923b9e >2014-01-06 05:39:37,036 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:39:37,037 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:39:37,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, log id: 3e923b9e >2014-01-06 05:39:37,037 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-68) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:39:37,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ef9c1c4 >2014-01-06 05:39:38,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1ef9c1c4 >2014-01-06 05:39:38,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1161c5b9 >2014-01-06 05:39:38,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d84645a}, log id: 1161c5b9 >2014-01-06 05:39:43,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c2634e3 >2014-01-06 05:39:43,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3c2634e3 >2014-01-06 05:39:43,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c68f7e4 >2014-01-06 05:39:43,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b624c4b}, log id: 6c68f7e4 >2014-01-06 05:39:48,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 158c55aa >2014-01-06 05:39:48,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 158c55aa >2014-01-06 05:39:48,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b6eaefe >2014-01-06 05:39:49,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32d9b2af}, log id: 3b6eaefe >2014-01-06 05:39:54,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: a352a8 >2014-01-06 05:39:54,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: a352a8 >2014-01-06 05:39:54,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4aa324a7 >2014-01-06 05:39:54,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78d98560}, log id: 4aa324a7 >2014-01-06 05:39:59,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 370c9571 >2014-01-06 05:39:59,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 370c9571 >2014-01-06 05:39:59,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37f6f3e5 >2014-01-06 05:40:00,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47ec8877}, log id: 37f6f3e5 >2014-01-06 05:40:05,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2d8ed82b >2014-01-06 05:40:05,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2d8ed82b >2014-01-06 05:40:05,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: cac28a3 >2014-01-06 05:40:05,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bebe4054}, log id: cac28a3 >2014-01-06 05:40:10,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14d687c3 >2014-01-06 05:40:10,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 14d687c3 >2014-01-06 05:40:10,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 500c076f >2014-01-06 05:40:10,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b519fdf}, log id: 500c076f >2014-01-06 05:40:15,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c492c9b >2014-01-06 05:40:16,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2c492c9b >2014-01-06 05:40:16,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40659d55 >2014-01-06 05:40:16,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bdfbcd1}, log id: 40659d55 >2014-01-06 05:40:21,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72922b35 >2014-01-06 05:40:21,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 72922b35 >2014-01-06 05:40:21,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b07d0ff >2014-01-06 05:40:21,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32a7d2cc}, log id: 3b07d0ff >2014-01-06 05:40:26,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 200e8f99 >2014-01-06 05:40:27,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 200e8f99 >2014-01-06 05:40:27,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 199a3241 >2014-01-06 05:40:27,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d92dabc6}, log id: 199a3241 >2014-01-06 05:40:32,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 11536b64 >2014-01-06 05:40:32,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 11536b64 >2014-01-06 05:40:32,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19b74e3b >2014-01-06 05:40:32,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f58b1b1e}, log id: 19b74e3b >2014-01-06 05:40:37,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 73109269 >2014-01-06 05:40:37,363 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:40:37,363 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:40:37,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, log id: 73109269 >2014-01-06 05:40:37,363 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-15) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:40:37,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e674aa >2014-01-06 05:40:38,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e674aa >2014-01-06 05:40:38,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22e326e5 >2014-01-06 05:40:38,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@669bdcc6}, log id: 22e326e5 >2014-01-06 05:40:43,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71169265 >2014-01-06 05:40:43,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71169265 >2014-01-06 05:40:43,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2771d025 >2014-01-06 05:40:43,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93329925}, log id: 2771d025 >2014-01-06 05:40:48,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f344632 >2014-01-06 05:40:48,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4f344632 >2014-01-06 05:40:48,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7380c8ee >2014-01-06 05:40:49,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bb5f650}, log id: 7380c8ee >2014-01-06 05:40:54,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12519076 >2014-01-06 05:40:54,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 12519076 >2014-01-06 05:40:54,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f8198ea >2014-01-06 05:40:54,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5a3a1f4}, log id: 3f8198ea >2014-01-06 05:40:59,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f7cfa58 >2014-01-06 05:40:59,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6f7cfa58 >2014-01-06 05:40:59,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2d15b916 >2014-01-06 05:41:00,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a16c5bd2}, log id: 2d15b916 >2014-01-06 05:41:05,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60565634 >2014-01-06 05:41:05,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 60565634 >2014-01-06 05:41:05,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13c73f0d >2014-01-06 05:41:05,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcfbb71d}, log id: 13c73f0d >2014-01-06 05:41:10,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2605911f >2014-01-06 05:41:10,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2605911f >2014-01-06 05:41:10,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d652370 >2014-01-06 05:41:10,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6aafd77}, log id: 1d652370 >2014-01-06 05:41:15,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5018c2c5 >2014-01-06 05:41:16,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5018c2c5 >2014-01-06 05:41:16,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e8f50bf >2014-01-06 05:41:16,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bac60f75}, log id: 1e8f50bf >2014-01-06 05:41:21,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c7d0697 >2014-01-06 05:41:21,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3c7d0697 >2014-01-06 05:41:21,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 571b50b2 >2014-01-06 05:41:21,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86f86064}, log id: 571b50b2 >2014-01-06 05:41:26,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b632d80 >2014-01-06 05:41:27,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3b632d80 >2014-01-06 05:41:27,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 470cfcde >2014-01-06 05:41:27,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@352bb373}, log id: 470cfcde >2014-01-06 05:41:32,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39571a07 >2014-01-06 05:41:32,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 39571a07 >2014-01-06 05:41:32,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 49c8fdc9 >2014-01-06 05:41:32,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93dec191}, log id: 49c8fdc9 >2014-01-06 05:41:37,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 275812c6 >2014-01-06 05:41:37,700 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:41:37,700 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:41:37,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, log id: 275812c6 >2014-01-06 05:41:37,701 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-50) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:41:37,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 241bbb85 >2014-01-06 05:41:38,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 241bbb85 >2014-01-06 05:41:38,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78d44fea >2014-01-06 05:41:38,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c58a8026}, log id: 78d44fea >2014-01-06 05:41:43,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 122e2ca9 >2014-01-06 05:41:43,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 122e2ca9 >2014-01-06 05:41:43,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cd84c1f >2014-01-06 05:41:43,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23d338cc}, log id: 6cd84c1f >2014-01-06 05:41:48,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ac7006f >2014-01-06 05:41:49,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6ac7006f >2014-01-06 05:41:49,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 32090aa >2014-01-06 05:41:49,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4c36cbb}, log id: 32090aa >2014-01-06 05:41:54,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 601c34b3 >2014-01-06 05:41:54,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 601c34b3 >2014-01-06 05:41:54,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ad00634 >2014-01-06 05:41:54,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63173f6e}, log id: 2ad00634 >2014-01-06 05:41:59,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54a1eee5 >2014-01-06 05:41:59,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 54a1eee5 >2014-01-06 05:41:59,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2407ec18 >2014-01-06 05:42:00,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59c1f5ea}, log id: 2407ec18 >2014-01-06 05:42:05,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77a8c808 >2014-01-06 05:42:05,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 77a8c808 >2014-01-06 05:42:05,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 789362e9 >2014-01-06 05:42:05,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e6fbe3d}, log id: 789362e9 >2014-01-06 05:42:10,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 186ff0a5 >2014-01-06 05:42:10,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 186ff0a5 >2014-01-06 05:42:10,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: cf95799 >2014-01-06 05:42:11,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d50709f9}, log id: cf95799 >2014-01-06 05:42:16,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 32889ff0 >2014-01-06 05:42:16,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 32889ff0 >2014-01-06 05:42:16,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b8f4d02 >2014-01-06 05:42:16,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efd03a26}, log id: 2b8f4d02 >2014-01-06 05:42:21,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 555efb85 >2014-01-06 05:42:21,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 555efb85 >2014-01-06 05:42:21,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c49e07c >2014-01-06 05:42:21,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d22b7c3}, log id: 1c49e07c >2014-01-06 05:42:26,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3915a84b >2014-01-06 05:42:27,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3915a84b >2014-01-06 05:42:27,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b148e95 >2014-01-06 05:42:27,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3620c63c}, log id: 4b148e95 >2014-01-06 05:42:32,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c25da9e >2014-01-06 05:42:32,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4c25da9e >2014-01-06 05:42:32,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4531fdd4 >2014-01-06 05:42:32,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd30019e}, log id: 4531fdd4 >2014-01-06 05:42:37,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 622ac530 >2014-01-06 05:42:37,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54402d9 >2014-01-06 05:42:38,037 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:42:38,037 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:42:38,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterTasksListVDSCommand, log id: 622ac530 >2014-01-06 05:42:38,037 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-83) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:42:38,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54402d9 >2014-01-06 05:42:38,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c70393b >2014-01-06 05:42:38,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89515460}, log id: 5c70393b >2014-01-06 05:42:43,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f2d441b >2014-01-06 05:42:43,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2f2d441b >2014-01-06 05:42:43,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2cc0502 >2014-01-06 05:42:43,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f89d9d3b}, log id: 2cc0502 >2014-01-06 05:42:48,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5134953c >2014-01-06 05:42:49,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5134953c >2014-01-06 05:42:49,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31b4ff0a >2014-01-06 05:42:49,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb9ea90f}, log id: 31b4ff0a >2014-01-06 05:42:54,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36dc9ed8 >2014-01-06 05:42:54,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 36dc9ed8 >2014-01-06 05:42:54,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2deac496 >2014-01-06 05:42:54,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de197ef2}, log id: 2deac496 >2014-01-06 05:42:59,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e975f0b >2014-01-06 05:42:59,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4e975f0b >2014-01-06 05:42:59,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a853141 >2014-01-06 05:43:00,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e25b0cd7}, log id: 4a853141 >2014-01-06 05:43:05,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 113064c0 >2014-01-06 05:43:05,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 113064c0 >2014-01-06 05:43:05,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 483251ff >2014-01-06 05:43:05,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f71407ed}, log id: 483251ff >2014-01-06 05:43:10,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2960ab01 >2014-01-06 05:43:10,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2960ab01 >2014-01-06 05:43:10,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f105787 >2014-01-06 05:43:11,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24159f00}, log id: 1f105787 >2014-01-06 05:43:16,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28ea1b78 >2014-01-06 05:43:16,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 28ea1b78 >2014-01-06 05:43:16,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7df635f4 >2014-01-06 05:43:16,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e13402b}, log id: 7df635f4 >2014-01-06 05:43:21,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1124c67d >2014-01-06 05:43:21,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1124c67d >2014-01-06 05:43:21,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d07f161 >2014-01-06 05:43:21,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6273df6b}, log id: 3d07f161 >2014-01-06 05:43:26,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 45d10bdd >2014-01-06 05:43:27,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 45d10bdd >2014-01-06 05:43:27,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7733f65e >2014-01-06 05:43:27,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5be0613}, log id: 7733f65e >2014-01-06 05:43:32,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35419a13 >2014-01-06 05:43:32,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 35419a13 >2014-01-06 05:43:32,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4616decc >2014-01-06 05:43:32,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2dcddf0}, log id: 4616decc >2014-01-06 05:43:37,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d9c2605 >2014-01-06 05:43:38,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c2ba323 >2014-01-06 05:43:38,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7d9c2605 >2014-01-06 05:43:38,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53f4a34 >2014-01-06 05:43:38,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83d1e8c5}, log id: 53f4a34 >2014-01-06 05:43:38,372 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:43:38,372 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:43:38,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, log id: 5c2ba323 >2014-01-06 05:43:38,373 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-78) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:43:42,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 170adc61 >2014-01-06 05:43:42,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@292f94e2, log id: 170adc61 >2014-01-06 05:43:43,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 667a0b07 >2014-01-06 05:43:43,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 667a0b07 >2014-01-06 05:43:43,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c26332b >2014-01-06 05:43:43,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68e972d4}, log id: 6c26332b >2014-01-06 05:43:48,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43bff92 >2014-01-06 05:43:49,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43bff92 >2014-01-06 05:43:49,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 445d94de >2014-01-06 05:43:49,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38d70e82}, log id: 445d94de >2014-01-06 05:43:54,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 226df2e0 >2014-01-06 05:43:54,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 226df2e0 >2014-01-06 05:43:54,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a8be333 >2014-01-06 05:43:54,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81e73cdc}, log id: 6a8be333 >2014-01-06 05:43:59,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7107f979 >2014-01-06 05:43:59,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7107f979 >2014-01-06 05:43:59,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19762d58 >2014-01-06 05:44:00,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6748395}, log id: 19762d58 >2014-01-06 05:44:05,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5bff46e8 >2014-01-06 05:44:05,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5bff46e8 >2014-01-06 05:44:05,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 438129de >2014-01-06 05:44:05,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e47db93}, log id: 438129de >2014-01-06 05:44:10,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ed15d50 >2014-01-06 05:44:10,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: ed15d50 >2014-01-06 05:44:10,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 24577c4b >2014-01-06 05:44:11,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73d0d78b}, log id: 24577c4b >2014-01-06 05:44:16,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fa8c26d >2014-01-06 05:44:16,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3fa8c26d >2014-01-06 05:44:16,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26750875 >2014-01-06 05:44:16,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c13c207}, log id: 26750875 >2014-01-06 05:44:21,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c31b80a >2014-01-06 05:44:21,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5c31b80a >2014-01-06 05:44:21,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2124c836 >2014-01-06 05:44:21,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb9fb8ee}, log id: 2124c836 >2014-01-06 05:44:26,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56a30603 >2014-01-06 05:44:27,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 56a30603 >2014-01-06 05:44:27,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 55fdd8dc >2014-01-06 05:44:27,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5b7b535}, log id: 55fdd8dc >2014-01-06 05:44:32,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6714bc84 >2014-01-06 05:44:32,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6714bc84 >2014-01-06 05:44:32,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 551820ff >2014-01-06 05:44:32,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@455566a0}, log id: 551820ff >2014-01-06 05:44:37,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d9179af >2014-01-06 05:44:38,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3d9179af >2014-01-06 05:44:38,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 199e2c >2014-01-06 05:44:38,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6610d58}, log id: 199e2c >2014-01-06 05:44:38,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 768cc5d2 >2014-01-06 05:44:38,693 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:44:38,693 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:44:38,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, log id: 768cc5d2 >2014-01-06 05:44:38,693 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-77) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:44:43,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b85302d >2014-01-06 05:44:43,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1b85302d >2014-01-06 05:44:43,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d5d47e5 >2014-01-06 05:44:43,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61654e3e}, log id: 3d5d47e5 >2014-01-06 05:44:48,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 354fd8f4 >2014-01-06 05:44:49,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 354fd8f4 >2014-01-06 05:44:49,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2462dc23 >2014-01-06 05:44:49,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24cd7386}, log id: 2462dc23 >2014-01-06 05:44:54,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6bfdf114 >2014-01-06 05:44:54,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6bfdf114 >2014-01-06 05:44:54,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f83ee91 >2014-01-06 05:44:54,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c5a27e7}, log id: 3f83ee91 >2014-01-06 05:44:59,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68b116a2 >2014-01-06 05:44:59,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 68b116a2 >2014-01-06 05:44:59,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7141202e >2014-01-06 05:45:00,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e599cea}, log id: 7141202e >2014-01-06 05:45:05,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14f9ab37 >2014-01-06 05:45:05,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 14f9ab37 >2014-01-06 05:45:05,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 711141af >2014-01-06 05:45:05,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@564a1393}, log id: 711141af >2014-01-06 05:45:10,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23947ef6 >2014-01-06 05:45:10,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 23947ef6 >2014-01-06 05:45:10,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 567fad7b >2014-01-06 05:45:11,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12ca6d35}, log id: 567fad7b >2014-01-06 05:45:16,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: fb49a97 >2014-01-06 05:45:16,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: fb49a97 >2014-01-06 05:45:16,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5426e310 >2014-01-06 05:45:16,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e8025ec}, log id: 5426e310 >2014-01-06 05:45:21,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4fec8e31 >2014-01-06 05:45:21,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4fec8e31 >2014-01-06 05:45:21,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4198a71f >2014-01-06 05:45:21,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30f090e8}, log id: 4198a71f >2014-01-06 05:45:26,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a347052 >2014-01-06 05:45:27,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6a347052 >2014-01-06 05:45:27,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3953e7d8 >2014-01-06 05:45:27,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e4e0a8d}, log id: 3953e7d8 >2014-01-06 05:45:32,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73eda7ad >2014-01-06 05:45:32,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73eda7ad >2014-01-06 05:45:32,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 235e6005 >2014-01-06 05:45:32,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@881e1d6}, log id: 235e6005 >2014-01-06 05:45:37,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 161c3c7b >2014-01-06 05:45:38,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 161c3c7b >2014-01-06 05:45:38,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 307e74f0 >2014-01-06 05:45:38,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e838edae}, log id: 307e74f0 >2014-01-06 05:45:38,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7cc4a54e >2014-01-06 05:45:39,016 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:45:39,016 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:45:39,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, log id: 7cc4a54e >2014-01-06 05:45:39,016 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-85) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:45:43,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a77260c >2014-01-06 05:45:43,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2a77260c >2014-01-06 05:45:43,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e5e259a >2014-01-06 05:45:43,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c51cf13f}, log id: e5e259a >2014-01-06 05:45:48,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25f5e8b5 >2014-01-06 05:45:49,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25f5e8b5 >2014-01-06 05:45:49,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 468d7a0b >2014-01-06 05:45:49,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15e821ee}, log id: 468d7a0b >2014-01-06 05:45:54,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a8b4f76 >2014-01-06 05:45:54,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6a8b4f76 >2014-01-06 05:45:54,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e52c870 >2014-01-06 05:45:54,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@965c313f}, log id: 5e52c870 >2014-01-06 05:45:59,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8eb22c6 >2014-01-06 05:46:00,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 8eb22c6 >2014-01-06 05:46:00,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63824b3c >2014-01-06 05:46:00,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e196512d}, log id: 63824b3c >2014-01-06 05:46:05,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e512c83 >2014-01-06 05:46:05,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3e512c83 >2014-01-06 05:46:05,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2647c0e2 >2014-01-06 05:46:05,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c634254e}, log id: 2647c0e2 >2014-01-06 05:46:10,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3646d885 >2014-01-06 05:46:10,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3646d885 >2014-01-06 05:46:10,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35886c0a >2014-01-06 05:46:11,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1345afe9}, log id: 35886c0a >2014-01-06 05:46:16,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5d623129 >2014-01-06 05:46:16,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5d623129 >2014-01-06 05:46:16,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16597af5 >2014-01-06 05:46:16,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d80f5373}, log id: 16597af5 >2014-01-06 05:46:21,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3839db4d >2014-01-06 05:46:21,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3839db4d >2014-01-06 05:46:21,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21d84c67 >2014-01-06 05:46:21,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32f4624c}, log id: 21d84c67 >2014-01-06 05:46:27,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 11038ce4 >2014-01-06 05:46:27,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 11038ce4 >2014-01-06 05:46:27,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f6ec065 >2014-01-06 05:46:27,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50d7ab80}, log id: 1f6ec065 >2014-01-06 05:46:32,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: cc9c2aa >2014-01-06 05:46:32,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: cc9c2aa >2014-01-06 05:46:32,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46962b0b >2014-01-06 05:46:32,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6910cf0a}, log id: 46962b0b >2014-01-06 05:46:37,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29cc7b54 >2014-01-06 05:46:38,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29cc7b54 >2014-01-06 05:46:38,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c88f70c >2014-01-06 05:46:38,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fb823e}, log id: 5c88f70c >2014-01-06 05:46:39,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4bb6cb9e >2014-01-06 05:46:39,343 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:46:39,344 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:46:39,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, log id: 4bb6cb9e >2014-01-06 05:46:39,344 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-71) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:46:43,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 485632ce >2014-01-06 05:46:43,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 485632ce >2014-01-06 05:46:43,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c4d5411 >2014-01-06 05:46:43,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5421c1c}, log id: 2c4d5411 >2014-01-06 05:46:48,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3681ea83 >2014-01-06 05:46:49,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3681ea83 >2014-01-06 05:46:49,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f3f9467 >2014-01-06 05:46:49,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a858279}, log id: 6f3f9467 >2014-01-06 05:46:54,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13c1b4f0 >2014-01-06 05:46:54,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 13c1b4f0 >2014-01-06 05:46:54,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 44e9341 >2014-01-06 05:46:54,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e301883}, log id: 44e9341 >2014-01-06 05:46:59,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f7c9edf >2014-01-06 05:47:00,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4f7c9edf >2014-01-06 05:47:00,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 151efb1e >2014-01-06 05:47:00,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ea00048}, log id: 151efb1e >2014-01-06 05:47:05,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2500ca52 >2014-01-06 05:47:05,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2500ca52 >2014-01-06 05:47:05,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1844904 >2014-01-06 05:47:05,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@186655d1}, log id: 1844904 >2014-01-06 05:47:10,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50c6a2c8 >2014-01-06 05:47:10,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 50c6a2c8 >2014-01-06 05:47:10,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71ea42b5 >2014-01-06 05:47:11,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14099b4c}, log id: 71ea42b5 >2014-01-06 05:47:16,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 588af7ad >2014-01-06 05:47:16,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 588af7ad >2014-01-06 05:47:16,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 746674a9 >2014-01-06 05:47:16,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6cc3aa9}, log id: 746674a9 >2014-01-06 05:47:21,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5952791b >2014-01-06 05:47:21,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5952791b >2014-01-06 05:47:21,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2399cd0a >2014-01-06 05:47:22,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3eba5a6}, log id: 2399cd0a >2014-01-06 05:47:27,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c38a10d >2014-01-06 05:47:27,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4c38a10d >2014-01-06 05:47:27,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e1ef5c1 >2014-01-06 05:47:27,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48d674b3}, log id: 4e1ef5c1 >2014-01-06 05:47:32,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c2438d7 >2014-01-06 05:47:32,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: c2438d7 >2014-01-06 05:47:32,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1dddb054 >2014-01-06 05:47:32,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d51d0c6}, log id: 1dddb054 >2014-01-06 05:47:37,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 612bcbb4 >2014-01-06 05:47:38,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 612bcbb4 >2014-01-06 05:47:38,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f7e4fe6 >2014-01-06 05:47:38,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e0fc70d}, log id: 6f7e4fe6 >2014-01-06 05:47:39,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: aed7417 >2014-01-06 05:47:39,673 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:47:39,673 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:47:39,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, log id: aed7417 >2014-01-06 05:47:39,673 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-81) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:47:43,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3bbd1695 >2014-01-06 05:47:43,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3bbd1695 >2014-01-06 05:47:43,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e847616 >2014-01-06 05:47:43,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec6c506b}, log id: 5e847616 >2014-01-06 05:47:48,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a830d6f >2014-01-06 05:47:49,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6a830d6f >2014-01-06 05:47:49,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3989efb4 >2014-01-06 05:47:49,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f766681}, log id: 3989efb4 >2014-01-06 05:47:54,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2608c253 >2014-01-06 05:47:54,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2608c253 >2014-01-06 05:47:54,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 18a16af4 >2014-01-06 05:47:54,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4b128e4}, log id: 18a16af4 >2014-01-06 05:47:59,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b14ff88 >2014-01-06 05:48:00,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b14ff88 >2014-01-06 05:48:00,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5885b7f9 >2014-01-06 05:48:00,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff5670ad}, log id: 5885b7f9 >2014-01-06 05:48:05,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5544c468 >2014-01-06 05:48:05,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5544c468 >2014-01-06 05:48:05,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3313e4da >2014-01-06 05:48:05,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f6ce87e}, log id: 3313e4da >2014-01-06 05:48:10,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63d88a2f >2014-01-06 05:48:11,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 63d88a2f >2014-01-06 05:48:11,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47ed69aa >2014-01-06 05:48:11,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9126453e}, log id: 47ed69aa >2014-01-06 05:48:16,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c520edd >2014-01-06 05:48:16,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4c520edd >2014-01-06 05:48:16,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29a01dd9 >2014-01-06 05:48:16,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2374655f}, log id: 29a01dd9 >2014-01-06 05:48:21,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7159fc39 >2014-01-06 05:48:21,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7159fc39 >2014-01-06 05:48:22,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e114743 >2014-01-06 05:48:22,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4a5f221}, log id: 2e114743 >2014-01-06 05:48:27,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c746dac >2014-01-06 05:48:27,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7c746dac >2014-01-06 05:48:27,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b3f640d >2014-01-06 05:48:27,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85da819e}, log id: 6b3f640d >2014-01-06 05:48:32,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 188a4b8d >2014-01-06 05:48:32,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 188a4b8d >2014-01-06 05:48:32,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c129fef >2014-01-06 05:48:33,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c89c1fb}, log id: 3c129fef >2014-01-06 05:48:38,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5abc11c6 >2014-01-06 05:48:38,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5abc11c6 >2014-01-06 05:48:38,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c2a3830 >2014-01-06 05:48:38,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e721e1ce}, log id: 3c2a3830 >2014-01-06 05:48:39,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51a409b7 >2014-01-06 05:48:40,009 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:48:40,009 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:48:40,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, log id: 51a409b7 >2014-01-06 05:48:40,010 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-63) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:48:42,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20652fd7 >2014-01-06 05:48:42,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@10ca30a5, log id: 20652fd7 >2014-01-06 05:48:43,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d176c0d >2014-01-06 05:48:43,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3d176c0d >2014-01-06 05:48:43,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3a29c26d >2014-01-06 05:48:43,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59fa4367}, log id: 3a29c26d >2014-01-06 05:48:48,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 759543dd >2014-01-06 05:48:49,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 759543dd >2014-01-06 05:48:49,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a514311 >2014-01-06 05:48:49,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7377e06}, log id: 5a514311 >2014-01-06 05:48:54,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 259792c8 >2014-01-06 05:48:54,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 259792c8 >2014-01-06 05:48:54,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50255c15 >2014-01-06 05:48:54,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50dc996c}, log id: 50255c15 >2014-01-06 05:48:59,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c5c90f >2014-01-06 05:49:00,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3c5c90f >2014-01-06 05:49:00,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 317506ec >2014-01-06 05:49:00,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4823aded}, log id: 317506ec >2014-01-06 05:49:05,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1be0dde6 >2014-01-06 05:49:05,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1be0dde6 >2014-01-06 05:49:05,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21486d14 >2014-01-06 05:49:05,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c16723e0}, log id: 21486d14 >2014-01-06 05:49:10,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 502271c3 >2014-01-06 05:49:11,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 502271c3 >2014-01-06 05:49:11,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74f5f83d >2014-01-06 05:49:11,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8612bff}, log id: 74f5f83d >2014-01-06 05:49:16,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15302a94 >2014-01-06 05:49:16,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 15302a94 >2014-01-06 05:49:16,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ab4fc43 >2014-01-06 05:49:16,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6445ffe}, log id: 4ab4fc43 >2014-01-06 05:49:21,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f0ad371 >2014-01-06 05:49:21,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7f0ad371 >2014-01-06 05:49:22,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e9de4d1 >2014-01-06 05:49:22,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffec239c}, log id: 4e9de4d1 >2014-01-06 05:49:27,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56c409ad >2014-01-06 05:49:27,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56c409ad >2014-01-06 05:49:27,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b105534 >2014-01-06 05:49:27,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0c45468}, log id: 6b105534 >2014-01-06 05:49:32,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10f5278f >2014-01-06 05:49:32,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 10f5278f >2014-01-06 05:49:32,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b8f94d2 >2014-01-06 05:49:33,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb47664d}, log id: 5b8f94d2 >2014-01-06 05:49:38,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 409bcb49 >2014-01-06 05:49:38,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 409bcb49 >2014-01-06 05:49:38,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4430e9bb >2014-01-06 05:49:38,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37076571}, log id: 4430e9bb >2014-01-06 05:49:40,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a94483d >2014-01-06 05:49:40,349 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:49:40,349 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:49:40,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, log id: 5a94483d >2014-01-06 05:49:40,349 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-44) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:49:43,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7913b5e1 >2014-01-06 05:49:43,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7913b5e1 >2014-01-06 05:49:43,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4614b117 >2014-01-06 05:49:43,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@228ef3ec}, log id: 4614b117 >2014-01-06 05:49:48,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a28e7f9 >2014-01-06 05:49:49,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1a28e7f9 >2014-01-06 05:49:49,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d89e839 >2014-01-06 05:49:49,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@715b6091}, log id: 6d89e839 >2014-01-06 05:49:54,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 798fe56 >2014-01-06 05:49:54,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 798fe56 >2014-01-06 05:49:54,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 41f68ecd >2014-01-06 05:49:54,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5221843}, log id: 41f68ecd >2014-01-06 05:49:59,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d506229 >2014-01-06 05:50:00,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1d506229 >2014-01-06 05:50:00,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ea3c807 >2014-01-06 05:50:00,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@677a661b}, log id: 2ea3c807 >2014-01-06 05:50:05,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2645bc13 >2014-01-06 05:50:05,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2645bc13 >2014-01-06 05:50:05,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: edbbd33 >2014-01-06 05:50:05,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfcb792b}, log id: edbbd33 >2014-01-06 05:50:10,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ffc0fdc >2014-01-06 05:50:11,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1ffc0fdc >2014-01-06 05:50:11,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19e587f2 >2014-01-06 05:50:11,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54d0985}, log id: 19e587f2 >2014-01-06 05:50:16,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25765681 >2014-01-06 05:50:16,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25765681 >2014-01-06 05:50:16,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44ca9d97 >2014-01-06 05:50:16,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bf7d8f1}, log id: 44ca9d97 >2014-01-06 05:50:21,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2da06f7 >2014-01-06 05:50:22,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2da06f7 >2014-01-06 05:50:22,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2369350 >2014-01-06 05:50:22,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f642f057}, log id: 2369350 >2014-01-06 05:50:27,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 450d4cf >2014-01-06 05:50:27,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 450d4cf >2014-01-06 05:50:27,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45ff772b >2014-01-06 05:50:27,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e6dae44}, log id: 45ff772b >2014-01-06 05:50:32,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 657c1b84 >2014-01-06 05:50:32,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 657c1b84 >2014-01-06 05:50:32,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 522dc2b5 >2014-01-06 05:50:33,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92e9968c}, log id: 522dc2b5 >2014-01-06 05:50:38,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ca17840 >2014-01-06 05:50:38,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ca17840 >2014-01-06 05:50:38,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 23127a81 >2014-01-06 05:50:38,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7186a5a}, log id: 23127a81 >2014-01-06 05:50:40,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 443cd755 >2014-01-06 05:50:40,684 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:50:40,684 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:50:40,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, log id: 443cd755 >2014-01-06 05:50:40,684 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-26) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:50:43,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4522d6e9 >2014-01-06 05:50:43,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4522d6e9 >2014-01-06 05:50:43,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13b942d8 >2014-01-06 05:50:44,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bef11b44}, log id: 13b942d8 >2014-01-06 05:50:49,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 11155a67 >2014-01-06 05:50:49,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 11155a67 >2014-01-06 05:50:49,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35dfc476 >2014-01-06 05:50:49,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ed0a118}, log id: 35dfc476 >2014-01-06 05:50:54,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c1dff2a >2014-01-06 05:50:54,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2c1dff2a >2014-01-06 05:50:54,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 32bdfaaf >2014-01-06 05:50:54,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26e18cdd}, log id: 32bdfaaf >2014-01-06 05:50:59,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1313a93e >2014-01-06 05:51:00,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1313a93e >2014-01-06 05:51:00,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b1b98d2 >2014-01-06 05:51:00,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56b28375}, log id: 5b1b98d2 >2014-01-06 05:51:05,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f61810d >2014-01-06 05:51:05,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5f61810d >2014-01-06 05:51:05,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46d2e305 >2014-01-06 05:51:05,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16ecdb55}, log id: 46d2e305 >2014-01-06 05:51:10,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2751322c >2014-01-06 05:51:11,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2751322c >2014-01-06 05:51:11,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 30e87eea >2014-01-06 05:51:11,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29d2915e}, log id: 30e87eea >2014-01-06 05:51:16,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57591f49 >2014-01-06 05:51:16,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 57591f49 >2014-01-06 05:51:16,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 690a8f3d >2014-01-06 05:51:16,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9116f3e}, log id: 690a8f3d >2014-01-06 05:51:21,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60116a37 >2014-01-06 05:51:22,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 60116a37 >2014-01-06 05:51:22,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 26dcc799 >2014-01-06 05:51:22,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d8aea2e}, log id: 26dcc799 >2014-01-06 05:51:27,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e7467c1 >2014-01-06 05:51:27,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e7467c1 >2014-01-06 05:51:27,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a678c1 >2014-01-06 05:51:27,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33b22981}, log id: 3a678c1 >2014-01-06 05:51:32,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13fd803a >2014-01-06 05:51:32,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 13fd803a >2014-01-06 05:51:32,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2717c420 >2014-01-06 05:51:33,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0077800}, log id: 2717c420 >2014-01-06 05:51:38,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b5d6a7d >2014-01-06 05:51:38,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2b5d6a7d >2014-01-06 05:51:38,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 12a0d8b9 >2014-01-06 05:51:38,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95c0f0ff}, log id: 12a0d8b9 >2014-01-06 05:51:40,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17eb171e >2014-01-06 05:51:41,010 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:51:41,010 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:51:41,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterTasksListVDSCommand, log id: 17eb171e >2014-01-06 05:51:41,010 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-4) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:51:43,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1fa9b372 >2014-01-06 05:51:43,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1fa9b372 >2014-01-06 05:51:43,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d79189c >2014-01-06 05:51:44,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2e0ff39}, log id: 3d79189c >2014-01-06 05:51:49,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74086a9c >2014-01-06 05:51:49,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 74086a9c >2014-01-06 05:51:49,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e694955 >2014-01-06 05:51:49,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3300c4de}, log id: 2e694955 >2014-01-06 05:51:54,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4557321a >2014-01-06 05:51:54,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4557321a >2014-01-06 05:51:54,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 277a6473 >2014-01-06 05:51:54,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e928570}, log id: 277a6473 >2014-01-06 05:51:59,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13396618 >2014-01-06 05:52:00,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 13396618 >2014-01-06 05:52:00,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f341452 >2014-01-06 05:52:00,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@270dcbd4}, log id: 4f341452 >2014-01-06 05:52:05,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 615b3351 >2014-01-06 05:52:05,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 615b3351 >2014-01-06 05:52:05,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3fd0f89e >2014-01-06 05:52:05,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a599821d}, log id: 3fd0f89e >2014-01-06 05:52:10,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e442a7e >2014-01-06 05:52:11,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5e442a7e >2014-01-06 05:52:11,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: dfee9e9 >2014-01-06 05:52:11,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0e37a11}, log id: dfee9e9 >2014-01-06 05:52:16,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 26356ff4 >2014-01-06 05:52:16,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 26356ff4 >2014-01-06 05:52:16,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7cb11731 >2014-01-06 05:52:16,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@636d78ba}, log id: 7cb11731 >2014-01-06 05:52:21,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 69c5c6b8 >2014-01-06 05:52:22,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 69c5c6b8 >2014-01-06 05:52:22,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 234d32a4 >2014-01-06 05:52:22,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@948b5a75}, log id: 234d32a4 >2014-01-06 05:52:27,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b5b815 >2014-01-06 05:52:27,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b5b815 >2014-01-06 05:52:27,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a851c5f >2014-01-06 05:52:27,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e75e0da5}, log id: 5a851c5f >2014-01-06 05:52:32,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 643ba539 >2014-01-06 05:52:32,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 643ba539 >2014-01-06 05:52:33,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49b9798a >2014-01-06 05:52:33,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cbd2a40}, log id: 49b9798a >2014-01-06 05:52:38,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1aafe587 >2014-01-06 05:52:38,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1aafe587 >2014-01-06 05:52:38,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2aebdf42 >2014-01-06 05:52:38,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f3cd8b1}, log id: 2aebdf42 >2014-01-06 05:52:41,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a43771e >2014-01-06 05:52:41,350 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:52:41,350 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:52:41,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, log id: 4a43771e >2014-01-06 05:52:41,350 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-73) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:52:43,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5eee114d >2014-01-06 05:52:43,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5eee114d >2014-01-06 05:52:43,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a6f13b2 >2014-01-06 05:52:44,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16177ddf}, log id: 1a6f13b2 >2014-01-06 05:52:49,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f693f78 >2014-01-06 05:52:49,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: f693f78 >2014-01-06 05:52:49,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f6b82e3 >2014-01-06 05:52:49,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c51dd320}, log id: 1f6b82e3 >2014-01-06 05:52:54,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4bd793d7 >2014-01-06 05:52:54,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4bd793d7 >2014-01-06 05:52:54,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1bc66ddf >2014-01-06 05:52:54,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5195d822}, log id: 1bc66ddf >2014-01-06 05:52:59,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46555220 >2014-01-06 05:53:00,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 46555220 >2014-01-06 05:53:00,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b2fa5a8 >2014-01-06 05:53:00,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f45f6e1}, log id: 3b2fa5a8 >2014-01-06 05:53:05,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58b20e23 >2014-01-06 05:53:05,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 58b20e23 >2014-01-06 05:53:05,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c19fcc9 >2014-01-06 05:53:05,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a81cc95}, log id: 1c19fcc9 >2014-01-06 05:53:10,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 515c9801 >2014-01-06 05:53:11,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 515c9801 >2014-01-06 05:53:11,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 158d956c >2014-01-06 05:53:11,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2118602e}, log id: 158d956c >2014-01-06 05:53:16,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2acfcf0d >2014-01-06 05:53:16,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2acfcf0d >2014-01-06 05:53:16,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5034a14a >2014-01-06 05:53:16,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ec159d2}, log id: 5034a14a >2014-01-06 05:53:21,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1596ceca >2014-01-06 05:53:22,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1596ceca >2014-01-06 05:53:22,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d2d38f4 >2014-01-06 05:53:22,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e64dfd4}, log id: 4d2d38f4 >2014-01-06 05:53:27,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a284be8 >2014-01-06 05:53:27,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3a284be8 >2014-01-06 05:53:27,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e4a70ef >2014-01-06 05:53:27,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffb4ef2}, log id: 4e4a70ef >2014-01-06 05:53:32,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2274a2f1 >2014-01-06 05:53:33,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2274a2f1 >2014-01-06 05:53:33,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39395c92 >2014-01-06 05:53:33,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b01a15c1}, log id: 39395c92 >2014-01-06 05:53:38,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 601681b1 >2014-01-06 05:53:38,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 601681b1 >2014-01-06 05:53:38,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76ffd2e0 >2014-01-06 05:53:38,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62b98ccc}, log id: 76ffd2e0 >2014-01-06 05:53:41,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a7cf96a >2014-01-06 05:53:41,681 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:53:41,681 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:53:41,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, log id: 1a7cf96a >2014-01-06 05:53:41,682 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-52) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:53:42,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79cfee3e >2014-01-06 05:53:42,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@373035a8, log id: 79cfee3e >2014-01-06 05:53:43,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f9fe76d >2014-01-06 05:53:43,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2f9fe76d >2014-01-06 05:53:43,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c0dff6a >2014-01-06 05:53:44,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@974773d5}, log id: 6c0dff6a >2014-01-06 05:53:49,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31f368ea >2014-01-06 05:53:49,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 31f368ea >2014-01-06 05:53:49,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4bd4058d >2014-01-06 05:53:49,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bac0b50}, log id: 4bd4058d >2014-01-06 05:53:54,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a198894 >2014-01-06 05:53:54,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4a198894 >2014-01-06 05:53:54,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fe314b2 >2014-01-06 05:53:54,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8459e2df}, log id: 3fe314b2 >2014-01-06 05:54:00,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27755e79 >2014-01-06 05:54:00,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 27755e79 >2014-01-06 05:54:00,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ea53a0e >2014-01-06 05:54:00,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b74a906}, log id: 3ea53a0e >2014-01-06 05:54:05,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e0a44c7 >2014-01-06 05:54:05,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1e0a44c7 >2014-01-06 05:54:05,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5eb9d5f6 >2014-01-06 05:54:05,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e6ec7b0}, log id: 5eb9d5f6 >2014-01-06 05:54:10,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24a44835 >2014-01-06 05:54:11,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 24a44835 >2014-01-06 05:54:11,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f37d807 >2014-01-06 05:54:11,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a614a9a5}, log id: 6f37d807 >2014-01-06 05:54:16,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f99883d >2014-01-06 05:54:16,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3f99883d >2014-01-06 05:54:16,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18560374 >2014-01-06 05:54:16,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c7e9b04}, log id: 18560374 >2014-01-06 05:54:21,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 55df8adc >2014-01-06 05:54:22,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 55df8adc >2014-01-06 05:54:22,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b9c1091 >2014-01-06 05:54:22,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@137b8032}, log id: 5b9c1091 >2014-01-06 05:54:27,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5dbdc1c6 >2014-01-06 05:54:27,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5dbdc1c6 >2014-01-06 05:54:27,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27590269 >2014-01-06 05:54:27,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f70c223a}, log id: 27590269 >2014-01-06 05:54:32,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1cfd26b9 >2014-01-06 05:54:33,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1cfd26b9 >2014-01-06 05:54:33,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 155c08f8 >2014-01-06 05:54:33,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9093799}, log id: 155c08f8 >2014-01-06 05:54:38,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 32c24326 >2014-01-06 05:54:38,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 32c24326 >2014-01-06 05:54:38,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c959864 >2014-01-06 05:54:38,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be66e20a}, log id: 3c959864 >2014-01-06 05:54:41,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35d9aa93 >2014-01-06 05:54:42,015 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:54:42,015 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:54:42,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, log id: 35d9aa93 >2014-01-06 05:54:42,015 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-44) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:54:43,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2440ea04 >2014-01-06 05:54:43,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2440ea04 >2014-01-06 05:54:43,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22490a92 >2014-01-06 05:54:44,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48951612}, log id: 22490a92 >2014-01-06 05:54:49,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c9ad63c >2014-01-06 05:54:49,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3c9ad63c >2014-01-06 05:54:49,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65e5ab81 >2014-01-06 05:54:49,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5fd697e}, log id: 65e5ab81 >2014-01-06 05:54:54,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e670e86 >2014-01-06 05:54:54,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e670e86 >2014-01-06 05:54:54,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: efb22e7 >2014-01-06 05:54:54,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3382d9e}, log id: efb22e7 >2014-01-06 05:55:00,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b287fc8 >2014-01-06 05:55:00,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1b287fc8 >2014-01-06 05:55:00,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1130f2cb >2014-01-06 05:55:00,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60b5e5aa}, log id: 1130f2cb >2014-01-06 05:55:05,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 161e83ae >2014-01-06 05:55:05,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 161e83ae >2014-01-06 05:55:05,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2cb58a9a >2014-01-06 05:55:05,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@878a54be}, log id: 2cb58a9a >2014-01-06 05:55:10,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e05a280 >2014-01-06 05:55:11,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6e05a280 >2014-01-06 05:55:11,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f12187e >2014-01-06 05:55:11,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5029195}, log id: 2f12187e >2014-01-06 05:55:16,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ca7a453 >2014-01-06 05:55:16,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6ca7a453 >2014-01-06 05:55:16,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2fd15b72 >2014-01-06 05:55:16,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a432797c}, log id: 2fd15b72 >2014-01-06 05:55:21,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1551f25b >2014-01-06 05:55:22,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1551f25b >2014-01-06 05:55:22,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d127f13 >2014-01-06 05:55:22,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a0df6ad}, log id: 4d127f13 >2014-01-06 05:55:27,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b6a8a5c >2014-01-06 05:55:27,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b6a8a5c >2014-01-06 05:55:27,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27ae3cce >2014-01-06 05:55:27,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d68b1e3}, log id: 27ae3cce >2014-01-06 05:55:32,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e723ba0 >2014-01-06 05:55:33,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2e723ba0 >2014-01-06 05:55:33,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 53b40e7e >2014-01-06 05:55:33,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff76345f}, log id: 53b40e7e >2014-01-06 05:55:38,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 401b04d0 >2014-01-06 05:55:38,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 401b04d0 >2014-01-06 05:55:38,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 355ef5cf >2014-01-06 05:55:38,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@425b2007}, log id: 355ef5cf >2014-01-06 05:55:42,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 191d4b3f >2014-01-06 05:55:42,338 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:55:42,339 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:55:42,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, log id: 191d4b3f >2014-01-06 05:55:42,339 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-41) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:55:43,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 687b6548 >2014-01-06 05:55:43,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 687b6548 >2014-01-06 05:55:43,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 167b306e >2014-01-06 05:55:44,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86b21beb}, log id: 167b306e >2014-01-06 05:55:49,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14ce4b5d >2014-01-06 05:55:49,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 14ce4b5d >2014-01-06 05:55:49,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 321d8c0b >2014-01-06 05:55:49,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@475f1b9c}, log id: 321d8c0b >2014-01-06 05:55:54,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68daa51c >2014-01-06 05:55:54,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 68daa51c >2014-01-06 05:55:54,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2049ba96 >2014-01-06 05:55:54,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9428175}, log id: 2049ba96 >2014-01-06 05:56:00,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c8c3fff >2014-01-06 05:56:00,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3c8c3fff >2014-01-06 05:56:00,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 62c91e69 >2014-01-06 05:56:00,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@294be2d3}, log id: 62c91e69 >2014-01-06 05:56:05,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 598d8320 >2014-01-06 05:56:05,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 598d8320 >2014-01-06 05:56:05,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59d140da >2014-01-06 05:56:05,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5800284}, log id: 59d140da >2014-01-06 05:56:10,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2250ab34 >2014-01-06 05:56:11,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2250ab34 >2014-01-06 05:56:11,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e534651 >2014-01-06 05:56:11,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcb4e599}, log id: e534651 >2014-01-06 05:56:16,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4df66e3f >2014-01-06 05:56:16,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4df66e3f >2014-01-06 05:56:16,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7fc71885 >2014-01-06 05:56:16,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab2572e5}, log id: 7fc71885 >2014-01-06 05:56:21,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 125a0a02 >2014-01-06 05:56:22,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 125a0a02 >2014-01-06 05:56:22,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55ac43e2 >2014-01-06 05:56:22,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36aafbdd}, log id: 55ac43e2 >2014-01-06 05:56:27,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 597c481c >2014-01-06 05:56:27,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 597c481c >2014-01-06 05:56:27,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a5e371b >2014-01-06 05:56:27,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5407449d}, log id: 3a5e371b >2014-01-06 05:56:32,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8c6f468 >2014-01-06 05:56:33,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 8c6f468 >2014-01-06 05:56:33,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 327d59b5 >2014-01-06 05:56:33,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@114a21b2}, log id: 327d59b5 >2014-01-06 05:56:38,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 779f1f1f >2014-01-06 05:56:38,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 779f1f1f >2014-01-06 05:56:38,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40040f27 >2014-01-06 05:56:38,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@146f9067}, log id: 40040f27 >2014-01-06 05:56:42,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 640909d9 >2014-01-06 05:56:42,663 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:56:42,663 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:56:42,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, log id: 640909d9 >2014-01-06 05:56:42,664 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-23) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:56:43,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 172bb951 >2014-01-06 05:56:43,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 172bb951 >2014-01-06 05:56:43,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b985873 >2014-01-06 05:56:44,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aef28fd3}, log id: 1b985873 >2014-01-06 05:56:49,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b91ebe6 >2014-01-06 05:56:49,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1b91ebe6 >2014-01-06 05:56:49,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5bda1126 >2014-01-06 05:56:49,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd0752af}, log id: 5bda1126 >2014-01-06 05:56:54,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71c0ccb7 >2014-01-06 05:56:54,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71c0ccb7 >2014-01-06 05:56:54,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5abf7036 >2014-01-06 05:56:55,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@593d2514}, log id: 5abf7036 >2014-01-06 05:57:00,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56b7161e >2014-01-06 05:57:00,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 56b7161e >2014-01-06 05:57:00,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5faf7314 >2014-01-06 05:57:00,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63f4868}, log id: 5faf7314 >2014-01-06 05:57:05,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f3720ae >2014-01-06 05:57:05,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f3720ae >2014-01-06 05:57:05,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4fc84bdc >2014-01-06 05:57:05,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f43b18f4}, log id: 4fc84bdc >2014-01-06 05:57:10,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a3e825 >2014-01-06 05:57:11,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5a3e825 >2014-01-06 05:57:11,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31e70325 >2014-01-06 05:57:11,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@672445ac}, log id: 31e70325 >2014-01-06 05:57:16,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b3ca192 >2014-01-06 05:57:16,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b3ca192 >2014-01-06 05:57:16,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 153ed77b >2014-01-06 05:57:16,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39180bad}, log id: 153ed77b >2014-01-06 05:57:21,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 41df9e6 >2014-01-06 05:57:22,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 41df9e6 >2014-01-06 05:57:22,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a1ce70d >2014-01-06 05:57:22,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71ab6be7}, log id: 3a1ce70d >2014-01-06 05:57:27,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 402b686f >2014-01-06 05:57:27,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 402b686f >2014-01-06 05:57:27,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36c6ba40 >2014-01-06 05:57:27,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59f38882}, log id: 36c6ba40 >2014-01-06 05:57:32,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4cbf0fe9 >2014-01-06 05:57:33,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4cbf0fe9 >2014-01-06 05:57:33,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59b76540 >2014-01-06 05:57:33,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad03b24b}, log id: 59b76540 >2014-01-06 05:57:38,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12ca677a >2014-01-06 05:57:38,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 12ca677a >2014-01-06 05:57:38,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 623747db >2014-01-06 05:57:38,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eca34035}, log id: 623747db >2014-01-06 05:57:42,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 228a09be >2014-01-06 05:57:42,986 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:57:42,986 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:57:42,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, log id: 228a09be >2014-01-06 05:57:42,986 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-98) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:57:43,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c9ed860 >2014-01-06 05:57:43,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7c9ed860 >2014-01-06 05:57:43,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2923f1bf >2014-01-06 05:57:44,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85becbab}, log id: 2923f1bf >2014-01-06 05:57:49,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2260704e >2014-01-06 05:57:49,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2260704e >2014-01-06 05:57:49,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4989c2b5 >2014-01-06 05:57:49,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc864b59}, log id: 4989c2b5 >2014-01-06 05:57:54,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 590ae89f >2014-01-06 05:57:54,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 590ae89f >2014-01-06 05:57:54,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3600b10f >2014-01-06 05:57:55,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da6b2782}, log id: 3600b10f >2014-01-06 05:58:00,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 170c84c0 >2014-01-06 05:58:00,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 170c84c0 >2014-01-06 05:58:00,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16219fb >2014-01-06 05:58:00,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@817e4424}, log id: 16219fb >2014-01-06 05:58:05,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2277b790 >2014-01-06 05:58:05,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2277b790 >2014-01-06 05:58:05,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6557ed83 >2014-01-06 05:58:05,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4402bcf7}, log id: 6557ed83 >2014-01-06 05:58:10,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: eb845ea >2014-01-06 05:58:11,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: eb845ea >2014-01-06 05:58:11,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f0c51d8 >2014-01-06 05:58:11,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99757f4b}, log id: 1f0c51d8 >2014-01-06 05:58:16,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77ff8478 >2014-01-06 05:58:16,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 77ff8478 >2014-01-06 05:58:16,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68fba7ab >2014-01-06 05:58:16,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16090cb2}, log id: 68fba7ab >2014-01-06 05:58:21,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e0973a7 >2014-01-06 05:58:22,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3e0973a7 >2014-01-06 05:58:22,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 75ef8143 >2014-01-06 05:58:22,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7e0ff08}, log id: 75ef8143 >2014-01-06 05:58:27,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66623f23 >2014-01-06 05:58:27,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66623f23 >2014-01-06 05:58:27,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ba8118b >2014-01-06 05:58:27,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d179842f}, log id: 6ba8118b >2014-01-06 05:58:32,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27f0a261 >2014-01-06 05:58:33,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 27f0a261 >2014-01-06 05:58:33,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8633fcb >2014-01-06 05:58:33,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc9cc413}, log id: 8633fcb >2014-01-06 05:58:38,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f033def >2014-01-06 05:58:38,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5f033def >2014-01-06 05:58:38,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 77d92f2b >2014-01-06 05:58:38,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8abc475}, log id: 77d92f2b >2014-01-06 05:58:42,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14fb79db >2014-01-06 05:58:42,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e73c111 >2014-01-06 05:58:43,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1d9d4716, log id: 14fb79db >2014-01-06 05:58:43,315 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 05:58:43,315 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:58:43,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, log id: 2e73c111 >2014-01-06 05:58:43,315 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-22) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:58:43,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2271e1a6 >2014-01-06 05:58:44,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2271e1a6 >2014-01-06 05:58:44,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c5179c7 >2014-01-06 05:58:44,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@143a080f}, log id: 7c5179c7 >2014-01-06 05:58:49,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a76341a >2014-01-06 05:58:49,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7a76341a >2014-01-06 05:58:49,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f509d7e >2014-01-06 05:58:49,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2298c91f}, log id: f509d7e >2014-01-06 05:58:54,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7feedf1a >2014-01-06 05:58:54,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7feedf1a >2014-01-06 05:58:54,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 30918497 >2014-01-06 05:58:55,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f03ee4b}, log id: 30918497 >2014-01-06 05:59:00,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d1ca4c4 >2014-01-06 05:59:00,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d1ca4c4 >2014-01-06 05:59:00,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 32b1910a >2014-01-06 05:59:00,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dce494f8}, log id: 32b1910a >2014-01-06 05:59:05,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b83ff66 >2014-01-06 05:59:05,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7b83ff66 >2014-01-06 05:59:05,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2d592ee5 >2014-01-06 05:59:05,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@958b0a6a}, log id: 2d592ee5 >2014-01-06 05:59:11,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10151b9a >2014-01-06 05:59:11,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 10151b9a >2014-01-06 05:59:11,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e77f090 >2014-01-06 05:59:11,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5ef207b}, log id: 7e77f090 >2014-01-06 05:59:16,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1533c5b0 >2014-01-06 05:59:16,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1533c5b0 >2014-01-06 05:59:16,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b246cbe >2014-01-06 05:59:16,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ea0a63c}, log id: 1b246cbe >2014-01-06 05:59:21,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e75e444 >2014-01-06 05:59:22,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e75e444 >2014-01-06 05:59:22,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 161ada34 >2014-01-06 05:59:22,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e5c8b5f}, log id: 161ada34 >2014-01-06 05:59:27,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3099d11e >2014-01-06 05:59:27,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3099d11e >2014-01-06 05:59:27,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c2da526 >2014-01-06 05:59:27,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f023b203}, log id: 1c2da526 >2014-01-06 05:59:32,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 16ed1079 >2014-01-06 05:59:33,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 16ed1079 >2014-01-06 05:59:33,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7b819e37 >2014-01-06 05:59:33,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3306159}, log id: 7b819e37 >2014-01-06 05:59:38,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 322b5ed9 >2014-01-06 05:59:38,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 322b5ed9 >2014-01-06 05:59:38,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 156f86b4 >2014-01-06 05:59:38,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf250fb4}, log id: 156f86b4 >2014-01-06 05:59:43,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e213803 >2014-01-06 05:59:43,645 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 05:59:43,646 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 05:59:43,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, log id: 2e213803 >2014-01-06 05:59:43,646 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-16) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 05:59:43,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d86e4d8 >2014-01-06 05:59:44,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4d86e4d8 >2014-01-06 05:59:44,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 470974de >2014-01-06 05:59:44,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ac5340f}, log id: 470974de >2014-01-06 05:59:49,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b06868d >2014-01-06 05:59:49,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b06868d >2014-01-06 05:59:49,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4969eadf >2014-01-06 05:59:49,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86a43114}, log id: 4969eadf >2014-01-06 05:59:54,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 259db600 >2014-01-06 05:59:54,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 259db600 >2014-01-06 05:59:54,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2709089 >2014-01-06 05:59:55,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1eb378c4}, log id: 2709089 >2014-01-06 06:00:00,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c1d28ba >2014-01-06 06:00:00,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3c1d28ba >2014-01-06 06:00:00,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ec04b30 >2014-01-06 06:00:00,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d69d528}, log id: 4ec04b30 >2014-01-06 06:00:05,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 359e56a8 >2014-01-06 06:00:05,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 359e56a8 >2014-01-06 06:00:05,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 67b899c4 >2014-01-06 06:00:05,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6f59457}, log id: 67b899c4 >2014-01-06 06:00:11,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f665be7 >2014-01-06 06:00:11,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7f665be7 >2014-01-06 06:00:11,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 485b996a >2014-01-06 06:00:11,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0163418}, log id: 485b996a >2014-01-06 06:00:16,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7957721a >2014-01-06 06:00:16,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7957721a >2014-01-06 06:00:16,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e1edfd4 >2014-01-06 06:00:16,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c44602da}, log id: 1e1edfd4 >2014-01-06 06:00:21,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27dd0798 >2014-01-06 06:00:22,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 27dd0798 >2014-01-06 06:00:22,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4aa718e2 >2014-01-06 06:00:22,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9e22da}, log id: 4aa718e2 >2014-01-06 06:00:27,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b0638ed >2014-01-06 06:00:27,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: b0638ed >2014-01-06 06:00:27,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 190bcdba >2014-01-06 06:00:27,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e02c5cf2}, log id: 190bcdba >2014-01-06 06:00:32,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d94e26c >2014-01-06 06:00:33,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6d94e26c >2014-01-06 06:00:33,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70ee9f6d >2014-01-06 06:00:33,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4d5b092}, log id: 70ee9f6d >2014-01-06 06:00:38,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16eff115 >2014-01-06 06:00:38,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 16eff115 >2014-01-06 06:00:38,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35d6626d >2014-01-06 06:00:38,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab6a088d}, log id: 35d6626d >2014-01-06 06:00:43,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3fc7627f >2014-01-06 06:00:43,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79194920 >2014-01-06 06:00:43,987 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:00:43,987 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:00:43,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterTasksListVDSCommand, log id: 3fc7627f >2014-01-06 06:00:43,988 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-6) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:00:44,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 79194920 >2014-01-06 06:00:44,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36393bfa >2014-01-06 06:00:44,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@773ad365}, log id: 36393bfa >2014-01-06 06:00:49,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f6a1233 >2014-01-06 06:00:49,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f6a1233 >2014-01-06 06:00:49,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7743b4e9 >2014-01-06 06:00:49,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@730bd911}, log id: 7743b4e9 >2014-01-06 06:00:54,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e434a2b >2014-01-06 06:00:54,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e434a2b >2014-01-06 06:00:54,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6118d2bb >2014-01-06 06:00:55,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@980f892d}, log id: 6118d2bb >2014-01-06 06:01:00,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 588400ef >2014-01-06 06:01:00,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 588400ef >2014-01-06 06:01:00,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 349028dc >2014-01-06 06:01:00,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dd3d3ac}, log id: 349028dc >2014-01-06 06:01:05,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: fbd7aba >2014-01-06 06:01:05,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: fbd7aba >2014-01-06 06:01:05,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55c72557 >2014-01-06 06:01:06,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d29e5cd}, log id: 55c72557 >2014-01-06 06:01:11,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ab467f8 >2014-01-06 06:01:11,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5ab467f8 >2014-01-06 06:01:11,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 518b1872 >2014-01-06 06:01:11,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d46400a9}, log id: 518b1872 >2014-01-06 06:01:16,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a9d6c8f >2014-01-06 06:01:16,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7a9d6c8f >2014-01-06 06:01:16,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39b928c9 >2014-01-06 06:01:16,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88d3bf56}, log id: 39b928c9 >2014-01-06 06:01:21,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66290b1c >2014-01-06 06:01:22,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 66290b1c >2014-01-06 06:01:22,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ff1d7c5 >2014-01-06 06:01:22,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa6fe4e6}, log id: 5ff1d7c5 >2014-01-06 06:01:27,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b7a405e >2014-01-06 06:01:27,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b7a405e >2014-01-06 06:01:27,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d094fae >2014-01-06 06:01:27,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d34b1529}, log id: 4d094fae >2014-01-06 06:01:32,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25502f48 >2014-01-06 06:01:33,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25502f48 >2014-01-06 06:01:33,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5edbb49a >2014-01-06 06:01:33,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbadceb4}, log id: 5edbb49a >2014-01-06 06:01:38,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3efeba0b >2014-01-06 06:01:38,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3efeba0b >2014-01-06 06:01:38,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7473aac1 >2014-01-06 06:01:38,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60ca9f9e}, log id: 7473aac1 >2014-01-06 06:01:43,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36c13e48 >2014-01-06 06:01:43,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25b6f74a >2014-01-06 06:01:44,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 36c13e48 >2014-01-06 06:01:44,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 288df6da >2014-01-06 06:01:44,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d40ab03}, log id: 288df6da >2014-01-06 06:01:44,324 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:01:44,324 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:01:44,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, log id: 25b6f74a >2014-01-06 06:01:44,324 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-88) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:01:49,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7baf7b26 >2014-01-06 06:01:49,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7baf7b26 >2014-01-06 06:01:49,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a35462f >2014-01-06 06:01:49,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c088399}, log id: 5a35462f >2014-01-06 06:01:54,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: cc76688 >2014-01-06 06:01:54,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: cc76688 >2014-01-06 06:01:54,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a4b15c9 >2014-01-06 06:01:55,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f41bc0bb}, log id: 5a4b15c9 >2014-01-06 06:02:00,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 73e9d85c >2014-01-06 06:02:00,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 73e9d85c >2014-01-06 06:02:00,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4fff7254 >2014-01-06 06:02:00,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b866da}, log id: 4fff7254 >2014-01-06 06:02:05,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 70350a6f >2014-01-06 06:02:05,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 70350a6f >2014-01-06 06:02:05,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 451af6d1 >2014-01-06 06:02:06,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8959d080}, log id: 451af6d1 >2014-01-06 06:02:11,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c82ef4 >2014-01-06 06:02:11,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7c82ef4 >2014-01-06 06:02:11,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f8803c9 >2014-01-06 06:02:11,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76a9a304}, log id: 7f8803c9 >2014-01-06 06:02:16,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d03be21 >2014-01-06 06:02:16,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d03be21 >2014-01-06 06:02:16,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 45494c55 >2014-01-06 06:02:16,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d86575b}, log id: 45494c55 >2014-01-06 06:02:21,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b2d76d6 >2014-01-06 06:02:22,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b2d76d6 >2014-01-06 06:02:22,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 984e8d2 >2014-01-06 06:02:22,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98f1643b}, log id: 984e8d2 >2014-01-06 06:02:27,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 609be60b >2014-01-06 06:02:27,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 609be60b >2014-01-06 06:02:27,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 38e29e6b >2014-01-06 06:02:27,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@422aa250}, log id: 38e29e6b >2014-01-06 06:02:32,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5675453e >2014-01-06 06:02:33,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5675453e >2014-01-06 06:02:33,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54e29b2e >2014-01-06 06:02:33,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecfd0373}, log id: 54e29b2e >2014-01-06 06:02:38,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a33d464 >2014-01-06 06:02:38,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6a33d464 >2014-01-06 06:02:38,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 303cb783 >2014-01-06 06:02:38,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@292daaee}, log id: 303cb783 >2014-01-06 06:02:43,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7eaea0fe >2014-01-06 06:02:44,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7eaea0fe >2014-01-06 06:02:44,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 529bad70 >2014-01-06 06:02:44,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9237efc6}, log id: 529bad70 >2014-01-06 06:02:44,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 44a5c4e0 >2014-01-06 06:02:44,649 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:02:44,649 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:02:44,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, log id: 44a5c4e0 >2014-01-06 06:02:44,649 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-33) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:02:49,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7142bdda >2014-01-06 06:02:49,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7142bdda >2014-01-06 06:02:49,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c28c758 >2014-01-06 06:02:49,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94b3bb32}, log id: 3c28c758 >2014-01-06 06:02:54,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78b7fee8 >2014-01-06 06:02:55,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 78b7fee8 >2014-01-06 06:02:55,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 44c90a91 >2014-01-06 06:02:55,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dda3a1f3}, log id: 44c90a91 >2014-01-06 06:03:00,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58ac9895 >2014-01-06 06:03:00,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 58ac9895 >2014-01-06 06:03:00,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 685481eb >2014-01-06 06:03:00,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@321fa74c}, log id: 685481eb >2014-01-06 06:03:05,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b887c80 >2014-01-06 06:03:05,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b887c80 >2014-01-06 06:03:05,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 208220bc >2014-01-06 06:03:06,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@677e6ae0}, log id: 208220bc >2014-01-06 06:03:11,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a0a2b38 >2014-01-06 06:03:11,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7a0a2b38 >2014-01-06 06:03:11,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7adb528 >2014-01-06 06:03:11,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c65f9d29}, log id: 7adb528 >2014-01-06 06:03:16,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6bdc6d00 >2014-01-06 06:03:16,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6bdc6d00 >2014-01-06 06:03:16,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ed6940c >2014-01-06 06:03:16,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4209bc6}, log id: 6ed6940c >2014-01-06 06:03:21,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 32b749cd >2014-01-06 06:03:22,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 32b749cd >2014-01-06 06:03:22,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6003c9d0 >2014-01-06 06:03:22,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3a8ecb5}, log id: 6003c9d0 >2014-01-06 06:03:27,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10e519be >2014-01-06 06:03:27,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 10e519be >2014-01-06 06:03:27,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50c25b80 >2014-01-06 06:03:27,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5faead3a}, log id: 50c25b80 >2014-01-06 06:03:32,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 239bcee8 >2014-01-06 06:03:33,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 239bcee8 >2014-01-06 06:03:33,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b0156f7 >2014-01-06 06:03:33,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7302eb8}, log id: 2b0156f7 >2014-01-06 06:03:38,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ecdffa7 >2014-01-06 06:03:38,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ecdffa7 >2014-01-06 06:03:38,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ea47ef4 >2014-01-06 06:03:38,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45f916d9}, log id: 3ea47ef4 >2014-01-06 06:03:43,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1325b8df >2014-01-06 06:03:43,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@33780bd6, log id: 1325b8df >2014-01-06 06:03:43,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72217c4a >2014-01-06 06:03:44,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 72217c4a >2014-01-06 06:03:44,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ec5e443 >2014-01-06 06:03:44,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@426d4e2c}, log id: 6ec5e443 >2014-01-06 06:03:44,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 32902cc >2014-01-06 06:03:44,979 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:03:44,979 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:03:44,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, log id: 32902cc >2014-01-06 06:03:44,979 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-51) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:03:49,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a4f3351 >2014-01-06 06:03:49,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4a4f3351 >2014-01-06 06:03:49,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62f88d0b >2014-01-06 06:03:49,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d0118ad}, log id: 62f88d0b >2014-01-06 06:03:54,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20957f36 >2014-01-06 06:03:55,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 20957f36 >2014-01-06 06:03:55,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72aaf9b5 >2014-01-06 06:03:55,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2025a2d5}, log id: 72aaf9b5 >2014-01-06 06:04:00,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4220747d >2014-01-06 06:04:00,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4220747d >2014-01-06 06:04:00,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e77e5b3 >2014-01-06 06:04:00,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50f005af}, log id: 5e77e5b3 >2014-01-06 06:04:05,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3238ede4 >2014-01-06 06:04:05,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3238ede4 >2014-01-06 06:04:05,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: fd8655f >2014-01-06 06:04:06,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9be1ae87}, log id: fd8655f >2014-01-06 06:04:11,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ef2961c >2014-01-06 06:04:11,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ef2961c >2014-01-06 06:04:11,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10a4772 >2014-01-06 06:04:11,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8f155d3}, log id: 10a4772 >2014-01-06 06:04:16,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20c30e2b >2014-01-06 06:04:16,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 20c30e2b >2014-01-06 06:04:16,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30831fb7 >2014-01-06 06:04:16,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9bf6b9b}, log id: 30831fb7 >2014-01-06 06:04:22,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18b6b091 >2014-01-06 06:04:22,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 18b6b091 >2014-01-06 06:04:22,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b8a5aae >2014-01-06 06:04:22,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d77d5d0}, log id: 2b8a5aae >2014-01-06 06:04:27,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e4b8cfb >2014-01-06 06:04:27,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6e4b8cfb >2014-01-06 06:04:27,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22346879 >2014-01-06 06:04:27,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3ffc52}, log id: 22346879 >2014-01-06 06:04:32,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39dac304 >2014-01-06 06:04:33,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 39dac304 >2014-01-06 06:04:33,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 527c3bbd >2014-01-06 06:04:33,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e7343f6}, log id: 527c3bbd >2014-01-06 06:04:38,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b4d7342 >2014-01-06 06:04:38,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b4d7342 >2014-01-06 06:04:38,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b7b24f >2014-01-06 06:04:38,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93fae653}, log id: 5b7b24f >2014-01-06 06:04:43,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f58cf49 >2014-01-06 06:04:44,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1f58cf49 >2014-01-06 06:04:44,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9b1b62d >2014-01-06 06:04:44,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad07200c}, log id: 9b1b62d >2014-01-06 06:04:44,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5364abc0 >2014-01-06 06:04:45,311 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:04:45,312 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:04:45,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, log id: 5364abc0 >2014-01-06 06:04:45,312 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-59) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:04:49,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ba4b713 >2014-01-06 06:04:49,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: ba4b713 >2014-01-06 06:04:49,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b756a59 >2014-01-06 06:04:49,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16b8489f}, log id: 3b756a59 >2014-01-06 06:04:54,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27946b99 >2014-01-06 06:04:55,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 27946b99 >2014-01-06 06:04:55,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b55748b >2014-01-06 06:04:55,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@537c67e}, log id: 6b55748b >2014-01-06 06:05:00,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36622cb4 >2014-01-06 06:05:00,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 36622cb4 >2014-01-06 06:05:00,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 665f3750 >2014-01-06 06:05:00,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f0282a4}, log id: 665f3750 >2014-01-06 06:05:05,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77849f3f >2014-01-06 06:05:05,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 77849f3f >2014-01-06 06:05:05,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 427353f0 >2014-01-06 06:05:06,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5c297e9}, log id: 427353f0 >2014-01-06 06:05:11,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33f7d283 >2014-01-06 06:05:11,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 33f7d283 >2014-01-06 06:05:11,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1174829c >2014-01-06 06:05:11,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c546ffa2}, log id: 1174829c >2014-01-06 06:05:16,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f066358 >2014-01-06 06:05:16,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7f066358 >2014-01-06 06:05:16,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5193f648 >2014-01-06 06:05:17,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f33c8236}, log id: 5193f648 >2014-01-06 06:05:22,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 333b5bdd >2014-01-06 06:05:22,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 333b5bdd >2014-01-06 06:05:22,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ac0eaa7 >2014-01-06 06:05:22,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23134573}, log id: 1ac0eaa7 >2014-01-06 06:05:27,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f7aa07 >2014-01-06 06:05:27,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6f7aa07 >2014-01-06 06:05:27,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 84dcb95 >2014-01-06 06:05:27,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba3ae1d3}, log id: 84dcb95 >2014-01-06 06:05:32,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79c1abd3 >2014-01-06 06:05:33,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 79c1abd3 >2014-01-06 06:05:33,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1cb8ff94 >2014-01-06 06:05:33,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5655c357}, log id: 1cb8ff94 >2014-01-06 06:05:38,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b7d7391 >2014-01-06 06:05:38,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b7d7391 >2014-01-06 06:05:38,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68db60df >2014-01-06 06:05:38,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36bd9298}, log id: 68db60df >2014-01-06 06:05:43,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: d99e570 >2014-01-06 06:05:44,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: d99e570 >2014-01-06 06:05:44,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 175643a1 >2014-01-06 06:05:44,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c49019c8}, log id: 175643a1 >2014-01-06 06:05:45,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7717d551 >2014-01-06 06:05:45,634 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:05:45,634 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:05:45,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, log id: 7717d551 >2014-01-06 06:05:45,634 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-11) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:05:49,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a7349e2 >2014-01-06 06:05:49,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4a7349e2 >2014-01-06 06:05:49,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a3355e1 >2014-01-06 06:05:49,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@326cf36e}, log id: 5a3355e1 >2014-01-06 06:05:54,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15d63dad >2014-01-06 06:05:55,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 15d63dad >2014-01-06 06:05:55,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ca4699a >2014-01-06 06:05:55,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e783b6fa}, log id: 6ca4699a >2014-01-06 06:06:00,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d481c32 >2014-01-06 06:06:00,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d481c32 >2014-01-06 06:06:00,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1242d5db >2014-01-06 06:06:00,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@606cb000}, log id: 1242d5db >2014-01-06 06:06:05,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cee577a >2014-01-06 06:06:05,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6cee577a >2014-01-06 06:06:05,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44441c89 >2014-01-06 06:06:06,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac8fe570}, log id: 44441c89 >2014-01-06 06:06:11,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c16059e >2014-01-06 06:06:11,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5c16059e >2014-01-06 06:06:11,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b5b6067 >2014-01-06 06:06:11,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cc6c440}, log id: 2b5b6067 >2014-01-06 06:06:16,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51d45a40 >2014-01-06 06:06:16,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 51d45a40 >2014-01-06 06:06:16,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2188816b >2014-01-06 06:06:17,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2d447d4}, log id: 2188816b >2014-01-06 06:06:22,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6abb0c2d >2014-01-06 06:06:22,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6abb0c2d >2014-01-06 06:06:22,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 220a0619 >2014-01-06 06:06:22,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68a9f0a0}, log id: 220a0619 >2014-01-06 06:06:27,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17106e81 >2014-01-06 06:06:27,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 17106e81 >2014-01-06 06:06:27,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 668803d1 >2014-01-06 06:06:27,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aac783e8}, log id: 668803d1 >2014-01-06 06:06:32,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7116c663 >2014-01-06 06:06:33,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7116c663 >2014-01-06 06:06:33,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13d6268c >2014-01-06 06:06:33,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c51eaa8e}, log id: 13d6268c >2014-01-06 06:06:38,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 591d2cb8 >2014-01-06 06:06:38,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 591d2cb8 >2014-01-06 06:06:38,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43a4a34b >2014-01-06 06:06:38,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f0529dc}, log id: 43a4a34b >2014-01-06 06:06:43,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19ae1498 >2014-01-06 06:06:44,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 19ae1498 >2014-01-06 06:06:44,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29fc863d >2014-01-06 06:06:44,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb3b78a6}, log id: 29fc863d >2014-01-06 06:06:45,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 567b76c0 >2014-01-06 06:06:45,954 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:06:45,954 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:06:45,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, log id: 567b76c0 >2014-01-06 06:06:45,954 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-78) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:06:49,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b50d999 >2014-01-06 06:06:49,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7b50d999 >2014-01-06 06:06:49,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52ff050d >2014-01-06 06:06:49,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70f3b51f}, log id: 52ff050d >2014-01-06 06:06:54,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 371e38a >2014-01-06 06:06:55,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 371e38a >2014-01-06 06:06:55,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e6fe415 >2014-01-06 06:06:55,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c10b6e45}, log id: 3e6fe415 >2014-01-06 06:07:00,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 51dc1d07 >2014-01-06 06:07:00,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 51dc1d07 >2014-01-06 06:07:00,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35a85edd >2014-01-06 06:07:00,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15e8e94b}, log id: 35a85edd >2014-01-06 06:07:05,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 203c4c28 >2014-01-06 06:07:05,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 203c4c28 >2014-01-06 06:07:05,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2314e52c >2014-01-06 06:07:06,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e82e62ff}, log id: 2314e52c >2014-01-06 06:07:11,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 86dd0b9 >2014-01-06 06:07:11,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 86dd0b9 >2014-01-06 06:07:11,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e5ff628 >2014-01-06 06:07:11,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8ccd8bd}, log id: 6e5ff628 >2014-01-06 06:07:16,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37feacc >2014-01-06 06:07:16,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 37feacc >2014-01-06 06:07:16,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f1a37a8 >2014-01-06 06:07:17,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1c48f93}, log id: 4f1a37a8 >2014-01-06 06:07:22,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ad11010 >2014-01-06 06:07:22,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ad11010 >2014-01-06 06:07:22,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 665bcf95 >2014-01-06 06:07:22,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee962610}, log id: 665bcf95 >2014-01-06 06:07:27,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f589ca6 >2014-01-06 06:07:27,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3f589ca6 >2014-01-06 06:07:27,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1315e725 >2014-01-06 06:07:27,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfcb5b2f}, log id: 1315e725 >2014-01-06 06:07:32,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54a5ebec >2014-01-06 06:07:33,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 54a5ebec >2014-01-06 06:07:33,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33e65ec0 >2014-01-06 06:07:33,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9c61c72}, log id: 33e65ec0 >2014-01-06 06:07:38,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4bbd63af >2014-01-06 06:07:38,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4bbd63af >2014-01-06 06:07:38,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f97e05c >2014-01-06 06:07:38,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f9d50}, log id: 7f97e05c >2014-01-06 06:07:43,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25079ad5 >2014-01-06 06:07:44,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25079ad5 >2014-01-06 06:07:44,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17c56b00 >2014-01-06 06:07:44,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad79aec9}, log id: 17c56b00 >2014-01-06 06:07:45,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22067f23 >2014-01-06 06:07:46,282 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:07:46,282 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:07:46,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, log id: 22067f23 >2014-01-06 06:07:46,282 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-57) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:07:49,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62e81f95 >2014-01-06 06:07:49,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 62e81f95 >2014-01-06 06:07:49,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b365de9 >2014-01-06 06:07:49,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a6df1d5}, log id: 3b365de9 >2014-01-06 06:07:54,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e956e2d >2014-01-06 06:07:55,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e956e2d >2014-01-06 06:07:55,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41f27610 >2014-01-06 06:07:55,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1309d503}, log id: 41f27610 >2014-01-06 06:08:00,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78a6a754 >2014-01-06 06:08:00,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 78a6a754 >2014-01-06 06:08:00,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8c685a3 >2014-01-06 06:08:00,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa60319a}, log id: 8c685a3 >2014-01-06 06:08:05,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 30d46cb >2014-01-06 06:08:05,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 30d46cb >2014-01-06 06:08:05,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 672b416e >2014-01-06 06:08:06,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e53fa155}, log id: 672b416e >2014-01-06 06:08:11,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ae171cd >2014-01-06 06:08:11,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6ae171cd >2014-01-06 06:08:11,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f940fa3 >2014-01-06 06:08:11,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23677dfa}, log id: 5f940fa3 >2014-01-06 06:08:16,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42e97a85 >2014-01-06 06:08:16,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 42e97a85 >2014-01-06 06:08:16,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79d3144e >2014-01-06 06:08:17,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19fa0cf3}, log id: 79d3144e >2014-01-06 06:08:22,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ba0edd >2014-01-06 06:08:22,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7ba0edd >2014-01-06 06:08:22,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2feccf0 >2014-01-06 06:08:22,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26cd538c}, log id: 2feccf0 >2014-01-06 06:08:27,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 506907ed >2014-01-06 06:08:27,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 506907ed >2014-01-06 06:08:27,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33a48bd3 >2014-01-06 06:08:27,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67c49cb0}, log id: 33a48bd3 >2014-01-06 06:08:32,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 16827fad >2014-01-06 06:08:33,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 16827fad >2014-01-06 06:08:33,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c6732de >2014-01-06 06:08:33,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d1cd361}, log id: 1c6732de >2014-01-06 06:08:38,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45deb6a1 >2014-01-06 06:08:38,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 45deb6a1 >2014-01-06 06:08:38,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 164a07ea >2014-01-06 06:08:38,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a13dc133}, log id: 164a07ea >2014-01-06 06:08:43,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50571977 >2014-01-06 06:08:43,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@420deecb, log id: 50571977 >2014-01-06 06:08:43,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 586b8152 >2014-01-06 06:08:44,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 586b8152 >2014-01-06 06:08:44,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 16bfa0e4 >2014-01-06 06:08:44,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5a3e48b}, log id: 16bfa0e4 >2014-01-06 06:08:46,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f349ed3 >2014-01-06 06:08:46,619 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:08:46,619 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:08:46,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, log id: 6f349ed3 >2014-01-06 06:08:46,620 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-85) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:08:49,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 83a9feb >2014-01-06 06:08:49,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 83a9feb >2014-01-06 06:08:49,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b5ed1bf >2014-01-06 06:08:49,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac4fdb51}, log id: 1b5ed1bf >2014-01-06 06:08:54,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e29a369 >2014-01-06 06:08:55,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2e29a369 >2014-01-06 06:08:55,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c794794 >2014-01-06 06:08:55,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86ab2fa0}, log id: 7c794794 >2014-01-06 06:09:00,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75209586 >2014-01-06 06:09:00,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 75209586 >2014-01-06 06:09:00,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e757200 >2014-01-06 06:09:00,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a626ebb2}, log id: 3e757200 >2014-01-06 06:09:05,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d8be165 >2014-01-06 06:09:06,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6d8be165 >2014-01-06 06:09:06,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60b0c9d4 >2014-01-06 06:09:06,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43af686d}, log id: 60b0c9d4 >2014-01-06 06:09:11,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40c8c670 >2014-01-06 06:09:11,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 40c8c670 >2014-01-06 06:09:11,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7be73233 >2014-01-06 06:09:11,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14b5b6cf}, log id: 7be73233 >2014-01-06 06:09:16,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16a7997a >2014-01-06 06:09:16,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 16a7997a >2014-01-06 06:09:16,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c23e9e1 >2014-01-06 06:09:17,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28b70312}, log id: c23e9e1 >2014-01-06 06:09:22,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 125024c7 >2014-01-06 06:09:22,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 125024c7 >2014-01-06 06:09:22,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64482558 >2014-01-06 06:09:22,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75538a14}, log id: 64482558 >2014-01-06 06:09:27,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51b5f9b6 >2014-01-06 06:09:27,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 51b5f9b6 >2014-01-06 06:09:27,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 651b62e2 >2014-01-06 06:09:28,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@989f6e65}, log id: 651b62e2 >2014-01-06 06:09:33,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f3d5244 >2014-01-06 06:09:33,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7f3d5244 >2014-01-06 06:09:33,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40e65a63 >2014-01-06 06:09:33,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d591735a}, log id: 40e65a63 >2014-01-06 06:09:38,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27054a88 >2014-01-06 06:09:38,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 27054a88 >2014-01-06 06:09:38,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d5a7649 >2014-01-06 06:09:38,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f22d86b}, log id: 6d5a7649 >2014-01-06 06:09:43,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: af202da >2014-01-06 06:09:44,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: af202da >2014-01-06 06:09:44,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42e5842c >2014-01-06 06:09:44,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f62bb6ac}, log id: 42e5842c >2014-01-06 06:09:46,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c704e3d >2014-01-06 06:09:46,944 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:09:46,945 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:09:46,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, log id: 2c704e3d >2014-01-06 06:09:46,945 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-96) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:09:49,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3468a590 >2014-01-06 06:09:49,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3468a590 >2014-01-06 06:09:49,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 174c7e13 >2014-01-06 06:09:49,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4cb150e}, log id: 174c7e13 >2014-01-06 06:09:54,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1cf365d4 >2014-01-06 06:09:55,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1cf365d4 >2014-01-06 06:09:55,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65ac5242 >2014-01-06 06:09:55,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd6b97d8}, log id: 65ac5242 >2014-01-06 06:10:00,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f40b4cb >2014-01-06 06:10:00,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7f40b4cb >2014-01-06 06:10:00,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a0777b2 >2014-01-06 06:10:00,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b3f9e01}, log id: 4a0777b2 >2014-01-06 06:10:05,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c25ffa1 >2014-01-06 06:10:06,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1c25ffa1 >2014-01-06 06:10:06,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43dfccb6 >2014-01-06 06:10:06,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4f9d7e1}, log id: 43dfccb6 >2014-01-06 06:10:11,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b37fb6a >2014-01-06 06:10:11,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2b37fb6a >2014-01-06 06:10:11,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6fb6bb1b >2014-01-06 06:10:11,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4935ed02}, log id: 6fb6bb1b >2014-01-06 06:10:16,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e441b96 >2014-01-06 06:10:16,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e441b96 >2014-01-06 06:10:16,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b944c2b >2014-01-06 06:10:17,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee7ef3ed}, log id: 5b944c2b >2014-01-06 06:10:22,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7eb39595 >2014-01-06 06:10:22,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7eb39595 >2014-01-06 06:10:22,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 773ba13b >2014-01-06 06:10:22,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56f750cd}, log id: 773ba13b >2014-01-06 06:10:27,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6cf8e94b >2014-01-06 06:10:27,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6cf8e94b >2014-01-06 06:10:27,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a807b4d >2014-01-06 06:10:28,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99b2a525}, log id: 4a807b4d >2014-01-06 06:10:33,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 523bc4c4 >2014-01-06 06:10:33,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 523bc4c4 >2014-01-06 06:10:33,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 217a2f3a >2014-01-06 06:10:33,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6be2f17e}, log id: 217a2f3a >2014-01-06 06:10:38,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 393df03c >2014-01-06 06:10:38,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 393df03c >2014-01-06 06:10:38,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f5320ac >2014-01-06 06:10:38,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8fa408f}, log id: 2f5320ac >2014-01-06 06:10:43,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7281ffc3 >2014-01-06 06:10:44,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7281ffc3 >2014-01-06 06:10:44,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 12b9b397 >2014-01-06 06:10:44,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5e7d653}, log id: 12b9b397 >2014-01-06 06:10:46,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 498a176e >2014-01-06 06:10:47,282 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:10:47,283 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:10:47,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, log id: 498a176e >2014-01-06 06:10:47,283 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-62) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:10:49,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 720d8f2a >2014-01-06 06:10:49,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 720d8f2a >2014-01-06 06:10:49,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2bd377f0 >2014-01-06 06:10:49,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3e98478}, log id: 2bd377f0 >2014-01-06 06:10:54,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3fc4d3cc >2014-01-06 06:10:55,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3fc4d3cc >2014-01-06 06:10:55,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: bd9029c >2014-01-06 06:10:55,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@304967f2}, log id: bd9029c >2014-01-06 06:11:00,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6549f930 >2014-01-06 06:11:00,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6549f930 >2014-01-06 06:11:00,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70914349 >2014-01-06 06:11:00,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b64305b}, log id: 70914349 >2014-01-06 06:11:05,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1589d843 >2014-01-06 06:11:06,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1589d843 >2014-01-06 06:11:06,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 65e4d88b >2014-01-06 06:11:06,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb8d42e3}, log id: 65e4d88b >2014-01-06 06:11:11,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1af98a56 >2014-01-06 06:11:11,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1af98a56 >2014-01-06 06:11:11,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 756e5366 >2014-01-06 06:11:11,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b227a43}, log id: 756e5366 >2014-01-06 06:11:16,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cad3c08 >2014-01-06 06:11:17,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6cad3c08 >2014-01-06 06:11:17,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77bf7dd3 >2014-01-06 06:11:17,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bbef7e6}, log id: 77bf7dd3 >2014-01-06 06:11:22,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 613c957 >2014-01-06 06:11:22,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 613c957 >2014-01-06 06:11:22,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a943187 >2014-01-06 06:11:22,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a6c51fe}, log id: 7a943187 >2014-01-06 06:11:27,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4fd2a332 >2014-01-06 06:11:27,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4fd2a332 >2014-01-06 06:11:27,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 618bfa52 >2014-01-06 06:11:28,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffa5cebc}, log id: 618bfa52 >2014-01-06 06:11:33,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67796bab >2014-01-06 06:11:33,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 67796bab >2014-01-06 06:11:33,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c778794 >2014-01-06 06:11:33,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51ec4721}, log id: 5c778794 >2014-01-06 06:11:38,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c4fbbfa >2014-01-06 06:11:38,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4c4fbbfa >2014-01-06 06:11:38,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 585590c6 >2014-01-06 06:11:38,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1cb1da6}, log id: 585590c6 >2014-01-06 06:11:44,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7136b16 >2014-01-06 06:11:44,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7136b16 >2014-01-06 06:11:44,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4938ac4a >2014-01-06 06:11:44,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8502f1d0}, log id: 4938ac4a >2014-01-06 06:11:47,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 515d33cc >2014-01-06 06:11:47,610 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:11:47,610 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:11:47,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, log id: 515d33cc >2014-01-06 06:11:47,610 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-32) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:11:49,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59329132 >2014-01-06 06:11:49,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 59329132 >2014-01-06 06:11:49,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79790499 >2014-01-06 06:11:49,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5061938a}, log id: 79790499 >2014-01-06 06:11:54,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e7f98dc >2014-01-06 06:11:55,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e7f98dc >2014-01-06 06:11:55,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1513a068 >2014-01-06 06:11:55,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@903e82af}, log id: 1513a068 >2014-01-06 06:12:00,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2851190 >2014-01-06 06:12:00,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2851190 >2014-01-06 06:12:00,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8e77938 >2014-01-06 06:12:00,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7157973}, log id: 8e77938 >2014-01-06 06:12:05,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 332bc353 >2014-01-06 06:12:06,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 332bc353 >2014-01-06 06:12:06,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79374d58 >2014-01-06 06:12:06,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1adf088e}, log id: 79374d58 >2014-01-06 06:12:11,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 552a8f0 >2014-01-06 06:12:11,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 552a8f0 >2014-01-06 06:12:11,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7cb195fa >2014-01-06 06:12:11,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@461ee5b3}, log id: 7cb195fa >2014-01-06 06:12:16,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4292f20e >2014-01-06 06:12:17,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4292f20e >2014-01-06 06:12:17,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a58ec7 >2014-01-06 06:12:17,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e93fa730}, log id: 7a58ec7 >2014-01-06 06:12:22,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 789acb17 >2014-01-06 06:12:22,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 789acb17 >2014-01-06 06:12:22,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e31e51c >2014-01-06 06:12:22,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fbc8471}, log id: 6e31e51c >2014-01-06 06:12:27,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9996d72 >2014-01-06 06:12:27,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 9996d72 >2014-01-06 06:12:27,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6cdca3f0 >2014-01-06 06:12:28,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3cf0996}, log id: 6cdca3f0 >2014-01-06 06:12:33,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74ac87b2 >2014-01-06 06:12:33,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 74ac87b2 >2014-01-06 06:12:33,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63197fab >2014-01-06 06:12:33,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdd18a5}, log id: 63197fab >2014-01-06 06:12:38,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f53d8fa >2014-01-06 06:12:38,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1f53d8fa >2014-01-06 06:12:38,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77f673dc >2014-01-06 06:12:38,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@594f3f2}, log id: 77f673dc >2014-01-06 06:12:44,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a992741 >2014-01-06 06:12:44,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2a992741 >2014-01-06 06:12:44,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ee1870f >2014-01-06 06:12:44,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87849299}, log id: 3ee1870f >2014-01-06 06:12:47,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c161301 >2014-01-06 06:12:47,942 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:12:47,942 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:12:47,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, log id: c161301 >2014-01-06 06:12:47,943 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-56) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:12:49,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 344fc377 >2014-01-06 06:12:49,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 344fc377 >2014-01-06 06:12:49,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75fc80fb >2014-01-06 06:12:49,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c0cd5b8}, log id: 75fc80fb >2014-01-06 06:12:54,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76b5b18b >2014-01-06 06:12:55,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 76b5b18b >2014-01-06 06:12:55,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 546d9aa7 >2014-01-06 06:12:55,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@923804f4}, log id: 546d9aa7 >2014-01-06 06:13:00,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 265a95b8 >2014-01-06 06:13:00,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 265a95b8 >2014-01-06 06:13:00,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 94f44e3 >2014-01-06 06:13:00,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@344f0eb0}, log id: 94f44e3 >2014-01-06 06:13:05,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66d0edba >2014-01-06 06:13:06,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66d0edba >2014-01-06 06:13:06,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f198ee8 >2014-01-06 06:13:06,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d712789e}, log id: 2f198ee8 >2014-01-06 06:13:11,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: aa839fc >2014-01-06 06:13:11,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: aa839fc >2014-01-06 06:13:11,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28e76e9a >2014-01-06 06:13:11,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6500b25}, log id: 28e76e9a >2014-01-06 06:13:16,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a407ee >2014-01-06 06:13:17,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4a407ee >2014-01-06 06:13:17,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7eadee52 >2014-01-06 06:13:17,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14e63e51}, log id: 7eadee52 >2014-01-06 06:13:22,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 215d6da >2014-01-06 06:13:22,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 215d6da >2014-01-06 06:13:22,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7388015d >2014-01-06 06:13:22,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf903682}, log id: 7388015d >2014-01-06 06:13:27,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53bae6d3 >2014-01-06 06:13:27,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 53bae6d3 >2014-01-06 06:13:27,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5d41c657 >2014-01-06 06:13:28,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62fd0c02}, log id: 5d41c657 >2014-01-06 06:13:33,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4abe1ebd >2014-01-06 06:13:33,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4abe1ebd >2014-01-06 06:13:33,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b356a6a >2014-01-06 06:13:33,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b201329a}, log id: 1b356a6a >2014-01-06 06:13:38,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e65dd7a >2014-01-06 06:13:38,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: e65dd7a >2014-01-06 06:13:38,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e90863a >2014-01-06 06:13:39,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7512aa66}, log id: e90863a >2014-01-06 06:13:43,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78566aeb >2014-01-06 06:13:43,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4832ddfe, log id: 78566aeb >2014-01-06 06:13:44,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ef88b62 >2014-01-06 06:13:44,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: ef88b62 >2014-01-06 06:13:44,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c4641c6 >2014-01-06 06:13:44,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b31439ba}, log id: 7c4641c6 >2014-01-06 06:13:47,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 533c6441 >2014-01-06 06:13:48,277 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:13:48,277 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:13:48,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, log id: 533c6441 >2014-01-06 06:13:48,277 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-34) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:13:49,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1cc7d7c1 >2014-01-06 06:13:49,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1cc7d7c1 >2014-01-06 06:13:49,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56b6865d >2014-01-06 06:13:49,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40e467d6}, log id: 56b6865d >2014-01-06 06:13:54,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1bdaa5db >2014-01-06 06:13:55,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1bdaa5db >2014-01-06 06:13:55,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36c5c3b8 >2014-01-06 06:13:55,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19e4a2a3}, log id: 36c5c3b8 >2014-01-06 06:14:00,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 230b537f >2014-01-06 06:14:00,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 230b537f >2014-01-06 06:14:00,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56612d0b >2014-01-06 06:14:00,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c4a4662}, log id: 56612d0b >2014-01-06 06:14:05,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1dbb30b1 >2014-01-06 06:14:06,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1dbb30b1 >2014-01-06 06:14:06,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 723e8957 >2014-01-06 06:14:06,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f57e409}, log id: 723e8957 >2014-01-06 06:14:11,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5acfc5aa >2014-01-06 06:14:11,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5acfc5aa >2014-01-06 06:14:11,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b5ea329 >2014-01-06 06:14:11,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed8051c2}, log id: b5ea329 >2014-01-06 06:14:16,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 134fa8c0 >2014-01-06 06:14:17,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 134fa8c0 >2014-01-06 06:14:17,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7aa58f58 >2014-01-06 06:14:17,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7629c083}, log id: 7aa58f58 >2014-01-06 06:14:22,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ed0e18b >2014-01-06 06:14:22,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2ed0e18b >2014-01-06 06:14:22,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e2831b2 >2014-01-06 06:14:22,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@656d16d7}, log id: 1e2831b2 >2014-01-06 06:14:27,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b81f6d4 >2014-01-06 06:14:27,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b81f6d4 >2014-01-06 06:14:27,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4817d4a0 >2014-01-06 06:14:28,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0af0dbe}, log id: 4817d4a0 >2014-01-06 06:14:33,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 588e8a63 >2014-01-06 06:14:33,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 588e8a63 >2014-01-06 06:14:33,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c3b2a0a >2014-01-06 06:14:33,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7654479c}, log id: 5c3b2a0a >2014-01-06 06:14:38,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56a15b51 >2014-01-06 06:14:38,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56a15b51 >2014-01-06 06:14:38,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37133fb5 >2014-01-06 06:14:39,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8487782b}, log id: 37133fb5 >2014-01-06 06:14:44,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d85d423 >2014-01-06 06:14:44,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6d85d423 >2014-01-06 06:14:44,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a5c1ce6 >2014-01-06 06:14:44,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c29311ab}, log id: 1a5c1ce6 >2014-01-06 06:14:48,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57ed2b8a >2014-01-06 06:14:48,612 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:14:48,613 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:14:48,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterTasksListVDSCommand, log id: 57ed2b8a >2014-01-06 06:14:48,613 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-19) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:14:49,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d0a7614 >2014-01-06 06:14:49,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1d0a7614 >2014-01-06 06:14:49,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71f2c42b >2014-01-06 06:14:49,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7451817f}, log id: 71f2c42b >2014-01-06 06:14:54,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3bcdf0c0 >2014-01-06 06:14:55,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3bcdf0c0 >2014-01-06 06:14:55,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d0a6b3c >2014-01-06 06:14:55,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8956b9c}, log id: 4d0a6b3c >2014-01-06 06:15:00,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f03b1ed >2014-01-06 06:15:00,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7f03b1ed >2014-01-06 06:15:00,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 607068b4 >2014-01-06 06:15:00,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6a163f7}, log id: 607068b4 >2014-01-06 06:15:05,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fd1977a >2014-01-06 06:15:06,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3fd1977a >2014-01-06 06:15:06,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ae0ba56 >2014-01-06 06:15:06,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f1c4fe8}, log id: 7ae0ba56 >2014-01-06 06:15:11,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c707cde >2014-01-06 06:15:11,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2c707cde >2014-01-06 06:15:11,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 798a8c7a >2014-01-06 06:15:11,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af571989}, log id: 798a8c7a >2014-01-06 06:15:16,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6bafc363 >2014-01-06 06:15:17,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6bafc363 >2014-01-06 06:15:17,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6eb350cd >2014-01-06 06:15:17,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f803d27b}, log id: 6eb350cd >2014-01-06 06:15:22,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5081a92 >2014-01-06 06:15:22,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5081a92 >2014-01-06 06:15:22,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c16412b >2014-01-06 06:15:22,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95e28f91}, log id: c16412b >2014-01-06 06:15:27,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 683835a2 >2014-01-06 06:15:27,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 683835a2 >2014-01-06 06:15:27,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 44f0771c >2014-01-06 06:15:28,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@300a946b}, log id: 44f0771c >2014-01-06 06:15:33,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3944e792 >2014-01-06 06:15:33,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3944e792 >2014-01-06 06:15:33,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a8ef59e >2014-01-06 06:15:33,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6feff0}, log id: 6a8ef59e >2014-01-06 06:15:38,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 315ba5f >2014-01-06 06:15:38,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 315ba5f >2014-01-06 06:15:38,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 440fd686 >2014-01-06 06:15:39,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dce1671}, log id: 440fd686 >2014-01-06 06:15:44,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79f4be7d >2014-01-06 06:15:44,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 79f4be7d >2014-01-06 06:15:44,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16c78f99 >2014-01-06 06:15:44,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1b89e1f}, log id: 16c78f99 >2014-01-06 06:15:48,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c1332ea >2014-01-06 06:15:48,942 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:15:48,943 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:15:48,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, log id: 2c1332ea >2014-01-06 06:15:48,943 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-94) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:15:49,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75e356ff >2014-01-06 06:15:49,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 75e356ff >2014-01-06 06:15:49,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 354990d2 >2014-01-06 06:15:49,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91be122}, log id: 354990d2 >2014-01-06 06:15:54,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77db1baf >2014-01-06 06:15:55,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 77db1baf >2014-01-06 06:15:55,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e795822 >2014-01-06 06:15:55,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27a0781f}, log id: 7e795822 >2014-01-06 06:16:00,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a7b5ada >2014-01-06 06:16:00,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1a7b5ada >2014-01-06 06:16:00,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2bb4d68f >2014-01-06 06:16:00,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac0a995c}, log id: 2bb4d68f >2014-01-06 06:16:05,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7555f4c8 >2014-01-06 06:16:06,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7555f4c8 >2014-01-06 06:16:06,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5cbeae8c >2014-01-06 06:16:06,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d592f642}, log id: 5cbeae8c >2014-01-06 06:16:09,584 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-7) Start refreshing all users data >2014-01-06 06:16:10,559 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-01-06 06:16:10,560 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VM OVFs in Data Center Posixfs-DC-1 >2014-01-06 06:16:10,561 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated VM OVFs in Data Center Posixfs-DC-1 >2014-01-06 06:16:10,562 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update template OVFs in Data Center Posixfs-DC-1 >2014-01-06 06:16:10,563 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated templates OVFs in Data Center Posixfs-DC-1 >2014-01-06 06:16:10,563 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to remove unneeded template/vm OVFs in Data Center Posixfs-DC-1 >2014-01-06 06:16:10,564 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully removed unneeded template/vm OVFs in Data Center Posixfs-DC-1 >2014-01-06 06:16:10,564 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VM OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 06:16:10,565 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated VM OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 06:16:10,565 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update template OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 06:16:10,566 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated templates OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 06:16:10,566 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to remove unneeded template/vm OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 06:16:10,567 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully removed unneeded template/vm OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 06:16:11,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29708a2e >2014-01-06 06:16:11,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29708a2e >2014-01-06 06:16:11,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 646098fb >2014-01-06 06:16:11,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d739161}, log id: 646098fb >2014-01-06 06:16:16,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a77573d >2014-01-06 06:16:17,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6a77573d >2014-01-06 06:16:17,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d990f0 >2014-01-06 06:16:17,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f0ada33}, log id: 4d990f0 >2014-01-06 06:16:22,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63d724ef >2014-01-06 06:16:22,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 63d724ef >2014-01-06 06:16:22,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b7cb3c >2014-01-06 06:16:22,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b3cf7cf}, log id: 3b7cb3c >2014-01-06 06:16:27,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 12351277 >2014-01-06 06:16:27,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 12351277 >2014-01-06 06:16:27,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ef2a2c5 >2014-01-06 06:16:28,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95ceccce}, log id: 4ef2a2c5 >2014-01-06 06:16:33,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2936d9b3 >2014-01-06 06:16:33,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2936d9b3 >2014-01-06 06:16:33,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b3041be >2014-01-06 06:16:33,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcc885ad}, log id: 3b3041be >2014-01-06 06:16:38,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6abdbce0 >2014-01-06 06:16:38,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6abdbce0 >2014-01-06 06:16:38,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d1dc83c >2014-01-06 06:16:39,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@853a488e}, log id: 6d1dc83c >2014-01-06 06:16:44,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: d92a0a2 >2014-01-06 06:16:44,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: d92a0a2 >2014-01-06 06:16:44,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22148e63 >2014-01-06 06:16:44,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c6f8790}, log id: 22148e63 >2014-01-06 06:16:48,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d6b1448 >2014-01-06 06:16:49,266 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:16:49,267 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:16:49,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterTasksListVDSCommand, log id: d6b1448 >2014-01-06 06:16:49,267 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-27) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:16:49,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6293783c >2014-01-06 06:16:49,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6293783c >2014-01-06 06:16:49,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3acf8416 >2014-01-06 06:16:49,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b376b864}, log id: 3acf8416 >2014-01-06 06:16:54,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c2e47c0 >2014-01-06 06:16:55,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5c2e47c0 >2014-01-06 06:16:55,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1569de76 >2014-01-06 06:16:55,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fafa87fd}, log id: 1569de76 >2014-01-06 06:17:00,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ae6f3f8 >2014-01-06 06:17:00,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3ae6f3f8 >2014-01-06 06:17:00,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b3cfc1b >2014-01-06 06:17:00,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d0cb2b6}, log id: 1b3cfc1b >2014-01-06 06:17:05,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20740112 >2014-01-06 06:17:06,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 20740112 >2014-01-06 06:17:06,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34badd58 >2014-01-06 06:17:06,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d0c9e83}, log id: 34badd58 >2014-01-06 06:17:11,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: a2a4710 >2014-01-06 06:17:11,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: a2a4710 >2014-01-06 06:17:11,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3793f463 >2014-01-06 06:17:11,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4319812c}, log id: 3793f463 >2014-01-06 06:17:16,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e85a8ef >2014-01-06 06:17:17,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4e85a8ef >2014-01-06 06:17:17,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f9149d1 >2014-01-06 06:17:17,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93b2511b}, log id: 1f9149d1 >2014-01-06 06:17:22,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19dc1c5c >2014-01-06 06:17:22,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 19dc1c5c >2014-01-06 06:17:22,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f1dfb5e >2014-01-06 06:17:22,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf7894f3}, log id: 7f1dfb5e >2014-01-06 06:17:27,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9bc2613 >2014-01-06 06:17:27,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 9bc2613 >2014-01-06 06:17:27,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20752481 >2014-01-06 06:17:28,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fab0e8db}, log id: 20752481 >2014-01-06 06:17:33,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38fe5ba3 >2014-01-06 06:17:33,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 38fe5ba3 >2014-01-06 06:17:33,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2d86d957 >2014-01-06 06:17:33,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f63d0e86}, log id: 2d86d957 >2014-01-06 06:17:38,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27ba6763 >2014-01-06 06:17:38,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 27ba6763 >2014-01-06 06:17:38,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 32fc0f3 >2014-01-06 06:17:39,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97d45bd}, log id: 32fc0f3 >2014-01-06 06:17:44,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4229b339 >2014-01-06 06:17:44,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4229b339 >2014-01-06 06:17:44,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c3269e4 >2014-01-06 06:17:44,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4084b831}, log id: 4c3269e4 >2014-01-06 06:17:49,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4fa0f809 >2014-01-06 06:17:49,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 570c6222 >2014-01-06 06:17:49,592 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:17:49,592 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:17:49,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, log id: 4fa0f809 >2014-01-06 06:17:49,592 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-16) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:17:49,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 570c6222 >2014-01-06 06:17:49,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d671a40 >2014-01-06 06:17:49,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25c23e4c}, log id: 5d671a40 >2014-01-06 06:17:55,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63ef1be >2014-01-06 06:17:55,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 63ef1be >2014-01-06 06:17:55,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 26db4c5c >2014-01-06 06:17:55,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c5773a4}, log id: 26db4c5c >2014-01-06 06:18:00,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 657b6382 >2014-01-06 06:18:00,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 657b6382 >2014-01-06 06:18:00,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7fcdb61d >2014-01-06 06:18:00,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7597bf47}, log id: 7fcdb61d >2014-01-06 06:18:05,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65dfe29c >2014-01-06 06:18:06,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 65dfe29c >2014-01-06 06:18:06,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21aae90b >2014-01-06 06:18:06,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@444d7353}, log id: 21aae90b >2014-01-06 06:18:11,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25358654 >2014-01-06 06:18:11,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25358654 >2014-01-06 06:18:11,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64ef65a1 >2014-01-06 06:18:11,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ddfaba2}, log id: 64ef65a1 >2014-01-06 06:18:16,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60d30ef7 >2014-01-06 06:18:17,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 60d30ef7 >2014-01-06 06:18:17,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2d73a5e1 >2014-01-06 06:18:17,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@183429f2}, log id: 2d73a5e1 >2014-01-06 06:18:22,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7bc1a79 >2014-01-06 06:18:22,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7bc1a79 >2014-01-06 06:18:22,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38d5c5c >2014-01-06 06:18:22,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33e12c6c}, log id: 38d5c5c >2014-01-06 06:18:27,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e7f7713 >2014-01-06 06:18:28,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e7f7713 >2014-01-06 06:18:28,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21c9b2d5 >2014-01-06 06:18:28,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0f2e6e}, log id: 21c9b2d5 >2014-01-06 06:18:33,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f82a223 >2014-01-06 06:18:33,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7f82a223 >2014-01-06 06:18:33,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ee0244e >2014-01-06 06:18:33,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33e82150}, log id: 7ee0244e >2014-01-06 06:18:38,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 510e5235 >2014-01-06 06:18:38,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 510e5235 >2014-01-06 06:18:38,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68387b36 >2014-01-06 06:18:39,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0737038}, log id: 68387b36 >2014-01-06 06:18:43,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 256d2120 >2014-01-06 06:18:43,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4c835a02, log id: 256d2120 >2014-01-06 06:18:44,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58d3de6c >2014-01-06 06:18:44,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 58d3de6c >2014-01-06 06:18:44,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b6a61b6 >2014-01-06 06:18:44,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4accd3b}, log id: b6a61b6 >2014-01-06 06:18:49,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4dedd8c6 >2014-01-06 06:18:49,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 599c4672 >2014-01-06 06:18:49,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4dedd8c6 >2014-01-06 06:18:49,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24733c2 >2014-01-06 06:18:49,928 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:18:49,928 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:18:49,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, log id: 599c4672 >2014-01-06 06:18:49,928 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-39) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:18:50,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68c2a3ed}, log id: 24733c2 >2014-01-06 06:18:55,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4069889c >2014-01-06 06:18:55,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4069889c >2014-01-06 06:18:55,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59d4b692 >2014-01-06 06:18:55,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7cb8ea1}, log id: 59d4b692 >2014-01-06 06:19:00,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b00f306 >2014-01-06 06:19:00,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b00f306 >2014-01-06 06:19:00,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10f12f8e >2014-01-06 06:19:00,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@822681bf}, log id: 10f12f8e >2014-01-06 06:19:05,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a7581fb >2014-01-06 06:19:06,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1a7581fb >2014-01-06 06:19:06,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55e72ac8 >2014-01-06 06:19:06,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ed0cbad}, log id: 55e72ac8 >2014-01-06 06:19:11,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65f6c4ee >2014-01-06 06:19:11,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 65f6c4ee >2014-01-06 06:19:11,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58845cad >2014-01-06 06:19:11,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e31d5799}, log id: 58845cad >2014-01-06 06:19:16,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68cc8a40 >2014-01-06 06:19:17,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 68cc8a40 >2014-01-06 06:19:17,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4adbf6f0 >2014-01-06 06:19:17,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b8d4966}, log id: 4adbf6f0 >2014-01-06 06:19:22,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b788289 >2014-01-06 06:19:22,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1b788289 >2014-01-06 06:19:22,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 435cb7f9 >2014-01-06 06:19:22,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e43b5fb7}, log id: 435cb7f9 >2014-01-06 06:19:27,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3428520a >2014-01-06 06:19:28,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3428520a >2014-01-06 06:19:28,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 369126b1 >2014-01-06 06:19:28,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d9b2aaf}, log id: 369126b1 >2014-01-06 06:19:33,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1512c4b >2014-01-06 06:19:33,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1512c4b >2014-01-06 06:19:33,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 268340fb >2014-01-06 06:19:33,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39c22c0b}, log id: 268340fb >2014-01-06 06:19:38,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6452de4c >2014-01-06 06:19:39,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6452de4c >2014-01-06 06:19:39,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3dec7c66 >2014-01-06 06:19:39,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f2f9505}, log id: 3dec7c66 >2014-01-06 06:19:44,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58fb6962 >2014-01-06 06:19:44,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 58fb6962 >2014-01-06 06:19:44,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b42992a >2014-01-06 06:19:44,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30b2bdbe}, log id: 6b42992a >2014-01-06 06:19:49,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40f8da45 >2014-01-06 06:19:49,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 40f8da45 >2014-01-06 06:19:49,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77e39787 >2014-01-06 06:19:49,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 615de61c >2014-01-06 06:19:50,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb7024e5}, log id: 77e39787 >2014-01-06 06:19:50,256 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:19:50,256 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:19:50,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, log id: 615de61c >2014-01-06 06:19:50,256 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-28) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:19:55,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25292563 >2014-01-06 06:19:55,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25292563 >2014-01-06 06:19:55,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d1da980 >2014-01-06 06:19:55,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@927587e4}, log id: 6d1da980 >2014-01-06 06:20:00,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 326f5781 >2014-01-06 06:20:00,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 326f5781 >2014-01-06 06:20:00,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1da37981 >2014-01-06 06:20:00,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@340f2535}, log id: 1da37981 >2014-01-06 06:20:06,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f6bc5dd >2014-01-06 06:20:06,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7f6bc5dd >2014-01-06 06:20:06,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28639f99 >2014-01-06 06:20:06,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dfaa4f0}, log id: 28639f99 >2014-01-06 06:20:11,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30cc7275 >2014-01-06 06:20:11,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 30cc7275 >2014-01-06 06:20:11,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ec07851 >2014-01-06 06:20:11,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78f1d69a}, log id: 5ec07851 >2014-01-06 06:20:16,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ab0b048 >2014-01-06 06:20:17,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6ab0b048 >2014-01-06 06:20:17,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77d55d31 >2014-01-06 06:20:17,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e279cb1f}, log id: 77d55d31 >2014-01-06 06:20:22,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62498f1a >2014-01-06 06:20:22,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 62498f1a >2014-01-06 06:20:22,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54e2c769 >2014-01-06 06:20:22,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a28f4429}, log id: 54e2c769 >2014-01-06 06:20:27,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7259fb83 >2014-01-06 06:20:28,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7259fb83 >2014-01-06 06:20:28,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ccce15d >2014-01-06 06:20:28,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7349e38f}, log id: 3ccce15d >2014-01-06 06:20:33,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ad1fde1 >2014-01-06 06:20:33,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6ad1fde1 >2014-01-06 06:20:33,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 592c7402 >2014-01-06 06:20:33,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15b74b2b}, log id: 592c7402 >2014-01-06 06:20:38,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 673ca574 >2014-01-06 06:20:39,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 673ca574 >2014-01-06 06:20:39,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3367c8ee >2014-01-06 06:20:39,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f836ac18}, log id: 3367c8ee >2014-01-06 06:20:44,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12ad6668 >2014-01-06 06:20:44,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 12ad6668 >2014-01-06 06:20:44,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 57d69148 >2014-01-06 06:20:44,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1df1e2c6}, log id: 57d69148 >2014-01-06 06:20:49,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2453c535 >2014-01-06 06:20:49,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2453c535 >2014-01-06 06:20:49,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 572f92d5 >2014-01-06 06:20:50,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d92df6e9}, log id: 572f92d5 >2014-01-06 06:20:50,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 513c14fc >2014-01-06 06:20:50,586 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:20:50,586 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:20:50,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, log id: 513c14fc >2014-01-06 06:20:50,586 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-98) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:20:55,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: bbe06c3 >2014-01-06 06:20:55,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: bbe06c3 >2014-01-06 06:20:55,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 528cace >2014-01-06 06:20:55,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95666ba9}, log id: 528cace >2014-01-06 06:21:00,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e05e8b4 >2014-01-06 06:21:00,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4e05e8b4 >2014-01-06 06:21:00,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 605114bd >2014-01-06 06:21:01,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2fb0e8f}, log id: 605114bd >2014-01-06 06:21:06,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a7cfc1a >2014-01-06 06:21:06,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6a7cfc1a >2014-01-06 06:21:06,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3802a13b >2014-01-06 06:21:06,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a49ce48c}, log id: 3802a13b >2014-01-06 06:21:11,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-48) START, GetIsoListVDSCommand( storagePoolId = ee718678-261f-4bad-ab5e-73b9697cb5f8, ignoreFailoverLimit = false), log id: 228e8b3e >2014-01-06 06:21:11,336 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-48) START, HsmGetIsoListVDSCommand(HostName = rhs-client10, HostId = e80de893-f6c4-4b96-9ce1-92a74ca5869a, storagePoolId=ee718678-261f-4bad-ab5e-73b9697cb5f8), log id: 3c57a52b >2014-01-06 06:21:11,353 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-48) FINISH, HsmGetIsoListVDSCommand, return: [en_windows_7_enterprise_with_sp1_x64_dvd_u_677651.iso], log id: 3c57a52b >2014-01-06 06:21:11,353 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-48) FINISH, GetIsoListVDSCommand, return: [en_windows_7_enterprise_with_sp1_x64_dvd_u_677651.iso], log id: 228e8b3e >2014-01-06 06:21:11,356 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (pool-4-thread-48) Finished automatic refresh process for ISO file type with success, for storage domain id cc1bba44-7b89-4b6e-acff-fb066601f8c7. >2014-01-06 06:21:11,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b2db0fa >2014-01-06 06:21:11,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2b2db0fa >2014-01-06 06:21:11,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7205f1b8 >2014-01-06 06:21:11,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ab05a86}, log id: 7205f1b8 >2014-01-06 06:21:16,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 778d72f7 >2014-01-06 06:21:17,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 778d72f7 >2014-01-06 06:21:17,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40834e61 >2014-01-06 06:21:17,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@364c81bf}, log id: 40834e61 >2014-01-06 06:21:22,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73147661 >2014-01-06 06:21:22,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73147661 >2014-01-06 06:21:22,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49a1fd6 >2014-01-06 06:21:22,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b23673f}, log id: 49a1fd6 >2014-01-06 06:21:27,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13b59ac8 >2014-01-06 06:21:28,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 13b59ac8 >2014-01-06 06:21:28,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f41cab3 >2014-01-06 06:21:28,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@210f5949}, log id: 6f41cab3 >2014-01-06 06:21:33,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33a919f5 >2014-01-06 06:21:33,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 33a919f5 >2014-01-06 06:21:33,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 378d8cf0 >2014-01-06 06:21:33,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f35cd5cd}, log id: 378d8cf0 >2014-01-06 06:21:38,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ad9b766 >2014-01-06 06:21:39,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6ad9b766 >2014-01-06 06:21:39,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 559114b9 >2014-01-06 06:21:39,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d54d7339}, log id: 559114b9 >2014-01-06 06:21:44,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 511eae4b >2014-01-06 06:21:44,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 511eae4b >2014-01-06 06:21:44,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31d210a2 >2014-01-06 06:21:44,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4240882b}, log id: 31d210a2 >2014-01-06 06:21:49,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 260e9335 >2014-01-06 06:21:49,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 260e9335 >2014-01-06 06:21:49,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 41356bc0 >2014-01-06 06:21:50,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6e07195}, log id: 41356bc0 >2014-01-06 06:21:50,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f02aa8a >2014-01-06 06:21:50,920 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:21:50,920 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:21:50,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, log id: 6f02aa8a >2014-01-06 06:21:50,921 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-91) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:21:55,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e320069 >2014-01-06 06:21:55,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e320069 >2014-01-06 06:21:55,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 286672a8 >2014-01-06 06:21:55,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab324190}, log id: 286672a8 >2014-01-06 06:22:00,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c499149 >2014-01-06 06:22:00,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3c499149 >2014-01-06 06:22:00,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2837c50 >2014-01-06 06:22:01,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84a1cc7e}, log id: 2837c50 >2014-01-06 06:22:06,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: a1302e7 >2014-01-06 06:22:06,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: a1302e7 >2014-01-06 06:22:06,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14e3e601 >2014-01-06 06:22:06,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@462563bc}, log id: 14e3e601 >2014-01-06 06:22:11,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6532edfa >2014-01-06 06:22:11,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6532edfa >2014-01-06 06:22:11,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ccc85d9 >2014-01-06 06:22:11,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63cd93df}, log id: 2ccc85d9 >2014-01-06 06:22:16,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 666c3058 >2014-01-06 06:22:17,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 666c3058 >2014-01-06 06:22:17,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58b7e300 >2014-01-06 06:22:17,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b51d0bc}, log id: 58b7e300 >2014-01-06 06:22:22,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66de5e55 >2014-01-06 06:22:22,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66de5e55 >2014-01-06 06:22:22,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3bf63fa2 >2014-01-06 06:22:22,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac03f5e9}, log id: 3bf63fa2 >2014-01-06 06:22:27,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d9305ae >2014-01-06 06:22:28,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5d9305ae >2014-01-06 06:22:28,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e3e0422 >2014-01-06 06:22:28,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d303e83a}, log id: 4e3e0422 >2014-01-06 06:22:33,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f70f272 >2014-01-06 06:22:33,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2f70f272 >2014-01-06 06:22:33,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22013668 >2014-01-06 06:22:33,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1283cddb}, log id: 22013668 >2014-01-06 06:22:38,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d23532f >2014-01-06 06:22:39,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5d23532f >2014-01-06 06:22:39,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3189d05f >2014-01-06 06:22:39,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c628bbc}, log id: 3189d05f >2014-01-06 06:22:44,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60bb870c >2014-01-06 06:22:44,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 60bb870c >2014-01-06 06:22:44,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 789e19ae >2014-01-06 06:22:44,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df0a733e}, log id: 789e19ae >2014-01-06 06:22:49,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18fe4482 >2014-01-06 06:22:49,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 18fe4482 >2014-01-06 06:22:49,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66310d69 >2014-01-06 06:22:50,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9747362e}, log id: 66310d69 >2014-01-06 06:22:50,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48c5c0fc >2014-01-06 06:22:51,261 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:22:51,262 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:22:51,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, log id: 48c5c0fc >2014-01-06 06:22:51,262 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-100) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:22:55,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10979ef6 >2014-01-06 06:22:55,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 10979ef6 >2014-01-06 06:22:55,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b30e099 >2014-01-06 06:22:55,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58691b8f}, log id: 1b30e099 >2014-01-06 06:23:00,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14ea0add >2014-01-06 06:23:00,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 14ea0add >2014-01-06 06:23:00,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36b11b24 >2014-01-06 06:23:01,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61a37c72}, log id: 36b11b24 >2014-01-06 06:23:06,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3566785c >2014-01-06 06:23:06,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3566785c >2014-01-06 06:23:06,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 533d0568 >2014-01-06 06:23:06,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89fcf249}, log id: 533d0568 >2014-01-06 06:23:11,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29c7d9f5 >2014-01-06 06:23:11,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29c7d9f5 >2014-01-06 06:23:11,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 772e0b47 >2014-01-06 06:23:11,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e05c2744}, log id: 772e0b47 >2014-01-06 06:23:17,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ad897a5 >2014-01-06 06:23:17,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1ad897a5 >2014-01-06 06:23:17,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 685c6b12 >2014-01-06 06:23:17,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f280335e}, log id: 685c6b12 >2014-01-06 06:23:22,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2000e4d4 >2014-01-06 06:23:22,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2000e4d4 >2014-01-06 06:23:22,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 55cd0d81 >2014-01-06 06:23:22,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a96e88cf}, log id: 55cd0d81 >2014-01-06 06:23:27,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ca7c14e >2014-01-06 06:23:28,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2ca7c14e >2014-01-06 06:23:28,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 51f2f5f4 >2014-01-06 06:23:28,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d770822}, log id: 51f2f5f4 >2014-01-06 06:23:33,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a5f8d96 >2014-01-06 06:23:33,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1a5f8d96 >2014-01-06 06:23:33,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3806addc >2014-01-06 06:23:33,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62e37e4c}, log id: 3806addc >2014-01-06 06:23:38,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 55382022 >2014-01-06 06:23:39,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 55382022 >2014-01-06 06:23:39,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 743e1284 >2014-01-06 06:23:39,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dec1009d}, log id: 743e1284 >2014-01-06 06:23:43,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 394e061e >2014-01-06 06:23:43,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@46579f61, log id: 394e061e >2014-01-06 06:23:44,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79bc0cfa >2014-01-06 06:23:44,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 79bc0cfa >2014-01-06 06:23:44,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b4a04b >2014-01-06 06:23:44,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a05d098}, log id: 5b4a04b >2014-01-06 06:23:49,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38aa177c >2014-01-06 06:23:50,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 38aa177c >2014-01-06 06:23:50,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3dc9395f >2014-01-06 06:23:50,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3572ce63}, log id: 3dc9395f >2014-01-06 06:23:51,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36a12a75 >2014-01-06 06:23:51,604 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:23:51,604 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:23:51,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, log id: 36a12a75 >2014-01-06 06:23:51,604 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-49) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:23:55,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33688d17 >2014-01-06 06:23:55,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 33688d17 >2014-01-06 06:23:55,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7aaf049f >2014-01-06 06:23:55,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc0b985f}, log id: 7aaf049f >2014-01-06 06:24:00,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 392ae24a >2014-01-06 06:24:00,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 392ae24a >2014-01-06 06:24:00,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 70465780 >2014-01-06 06:24:01,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3319df5e}, log id: 70465780 >2014-01-06 06:24:06,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 234aca33 >2014-01-06 06:24:06,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 234aca33 >2014-01-06 06:24:06,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e21b4b1 >2014-01-06 06:24:06,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3a62d96}, log id: 3e21b4b1 >2014-01-06 06:24:11,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d7c1eca >2014-01-06 06:24:11,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3d7c1eca >2014-01-06 06:24:11,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47b0987a >2014-01-06 06:24:12,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dea2afc}, log id: 47b0987a >2014-01-06 06:24:17,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7b0aca19 >2014-01-06 06:24:17,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7b0aca19 >2014-01-06 06:24:17,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 150341a3 >2014-01-06 06:24:17,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b055f88}, log id: 150341a3 >2014-01-06 06:24:22,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20b76cbd >2014-01-06 06:24:22,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 20b76cbd >2014-01-06 06:24:22,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c64a70c >2014-01-06 06:24:22,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63ad4057}, log id: 3c64a70c >2014-01-06 06:24:27,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25690300 >2014-01-06 06:24:28,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25690300 >2014-01-06 06:24:28,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 73997797 >2014-01-06 06:24:28,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81bc11f9}, log id: 73997797 >2014-01-06 06:24:33,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ff12bb4 >2014-01-06 06:24:33,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ff12bb4 >2014-01-06 06:24:33,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 42bd94b3 >2014-01-06 06:24:33,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfe40d6c}, log id: 42bd94b3 >2014-01-06 06:24:38,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5cc23694 >2014-01-06 06:24:39,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5cc23694 >2014-01-06 06:24:39,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 8c82536 >2014-01-06 06:24:39,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2d6ad9d}, log id: 8c82536 >2014-01-06 06:24:44,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6847988d >2014-01-06 06:24:44,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6847988d >2014-01-06 06:24:44,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22b74579 >2014-01-06 06:24:44,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42797aa2}, log id: 22b74579 >2014-01-06 06:24:49,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17034d11 >2014-01-06 06:24:50,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 17034d11 >2014-01-06 06:24:50,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d3d753b >2014-01-06 06:24:50,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f80b50b2}, log id: 6d3d753b >2014-01-06 06:24:51,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27da3655 >2014-01-06 06:24:51,938 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:24:51,938 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:24:51,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, log id: 27da3655 >2014-01-06 06:24:51,938 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-29) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:24:55,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66c2dec7 >2014-01-06 06:24:55,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66c2dec7 >2014-01-06 06:24:55,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ca0f61a >2014-01-06 06:24:55,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c40859b9}, log id: ca0f61a >2014-01-06 06:25:00,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3eddd174 >2014-01-06 06:25:00,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3eddd174 >2014-01-06 06:25:00,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 351096ef >2014-01-06 06:25:01,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21f6ed4d}, log id: 351096ef >2014-01-06 06:25:06,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 529c9761 >2014-01-06 06:25:06,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 529c9761 >2014-01-06 06:25:06,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1d2a5a27 >2014-01-06 06:25:06,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cce15cd9}, log id: 1d2a5a27 >2014-01-06 06:25:11,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c9a6979 >2014-01-06 06:25:11,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: c9a6979 >2014-01-06 06:25:11,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 106351b7 >2014-01-06 06:25:12,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a62fb05e}, log id: 106351b7 >2014-01-06 06:25:17,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f83d9e9 >2014-01-06 06:25:17,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5f83d9e9 >2014-01-06 06:25:17,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 796e2454 >2014-01-06 06:25:17,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea4a9307}, log id: 796e2454 >2014-01-06 06:25:22,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44f7d057 >2014-01-06 06:25:22,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 44f7d057 >2014-01-06 06:25:22,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46fdc9b0 >2014-01-06 06:25:22,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce31a764}, log id: 46fdc9b0 >2014-01-06 06:25:27,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50ced19 >2014-01-06 06:25:28,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 50ced19 >2014-01-06 06:25:28,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 180d6720 >2014-01-06 06:25:28,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebff204f}, log id: 180d6720 >2014-01-06 06:25:33,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7868c2b3 >2014-01-06 06:25:33,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7868c2b3 >2014-01-06 06:25:33,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 256b7dd6 >2014-01-06 06:25:33,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bc14e71}, log id: 256b7dd6 >2014-01-06 06:25:38,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: fea1ab3 >2014-01-06 06:25:39,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: fea1ab3 >2014-01-06 06:25:39,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5060dd24 >2014-01-06 06:25:39,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b22b65b9}, log id: 5060dd24 >2014-01-06 06:25:44,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18648e80 >2014-01-06 06:25:44,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 18648e80 >2014-01-06 06:25:44,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49459aa3 >2014-01-06 06:25:44,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6921f5b}, log id: 49459aa3 >2014-01-06 06:25:49,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31f6e016 >2014-01-06 06:25:50,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 31f6e016 >2014-01-06 06:25:50,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1eb67605 >2014-01-06 06:25:50,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@398faf88}, log id: 1eb67605 >2014-01-06 06:25:51,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6655528c >2014-01-06 06:25:52,270 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:25:52,271 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:25:52,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, log id: 6655528c >2014-01-06 06:25:52,271 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-61) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:25:55,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31a271ca >2014-01-06 06:25:55,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 31a271ca >2014-01-06 06:25:55,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2151aefa >2014-01-06 06:25:55,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa72d457}, log id: 2151aefa >2014-01-06 06:26:00,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3085cf32 >2014-01-06 06:26:00,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3085cf32 >2014-01-06 06:26:00,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56deadbd >2014-01-06 06:26:01,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1177cbec}, log id: 56deadbd >2014-01-06 06:26:06,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 560d36c0 >2014-01-06 06:26:06,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 560d36c0 >2014-01-06 06:26:06,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2854f469 >2014-01-06 06:26:06,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef955654}, log id: 2854f469 >2014-01-06 06:26:11,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2fc62898 >2014-01-06 06:26:11,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2fc62898 >2014-01-06 06:26:11,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d4406f4 >2014-01-06 06:26:12,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@770aa597}, log id: 4d4406f4 >2014-01-06 06:26:17,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 434d495c >2014-01-06 06:26:17,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 434d495c >2014-01-06 06:26:17,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7152e699 >2014-01-06 06:26:17,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d96cf50}, log id: 7152e699 >2014-01-06 06:26:22,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7bcf4e9e >2014-01-06 06:26:22,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7bcf4e9e >2014-01-06 06:26:22,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 38a1d87f >2014-01-06 06:26:22,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86bc9e5d}, log id: 38a1d87f >2014-01-06 06:26:27,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38e1114f >2014-01-06 06:26:28,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 38e1114f >2014-01-06 06:26:28,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d688045 >2014-01-06 06:26:28,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6129de9}, log id: 6d688045 >2014-01-06 06:26:33,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f814d74 >2014-01-06 06:26:33,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4f814d74 >2014-01-06 06:26:33,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35db7fc9 >2014-01-06 06:26:33,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78cb202f}, log id: 35db7fc9 >2014-01-06 06:26:38,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66bfea9f >2014-01-06 06:26:39,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 66bfea9f >2014-01-06 06:26:39,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 86efc69 >2014-01-06 06:26:39,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e173e0e0}, log id: 86efc69 >2014-01-06 06:26:44,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 53f37e24 >2014-01-06 06:26:44,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 53f37e24 >2014-01-06 06:26:44,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79e228eb >2014-01-06 06:26:44,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d4caec1}, log id: 79e228eb >2014-01-06 06:26:49,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7826e740 >2014-01-06 06:26:50,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7826e740 >2014-01-06 06:26:50,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 149eaf20 >2014-01-06 06:26:50,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9a4282f}, log id: 149eaf20 >2014-01-06 06:26:52,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 67a957d2 >2014-01-06 06:26:52,594 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:26:52,594 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:26:52,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterTasksListVDSCommand, log id: 67a957d2 >2014-01-06 06:26:52,595 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-5) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:26:55,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66556d80 >2014-01-06 06:26:55,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 66556d80 >2014-01-06 06:26:55,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 230e7c32 >2014-01-06 06:26:55,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1410c27b}, log id: 230e7c32 >2014-01-06 06:27:00,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a98b6a4 >2014-01-06 06:27:01,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7a98b6a4 >2014-01-06 06:27:01,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 727090e9 >2014-01-06 06:27:01,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3636eeac}, log id: 727090e9 >2014-01-06 06:27:06,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5dd62d00 >2014-01-06 06:27:06,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5dd62d00 >2014-01-06 06:27:06,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41805923 >2014-01-06 06:27:06,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c5acf6}, log id: 41805923 >2014-01-06 06:27:11,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11ad1d6 >2014-01-06 06:27:11,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 11ad1d6 >2014-01-06 06:27:11,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2878ced9 >2014-01-06 06:27:12,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@814f3e06}, log id: 2878ced9 >2014-01-06 06:27:17,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5024e803 >2014-01-06 06:27:17,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5024e803 >2014-01-06 06:27:17,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 362eee34 >2014-01-06 06:27:17,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f133004}, log id: 362eee34 >2014-01-06 06:27:22,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d3a5372 >2014-01-06 06:27:22,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d3a5372 >2014-01-06 06:27:22,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7bed91ce >2014-01-06 06:27:22,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d8f2c10}, log id: 7bed91ce >2014-01-06 06:27:27,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1582e6c4 >2014-01-06 06:27:28,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1582e6c4 >2014-01-06 06:27:28,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ec15d55 >2014-01-06 06:27:28,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42a50056}, log id: 6ec15d55 >2014-01-06 06:27:33,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7acb29b9 >2014-01-06 06:27:33,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7acb29b9 >2014-01-06 06:27:33,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 612bf24 >2014-01-06 06:27:33,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2769be96}, log id: 612bf24 >2014-01-06 06:27:38,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39a9149 >2014-01-06 06:27:39,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 39a9149 >2014-01-06 06:27:39,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e52830 >2014-01-06 06:27:39,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9bd005c}, log id: 4e52830 >2014-01-06 06:27:44,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71d80d63 >2014-01-06 06:27:44,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71d80d63 >2014-01-06 06:27:44,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21064fde >2014-01-06 06:27:44,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e0941b}, log id: 21064fde >2014-01-06 06:27:49,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 213ad5c5 >2014-01-06 06:27:50,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 213ad5c5 >2014-01-06 06:27:50,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e4ca77e >2014-01-06 06:27:50,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9be5720b}, log id: e4ca77e >2014-01-06 06:27:52,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 262da448 >2014-01-06 06:27:52,914 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:27:52,915 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:27:52,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, log id: 262da448 >2014-01-06 06:27:52,915 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-95) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:27:55,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c6de806 >2014-01-06 06:27:55,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7c6de806 >2014-01-06 06:27:55,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73fecd4f >2014-01-06 06:27:55,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@445a137a}, log id: 73fecd4f >2014-01-06 06:28:00,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25433a16 >2014-01-06 06:28:01,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25433a16 >2014-01-06 06:28:01,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1016e58b >2014-01-06 06:28:01,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e15e8ab2}, log id: 1016e58b >2014-01-06 06:28:06,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d76a696 >2014-01-06 06:28:06,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6d76a696 >2014-01-06 06:28:06,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18ec451a >2014-01-06 06:28:06,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63fc9b8b}, log id: 18ec451a >2014-01-06 06:28:11,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 516f984c >2014-01-06 06:28:11,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 516f984c >2014-01-06 06:28:11,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6dc0182a >2014-01-06 06:28:12,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af091065}, log id: 6dc0182a >2014-01-06 06:28:17,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5d1e78b5 >2014-01-06 06:28:17,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5d1e78b5 >2014-01-06 06:28:17,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a48ae94 >2014-01-06 06:28:17,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce81769e}, log id: 2a48ae94 >2014-01-06 06:28:22,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7be88f5d >2014-01-06 06:28:22,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7be88f5d >2014-01-06 06:28:22,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d958e63 >2014-01-06 06:28:22,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d14c2092}, log id: 6d958e63 >2014-01-06 06:28:27,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b992ffc >2014-01-06 06:28:28,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b992ffc >2014-01-06 06:28:28,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4de0aa5c >2014-01-06 06:28:28,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f9f057}, log id: 4de0aa5c >2014-01-06 06:28:33,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a127d33 >2014-01-06 06:28:33,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7a127d33 >2014-01-06 06:28:33,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47964f92 >2014-01-06 06:28:33,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23496820}, log id: 47964f92 >2014-01-06 06:28:38,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50cd9f45 >2014-01-06 06:28:39,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 50cd9f45 >2014-01-06 06:28:39,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b10affe >2014-01-06 06:28:39,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac5946fc}, log id: 6b10affe >2014-01-06 06:28:43,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39278436 >2014-01-06 06:28:44,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7a6ce713, log id: 39278436 >2014-01-06 06:28:44,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 55f7eb30 >2014-01-06 06:28:44,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 55f7eb30 >2014-01-06 06:28:44,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1505c6de >2014-01-06 06:28:44,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25668e7e}, log id: 1505c6de >2014-01-06 06:28:49,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a3303a3 >2014-01-06 06:28:50,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5a3303a3 >2014-01-06 06:28:50,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b21a5cd >2014-01-06 06:28:50,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9f546}, log id: 5b21a5cd >2014-01-06 06:28:52,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5acb63ea >2014-01-06 06:28:53,238 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:28:53,238 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:28:53,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, log id: 5acb63ea >2014-01-06 06:28:53,238 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-73) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:28:55,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b0f1c96 >2014-01-06 06:28:55,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b0f1c96 >2014-01-06 06:28:55,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2d740b38 >2014-01-06 06:28:55,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee8945cb}, log id: 2d740b38 >2014-01-06 06:29:00,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d169430 >2014-01-06 06:29:00,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4d169430 >2014-01-06 06:29:01,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e8d30c9 >2014-01-06 06:29:01,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c76e10fe}, log id: 7e8d30c9 >2014-01-06 06:29:06,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25b4b048 >2014-01-06 06:29:06,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25b4b048 >2014-01-06 06:29:06,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33787251 >2014-01-06 06:29:06,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20b06354}, log id: 33787251 >2014-01-06 06:29:11,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64f6e9ea >2014-01-06 06:29:11,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 64f6e9ea >2014-01-06 06:29:11,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40808446 >2014-01-06 06:29:12,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95f99191}, log id: 40808446 >2014-01-06 06:29:17,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 69706993 >2014-01-06 06:29:17,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 69706993 >2014-01-06 06:29:17,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20ead4c6 >2014-01-06 06:29:17,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af0e0a12}, log id: 20ead4c6 >2014-01-06 06:29:22,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ec61035 >2014-01-06 06:29:22,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2ec61035 >2014-01-06 06:29:22,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a7fc659 >2014-01-06 06:29:22,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c79a127}, log id: 5a7fc659 >2014-01-06 06:29:27,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3cbacca4 >2014-01-06 06:29:28,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3cbacca4 >2014-01-06 06:29:28,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 62317179 >2014-01-06 06:29:28,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f13cb086}, log id: 62317179 >2014-01-06 06:29:33,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25f92a03 >2014-01-06 06:29:33,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25f92a03 >2014-01-06 06:29:33,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 69dc22f7 >2014-01-06 06:29:33,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@329372f8}, log id: 69dc22f7 >2014-01-06 06:29:38,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 332a47e3 >2014-01-06 06:29:39,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 332a47e3 >2014-01-06 06:29:39,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59e8a060 >2014-01-06 06:29:39,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e770e95c}, log id: 59e8a060 >2014-01-06 06:29:44,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28dcfdc0 >2014-01-06 06:29:44,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 28dcfdc0 >2014-01-06 06:29:44,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33a1232d >2014-01-06 06:29:44,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64930bde}, log id: 33a1232d >2014-01-06 06:29:49,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b50f100 >2014-01-06 06:29:50,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b50f100 >2014-01-06 06:29:50,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 368dbec1 >2014-01-06 06:29:50,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87f5a471}, log id: 368dbec1 >2014-01-06 06:29:53,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a1218e >2014-01-06 06:29:53,561 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:29:53,561 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:29:53,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, log id: 3a1218e >2014-01-06 06:29:53,561 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-29) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:29:55,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 770c28aa >2014-01-06 06:29:55,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 770c28aa >2014-01-06 06:29:55,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c2bd337 >2014-01-06 06:29:55,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@152a0a62}, log id: 4c2bd337 >2014-01-06 06:30:00,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19fddda7 >2014-01-06 06:30:01,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 19fddda7 >2014-01-06 06:30:01,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1199970 >2014-01-06 06:30:01,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@460bafdd}, log id: 1199970 >2014-01-06 06:30:06,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ccf5f93 >2014-01-06 06:30:06,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7ccf5f93 >2014-01-06 06:30:06,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4bb2c3f6 >2014-01-06 06:30:06,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bd06cd8}, log id: 4bb2c3f6 >2014-01-06 06:30:11,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4837647e >2014-01-06 06:30:11,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4837647e >2014-01-06 06:30:11,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c733ab9 >2014-01-06 06:30:12,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e73a041}, log id: 4c733ab9 >2014-01-06 06:30:17,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50b9be71 >2014-01-06 06:30:17,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 50b9be71 >2014-01-06 06:30:17,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71199c28 >2014-01-06 06:30:17,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1111abde}, log id: 71199c28 >2014-01-06 06:30:22,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c4b2d6c >2014-01-06 06:30:22,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6c4b2d6c >2014-01-06 06:30:22,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79d8b527 >2014-01-06 06:30:22,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c6c5bb}, log id: 79d8b527 >2014-01-06 06:30:28,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7266d2fd >2014-01-06 06:30:28,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7266d2fd >2014-01-06 06:30:28,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 343b99d7 >2014-01-06 06:30:28,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54247c73}, log id: 343b99d7 >2014-01-06 06:30:33,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72ba5128 >2014-01-06 06:30:33,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 72ba5128 >2014-01-06 06:30:33,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4276e914 >2014-01-06 06:30:33,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af0d5a20}, log id: 4276e914 >2014-01-06 06:30:38,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a53855c >2014-01-06 06:30:39,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6a53855c >2014-01-06 06:30:39,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 77fb04b9 >2014-01-06 06:30:39,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f747d}, log id: 77fb04b9 >2014-01-06 06:30:44,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 291974a >2014-01-06 06:30:44,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 291974a >2014-01-06 06:30:44,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ff64e88 >2014-01-06 06:30:44,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b747a86}, log id: 5ff64e88 >2014-01-06 06:30:49,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e63030d >2014-01-06 06:30:50,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2e63030d >2014-01-06 06:30:50,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cdab3e6 >2014-01-06 06:30:50,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19d6351a}, log id: 6cdab3e6 >2014-01-06 06:30:53,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3da1883 >2014-01-06 06:30:53,888 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:30:53,890 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:30:53,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, log id: 3da1883 >2014-01-06 06:30:53,890 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-82) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:30:55,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: de8471b >2014-01-06 06:30:55,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: de8471b >2014-01-06 06:30:55,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e64406d >2014-01-06 06:30:55,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3712879}, log id: 7e64406d >2014-01-06 06:31:00,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ff8749a >2014-01-06 06:31:01,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: ff8749a >2014-01-06 06:31:01,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 722ed98 >2014-01-06 06:31:01,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88c9e70e}, log id: 722ed98 >2014-01-06 06:31:06,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 773048c8 >2014-01-06 06:31:06,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 773048c8 >2014-01-06 06:31:06,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42c743d8 >2014-01-06 06:31:06,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1f93fbd}, log id: 42c743d8 >2014-01-06 06:31:11,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1de910ef >2014-01-06 06:31:11,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1de910ef >2014-01-06 06:31:11,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 316ed540 >2014-01-06 06:31:12,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35e8410c}, log id: 316ed540 >2014-01-06 06:31:17,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e561e8f >2014-01-06 06:31:17,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6e561e8f >2014-01-06 06:31:17,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10e15012 >2014-01-06 06:31:17,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14e86ae9}, log id: 10e15012 >2014-01-06 06:31:22,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1668059d >2014-01-06 06:31:22,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1668059d >2014-01-06 06:31:22,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e58f79 >2014-01-06 06:31:23,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3387c2b}, log id: 5e58f79 >2014-01-06 06:31:28,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4df7f281 >2014-01-06 06:31:28,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4df7f281 >2014-01-06 06:31:28,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 612546d2 >2014-01-06 06:31:28,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a271d8a}, log id: 612546d2 >2014-01-06 06:31:33,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 546bc458 >2014-01-06 06:31:33,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 546bc458 >2014-01-06 06:31:33,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48dc3141 >2014-01-06 06:31:33,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89177847}, log id: 48dc3141 >2014-01-06 06:31:38,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46526253 >2014-01-06 06:31:39,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 46526253 >2014-01-06 06:31:39,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29350fdb >2014-01-06 06:31:39,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7bec6b8}, log id: 29350fdb >2014-01-06 06:31:44,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 120b0359 >2014-01-06 06:31:44,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 120b0359 >2014-01-06 06:31:44,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e3ec199 >2014-01-06 06:31:44,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66e664c3}, log id: 2e3ec199 >2014-01-06 06:31:49,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7dcf7fa5 >2014-01-06 06:31:50,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7dcf7fa5 >2014-01-06 06:31:50,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b41763 >2014-01-06 06:31:50,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f35ce79}, log id: 3b41763 >2014-01-06 06:31:53,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e8d991d >2014-01-06 06:31:54,225 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:31:54,225 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:31:54,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, log id: 1e8d991d >2014-01-06 06:31:54,225 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-92) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:31:55,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35d6f54f >2014-01-06 06:31:55,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 35d6f54f >2014-01-06 06:31:55,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73af1120 >2014-01-06 06:31:55,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29b72d6e}, log id: 73af1120 >2014-01-06 06:32:00,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1da156b2 >2014-01-06 06:32:01,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1da156b2 >2014-01-06 06:32:01,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 529bd1d9 >2014-01-06 06:32:01,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71754407}, log id: 529bd1d9 >2014-01-06 06:32:06,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11d5b91 >2014-01-06 06:32:06,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 11d5b91 >2014-01-06 06:32:06,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c318764 >2014-01-06 06:32:06,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1dd51f1}, log id: 5c318764 >2014-01-06 06:32:11,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 42fb3ecf >2014-01-06 06:32:11,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 42fb3ecf >2014-01-06 06:32:11,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46c488d0 >2014-01-06 06:32:12,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24a8bca6}, log id: 46c488d0 >2014-01-06 06:32:17,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 125fc8f >2014-01-06 06:32:17,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 125fc8f >2014-01-06 06:32:17,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 436f771e >2014-01-06 06:32:17,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea9a3de6}, log id: 436f771e >2014-01-06 06:32:22,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41e45dcf >2014-01-06 06:32:22,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 41e45dcf >2014-01-06 06:32:22,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b3a7445 >2014-01-06 06:32:23,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@452d1f16}, log id: 5b3a7445 >2014-01-06 06:32:28,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3328bac5 >2014-01-06 06:32:28,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3328bac5 >2014-01-06 06:32:28,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f30accb >2014-01-06 06:32:28,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@943c1098}, log id: 6f30accb >2014-01-06 06:32:33,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b4c671d >2014-01-06 06:32:33,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b4c671d >2014-01-06 06:32:33,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 432373ac >2014-01-06 06:32:33,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87045e52}, log id: 432373ac >2014-01-06 06:32:38,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 65ca8e14 >2014-01-06 06:32:39,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 65ca8e14 >2014-01-06 06:32:39,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7819cb0c >2014-01-06 06:32:39,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c3da70d}, log id: 7819cb0c >2014-01-06 06:32:44,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 156634ac >2014-01-06 06:32:44,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 156634ac >2014-01-06 06:32:44,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1425b939 >2014-01-06 06:32:44,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ae4ca76}, log id: 1425b939 >2014-01-06 06:32:49,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 46904bd4 >2014-01-06 06:32:50,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 46904bd4 >2014-01-06 06:32:50,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20d7b751 >2014-01-06 06:32:50,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68c6f28d}, log id: 20d7b751 >2014-01-06 06:32:54,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e43d69a >2014-01-06 06:32:54,551 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:32:54,551 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:32:54,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, log id: 7e43d69a >2014-01-06 06:32:54,551 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-30) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:32:55,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21f8c38 >2014-01-06 06:32:55,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 21f8c38 >2014-01-06 06:32:55,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33849f9 >2014-01-06 06:32:55,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c1bcee8}, log id: 33849f9 >2014-01-06 06:33:00,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 749b0fb4 >2014-01-06 06:33:01,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 749b0fb4 >2014-01-06 06:33:01,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27301c55 >2014-01-06 06:33:01,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e566622}, log id: 27301c55 >2014-01-06 06:33:06,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19791777 >2014-01-06 06:33:06,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 19791777 >2014-01-06 06:33:06,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ed5229c >2014-01-06 06:33:06,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bcce199}, log id: 7ed5229c >2014-01-06 06:33:11,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c2f2e43 >2014-01-06 06:33:11,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1c2f2e43 >2014-01-06 06:33:11,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d35962 >2014-01-06 06:33:12,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d059409}, log id: 3d35962 >2014-01-06 06:33:17,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14191df5 >2014-01-06 06:33:17,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 14191df5 >2014-01-06 06:33:17,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e55001d >2014-01-06 06:33:17,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c5beee5}, log id: 2e55001d >2014-01-06 06:33:22,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54bcf832 >2014-01-06 06:33:22,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54bcf832 >2014-01-06 06:33:22,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7df3b2bf >2014-01-06 06:33:23,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7212a7c}, log id: 7df3b2bf >2014-01-06 06:33:28,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f8d73a3 >2014-01-06 06:33:28,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f8d73a3 >2014-01-06 06:33:28,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b4fc34a >2014-01-06 06:33:28,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24efe169}, log id: 4b4fc34a >2014-01-06 06:33:33,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 519d732 >2014-01-06 06:33:33,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 519d732 >2014-01-06 06:33:33,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: eef1162 >2014-01-06 06:33:33,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae1d5327}, log id: eef1162 >2014-01-06 06:33:38,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ed245b6 >2014-01-06 06:33:39,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: ed245b6 >2014-01-06 06:33:39,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 194803ca >2014-01-06 06:33:39,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dd708f0}, log id: 194803ca >2014-01-06 06:33:44,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10069139 >2014-01-06 06:33:44,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@633fb14d, log id: 10069139 >2014-01-06 06:33:44,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ad1b4ae >2014-01-06 06:33:44,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ad1b4ae >2014-01-06 06:33:44,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f4ce583 >2014-01-06 06:33:44,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee0d265d}, log id: 2f4ce583 >2014-01-06 06:33:49,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59638b28 >2014-01-06 06:33:50,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 59638b28 >2014-01-06 06:33:50,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24a90f3 >2014-01-06 06:33:50,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85ed7952}, log id: 24a90f3 >2014-01-06 06:33:54,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 391702e4 >2014-01-06 06:33:54,878 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:33:54,878 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:33:54,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, log id: 391702e4 >2014-01-06 06:33:54,879 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-25) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:33:55,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61d25c41 >2014-01-06 06:33:55,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 61d25c41 >2014-01-06 06:33:55,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 86d5af6 >2014-01-06 06:33:55,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1faab72b}, log id: 86d5af6 >2014-01-06 06:34:00,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: dd52d97 >2014-01-06 06:34:01,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: dd52d97 >2014-01-06 06:34:01,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f232539 >2014-01-06 06:34:01,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@727010ce}, log id: 2f232539 >2014-01-06 06:34:06,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c16af3 >2014-01-06 06:34:06,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: c16af3 >2014-01-06 06:34:06,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 715c619d >2014-01-06 06:34:06,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eeb52c79}, log id: 715c619d >2014-01-06 06:34:11,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d68be7e >2014-01-06 06:34:11,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: d68be7e >2014-01-06 06:34:11,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52bbd3a6 >2014-01-06 06:34:12,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa6112d}, log id: 52bbd3a6 >2014-01-06 06:34:17,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 408e70da >2014-01-06 06:34:17,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 408e70da >2014-01-06 06:34:17,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56d0637e >2014-01-06 06:34:17,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95cebca9}, log id: 56d0637e >2014-01-06 06:34:22,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b13b5d >2014-01-06 06:34:22,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: b13b5d >2014-01-06 06:34:22,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d75f743 >2014-01-06 06:34:23,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c87d673}, log id: 3d75f743 >2014-01-06 06:34:28,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b60da81 >2014-01-06 06:34:28,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b60da81 >2014-01-06 06:34:28,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4698df1b >2014-01-06 06:34:28,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95d0dd8}, log id: 4698df1b >2014-01-06 06:34:33,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52b59f1a >2014-01-06 06:34:33,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 52b59f1a >2014-01-06 06:34:33,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 686cddec >2014-01-06 06:34:33,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d5eff6c}, log id: 686cddec >2014-01-06 06:34:38,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4584a0fc >2014-01-06 06:34:39,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4584a0fc >2014-01-06 06:34:39,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3bbbf483 >2014-01-06 06:34:39,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e678fff2}, log id: 3bbbf483 >2014-01-06 06:34:44,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68a3bf0 >2014-01-06 06:34:44,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 68a3bf0 >2014-01-06 06:34:44,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c60ac3e >2014-01-06 06:34:44,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77ad28ba}, log id: 1c60ac3e >2014-01-06 06:34:49,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b6e3688 >2014-01-06 06:34:50,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b6e3688 >2014-01-06 06:34:50,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 148aa66d >2014-01-06 06:34:50,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59a46517}, log id: 148aa66d >2014-01-06 06:34:54,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39994c1d >2014-01-06 06:34:55,210 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:34:55,210 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:34:55,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterTasksListVDSCommand, log id: 39994c1d >2014-01-06 06:34:55,210 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-60) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:34:55,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1199ed46 >2014-01-06 06:34:55,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1199ed46 >2014-01-06 06:34:55,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2feaf329 >2014-01-06 06:34:55,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cccfbef}, log id: 2feaf329 >2014-01-06 06:35:00,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60d3859f >2014-01-06 06:35:01,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 60d3859f >2014-01-06 06:35:01,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f2374e9 >2014-01-06 06:35:01,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adbb253f}, log id: f2374e9 >2014-01-06 06:35:06,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14d15e52 >2014-01-06 06:35:06,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 14d15e52 >2014-01-06 06:35:06,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 266ff94e >2014-01-06 06:35:06,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bee96216}, log id: 266ff94e >2014-01-06 06:35:11,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67e365bb >2014-01-06 06:35:11,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 67e365bb >2014-01-06 06:35:11,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43c42a8f >2014-01-06 06:35:12,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9114a55f}, log id: 43c42a8f >2014-01-06 06:35:17,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68158416 >2014-01-06 06:35:17,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 68158416 >2014-01-06 06:35:17,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d894821 >2014-01-06 06:35:17,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2aa5fe4}, log id: 5d894821 >2014-01-06 06:35:22,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4dbe4e64 >2014-01-06 06:35:22,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4dbe4e64 >2014-01-06 06:35:22,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5831af66 >2014-01-06 06:35:23,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4dfb08bf}, log id: 5831af66 >2014-01-06 06:35:28,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27581d37 >2014-01-06 06:35:28,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 27581d37 >2014-01-06 06:35:28,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 412a0041 >2014-01-06 06:35:28,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf6f38f4}, log id: 412a0041 >2014-01-06 06:35:33,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23af5a62 >2014-01-06 06:35:33,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 23af5a62 >2014-01-06 06:35:33,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f4a7760 >2014-01-06 06:35:33,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a9fa936}, log id: f4a7760 >2014-01-06 06:35:38,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b339ebd >2014-01-06 06:35:39,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2b339ebd >2014-01-06 06:35:39,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ab69995 >2014-01-06 06:35:39,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d62810}, log id: 3ab69995 >2014-01-06 06:35:44,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2727f24d >2014-01-06 06:35:44,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2727f24d >2014-01-06 06:35:44,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fba64ec >2014-01-06 06:35:44,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ead442e2}, log id: fba64ec >2014-01-06 06:35:49,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 378ba76 >2014-01-06 06:35:50,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 378ba76 >2014-01-06 06:35:50,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 76e49e0f >2014-01-06 06:35:50,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c01075b}, log id: 76e49e0f >2014-01-06 06:35:55,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 34b2d4cd >2014-01-06 06:35:55,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 410633e7 >2014-01-06 06:35:55,555 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:35:55,555 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:35:55,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, log id: 34b2d4cd >2014-01-06 06:35:55,555 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-74) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:35:55,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 410633e7 >2014-01-06 06:35:55,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35fe0b3d >2014-01-06 06:35:55,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52b80f51}, log id: 35fe0b3d >2014-01-06 06:36:00,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f9fc39 >2014-01-06 06:36:01,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4f9fc39 >2014-01-06 06:36:01,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b499465 >2014-01-06 06:36:01,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29566d83}, log id: b499465 >2014-01-06 06:36:06,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4909a008 >2014-01-06 06:36:06,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4909a008 >2014-01-06 06:36:06,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 679ee187 >2014-01-06 06:36:06,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34dd87c8}, log id: 679ee187 >2014-01-06 06:36:11,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f24835b >2014-01-06 06:36:11,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2f24835b >2014-01-06 06:36:11,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f6548db >2014-01-06 06:36:12,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a3360a1}, log id: 5f6548db >2014-01-06 06:36:17,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2723f03f >2014-01-06 06:36:17,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2723f03f >2014-01-06 06:36:17,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6bf50930 >2014-01-06 06:36:17,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73f0140f}, log id: 6bf50930 >2014-01-06 06:36:22,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 211031e8 >2014-01-06 06:36:22,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 211031e8 >2014-01-06 06:36:22,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 222e0f0a >2014-01-06 06:36:23,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d42c13c9}, log id: 222e0f0a >2014-01-06 06:36:28,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ffb634 >2014-01-06 06:36:28,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ffb634 >2014-01-06 06:36:28,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ac2fbad >2014-01-06 06:36:28,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1299f5}, log id: 5ac2fbad >2014-01-06 06:36:33,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e93c841 >2014-01-06 06:36:33,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1e93c841 >2014-01-06 06:36:33,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 570b1b33 >2014-01-06 06:36:33,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38725fc1}, log id: 570b1b33 >2014-01-06 06:36:38,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37c1e90 >2014-01-06 06:36:39,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 37c1e90 >2014-01-06 06:36:39,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d061c0a >2014-01-06 06:36:39,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@584afd41}, log id: 1d061c0a >2014-01-06 06:36:44,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 515702b9 >2014-01-06 06:36:44,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 515702b9 >2014-01-06 06:36:44,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5cc1d464 >2014-01-06 06:36:44,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63cd86df}, log id: 5cc1d464 >2014-01-06 06:36:49,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7cb8c370 >2014-01-06 06:36:50,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7cb8c370 >2014-01-06 06:36:50,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ef41f4e >2014-01-06 06:36:50,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fa28981}, log id: 1ef41f4e >2014-01-06 06:36:55,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4da132ab >2014-01-06 06:36:55,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 252a27f0 >2014-01-06 06:36:55,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4da132ab >2014-01-06 06:36:55,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4aeea656 >2014-01-06 06:36:55,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b360d8df}, log id: 4aeea656 >2014-01-06 06:36:55,885 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:36:55,886 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:36:55,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, log id: 252a27f0 >2014-01-06 06:36:55,886 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-26) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:37:00,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 712a45c >2014-01-06 06:37:01,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 712a45c >2014-01-06 06:37:01,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10ceefe >2014-01-06 06:37:01,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b03134f}, log id: 10ceefe >2014-01-06 06:37:06,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 421e234c >2014-01-06 06:37:06,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 421e234c >2014-01-06 06:37:06,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: a1a8b83 >2014-01-06 06:37:06,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ace78267}, log id: a1a8b83 >2014-01-06 06:37:11,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7041a15d >2014-01-06 06:37:11,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7041a15d >2014-01-06 06:37:11,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7b3800e6 >2014-01-06 06:37:12,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f75506c}, log id: 7b3800e6 >2014-01-06 06:37:17,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e1bcaee >2014-01-06 06:37:17,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: e1bcaee >2014-01-06 06:37:17,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ba6fc71 >2014-01-06 06:37:17,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@862170a7}, log id: 7ba6fc71 >2014-01-06 06:37:22,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f14029b >2014-01-06 06:37:22,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f14029b >2014-01-06 06:37:22,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 502fb08f >2014-01-06 06:37:23,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccc32ee3}, log id: 502fb08f >2014-01-06 06:37:28,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37f38713 >2014-01-06 06:37:28,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 37f38713 >2014-01-06 06:37:28,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33d40631 >2014-01-06 06:37:28,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@960b62ee}, log id: 33d40631 >2014-01-06 06:37:33,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30b3d5c7 >2014-01-06 06:37:33,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 30b3d5c7 >2014-01-06 06:37:33,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 177001a7 >2014-01-06 06:37:33,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f382380}, log id: 177001a7 >2014-01-06 06:37:38,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e148a42 >2014-01-06 06:37:39,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e148a42 >2014-01-06 06:37:39,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48467b93 >2014-01-06 06:37:39,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdbb2346}, log id: 48467b93 >2014-01-06 06:37:44,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42adf3fd >2014-01-06 06:37:44,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 42adf3fd >2014-01-06 06:37:44,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d89810c >2014-01-06 06:37:44,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c373f24}, log id: 6d89810c >2014-01-06 06:37:49,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71255108 >2014-01-06 06:37:50,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71255108 >2014-01-06 06:37:50,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3791320c >2014-01-06 06:37:50,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f33d28bf}, log id: 3791320c >2014-01-06 06:37:55,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2acc381d >2014-01-06 06:37:55,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2acc381d >2014-01-06 06:37:55,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4bb9f6e8 >2014-01-06 06:37:55,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@293d8eff}, log id: 4bb9f6e8 >2014-01-06 06:37:55,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f2a0e56 >2014-01-06 06:37:56,206 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:37:56,206 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:37:56,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterTasksListVDSCommand, log id: 6f2a0e56 >2014-01-06 06:37:56,206 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-4) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:38:00,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35a758be >2014-01-06 06:38:01,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 35a758be >2014-01-06 06:38:01,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 315d7cc2 >2014-01-06 06:38:01,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1675d5a}, log id: 315d7cc2 >2014-01-06 06:38:06,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fe1fcb0 >2014-01-06 06:38:06,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3fe1fcb0 >2014-01-06 06:38:06,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6af3caa4 >2014-01-06 06:38:06,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d9bb521}, log id: 6af3caa4 >2014-01-06 06:38:11,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f6225d3 >2014-01-06 06:38:11,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: f6225d3 >2014-01-06 06:38:11,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a9a1e6 >2014-01-06 06:38:12,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65e22173}, log id: 7a9a1e6 >2014-01-06 06:38:17,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26bc12b6 >2014-01-06 06:38:17,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 26bc12b6 >2014-01-06 06:38:17,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6386df9 >2014-01-06 06:38:17,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f99f28c}, log id: 6386df9 >2014-01-06 06:38:22,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d152db8 >2014-01-06 06:38:22,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d152db8 >2014-01-06 06:38:22,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3adf9830 >2014-01-06 06:38:23,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3111d0eb}, log id: 3adf9830 >2014-01-06 06:38:28,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2dca7023 >2014-01-06 06:38:28,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2dca7023 >2014-01-06 06:38:28,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d9b5ff4 >2014-01-06 06:38:28,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8be7d50}, log id: d9b5ff4 >2014-01-06 06:38:33,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5669e789 >2014-01-06 06:38:33,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5669e789 >2014-01-06 06:38:33,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e780520 >2014-01-06 06:38:33,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f22adea}, log id: 4e780520 >2014-01-06 06:38:39,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59e2ca6b >2014-01-06 06:38:39,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 59e2ca6b >2014-01-06 06:38:39,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c49288d >2014-01-06 06:38:39,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1d85077}, log id: 5c49288d >2014-01-06 06:38:44,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 53b9a4df >2014-01-06 06:38:44,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@16fca7, log id: 53b9a4df >2014-01-06 06:38:44,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25e371d4 >2014-01-06 06:38:44,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25e371d4 >2014-01-06 06:38:44,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e6a8d47 >2014-01-06 06:38:44,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b4f907a}, log id: e6a8d47 >2014-01-06 06:38:49,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39743cd >2014-01-06 06:38:50,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 39743cd >2014-01-06 06:38:50,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f3dd39f >2014-01-06 06:38:50,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73992829}, log id: 2f3dd39f >2014-01-06 06:38:55,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 11d76765 >2014-01-06 06:38:55,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 11d76765 >2014-01-06 06:38:55,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 114ab9fc >2014-01-06 06:38:55,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@672bf884}, log id: 114ab9fc >2014-01-06 06:38:56,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c4f9d56 >2014-01-06 06:38:56,536 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:38:56,536 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:38:56,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, log id: 4c4f9d56 >2014-01-06 06:38:56,536 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-53) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:39:00,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b9b17b1 >2014-01-06 06:39:01,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b9b17b1 >2014-01-06 06:39:01,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f3314b1 >2014-01-06 06:39:01,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3de20597}, log id: 7f3314b1 >2014-01-06 06:39:06,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 126bded >2014-01-06 06:39:06,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 126bded >2014-01-06 06:39:06,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b865288 >2014-01-06 06:39:06,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d757ff8}, log id: 4b865288 >2014-01-06 06:39:11,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3015d063 >2014-01-06 06:39:12,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3015d063 >2014-01-06 06:39:12,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f2f1f13 >2014-01-06 06:39:12,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@984e978}, log id: 7f2f1f13 >2014-01-06 06:39:17,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b2e328 >2014-01-06 06:39:17,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: b2e328 >2014-01-06 06:39:17,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: be9b010 >2014-01-06 06:39:17,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@430e54f8}, log id: be9b010 >2014-01-06 06:39:22,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6596dea0 >2014-01-06 06:39:22,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6596dea0 >2014-01-06 06:39:22,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 32e07d67 >2014-01-06 06:39:23,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3882a380}, log id: 32e07d67 >2014-01-06 06:39:28,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47ddc9af >2014-01-06 06:39:28,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 47ddc9af >2014-01-06 06:39:28,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b093ee8 >2014-01-06 06:39:28,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b98c54b0}, log id: 4b093ee8 >2014-01-06 06:39:33,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71255b78 >2014-01-06 06:39:33,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 71255b78 >2014-01-06 06:39:33,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 684c19cc >2014-01-06 06:39:34,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae06341}, log id: 684c19cc >2014-01-06 06:39:39,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e2e28dc >2014-01-06 06:39:39,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1e2e28dc >2014-01-06 06:39:39,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7da31a80 >2014-01-06 06:39:39,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2a8bc7a}, log id: 7da31a80 >2014-01-06 06:39:44,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6895bb7d >2014-01-06 06:39:44,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6895bb7d >2014-01-06 06:39:44,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c2946af >2014-01-06 06:39:44,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@498fccf0}, log id: c2946af >2014-01-06 06:39:49,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 716671cb >2014-01-06 06:39:50,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 716671cb >2014-01-06 06:39:50,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 307d629a >2014-01-06 06:39:50,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d501b2b}, log id: 307d629a >2014-01-06 06:39:55,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d6a3925 >2014-01-06 06:39:55,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4d6a3925 >2014-01-06 06:39:55,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22e11bf4 >2014-01-06 06:39:55,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61e578f4}, log id: 22e11bf4 >2014-01-06 06:39:56,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c3dabde >2014-01-06 06:39:56,866 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:39:56,866 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:39:56,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, log id: 4c3dabde >2014-01-06 06:39:56,866 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-22) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:40:00,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 15fe02f0 >2014-01-06 06:40:01,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 15fe02f0 >2014-01-06 06:40:01,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68f70bba >2014-01-06 06:40:01,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f89cf104}, log id: 68f70bba >2014-01-06 06:40:06,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2dbc74bf >2014-01-06 06:40:06,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2dbc74bf >2014-01-06 06:40:06,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 719de8fb >2014-01-06 06:40:06,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dfe9ce9}, log id: 719de8fb >2014-01-06 06:40:11,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79a0b901 >2014-01-06 06:40:12,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 79a0b901 >2014-01-06 06:40:12,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53e372f5 >2014-01-06 06:40:12,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a783e0b}, log id: 53e372f5 >2014-01-06 06:40:17,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b5bf4ba >2014-01-06 06:40:17,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b5bf4ba >2014-01-06 06:40:17,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79d0f96b >2014-01-06 06:40:17,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5e0d612}, log id: 79d0f96b >2014-01-06 06:40:22,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2d3f4c68 >2014-01-06 06:40:22,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2d3f4c68 >2014-01-06 06:40:22,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e266ef0 >2014-01-06 06:40:23,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a124311}, log id: e266ef0 >2014-01-06 06:40:28,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: bb06549 >2014-01-06 06:40:28,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: bb06549 >2014-01-06 06:40:28,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ad219a7 >2014-01-06 06:40:28,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80f3d7dc}, log id: 5ad219a7 >2014-01-06 06:40:33,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42626fd7 >2014-01-06 06:40:33,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 42626fd7 >2014-01-06 06:40:33,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 562393ff >2014-01-06 06:40:34,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b39e2e4c}, log id: 562393ff >2014-01-06 06:40:39,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b5da70b >2014-01-06 06:40:39,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b5da70b >2014-01-06 06:40:39,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 633792fe >2014-01-06 06:40:39,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8e9fbfc}, log id: 633792fe >2014-01-06 06:40:44,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17dd35e4 >2014-01-06 06:40:44,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 17dd35e4 >2014-01-06 06:40:44,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3abf01e8 >2014-01-06 06:40:44,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5bc6992}, log id: 3abf01e8 >2014-01-06 06:40:49,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52538a08 >2014-01-06 06:40:50,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 52538a08 >2014-01-06 06:40:50,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7859d77 >2014-01-06 06:40:50,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ebb0418}, log id: 7859d77 >2014-01-06 06:40:55,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22010a9f >2014-01-06 06:40:55,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 22010a9f >2014-01-06 06:40:55,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7955936e >2014-01-06 06:40:55,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fae0eaf8}, log id: 7955936e >2014-01-06 06:40:56,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68ebee6 >2014-01-06 06:40:57,187 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:40:57,188 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:40:57,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterTasksListVDSCommand, log id: 68ebee6 >2014-01-06 06:40:57,188 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-2) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:41:00,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24bbd37a >2014-01-06 06:41:01,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 24bbd37a >2014-01-06 06:41:01,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f1c091a >2014-01-06 06:41:01,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@448a8885}, log id: 5f1c091a >2014-01-06 06:41:06,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14f8eeaa >2014-01-06 06:41:06,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 14f8eeaa >2014-01-06 06:41:06,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f184165 >2014-01-06 06:41:06,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29992b87}, log id: 2f184165 >2014-01-06 06:41:11,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34840127 >2014-01-06 06:41:12,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 34840127 >2014-01-06 06:41:12,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6acaf8b2 >2014-01-06 06:41:12,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d48ba55}, log id: 6acaf8b2 >2014-01-06 06:41:17,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e711cff >2014-01-06 06:41:17,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7e711cff >2014-01-06 06:41:17,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 219a65f9 >2014-01-06 06:41:17,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22c77a28}, log id: 219a65f9 >2014-01-06 06:41:22,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1031faaa >2014-01-06 06:41:23,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1031faaa >2014-01-06 06:41:23,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50fe44c0 >2014-01-06 06:41:23,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@396572c8}, log id: 50fe44c0 >2014-01-06 06:41:28,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59deafde >2014-01-06 06:41:28,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 59deafde >2014-01-06 06:41:28,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68798bdd >2014-01-06 06:41:28,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d2eaa4a}, log id: 68798bdd >2014-01-06 06:41:33,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d2e3502 >2014-01-06 06:41:33,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d2e3502 >2014-01-06 06:41:33,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: e0c2ccb >2014-01-06 06:41:34,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6206a0ab}, log id: e0c2ccb >2014-01-06 06:41:39,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b372020 >2014-01-06 06:41:39,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b372020 >2014-01-06 06:41:39,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fac8d7e >2014-01-06 06:41:39,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91d678f0}, log id: fac8d7e >2014-01-06 06:41:44,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: bfdc6c2 >2014-01-06 06:41:44,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: bfdc6c2 >2014-01-06 06:41:44,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e8d3a4f >2014-01-06 06:41:44,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97a0d437}, log id: 6e8d3a4f >2014-01-06 06:41:50,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62924062 >2014-01-06 06:41:50,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 62924062 >2014-01-06 06:41:50,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17e92c08 >2014-01-06 06:41:50,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2bc4c78}, log id: 17e92c08 >2014-01-06 06:41:55,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f1d15e7 >2014-01-06 06:41:55,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f1d15e7 >2014-01-06 06:41:55,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 38272360 >2014-01-06 06:41:55,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b55590b}, log id: 38272360 >2014-01-06 06:41:57,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ca2432d >2014-01-06 06:41:57,522 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:41:57,522 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:41:57,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, log id: ca2432d >2014-01-06 06:41:57,522 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-39) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:42:00,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c9f5f07 >2014-01-06 06:42:01,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5c9f5f07 >2014-01-06 06:42:01,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4b9ce222 >2014-01-06 06:42:01,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85424c03}, log id: 4b9ce222 >2014-01-06 06:42:06,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c9583c7 >2014-01-06 06:42:06,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: c9583c7 >2014-01-06 06:42:06,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1746df5b >2014-01-06 06:42:06,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f5d2295}, log id: 1746df5b >2014-01-06 06:42:11,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 433d5831 >2014-01-06 06:42:12,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 433d5831 >2014-01-06 06:42:12,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52a94c2a >2014-01-06 06:42:12,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99d1ae}, log id: 52a94c2a >2014-01-06 06:42:17,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e8ae250 >2014-01-06 06:42:17,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6e8ae250 >2014-01-06 06:42:17,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ac8c817 >2014-01-06 06:42:17,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2951aee3}, log id: 6ac8c817 >2014-01-06 06:42:22,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c6cb0fb >2014-01-06 06:42:23,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4c6cb0fb >2014-01-06 06:42:23,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b021dd >2014-01-06 06:42:23,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d214eaeb}, log id: 4b021dd >2014-01-06 06:42:28,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29e9a485 >2014-01-06 06:42:28,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 29e9a485 >2014-01-06 06:42:28,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59521746 >2014-01-06 06:42:28,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50f7d8ea}, log id: 59521746 >2014-01-06 06:42:33,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47f338a6 >2014-01-06 06:42:33,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 47f338a6 >2014-01-06 06:42:33,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28a2f2a4 >2014-01-06 06:42:34,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a7882f6}, log id: 28a2f2a4 >2014-01-06 06:42:39,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22fc3204 >2014-01-06 06:42:39,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 22fc3204 >2014-01-06 06:42:39,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2db4afcf >2014-01-06 06:42:39,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfb386bc}, log id: 2db4afcf >2014-01-06 06:42:44,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3efb655d >2014-01-06 06:42:44,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3efb655d >2014-01-06 06:42:44,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 44a55d6d >2014-01-06 06:42:44,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cefb6b38}, log id: 44a55d6d >2014-01-06 06:42:50,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25e3a04e >2014-01-06 06:42:50,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 25e3a04e >2014-01-06 06:42:50,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b5a9b6a >2014-01-06 06:42:50,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95b367a0}, log id: b5a9b6a >2014-01-06 06:42:55,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71eea450 >2014-01-06 06:42:55,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 71eea450 >2014-01-06 06:42:55,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: fc93cef >2014-01-06 06:42:55,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ad2926b}, log id: fc93cef >2014-01-06 06:42:57,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1aeaa88c >2014-01-06 06:42:57,844 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:42:57,844 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:42:57,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, log id: 1aeaa88c >2014-01-06 06:42:57,844 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-13) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:43:00,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 26ff657d >2014-01-06 06:43:01,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 26ff657d >2014-01-06 06:43:01,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6051b2eb >2014-01-06 06:43:01,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a965f65c}, log id: 6051b2eb >2014-01-06 06:43:06,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57a0b04 >2014-01-06 06:43:06,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 57a0b04 >2014-01-06 06:43:06,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70277be8 >2014-01-06 06:43:06,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44f22ad0}, log id: 70277be8 >2014-01-06 06:43:11,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2bcbd14f >2014-01-06 06:43:12,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2bcbd14f >2014-01-06 06:43:12,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 541ecbf7 >2014-01-06 06:43:12,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17ea810e}, log id: 541ecbf7 >2014-01-06 06:43:17,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c824da9 >2014-01-06 06:43:17,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1c824da9 >2014-01-06 06:43:17,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8cdfd8a >2014-01-06 06:43:17,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98d8c8e}, log id: 8cdfd8a >2014-01-06 06:43:22,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31a84d81 >2014-01-06 06:43:23,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 31a84d81 >2014-01-06 06:43:23,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ce36d29 >2014-01-06 06:43:23,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96fb9208}, log id: 5ce36d29 >2014-01-06 06:43:28,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 464b7566 >2014-01-06 06:43:28,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 464b7566 >2014-01-06 06:43:28,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e1cf4f4 >2014-01-06 06:43:28,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ed15a85}, log id: 1e1cf4f4 >2014-01-06 06:43:33,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76ab29ce >2014-01-06 06:43:33,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 76ab29ce >2014-01-06 06:43:33,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5705fb1e >2014-01-06 06:43:34,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@254904f}, log id: 5705fb1e >2014-01-06 06:43:39,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7361c14c >2014-01-06 06:43:39,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7361c14c >2014-01-06 06:43:39,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d237ed2 >2014-01-06 06:43:39,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f2641cd}, log id: d237ed2 >2014-01-06 06:43:44,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d2f8b5d >2014-01-06 06:43:44,603 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-38) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 155234fe-976e-43af-ad30-7b760d7e7ca7 value: GLUSTER >, sharedLocks= ] >2014-01-06 06:43:44,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@395d1e8c, log id: 5d2f8b5d >2014-01-06 06:43:44,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 108096c0 >2014-01-06 06:43:44,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 108096c0 >2014-01-06 06:43:44,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b750935 >2014-01-06 06:43:45,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a43e7766}, log id: 5b750935 >2014-01-06 06:43:50,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2cdf5508 >2014-01-06 06:43:50,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2cdf5508 >2014-01-06 06:43:50,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5791d41c >2014-01-06 06:43:50,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18073062}, log id: 5791d41c >2014-01-06 06:43:55,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 410ac16b >2014-01-06 06:43:55,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 410ac16b >2014-01-06 06:43:55,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 34730a66 >2014-01-06 06:43:56,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@133f21f1}, log id: 34730a66 >2014-01-06 06:43:57,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ba72ca4 >2014-01-06 06:43:58,179 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:43:58,180 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:43:58,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, log id: 7ba72ca4 >2014-01-06 06:43:58,180 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-94) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:44:01,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c56a540 >2014-01-06 06:44:01,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7c56a540 >2014-01-06 06:44:01,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10e61e28 >2014-01-06 06:44:01,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ae8174c}, log id: 10e61e28 >2014-01-06 06:44:06,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d28947f >2014-01-06 06:44:06,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3d28947f >2014-01-06 06:44:06,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b0cbe4d >2014-01-06 06:44:06,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd2e8877}, log id: 6b0cbe4d >2014-01-06 06:44:11,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f1a9516 >2014-01-06 06:44:12,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2f1a9516 >2014-01-06 06:44:12,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d7241dc >2014-01-06 06:44:12,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac98f88a}, log id: 7d7241dc >2014-01-06 06:44:17,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d264ab4 >2014-01-06 06:44:17,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3d264ab4 >2014-01-06 06:44:17,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65aefc >2014-01-06 06:44:17,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0ec2378}, log id: 65aefc >2014-01-06 06:44:22,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7442637c >2014-01-06 06:44:23,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7442637c >2014-01-06 06:44:23,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f58dfc5 >2014-01-06 06:44:23,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d99e725c}, log id: 6f58dfc5 >2014-01-06 06:44:28,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f2807f3 >2014-01-06 06:44:28,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7f2807f3 >2014-01-06 06:44:28,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45640afc >2014-01-06 06:44:28,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35b78559}, log id: 45640afc >2014-01-06 06:44:33,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 245c4f2d >2014-01-06 06:44:34,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 245c4f2d >2014-01-06 06:44:34,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26d0eda3 >2014-01-06 06:44:34,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@546479d3}, log id: 26d0eda3 >2014-01-06 06:44:39,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4947021 >2014-01-06 06:44:39,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4947021 >2014-01-06 06:44:39,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2dd54498 >2014-01-06 06:44:39,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cabeb944}, log id: 2dd54498 >2014-01-06 06:44:44,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a782178 >2014-01-06 06:44:44,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7a782178 >2014-01-06 06:44:44,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62008e3e >2014-01-06 06:44:45,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@371f7136}, log id: 62008e3e >2014-01-06 06:44:50,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36e12120 >2014-01-06 06:44:50,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 36e12120 >2014-01-06 06:44:50,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ff3a5ed >2014-01-06 06:44:50,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e10e1d8a}, log id: 2ff3a5ed >2014-01-06 06:44:55,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7b09c811 >2014-01-06 06:44:55,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7b09c811 >2014-01-06 06:44:55,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17d52bea >2014-01-06 06:44:55,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@574fc2c4}, log id: 17d52bea >2014-01-06 06:44:58,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26406838 >2014-01-06 06:44:58,515 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:44:58,515 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:44:58,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, log id: 26406838 >2014-01-06 06:44:58,515 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-69) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:45:01,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d1ddc0f >2014-01-06 06:45:01,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4d1ddc0f >2014-01-06 06:45:01,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 641bfff2 >2014-01-06 06:45:01,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29367531}, log id: 641bfff2 >2014-01-06 06:45:06,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10ea2830 >2014-01-06 06:45:06,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 10ea2830 >2014-01-06 06:45:06,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 70e8cd3d >2014-01-06 06:45:06,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32bf85de}, log id: 70e8cd3d >2014-01-06 06:45:11,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78d3d9bb >2014-01-06 06:45:12,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 78d3d9bb >2014-01-06 06:45:12,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a4fe907 >2014-01-06 06:45:12,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@438d08b7}, log id: 2a4fe907 >2014-01-06 06:45:17,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a333b4e >2014-01-06 06:45:17,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4a333b4e >2014-01-06 06:45:17,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 36ab9aec >2014-01-06 06:45:17,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee1a6de0}, log id: 36ab9aec >2014-01-06 06:45:22,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14bb7fe2 >2014-01-06 06:45:23,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 14bb7fe2 >2014-01-06 06:45:23,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 388de0cc >2014-01-06 06:45:23,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11631665}, log id: 388de0cc >2014-01-06 06:45:28,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e06a743 >2014-01-06 06:45:28,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7e06a743 >2014-01-06 06:45:28,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d765440 >2014-01-06 06:45:28,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b10d225e}, log id: 4d765440 >2014-01-06 06:45:33,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18f7c628 >2014-01-06 06:45:34,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 18f7c628 >2014-01-06 06:45:34,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3acecd2a >2014-01-06 06:45:34,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79ea3bba}, log id: 3acecd2a >2014-01-06 06:45:39,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 573d8d3 >2014-01-06 06:45:39,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 573d8d3 >2014-01-06 06:45:39,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e3c6b8f >2014-01-06 06:45:39,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f30835f}, log id: 5e3c6b8f >2014-01-06 06:45:44,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 44f61500 >2014-01-06 06:45:44,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 44f61500 >2014-01-06 06:45:44,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3df67353 >2014-01-06 06:45:45,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3519e1b7}, log id: 3df67353 >2014-01-06 06:45:50,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 76343629 >2014-01-06 06:45:50,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 76343629 >2014-01-06 06:45:50,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 263277f9 >2014-01-06 06:45:50,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74e866f1}, log id: 263277f9 >2014-01-06 06:45:55,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31c21420 >2014-01-06 06:45:55,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 31c21420 >2014-01-06 06:45:55,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14862863 >2014-01-06 06:45:56,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2b2c4cb}, log id: 14862863 >2014-01-06 06:45:58,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21d79d1b >2014-01-06 06:45:58,839 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:45:58,840 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:45:58,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, log id: 21d79d1b >2014-01-06 06:45:58,840 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-59) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:46:01,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e4e6783 >2014-01-06 06:46:01,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1e4e6783 >2014-01-06 06:46:01,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2872e81c >2014-01-06 06:46:01,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@376b9ec3}, log id: 2872e81c >2014-01-06 06:46:06,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 16903ce7 >2014-01-06 06:46:06,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 16903ce7 >2014-01-06 06:46:06,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 468efaa >2014-01-06 06:46:06,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71a79215}, log id: 468efaa >2014-01-06 06:46:11,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2053edde >2014-01-06 06:46:12,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2053edde >2014-01-06 06:46:12,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 657a804 >2014-01-06 06:46:12,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b78ac0ae}, log id: 657a804 >2014-01-06 06:46:17,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e9d2418 >2014-01-06 06:46:17,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6e9d2418 >2014-01-06 06:46:17,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 749779dd >2014-01-06 06:46:17,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28b8359d}, log id: 749779dd >2014-01-06 06:46:22,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1c530f9e >2014-01-06 06:46:23,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1c530f9e >2014-01-06 06:46:23,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5eebae6a >2014-01-06 06:46:23,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1a96a27}, log id: 5eebae6a >2014-01-06 06:46:28,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28605998 >2014-01-06 06:46:28,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 28605998 >2014-01-06 06:46:28,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78c2d52c >2014-01-06 06:46:28,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b540bc25}, log id: 78c2d52c >2014-01-06 06:46:33,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 62c429ad >2014-01-06 06:46:34,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 62c429ad >2014-01-06 06:46:34,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fcc2a6f >2014-01-06 06:46:34,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67429387}, log id: 3fcc2a6f >2014-01-06 06:46:39,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 293b0f7 >2014-01-06 06:46:39,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 293b0f7 >2014-01-06 06:46:39,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 84e3016 >2014-01-06 06:46:39,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad660aa7}, log id: 84e3016 >2014-01-06 06:46:44,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71588d1a >2014-01-06 06:46:45,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71588d1a >2014-01-06 06:46:45,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14eeefb3 >2014-01-06 06:46:45,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ced818f1}, log id: 14eeefb3 >2014-01-06 06:46:50,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b7169ce >2014-01-06 06:46:50,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b7169ce >2014-01-06 06:46:50,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 469bb080 >2014-01-06 06:46:50,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24e393a0}, log id: 469bb080 >2014-01-06 06:46:55,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7202d146 >2014-01-06 06:46:55,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7202d146 >2014-01-06 06:46:55,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6d6c9a27 >2014-01-06 06:46:56,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba375595}, log id: 6d6c9a27 >2014-01-06 06:46:58,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66e2884d >2014-01-06 06:46:59,164 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:46:59,164 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:46:59,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, log id: 66e2884d >2014-01-06 06:46:59,164 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-47) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:47:01,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 16604b4a >2014-01-06 06:47:01,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 16604b4a >2014-01-06 06:47:01,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7275ff61 >2014-01-06 06:47:01,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7efeeafd}, log id: 7275ff61 >2014-01-06 06:47:06,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e3adfa8 >2014-01-06 06:47:06,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5e3adfa8 >2014-01-06 06:47:06,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ae7600f >2014-01-06 06:47:06,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@725a13f5}, log id: 7ae7600f >2014-01-06 06:47:12,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 464a87c8 >2014-01-06 06:47:12,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 464a87c8 >2014-01-06 06:47:12,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 45d533f >2014-01-06 06:47:12,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8db0adf}, log id: 45d533f >2014-01-06 06:47:17,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: be5a96a >2014-01-06 06:47:17,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: be5a96a >2014-01-06 06:47:17,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2dc7e509 >2014-01-06 06:47:17,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@691880ea}, log id: 2dc7e509 >2014-01-06 06:47:22,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b2b6485 >2014-01-06 06:47:23,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b2b6485 >2014-01-06 06:47:23,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c43f76d >2014-01-06 06:47:23,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@881ee559}, log id: 4c43f76d >2014-01-06 06:47:28,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cbee6bb >2014-01-06 06:47:28,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6cbee6bb >2014-01-06 06:47:28,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7eeb7dcc >2014-01-06 06:47:28,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3349e78c}, log id: 7eeb7dcc >2014-01-06 06:47:33,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 77951bcb >2014-01-06 06:47:34,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 77951bcb >2014-01-06 06:47:34,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 671a62f6 >2014-01-06 06:47:34,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@babd5f6b}, log id: 671a62f6 >2014-01-06 06:47:39,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 50bc8fe7 >2014-01-06 06:47:39,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 50bc8fe7 >2014-01-06 06:47:39,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59b0bbc2 >2014-01-06 06:47:39,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f158e65}, log id: 59b0bbc2 >2014-01-06 06:47:44,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72021236 >2014-01-06 06:47:45,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 72021236 >2014-01-06 06:47:45,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18ad18f >2014-01-06 06:47:45,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d0caa46}, log id: 18ad18f >2014-01-06 06:47:50,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71585d40 >2014-01-06 06:47:50,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 71585d40 >2014-01-06 06:47:50,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ffa6ff8 >2014-01-06 06:47:50,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5917a918}, log id: 5ffa6ff8 >2014-01-06 06:47:55,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ff7e532 >2014-01-06 06:47:55,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5ff7e532 >2014-01-06 06:47:55,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 28e027f6 >2014-01-06 06:47:56,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff1c388a}, log id: 28e027f6 >2014-01-06 06:47:59,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5bd9a61d >2014-01-06 06:47:59,495 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:47:59,495 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:47:59,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, log id: 5bd9a61d >2014-01-06 06:47:59,495 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-28) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:48:01,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c546ded >2014-01-06 06:48:01,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3c546ded >2014-01-06 06:48:01,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 465490af >2014-01-06 06:48:01,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba1d5e6c}, log id: 465490af >2014-01-06 06:48:06,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 370e8cfb >2014-01-06 06:48:06,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 370e8cfb >2014-01-06 06:48:06,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13b6c142 >2014-01-06 06:48:06,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@757a0ca0}, log id: 13b6c142 >2014-01-06 06:48:12,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ebcc696 >2014-01-06 06:48:12,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1ebcc696 >2014-01-06 06:48:12,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25be5d37 >2014-01-06 06:48:12,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@725c336}, log id: 25be5d37 >2014-01-06 06:48:17,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28d109e4 >2014-01-06 06:48:17,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 28d109e4 >2014-01-06 06:48:17,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26c23aac >2014-01-06 06:48:17,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e03ed279}, log id: 26c23aac >2014-01-06 06:48:22,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51bba4cb >2014-01-06 06:48:23,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 51bba4cb >2014-01-06 06:48:23,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 96303e1 >2014-01-06 06:48:23,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44e35e37}, log id: 96303e1 >2014-01-06 06:48:28,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ca1fc31 >2014-01-06 06:48:28,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4ca1fc31 >2014-01-06 06:48:28,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 32ae6951 >2014-01-06 06:48:28,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@307bb098}, log id: 32ae6951 >2014-01-06 06:48:33,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64d3c096 >2014-01-06 06:48:34,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 64d3c096 >2014-01-06 06:48:34,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c193754 >2014-01-06 06:48:34,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb549d58}, log id: 7c193754 >2014-01-06 06:48:39,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 354c0d30 >2014-01-06 06:48:39,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 354c0d30 >2014-01-06 06:48:39,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ca5b6ee >2014-01-06 06:48:39,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77965c20}, log id: 2ca5b6ee >2014-01-06 06:48:44,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b3f187e >2014-01-06 06:48:44,717 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-3) [4a16862e] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 155234fe-976e-43af-ad30-7b760d7e7ca7 value: GLUSTER >, sharedLocks= ] >2014-01-06 06:48:44,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@56045f54, log id: 2b3f187e >2014-01-06 06:48:44,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 390eafea >2014-01-06 06:48:45,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 390eafea >2014-01-06 06:48:45,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 116755aa >2014-01-06 06:48:45,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c195c60}, log id: 116755aa >2014-01-06 06:48:50,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19af12ab >2014-01-06 06:48:50,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 19af12ab >2014-01-06 06:48:50,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 80f5f7 >2014-01-06 06:48:50,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49f37ce0}, log id: 80f5f7 >2014-01-06 06:48:55,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e65b809 >2014-01-06 06:48:56,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6e65b809 >2014-01-06 06:48:56,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7792c93a >2014-01-06 06:48:56,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad08b813}, log id: 7792c93a >2014-01-06 06:48:59,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4699c1da >2014-01-06 06:48:59,822 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:48:59,822 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:48:59,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, log id: 4699c1da >2014-01-06 06:48:59,823 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-57) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:49:01,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13c443bc >2014-01-06 06:49:01,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 13c443bc >2014-01-06 06:49:01,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ec45be2 >2014-01-06 06:49:01,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1f91402}, log id: 1ec45be2 >2014-01-06 06:49:06,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3eff3ec4 >2014-01-06 06:49:06,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3eff3ec4 >2014-01-06 06:49:06,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 256c6013 >2014-01-06 06:49:07,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1674863}, log id: 256c6013 >2014-01-06 06:49:12,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d0889d0 >2014-01-06 06:49:12,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d0889d0 >2014-01-06 06:49:12,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2bd6dad4 >2014-01-06 06:49:12,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc9381bd}, log id: 2bd6dad4 >2014-01-06 06:49:17,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 95b009b >2014-01-06 06:49:17,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 95b009b >2014-01-06 06:49:17,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 356c3218 >2014-01-06 06:49:17,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfed2e26}, log id: 356c3218 >2014-01-06 06:49:23,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 30e4c9d2 >2014-01-06 06:49:23,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 30e4c9d2 >2014-01-06 06:49:23,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 653b0abb >2014-01-06 06:49:23,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5f5f416}, log id: 653b0abb >2014-01-06 06:49:28,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b7c799c >2014-01-06 06:49:28,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b7c799c >2014-01-06 06:49:28,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 16f18e7b >2014-01-06 06:49:28,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe766818}, log id: 16f18e7b >2014-01-06 06:49:33,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d7c4676 >2014-01-06 06:49:34,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6d7c4676 >2014-01-06 06:49:34,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 60e174f2 >2014-01-06 06:49:34,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd3bd0d0}, log id: 60e174f2 >2014-01-06 06:49:39,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40bc7a66 >2014-01-06 06:49:39,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 40bc7a66 >2014-01-06 06:49:39,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c450e0c >2014-01-06 06:49:39,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dfc8fa9}, log id: 2c450e0c >2014-01-06 06:49:44,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3dbae76b >2014-01-06 06:49:45,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3dbae76b >2014-01-06 06:49:45,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 341423e0 >2014-01-06 06:49:45,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa3b8074}, log id: 341423e0 >2014-01-06 06:49:50,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f0087bc >2014-01-06 06:49:50,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3f0087bc >2014-01-06 06:49:50,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 89afc89 >2014-01-06 06:49:50,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4edd4698}, log id: 89afc89 >2014-01-06 06:49:55,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e827230 >2014-01-06 06:49:55,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5e827230 >2014-01-06 06:49:56,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3eb8302d >2014-01-06 06:49:56,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b1e1aa2}, log id: 3eb8302d >2014-01-06 06:49:59,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a97fda2 >2014-01-06 06:50:00,150 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:50:00,150 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:50:00,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, log id: 4a97fda2 >2014-01-06 06:50:00,150 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-92) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:50:01,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17bca8bb >2014-01-06 06:50:01,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 17bca8bb >2014-01-06 06:50:01,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 97c3717 >2014-01-06 06:50:01,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eef8371}, log id: 97c3717 >2014-01-06 06:50:06,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2bb0f94f >2014-01-06 06:50:07,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2bb0f94f >2014-01-06 06:50:07,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 92bcc2 >2014-01-06 06:50:07,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61bbdf80}, log id: 92bcc2 >2014-01-06 06:50:12,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b8b8665 >2014-01-06 06:50:12,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1b8b8665 >2014-01-06 06:50:12,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c840304 >2014-01-06 06:50:12,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c99c8339}, log id: 1c840304 >2014-01-06 06:50:17,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68e65a12 >2014-01-06 06:50:18,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 68e65a12 >2014-01-06 06:50:18,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a45f1d1 >2014-01-06 06:50:18,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9c2d666}, log id: 1a45f1d1 >2014-01-06 06:50:23,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2fd9d0f4 >2014-01-06 06:50:23,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2fd9d0f4 >2014-01-06 06:50:23,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4ce62f14 >2014-01-06 06:50:23,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b19a6882}, log id: 4ce62f14 >2014-01-06 06:50:28,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 597c14d6 >2014-01-06 06:50:28,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 597c14d6 >2014-01-06 06:50:28,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 216c4368 >2014-01-06 06:50:29,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@969567ae}, log id: 216c4368 >2014-01-06 06:50:34,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75d49525 >2014-01-06 06:50:34,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 75d49525 >2014-01-06 06:50:34,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 701c0f1e >2014-01-06 06:50:34,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa7e84f3}, log id: 701c0f1e >2014-01-06 06:50:39,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21dd9cc3 >2014-01-06 06:50:39,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 21dd9cc3 >2014-01-06 06:50:39,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6744ab1c >2014-01-06 06:50:39,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81d0dffe}, log id: 6744ab1c >2014-01-06 06:50:44,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3fc9f0b6 >2014-01-06 06:50:45,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3fc9f0b6 >2014-01-06 06:50:45,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 61b7b968 >2014-01-06 06:50:45,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90cf2847}, log id: 61b7b968 >2014-01-06 06:50:50,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ef311d6 >2014-01-06 06:50:50,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: ef311d6 >2014-01-06 06:50:50,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b913c32 >2014-01-06 06:50:50,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a39eaa42}, log id: 4b913c32 >2014-01-06 06:50:55,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48c77adc >2014-01-06 06:50:56,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 48c77adc >2014-01-06 06:50:56,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a20c589 >2014-01-06 06:50:56,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19a03d1f}, log id: 4a20c589 >2014-01-06 06:51:00,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 9de0fc4 >2014-01-06 06:51:00,487 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:51:00,487 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:51:00,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterTasksListVDSCommand, log id: 9de0fc4 >2014-01-06 06:51:00,487 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-19) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:51:01,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63278984 >2014-01-06 06:51:01,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 63278984 >2014-01-06 06:51:01,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42483c8a >2014-01-06 06:51:01,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8043842f}, log id: 42483c8a >2014-01-06 06:51:06,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52f952c1 >2014-01-06 06:51:07,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 52f952c1 >2014-01-06 06:51:07,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 627b0538 >2014-01-06 06:51:07,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c36f0302}, log id: 627b0538 >2014-01-06 06:51:12,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20bc8332 >2014-01-06 06:51:12,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 20bc8332 >2014-01-06 06:51:12,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 336172a4 >2014-01-06 06:51:12,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d676d895}, log id: 336172a4 >2014-01-06 06:51:17,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72983f73 >2014-01-06 06:51:18,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 72983f73 >2014-01-06 06:51:18,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 604e5739 >2014-01-06 06:51:18,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@feeb4e0c}, log id: 604e5739 >2014-01-06 06:51:23,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c706632 >2014-01-06 06:51:23,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3c706632 >2014-01-06 06:51:23,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47a08f2b >2014-01-06 06:51:23,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8cbcc6}, log id: 47a08f2b >2014-01-06 06:51:28,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 64cada1b >2014-01-06 06:51:28,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 64cada1b >2014-01-06 06:51:28,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4208147b >2014-01-06 06:51:29,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27a09dcd}, log id: 4208147b >2014-01-06 06:51:34,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15a8f300 >2014-01-06 06:51:34,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 15a8f300 >2014-01-06 06:51:34,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d5b5f5 >2014-01-06 06:51:34,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc85195d}, log id: 3d5b5f5 >2014-01-06 06:51:39,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 12bc4e81 >2014-01-06 06:51:39,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 12bc4e81 >2014-01-06 06:51:39,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63f9d4be >2014-01-06 06:51:40,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66ea0e34}, log id: 63f9d4be >2014-01-06 06:51:45,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 434ca2cc >2014-01-06 06:51:45,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 434ca2cc >2014-01-06 06:51:45,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b201e4a >2014-01-06 06:51:45,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14bdab2c}, log id: b201e4a >2014-01-06 06:51:50,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 307a49f7 >2014-01-06 06:51:50,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 307a49f7 >2014-01-06 06:51:50,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4cf27b16 >2014-01-06 06:51:50,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56cc4c4c}, log id: 4cf27b16 >2014-01-06 06:51:56,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b280c10 >2014-01-06 06:51:56,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b280c10 >2014-01-06 06:51:56,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19c71bf4 >2014-01-06 06:51:56,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0ad88a1}, log id: 19c71bf4 >2014-01-06 06:52:00,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 24bba06a >2014-01-06 06:52:00,812 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:52:00,812 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:52:00,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, log id: 24bba06a >2014-01-06 06:52:00,813 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-11) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:52:01,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1dad9a7e >2014-01-06 06:52:01,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1dad9a7e >2014-01-06 06:52:01,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a16dcf4 >2014-01-06 06:52:01,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a2fec03}, log id: 4a16dcf4 >2014-01-06 06:52:06,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 16f405bb >2014-01-06 06:52:07,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 16f405bb >2014-01-06 06:52:07,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4bdc0da2 >2014-01-06 06:52:07,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e184cfe}, log id: 4bdc0da2 >2014-01-06 06:52:12,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b2d3fe7 >2014-01-06 06:52:12,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b2d3fe7 >2014-01-06 06:52:12,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 26c53b78 >2014-01-06 06:52:12,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abe1c505}, log id: 26c53b78 >2014-01-06 06:52:17,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56949f09 >2014-01-06 06:52:18,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56949f09 >2014-01-06 06:52:18,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 280e7df9 >2014-01-06 06:52:18,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e26a722}, log id: 280e7df9 >2014-01-06 06:52:23,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44500549 >2014-01-06 06:52:23,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 44500549 >2014-01-06 06:52:23,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c720f06 >2014-01-06 06:52:23,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2572992}, log id: 3c720f06 >2014-01-06 06:52:28,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6898e6d4 >2014-01-06 06:52:29,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6898e6d4 >2014-01-06 06:52:29,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6dc7d157 >2014-01-06 06:52:29,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d55f8d71}, log id: 6dc7d157 >2014-01-06 06:52:34,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72fc09de >2014-01-06 06:52:34,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 72fc09de >2014-01-06 06:52:34,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 75a817bc >2014-01-06 06:52:34,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca96ac8a}, log id: 75a817bc >2014-01-06 06:52:39,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7fa80a5 >2014-01-06 06:52:39,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7fa80a5 >2014-01-06 06:52:39,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3fa8ea6c >2014-01-06 06:52:40,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffdcaf04}, log id: 3fa8ea6c >2014-01-06 06:52:45,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 409c48b3 >2014-01-06 06:52:45,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 409c48b3 >2014-01-06 06:52:45,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c7b4aec >2014-01-06 06:52:45,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0f68f49}, log id: 5c7b4aec >2014-01-06 06:52:50,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 65d29785 >2014-01-06 06:52:50,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 65d29785 >2014-01-06 06:52:50,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e15e91d >2014-01-06 06:52:51,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92dbd3b7}, log id: 2e15e91d >2014-01-06 06:52:56,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e6da2a9 >2014-01-06 06:52:56,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2e6da2a9 >2014-01-06 06:52:56,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 515e6382 >2014-01-06 06:52:56,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99ab9ba1}, log id: 515e6382 >2014-01-06 06:53:00,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 115f3e1d >2014-01-06 06:53:01,135 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:53:01,135 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:53:01,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, log id: 115f3e1d >2014-01-06 06:53:01,135 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-20) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:53:01,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b224618 >2014-01-06 06:53:01,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7b224618 >2014-01-06 06:53:01,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14df1a70 >2014-01-06 06:53:01,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38ed19a2}, log id: 14df1a70 >2014-01-06 06:53:06,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cb668e2 >2014-01-06 06:53:07,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6cb668e2 >2014-01-06 06:53:07,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f915abc >2014-01-06 06:53:07,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58b33e21}, log id: 4f915abc >2014-01-06 06:53:12,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27c68be3 >2014-01-06 06:53:12,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 27c68be3 >2014-01-06 06:53:12,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58812d0d >2014-01-06 06:53:12,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec185b5f}, log id: 58812d0d >2014-01-06 06:53:17,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5bd227ed >2014-01-06 06:53:18,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5bd227ed >2014-01-06 06:53:18,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b7cbfc0 >2014-01-06 06:53:18,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e348c6a}, log id: 7b7cbfc0 >2014-01-06 06:53:23,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e4c132b >2014-01-06 06:53:23,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6e4c132b >2014-01-06 06:53:23,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 8d27eef >2014-01-06 06:53:23,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@379bdea8}, log id: 8d27eef >2014-01-06 06:53:28,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2238c416 >2014-01-06 06:53:29,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2238c416 >2014-01-06 06:53:29,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3f7fba3c >2014-01-06 06:53:29,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe742f61}, log id: 3f7fba3c >2014-01-06 06:53:34,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44725d90 >2014-01-06 06:53:34,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 44725d90 >2014-01-06 06:53:34,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 166c21 >2014-01-06 06:53:34,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e958d91}, log id: 166c21 >2014-01-06 06:53:39,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ee720c1 >2014-01-06 06:53:39,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5ee720c1 >2014-01-06 06:53:39,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7fc9263d >2014-01-06 06:53:40,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad13c193}, log id: 7fc9263d >2014-01-06 06:53:44,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: fbe2a88 >2014-01-06 06:53:44,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2d0160f3, log id: fbe2a88 >2014-01-06 06:53:45,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49aae880 >2014-01-06 06:53:45,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 49aae880 >2014-01-06 06:53:45,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67ea8be5 >2014-01-06 06:53:45,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@256dabda}, log id: 67ea8be5 >2014-01-06 06:53:50,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 70694853 >2014-01-06 06:53:50,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 70694853 >2014-01-06 06:53:50,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 287fdbd4 >2014-01-06 06:53:51,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3bc658e}, log id: 287fdbd4 >2014-01-06 06:53:56,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f5500c6 >2014-01-06 06:53:56,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4f5500c6 >2014-01-06 06:53:56,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b55fa4c >2014-01-06 06:53:56,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfbb8292}, log id: 5b55fa4c >2014-01-06 06:54:01,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 37c9291c >2014-01-06 06:54:01,497 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:54:01,498 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:54:01,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, log id: 37c9291c >2014-01-06 06:54:01,498 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-97) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:54:01,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c6d9998 >2014-01-06 06:54:01,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5c6d9998 >2014-01-06 06:54:01,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6721e70b >2014-01-06 06:54:01,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb2b78f1}, log id: 6721e70b >2014-01-06 06:54:06,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 17270fa5 >2014-01-06 06:54:07,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 17270fa5 >2014-01-06 06:54:07,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ca456ec >2014-01-06 06:54:07,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@550805a7}, log id: 7ca456ec >2014-01-06 06:54:12,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11e1e7db >2014-01-06 06:54:12,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 11e1e7db >2014-01-06 06:54:12,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e951877 >2014-01-06 06:54:12,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4dc8ad7a}, log id: 4e951877 >2014-01-06 06:54:17,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4769b950 >2014-01-06 06:54:18,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4769b950 >2014-01-06 06:54:18,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 489d1a3b >2014-01-06 06:54:18,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@864096d}, log id: 489d1a3b >2014-01-06 06:54:23,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43e0b381 >2014-01-06 06:54:23,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43e0b381 >2014-01-06 06:54:23,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2279e2dd >2014-01-06 06:54:23,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd273901}, log id: 2279e2dd >2014-01-06 06:54:28,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b2fdc95 >2014-01-06 06:54:29,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b2fdc95 >2014-01-06 06:54:29,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 591be08c >2014-01-06 06:54:29,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@310c6d99}, log id: 591be08c >2014-01-06 06:54:34,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59b70ace >2014-01-06 06:54:34,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 59b70ace >2014-01-06 06:54:34,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7134a2dc >2014-01-06 06:54:34,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ebb318}, log id: 7134a2dc >2014-01-06 06:54:39,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 750f3e48 >2014-01-06 06:54:39,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 750f3e48 >2014-01-06 06:54:39,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2573dc37 >2014-01-06 06:54:40,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2e3fa23}, log id: 2573dc37 >2014-01-06 06:54:45,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14c1b8fc >2014-01-06 06:54:45,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 14c1b8fc >2014-01-06 06:54:45,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26cf446 >2014-01-06 06:54:45,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94adb2a0}, log id: 26cf446 >2014-01-06 06:54:50,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d8904a1 >2014-01-06 06:54:50,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3d8904a1 >2014-01-06 06:54:50,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2df1245a >2014-01-06 06:54:51,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bb4b135}, log id: 2df1245a >2014-01-06 06:54:56,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1165e236 >2014-01-06 06:54:56,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1165e236 >2014-01-06 06:54:56,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45b28768 >2014-01-06 06:54:56,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35c1ef89}, log id: 45b28768 >2014-01-06 06:55:01,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65abc5a6 >2014-01-06 06:55:01,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b9fefff >2014-01-06 06:55:01,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: b9fefff >2014-01-06 06:55:01,844 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:55:01,844 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:55:01,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, log id: 65abc5a6 >2014-01-06 06:55:01,844 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-24) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:55:01,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5214c221 >2014-01-06 06:55:01,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4361b487}, log id: 5214c221 >2014-01-06 06:55:07,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ca955d4 >2014-01-06 06:55:07,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ca955d4 >2014-01-06 06:55:07,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 55734814 >2014-01-06 06:55:07,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13a81edf}, log id: 55734814 >2014-01-06 06:55:12,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 149bd3f0 >2014-01-06 06:55:12,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 149bd3f0 >2014-01-06 06:55:12,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 210c0f24 >2014-01-06 06:55:12,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca798668}, log id: 210c0f24 >2014-01-06 06:55:17,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ef58e0 >2014-01-06 06:55:18,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7ef58e0 >2014-01-06 06:55:18,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 374beaee >2014-01-06 06:55:18,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48330748}, log id: 374beaee >2014-01-06 06:55:23,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48061686 >2014-01-06 06:55:23,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 48061686 >2014-01-06 06:55:23,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d58d177 >2014-01-06 06:55:23,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24818f86}, log id: 3d58d177 >2014-01-06 06:55:28,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 584040b5 >2014-01-06 06:55:29,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 584040b5 >2014-01-06 06:55:29,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c67e0b >2014-01-06 06:55:29,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfdfe1e0}, log id: 4c67e0b >2014-01-06 06:55:34,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57289e66 >2014-01-06 06:55:34,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 57289e66 >2014-01-06 06:55:34,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13091b1e >2014-01-06 06:55:34,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe8ba248}, log id: 13091b1e >2014-01-06 06:55:39,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 485cc58a >2014-01-06 06:55:40,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 485cc58a >2014-01-06 06:55:40,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 26c09690 >2014-01-06 06:55:40,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2c1efeb}, log id: 26c09690 >2014-01-06 06:55:45,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66e45653 >2014-01-06 06:55:45,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66e45653 >2014-01-06 06:55:45,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 465f633c >2014-01-06 06:55:45,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49543ceb}, log id: 465f633c >2014-01-06 06:55:50,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 65a260d2 >2014-01-06 06:55:50,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 65a260d2 >2014-01-06 06:55:50,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ee198a4 >2014-01-06 06:55:51,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9584a9a8}, log id: 1ee198a4 >2014-01-06 06:55:56,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7aede9bb >2014-01-06 06:55:56,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7aede9bb >2014-01-06 06:55:56,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e7110d >2014-01-06 06:55:56,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9da04aba}, log id: 5e7110d >2014-01-06 06:56:01,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b6a651e >2014-01-06 06:56:01,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b756ae6 >2014-01-06 06:56:01,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b6a651e >2014-01-06 06:56:01,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71c59a9d >2014-01-06 06:56:02,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@372835a0}, log id: 71c59a9d >2014-01-06 06:56:02,206 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:56:02,207 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:56:02,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, log id: 6b756ae6 >2014-01-06 06:56:02,207 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-30) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:56:07,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 50c77ddc >2014-01-06 06:56:07,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 50c77ddc >2014-01-06 06:56:07,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a887f02 >2014-01-06 06:56:07,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d27aa3e1}, log id: 5a887f02 >2014-01-06 06:56:12,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6740995d >2014-01-06 06:56:12,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6740995d >2014-01-06 06:56:12,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6be9f1ca >2014-01-06 06:56:12,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eeaa3eeb}, log id: 6be9f1ca >2014-01-06 06:56:18,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5bc3addb >2014-01-06 06:56:18,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5bc3addb >2014-01-06 06:56:18,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2ba4384d >2014-01-06 06:56:18,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5696956}, log id: 2ba4384d >2014-01-06 06:56:23,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d628e57 >2014-01-06 06:56:23,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d628e57 >2014-01-06 06:56:23,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56cc76fd >2014-01-06 06:56:23,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f99d7af6}, log id: 56cc76fd >2014-01-06 06:56:28,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c258012 >2014-01-06 06:56:29,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7c258012 >2014-01-06 06:56:29,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40595385 >2014-01-06 06:56:29,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e33cab25}, log id: 40595385 >2014-01-06 06:56:34,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 63507acc >2014-01-06 06:56:34,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 63507acc >2014-01-06 06:56:34,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29bdc558 >2014-01-06 06:56:34,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f18b6bb7}, log id: 29bdc558 >2014-01-06 06:56:39,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 44fc5826 >2014-01-06 06:56:40,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 44fc5826 >2014-01-06 06:56:40,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 488966b1 >2014-01-06 06:56:40,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b012e4b}, log id: 488966b1 >2014-01-06 06:56:45,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1909eb42 >2014-01-06 06:56:45,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1909eb42 >2014-01-06 06:56:45,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b58191e >2014-01-06 06:56:45,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b474c9f}, log id: 2b58191e >2014-01-06 06:56:50,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 255eda66 >2014-01-06 06:56:51,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 255eda66 >2014-01-06 06:56:51,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f375a82 >2014-01-06 06:56:51,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e706a3f}, log id: 2f375a82 >2014-01-06 06:56:56,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4f26e23f >2014-01-06 06:56:56,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4f26e23f >2014-01-06 06:56:56,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: dd4e989 >2014-01-06 06:56:56,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b82dc18f}, log id: dd4e989 >2014-01-06 06:57:01,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 34772978 >2014-01-06 06:57:01,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 34772978 >2014-01-06 06:57:01,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7a7a8838 >2014-01-06 06:57:02,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@694ad613}, log id: 7a7a8838 >2014-01-06 06:57:02,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e6fe09e >2014-01-06 06:57:02,536 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 06:57:02,536 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:57:02,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, log id: 3e6fe09e >2014-01-06 06:57:02,536 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-9) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:57:07,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35f65950 >2014-01-06 06:57:07,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 35f65950 >2014-01-06 06:57:07,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14d7f055 >2014-01-06 06:57:07,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@640f690a}, log id: 14d7f055 >2014-01-06 06:57:12,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54eb2402 >2014-01-06 06:57:12,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 54eb2402 >2014-01-06 06:57:12,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f14835 >2014-01-06 06:57:13,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ccfb6e6}, log id: 5f14835 >2014-01-06 06:57:18,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: ef8341e >2014-01-06 06:57:18,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: ef8341e >2014-01-06 06:57:18,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44ae13fd >2014-01-06 06:57:18,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e3d2954}, log id: 44ae13fd >2014-01-06 06:57:23,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43f834f2 >2014-01-06 06:57:23,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43f834f2 >2014-01-06 06:57:23,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7b0b8e4f >2014-01-06 06:57:23,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2dffaff}, log id: 7b0b8e4f >2014-01-06 06:57:28,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 295433b8 >2014-01-06 06:57:29,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 295433b8 >2014-01-06 06:57:29,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21df009f >2014-01-06 06:57:29,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f050bab}, log id: 21df009f >2014-01-06 06:57:34,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6e61e116 >2014-01-06 06:57:34,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6e61e116 >2014-01-06 06:57:34,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5132e11e >2014-01-06 06:57:34,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8ed7969}, log id: 5132e11e >2014-01-06 06:57:39,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 627f8a54 >2014-01-06 06:57:40,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 627f8a54 >2014-01-06 06:57:40,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22989eb >2014-01-06 06:57:40,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a01da361}, log id: 22989eb >2014-01-06 06:57:45,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e558b2b >2014-01-06 06:57:45,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4e558b2b >2014-01-06 06:57:45,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53ab6f8d >2014-01-06 06:57:45,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf32d985}, log id: 53ab6f8d >2014-01-06 06:57:50,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56b833e4 >2014-01-06 06:57:51,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56b833e4 >2014-01-06 06:57:51,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1558abf >2014-01-06 06:57:51,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b145d56c}, log id: 1558abf >2014-01-06 06:57:56,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f35e74c >2014-01-06 06:57:56,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4f35e74c >2014-01-06 06:57:56,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 758d5e9e >2014-01-06 06:57:56,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f73d8414}, log id: 758d5e9e >2014-01-06 06:58:01,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30c662fd >2014-01-06 06:58:01,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 30c662fd >2014-01-06 06:58:01,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3342b5fa >2014-01-06 06:58:02,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9db6565f}, log id: 3342b5fa >2014-01-06 06:58:02,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5702da8e >2014-01-06 06:58:02,863 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:58:02,863 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:58:02,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, log id: 5702da8e >2014-01-06 06:58:02,863 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-63) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:58:07,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7dcb8a12 >2014-01-06 06:58:07,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7dcb8a12 >2014-01-06 06:58:07,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2016cc4c >2014-01-06 06:58:07,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3392e8bd}, log id: 2016cc4c >2014-01-06 06:58:12,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f6d00ea >2014-01-06 06:58:12,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6f6d00ea >2014-01-06 06:58:12,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7bdb0ca3 >2014-01-06 06:58:13,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@520e980e}, log id: 7bdb0ca3 >2014-01-06 06:58:18,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15b12e97 >2014-01-06 06:58:18,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 15b12e97 >2014-01-06 06:58:18,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40e0b7e8 >2014-01-06 06:58:18,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de6dde9a}, log id: 40e0b7e8 >2014-01-06 06:58:23,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 734aa608 >2014-01-06 06:58:23,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 734aa608 >2014-01-06 06:58:23,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58ef3248 >2014-01-06 06:58:23,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51f24fd4}, log id: 58ef3248 >2014-01-06 06:58:28,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c8ef0c7 >2014-01-06 06:58:29,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7c8ef0c7 >2014-01-06 06:58:29,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 70e59c20 >2014-01-06 06:58:29,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0775981}, log id: 70e59c20 >2014-01-06 06:58:34,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 332b7f97 >2014-01-06 06:58:34,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 332b7f97 >2014-01-06 06:58:34,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2fa3be7d >2014-01-06 06:58:34,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e81fef84}, log id: 2fa3be7d >2014-01-06 06:58:39,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b93644 >2014-01-06 06:58:40,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5b93644 >2014-01-06 06:58:40,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4538a01c >2014-01-06 06:58:40,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@467005ed}, log id: 4538a01c >2014-01-06 06:58:44,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 616dd703 >2014-01-06 06:58:45,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) [4a16862e] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@cfe13a1, log id: 616dd703 >2014-01-06 06:58:45,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 570347a5 >2014-01-06 06:58:45,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 570347a5 >2014-01-06 06:58:45,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39ca5dfe >2014-01-06 06:58:45,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2cac2a9}, log id: 39ca5dfe >2014-01-06 06:58:50,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71e2a30e >2014-01-06 06:58:51,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 71e2a30e >2014-01-06 06:58:51,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2d21e502 >2014-01-06 06:58:51,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5de2ced}, log id: 2d21e502 >2014-01-06 06:58:56,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 304d33a0 >2014-01-06 06:58:56,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 304d33a0 >2014-01-06 06:58:56,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11c8958 >2014-01-06 06:58:56,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3974396}, log id: 11c8958 >2014-01-06 06:59:01,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66ad97da >2014-01-06 06:59:02,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 66ad97da >2014-01-06 06:59:02,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1637099d >2014-01-06 06:59:02,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d18638e}, log id: 1637099d >2014-01-06 06:59:02,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4b94fa91 >2014-01-06 06:59:03,192 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 06:59:03,192 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 06:59:03,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, log id: 4b94fa91 >2014-01-06 06:59:03,192 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-86) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 06:59:07,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f1b6efb >2014-01-06 06:59:07,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6f1b6efb >2014-01-06 06:59:07,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c50d934 >2014-01-06 06:59:07,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0ed6574}, log id: 4c50d934 >2014-01-06 06:59:12,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c13abd8 >2014-01-06 06:59:12,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4c13abd8 >2014-01-06 06:59:12,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7615d57d >2014-01-06 06:59:13,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63f24e6}, log id: 7615d57d >2014-01-06 06:59:18,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 792d79b2 >2014-01-06 06:59:18,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 792d79b2 >2014-01-06 06:59:18,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52ff3ba6 >2014-01-06 06:59:18,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5207eeef}, log id: 52ff3ba6 >2014-01-06 06:59:23,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15e1f265 >2014-01-06 06:59:23,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 15e1f265 >2014-01-06 06:59:23,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ce795f5 >2014-01-06 06:59:23,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13864d54}, log id: 6ce795f5 >2014-01-06 06:59:29,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 86288b9 >2014-01-06 06:59:29,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 86288b9 >2014-01-06 06:59:29,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4fac7933 >2014-01-06 06:59:29,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2bfde8e}, log id: 4fac7933 >2014-01-06 06:59:34,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 322a3b9b >2014-01-06 06:59:34,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 322a3b9b >2014-01-06 06:59:34,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ad1e4d5 >2014-01-06 06:59:34,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@954fbcff}, log id: 2ad1e4d5 >2014-01-06 06:59:39,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fd96b6 >2014-01-06 06:59:40,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: fd96b6 >2014-01-06 06:59:40,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 560077d1 >2014-01-06 06:59:40,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79d1adf2}, log id: 560077d1 >2014-01-06 06:59:45,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 29268f43 >2014-01-06 06:59:45,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 29268f43 >2014-01-06 06:59:45,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2004bdc4 >2014-01-06 06:59:45,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e5a4562}, log id: 2004bdc4 >2014-01-06 06:59:50,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a2c04bf >2014-01-06 06:59:51,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1a2c04bf >2014-01-06 06:59:51,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b22df23 >2014-01-06 06:59:51,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d67f4141}, log id: 7b22df23 >2014-01-06 06:59:56,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c09465 >2014-01-06 06:59:56,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6c09465 >2014-01-06 06:59:56,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: dc3af65 >2014-01-06 06:59:57,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@772fcea3}, log id: dc3af65 >2014-01-06 07:00:02,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49359b96 >2014-01-06 07:00:02,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 49359b96 >2014-01-06 07:00:02,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c95426f >2014-01-06 07:00:02,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@527718bd}, log id: 2c95426f >2014-01-06 07:00:03,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1222728b >2014-01-06 07:00:03,524 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:00:03,524 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:00:03,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, log id: 1222728b >2014-01-06 07:00:03,524 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-40) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:00:07,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 473036d6 >2014-01-06 07:00:07,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 473036d6 >2014-01-06 07:00:07,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7fde184 >2014-01-06 07:00:08,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7528e5d4}, log id: 7fde184 >2014-01-06 07:00:13,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b181225 >2014-01-06 07:00:13,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1b181225 >2014-01-06 07:00:13,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 728d21bf >2014-01-06 07:00:13,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa60c9e8}, log id: 728d21bf >2014-01-06 07:00:18,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5eba991d >2014-01-06 07:00:18,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5eba991d >2014-01-06 07:00:18,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 302dfbab >2014-01-06 07:00:19,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5f75ff6}, log id: 302dfbab >2014-01-06 07:00:24,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1921f403 >2014-01-06 07:00:24,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1921f403 >2014-01-06 07:00:24,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6570361a >2014-01-06 07:00:24,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6ef80f2}, log id: 6570361a >2014-01-06 07:00:29,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 283f7333 >2014-01-06 07:00:29,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 283f7333 >2014-01-06 07:00:29,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6d1affb8 >2014-01-06 07:00:29,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@905960f4}, log id: 6d1affb8 >2014-01-06 07:00:34,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5274c60d >2014-01-06 07:00:35,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5274c60d >2014-01-06 07:00:35,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d44548c >2014-01-06 07:00:35,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30f63625}, log id: 1d44548c >2014-01-06 07:00:40,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29798de3 >2014-01-06 07:00:40,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29798de3 >2014-01-06 07:00:40,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70f76052 >2014-01-06 07:00:40,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dfd433b}, log id: 70f76052 >2014-01-06 07:00:45,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a8379e3 >2014-01-06 07:00:46,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5a8379e3 >2014-01-06 07:00:46,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30102b36 >2014-01-06 07:00:46,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d025dae9}, log id: 30102b36 >2014-01-06 07:00:51,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 772a85c4 >2014-01-06 07:00:51,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 772a85c4 >2014-01-06 07:00:51,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4be2cc20 >2014-01-06 07:00:51,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22e70c37}, log id: 4be2cc20 >2014-01-06 07:00:56,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c188794 >2014-01-06 07:00:57,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7c188794 >2014-01-06 07:00:57,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3526d51e >2014-01-06 07:00:57,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@deb24425}, log id: 3526d51e >2014-01-06 07:01:02,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40511d8e >2014-01-06 07:01:02,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 40511d8e >2014-01-06 07:01:02,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 42bcf38f >2014-01-06 07:01:02,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@296979f}, log id: 42bcf38f >2014-01-06 07:01:03,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56fbbdb8 >2014-01-06 07:01:03,852 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:01:03,853 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:01:03,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, log id: 56fbbdb8 >2014-01-06 07:01:03,853 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-30) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:01:07,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3d02f4fc >2014-01-06 07:01:07,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3d02f4fc >2014-01-06 07:01:07,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 342e8d65 >2014-01-06 07:01:08,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f1fba2}, log id: 342e8d65 >2014-01-06 07:01:13,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74000227 >2014-01-06 07:01:13,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 74000227 >2014-01-06 07:01:13,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ae889e2 >2014-01-06 07:01:13,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a86b0263}, log id: 2ae889e2 >2014-01-06 07:01:18,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c684f4e >2014-01-06 07:01:18,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5c684f4e >2014-01-06 07:01:18,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52f474f1 >2014-01-06 07:01:19,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f647ef8}, log id: 52f474f1 >2014-01-06 07:01:24,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1ef80605 >2014-01-06 07:01:24,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1ef80605 >2014-01-06 07:01:24,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f7c399d >2014-01-06 07:01:24,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b0893ec}, log id: 7f7c399d >2014-01-06 07:01:29,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3565973c >2014-01-06 07:01:29,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3565973c >2014-01-06 07:01:29,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e444b9b >2014-01-06 07:01:29,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b30d5baf}, log id: 1e444b9b >2014-01-06 07:01:34,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5fdc479d >2014-01-06 07:01:35,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5fdc479d >2014-01-06 07:01:35,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 74712178 >2014-01-06 07:01:35,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2de893f3}, log id: 74712178 >2014-01-06 07:01:40,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2c19a865 >2014-01-06 07:01:40,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2c19a865 >2014-01-06 07:01:40,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 78a5bf6f >2014-01-06 07:01:40,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d7fe021}, log id: 78a5bf6f >2014-01-06 07:01:45,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1943b344 >2014-01-06 07:01:46,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1943b344 >2014-01-06 07:01:46,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33574bb4 >2014-01-06 07:01:46,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79490199}, log id: 33574bb4 >2014-01-06 07:01:51,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3942b8cf >2014-01-06 07:01:51,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3942b8cf >2014-01-06 07:01:51,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f69ee0 >2014-01-06 07:01:51,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87059173}, log id: 7f69ee0 >2014-01-06 07:01:56,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a445086 >2014-01-06 07:01:57,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4a445086 >2014-01-06 07:01:57,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d10fd31 >2014-01-06 07:01:57,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db7b6813}, log id: d10fd31 >2014-01-06 07:02:02,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59cb4e2d >2014-01-06 07:02:02,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 59cb4e2d >2014-01-06 07:02:02,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 39a49213 >2014-01-06 07:02:02,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5de1a5c1}, log id: 39a49213 >2014-01-06 07:02:03,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b9a2119 >2014-01-06 07:02:04,178 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:02:04,178 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:02:04,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, log id: b9a2119 >2014-01-06 07:02:04,179 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-9) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:02:07,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ab6bb1 >2014-01-06 07:02:07,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7ab6bb1 >2014-01-06 07:02:07,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 77a0f705 >2014-01-06 07:02:08,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a42207e}, log id: 77a0f705 >2014-01-06 07:02:13,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 559b5a88 >2014-01-06 07:02:13,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 559b5a88 >2014-01-06 07:02:13,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34487aff >2014-01-06 07:02:13,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e32c5b1}, log id: 34487aff >2014-01-06 07:02:18,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f8cd27f >2014-01-06 07:02:18,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3f8cd27f >2014-01-06 07:02:18,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a1277ee >2014-01-06 07:02:18,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48421989}, log id: 1a1277ee >2014-01-06 07:02:24,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 469aebd9 >2014-01-06 07:02:24,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 469aebd9 >2014-01-06 07:02:24,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 604ad466 >2014-01-06 07:02:24,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@968a03df}, log id: 604ad466 >2014-01-06 07:02:29,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 469d269 >2014-01-06 07:02:29,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 469d269 >2014-01-06 07:02:29,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1981f6ee >2014-01-06 07:02:29,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d243c1e7}, log id: 1981f6ee >2014-01-06 07:02:34,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 166516c1 >2014-01-06 07:02:35,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 166516c1 >2014-01-06 07:02:35,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 387fa24 >2014-01-06 07:02:35,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42e38218}, log id: 387fa24 >2014-01-06 07:02:40,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4fd3f6e9 >2014-01-06 07:02:40,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4fd3f6e9 >2014-01-06 07:02:40,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 14f226ee >2014-01-06 07:02:40,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@746a562d}, log id: 14f226ee >2014-01-06 07:02:45,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c0fa7d2 >2014-01-06 07:02:46,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4c0fa7d2 >2014-01-06 07:02:46,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 725cb1a8 >2014-01-06 07:02:46,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49d281ce}, log id: 725cb1a8 >2014-01-06 07:02:51,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 761c7140 >2014-01-06 07:02:51,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 761c7140 >2014-01-06 07:02:51,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1de9de91 >2014-01-06 07:02:51,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56e54c79}, log id: 1de9de91 >2014-01-06 07:02:56,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1279843 >2014-01-06 07:02:57,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1279843 >2014-01-06 07:02:57,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 284a227a >2014-01-06 07:02:57,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f90e748}, log id: 284a227a >2014-01-06 07:03:02,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3703ae13 >2014-01-06 07:03:02,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3703ae13 >2014-01-06 07:03:02,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 20de9531 >2014-01-06 07:03:02,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e0e1405}, log id: 20de9531 >2014-01-06 07:03:04,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36e988b6 >2014-01-06 07:03:04,501 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:03:04,501 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:03:04,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, log id: 36e988b6 >2014-01-06 07:03:04,501 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-99) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:03:07,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f87f71c >2014-01-06 07:03:07,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: f87f71c >2014-01-06 07:03:07,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 77cefefc >2014-01-06 07:03:08,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4041ffa6}, log id: 77cefefc >2014-01-06 07:03:13,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ba5922c >2014-01-06 07:03:13,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4ba5922c >2014-01-06 07:03:13,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1616c6d7 >2014-01-06 07:03:13,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dd2d647}, log id: 1616c6d7 >2014-01-06 07:03:18,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c6c087d >2014-01-06 07:03:18,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3c6c087d >2014-01-06 07:03:18,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 202e5df0 >2014-01-06 07:03:19,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4cbc115}, log id: 202e5df0 >2014-01-06 07:03:24,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6313f4a >2014-01-06 07:03:24,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6313f4a >2014-01-06 07:03:24,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18fee967 >2014-01-06 07:03:24,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b74a268e}, log id: 18fee967 >2014-01-06 07:03:29,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1014a465 >2014-01-06 07:03:29,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1014a465 >2014-01-06 07:03:29,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7b82d233 >2014-01-06 07:03:29,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9767d903}, log id: 7b82d233 >2014-01-06 07:03:34,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b949eab >2014-01-06 07:03:35,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: b949eab >2014-01-06 07:03:35,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31aad8a3 >2014-01-06 07:03:35,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71c95da7}, log id: 31aad8a3 >2014-01-06 07:03:40,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5191ddd5 >2014-01-06 07:03:40,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5191ddd5 >2014-01-06 07:03:40,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3c092eef >2014-01-06 07:03:40,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6eb2680}, log id: 3c092eef >2014-01-06 07:03:45,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5aea05ac >2014-01-06 07:03:45,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4da03b6, log id: 5aea05ac >2014-01-06 07:03:45,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5cc2dcaf >2014-01-06 07:03:46,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5cc2dcaf >2014-01-06 07:03:46,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1df2297 >2014-01-06 07:03:46,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@952bc078}, log id: 1df2297 >2014-01-06 07:03:51,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1db5cf57 >2014-01-06 07:03:51,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1db5cf57 >2014-01-06 07:03:51,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 794cabae >2014-01-06 07:03:51,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c05ef77}, log id: 794cabae >2014-01-06 07:03:56,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 19a13fa6 >2014-01-06 07:03:57,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 19a13fa6 >2014-01-06 07:03:57,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 42cb7d90 >2014-01-06 07:03:57,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a27a4435}, log id: 42cb7d90 >2014-01-06 07:04:02,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5af3b523 >2014-01-06 07:04:02,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5af3b523 >2014-01-06 07:04:02,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e91253c >2014-01-06 07:04:02,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0d5c06}, log id: 4e91253c >2014-01-06 07:04:04,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 229f382a >2014-01-06 07:04:04,826 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:04:04,827 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:04:04,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, log id: 229f382a >2014-01-06 07:04:04,827 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-86) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:04:07,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 202edaef >2014-01-06 07:04:07,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 202edaef >2014-01-06 07:04:07,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7e95bcb6 >2014-01-06 07:04:08,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9a5ea78}, log id: 7e95bcb6 >2014-01-06 07:04:13,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: cddfb15 >2014-01-06 07:04:13,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: cddfb15 >2014-01-06 07:04:13,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f2bb596 >2014-01-06 07:04:13,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a155d226}, log id: 7f2bb596 >2014-01-06 07:04:18,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3eae262 >2014-01-06 07:04:18,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3eae262 >2014-01-06 07:04:18,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71a10304 >2014-01-06 07:04:19,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0f80798}, log id: 71a10304 >2014-01-06 07:04:24,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5170e8d7 >2014-01-06 07:04:24,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5170e8d7 >2014-01-06 07:04:24,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2974b88a >2014-01-06 07:04:24,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77fcf708}, log id: 2974b88a >2014-01-06 07:04:29,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a9d997c >2014-01-06 07:04:29,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3a9d997c >2014-01-06 07:04:29,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6beb869b >2014-01-06 07:04:29,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@913402a5}, log id: 6beb869b >2014-01-06 07:04:35,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ec86fd9 >2014-01-06 07:04:35,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6ec86fd9 >2014-01-06 07:04:35,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: dbda253 >2014-01-06 07:04:35,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47de9d1d}, log id: dbda253 >2014-01-06 07:04:40,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 49dfbd83 >2014-01-06 07:04:40,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 49dfbd83 >2014-01-06 07:04:40,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 493ab7bd >2014-01-06 07:04:40,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edab31c}, log id: 493ab7bd >2014-01-06 07:04:45,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3a749ff2 >2014-01-06 07:04:46,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3a749ff2 >2014-01-06 07:04:46,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 133f37e1 >2014-01-06 07:04:46,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4c55d0e}, log id: 133f37e1 >2014-01-06 07:04:51,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3eae6ec0 >2014-01-06 07:04:51,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3eae6ec0 >2014-01-06 07:04:51,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 792fa206 >2014-01-06 07:04:51,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18a2988f}, log id: 792fa206 >2014-01-06 07:04:56,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 13866ea8 >2014-01-06 07:04:57,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 13866ea8 >2014-01-06 07:04:57,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6009683a >2014-01-06 07:04:57,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f250a7e}, log id: 6009683a >2014-01-06 07:05:02,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29e8a807 >2014-01-06 07:05:02,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29e8a807 >2014-01-06 07:05:02,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a42a5d1 >2014-01-06 07:05:02,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76f21c6b}, log id: 4a42a5d1 >2014-01-06 07:05:04,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 67a7c024 >2014-01-06 07:05:05,153 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:05:05,153 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:05:05,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, log id: 67a7c024 >2014-01-06 07:05:05,153 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-40) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:05:07,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47cfbd96 >2014-01-06 07:05:07,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 47cfbd96 >2014-01-06 07:05:07,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f7fe7c6 >2014-01-06 07:05:08,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0047eaf}, log id: 1f7fe7c6 >2014-01-06 07:05:13,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 471605b9 >2014-01-06 07:05:13,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 471605b9 >2014-01-06 07:05:13,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25ac2c92 >2014-01-06 07:05:13,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0e96e4}, log id: 25ac2c92 >2014-01-06 07:05:18,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f0da6c >2014-01-06 07:05:18,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f0da6c >2014-01-06 07:05:18,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49cb123d >2014-01-06 07:05:19,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11c887c0}, log id: 49cb123d >2014-01-06 07:05:24,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66376018 >2014-01-06 07:05:24,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66376018 >2014-01-06 07:05:24,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e3a82ae >2014-01-06 07:05:24,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24e39192}, log id: 3e3a82ae >2014-01-06 07:05:29,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b2492e5 >2014-01-06 07:05:29,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b2492e5 >2014-01-06 07:05:29,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6541fea9 >2014-01-06 07:05:29,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f01fb862}, log id: 6541fea9 >2014-01-06 07:05:34,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 38c13043 >2014-01-06 07:05:35,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 38c13043 >2014-01-06 07:05:35,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1b2dadfd >2014-01-06 07:05:35,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30719757}, log id: 1b2dadfd >2014-01-06 07:05:40,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6eca7b1 >2014-01-06 07:05:40,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6eca7b1 >2014-01-06 07:05:40,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2aa1796 >2014-01-06 07:05:40,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@166806ed}, log id: 2aa1796 >2014-01-06 07:05:45,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ac65f28 >2014-01-06 07:05:46,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6ac65f28 >2014-01-06 07:05:46,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 28947d40 >2014-01-06 07:05:46,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49e49cc5}, log id: 28947d40 >2014-01-06 07:05:51,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48fd90d9 >2014-01-06 07:05:51,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 48fd90d9 >2014-01-06 07:05:51,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 702f4ea6 >2014-01-06 07:05:51,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2267370e}, log id: 702f4ea6 >2014-01-06 07:05:56,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 240f644b >2014-01-06 07:05:57,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 240f644b >2014-01-06 07:05:57,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54f2dabb >2014-01-06 07:05:57,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f6352a5}, log id: 54f2dabb >2014-01-06 07:06:02,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 66ebf188 >2014-01-06 07:06:02,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 66ebf188 >2014-01-06 07:06:02,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33a0d317 >2014-01-06 07:06:02,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85afe765}, log id: 33a0d317 >2014-01-06 07:06:05,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c59da7b >2014-01-06 07:06:05,489 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:06:05,489 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:06:05,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, log id: 6c59da7b >2014-01-06 07:06:05,489 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-87) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:06:07,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75213c28 >2014-01-06 07:06:08,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 75213c28 >2014-01-06 07:06:08,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4f0ab47a >2014-01-06 07:06:08,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc7b1f25}, log id: 4f0ab47a >2014-01-06 07:06:13,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 382b8b9d >2014-01-06 07:06:13,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 382b8b9d >2014-01-06 07:06:13,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 335be7b3 >2014-01-06 07:06:13,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5c92d85}, log id: 335be7b3 >2014-01-06 07:06:18,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34fd29f8 >2014-01-06 07:06:18,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 34fd29f8 >2014-01-06 07:06:18,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: cd101b7 >2014-01-06 07:06:19,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d303a5d}, log id: cd101b7 >2014-01-06 07:06:24,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 89bc376 >2014-01-06 07:06:24,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 89bc376 >2014-01-06 07:06:24,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1f8b7a12 >2014-01-06 07:06:24,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4dfb31ef}, log id: 1f8b7a12 >2014-01-06 07:06:29,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e8fbb27 >2014-01-06 07:06:29,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e8fbb27 >2014-01-06 07:06:29,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: fa8222c >2014-01-06 07:06:29,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a68b303b}, log id: fa8222c >2014-01-06 07:06:34,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33f67bd8 >2014-01-06 07:06:35,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 33f67bd8 >2014-01-06 07:06:35,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6a045ca8 >2014-01-06 07:06:35,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@724fabbd}, log id: 6a045ca8 >2014-01-06 07:06:40,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11279826 >2014-01-06 07:06:40,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 11279826 >2014-01-06 07:06:40,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 79aa262f >2014-01-06 07:06:40,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7d0331e}, log id: 79aa262f >2014-01-06 07:06:45,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b79a58f >2014-01-06 07:06:46,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b79a58f >2014-01-06 07:06:46,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46d04e75 >2014-01-06 07:06:46,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eca96b06}, log id: 46d04e75 >2014-01-06 07:06:51,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5088edc7 >2014-01-06 07:06:51,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5088edc7 >2014-01-06 07:06:51,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35d0fae5 >2014-01-06 07:06:51,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd430186}, log id: 35d0fae5 >2014-01-06 07:06:56,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7018e94c >2014-01-06 07:06:57,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7018e94c >2014-01-06 07:06:57,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a49e6c2 >2014-01-06 07:06:57,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c74c532}, log id: 1a49e6c2 >2014-01-06 07:07:02,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 304d2d3b >2014-01-06 07:07:02,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 304d2d3b >2014-01-06 07:07:02,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4fdd2b4d >2014-01-06 07:07:02,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@848fbcbb}, log id: 4fdd2b4d >2014-01-06 07:07:05,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3294df47 >2014-01-06 07:07:05,817 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:07:05,817 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:07:05,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, log id: 3294df47 >2014-01-06 07:07:05,817 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-45) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:07:07,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b75eee2 >2014-01-06 07:07:07,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6b75eee2 >2014-01-06 07:07:07,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 368e7e06 >2014-01-06 07:07:08,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36e5085}, log id: 368e7e06 >2014-01-06 07:07:13,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b2687d3 >2014-01-06 07:07:13,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b2687d3 >2014-01-06 07:07:13,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13bc2575 >2014-01-06 07:07:13,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea9d6947}, log id: 13bc2575 >2014-01-06 07:07:18,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 239cc14a >2014-01-06 07:07:18,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 239cc14a >2014-01-06 07:07:18,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3dca8ff >2014-01-06 07:07:19,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cc9cd00}, log id: 3dca8ff >2014-01-06 07:07:24,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f967c39 >2014-01-06 07:07:24,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: f967c39 >2014-01-06 07:07:24,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2c4a21f7 >2014-01-06 07:07:24,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@727c6067}, log id: 2c4a21f7 >2014-01-06 07:07:29,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 784fd63e >2014-01-06 07:07:29,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 784fd63e >2014-01-06 07:07:29,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d391ec4 >2014-01-06 07:07:29,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4944bd3}, log id: 4d391ec4 >2014-01-06 07:07:34,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7c8212b3 >2014-01-06 07:07:35,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7c8212b3 >2014-01-06 07:07:35,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 577f7801 >2014-01-06 07:07:35,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77ced943}, log id: 577f7801 >2014-01-06 07:07:40,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 49b8ba66 >2014-01-06 07:07:40,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 49b8ba66 >2014-01-06 07:07:40,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 27b9dd22 >2014-01-06 07:07:40,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d25ac388}, log id: 27b9dd22 >2014-01-06 07:07:45,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e034199 >2014-01-06 07:07:46,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3e034199 >2014-01-06 07:07:46,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 12fb9c43 >2014-01-06 07:07:46,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@142d3934}, log id: 12fb9c43 >2014-01-06 07:07:51,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ab87c31 >2014-01-06 07:07:51,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: ab87c31 >2014-01-06 07:07:51,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4654ef3c >2014-01-06 07:07:51,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@859b850f}, log id: 4654ef3c >2014-01-06 07:07:56,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 147474e8 >2014-01-06 07:07:57,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 147474e8 >2014-01-06 07:07:57,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2887145 >2014-01-06 07:07:57,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0a5508f}, log id: 2887145 >2014-01-06 07:08:02,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 48bf133a >2014-01-06 07:08:02,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 48bf133a >2014-01-06 07:08:02,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 73d581bf >2014-01-06 07:08:02,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5309c0bd}, log id: 73d581bf >2014-01-06 07:08:05,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b4d1a86 >2014-01-06 07:08:06,145 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:08:06,145 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:08:06,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, log id: b4d1a86 >2014-01-06 07:08:06,146 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-91) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:08:07,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 475b5a54 >2014-01-06 07:08:08,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 475b5a54 >2014-01-06 07:08:08,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 461ed774 >2014-01-06 07:08:08,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f2e802f}, log id: 461ed774 >2014-01-06 07:08:13,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 316cddb4 >2014-01-06 07:08:13,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 316cddb4 >2014-01-06 07:08:13,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b998602 >2014-01-06 07:08:13,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c5cbc5e}, log id: 1b998602 >2014-01-06 07:08:18,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 155ece25 >2014-01-06 07:08:18,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 155ece25 >2014-01-06 07:08:18,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f6a1af7 >2014-01-06 07:08:19,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8c4556}, log id: 3f6a1af7 >2014-01-06 07:08:24,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ea1b6c6 >2014-01-06 07:08:24,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1ea1b6c6 >2014-01-06 07:08:24,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7af8a9b3 >2014-01-06 07:08:24,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ea8c2e7}, log id: 7af8a9b3 >2014-01-06 07:08:29,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2b1f6d08 >2014-01-06 07:08:29,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2b1f6d08 >2014-01-06 07:08:29,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5a9791bf >2014-01-06 07:08:29,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7aa03401}, log id: 5a9791bf >2014-01-06 07:08:35,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46bedc66 >2014-01-06 07:08:35,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 46bedc66 >2014-01-06 07:08:35,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2051fa80 >2014-01-06 07:08:35,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3da1371c}, log id: 2051fa80 >2014-01-06 07:08:40,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 79e2bb3b >2014-01-06 07:08:40,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 79e2bb3b >2014-01-06 07:08:40,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d83569 >2014-01-06 07:08:40,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39978100}, log id: 4d83569 >2014-01-06 07:08:45,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73346d57 >2014-01-06 07:08:45,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@371abf21, log id: 73346d57 >2014-01-06 07:08:45,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71e4a87a >2014-01-06 07:08:46,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 71e4a87a >2014-01-06 07:08:46,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63051a1f >2014-01-06 07:08:46,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a7da7ed}, log id: 63051a1f >2014-01-06 07:08:51,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63acf3e7 >2014-01-06 07:08:51,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 63acf3e7 >2014-01-06 07:08:51,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d73959d >2014-01-06 07:08:51,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8025387e}, log id: 4d73959d >2014-01-06 07:08:56,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 293c0fe3 >2014-01-06 07:08:57,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 293c0fe3 >2014-01-06 07:08:57,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30470063 >2014-01-06 07:08:57,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfcbb297}, log id: 30470063 >2014-01-06 07:09:02,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c3f396b >2014-01-06 07:09:02,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6c3f396b >2014-01-06 07:09:02,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76a36d35 >2014-01-06 07:09:02,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3719498f}, log id: 76a36d35 >2014-01-06 07:09:06,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31be206a >2014-01-06 07:09:06,467 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:09:06,467 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:09:06,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, log id: 31be206a >2014-01-06 07:09:06,467 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-95) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:09:07,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7575b423 >2014-01-06 07:09:08,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7575b423 >2014-01-06 07:09:08,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 535adadb >2014-01-06 07:09:08,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6594b50d}, log id: 535adadb >2014-01-06 07:09:13,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13a057bc >2014-01-06 07:09:13,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 13a057bc >2014-01-06 07:09:13,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13618b36 >2014-01-06 07:09:13,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3957aec}, log id: 13618b36 >2014-01-06 07:09:18,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ca631b0 >2014-01-06 07:09:18,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ca631b0 >2014-01-06 07:09:18,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6331eefd >2014-01-06 07:09:19,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e29bb6e7}, log id: 6331eefd >2014-01-06 07:09:24,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 106da1ea >2014-01-06 07:09:24,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 106da1ea >2014-01-06 07:09:24,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 36c454ee >2014-01-06 07:09:24,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@580def13}, log id: 36c454ee >2014-01-06 07:09:29,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9c44f96 >2014-01-06 07:09:29,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 9c44f96 >2014-01-06 07:09:29,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 328fbdfc >2014-01-06 07:09:30,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bedf22ef}, log id: 328fbdfc >2014-01-06 07:09:35,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 555f311c >2014-01-06 07:09:35,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 555f311c >2014-01-06 07:09:35,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6118bfa4 >2014-01-06 07:09:35,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76b5d9d2}, log id: 6118bfa4 >2014-01-06 07:09:40,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ed2d480 >2014-01-06 07:09:40,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2ed2d480 >2014-01-06 07:09:40,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2e7febc2 >2014-01-06 07:09:40,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c79cc835}, log id: 2e7febc2 >2014-01-06 07:09:45,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 22a66de9 >2014-01-06 07:09:46,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 22a66de9 >2014-01-06 07:09:46,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a294241 >2014-01-06 07:09:46,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc3b98cc}, log id: 5a294241 >2014-01-06 07:09:51,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1fcfcd0b >2014-01-06 07:09:51,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1fcfcd0b >2014-01-06 07:09:51,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 277d1f68 >2014-01-06 07:09:51,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee4f4534}, log id: 277d1f68 >2014-01-06 07:09:56,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 336dc967 >2014-01-06 07:09:57,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 336dc967 >2014-01-06 07:09:57,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 535ab255 >2014-01-06 07:09:57,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e988c724}, log id: 535ab255 >2014-01-06 07:10:02,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 568f6834 >2014-01-06 07:10:02,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 568f6834 >2014-01-06 07:10:02,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4885b52d >2014-01-06 07:10:02,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@829b8b7b}, log id: 4885b52d >2014-01-06 07:10:06,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 59c8a91c >2014-01-06 07:10:06,800 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:10:06,800 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:10:06,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterTasksListVDSCommand, log id: 59c8a91c >2014-01-06 07:10:06,801 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-66) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:10:08,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f22cd2c >2014-01-06 07:10:08,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7f22cd2c >2014-01-06 07:10:08,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 23b1a9d8 >2014-01-06 07:10:08,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1f3026c}, log id: 23b1a9d8 >2014-01-06 07:10:13,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1271c0e3 >2014-01-06 07:10:13,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1271c0e3 >2014-01-06 07:10:13,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4e38f122 >2014-01-06 07:10:13,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e791c38e}, log id: 4e38f122 >2014-01-06 07:10:18,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 299a112b >2014-01-06 07:10:19,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 299a112b >2014-01-06 07:10:19,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f0a60b1 >2014-01-06 07:10:19,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@142a61c4}, log id: f0a60b1 >2014-01-06 07:10:24,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6178c2f8 >2014-01-06 07:10:24,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6178c2f8 >2014-01-06 07:10:24,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3499a8a0 >2014-01-06 07:10:24,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ccc7a69}, log id: 3499a8a0 >2014-01-06 07:10:29,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 76b92e02 >2014-01-06 07:10:30,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 76b92e02 >2014-01-06 07:10:30,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5fe2faf1 >2014-01-06 07:10:30,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce64e150}, log id: 5fe2faf1 >2014-01-06 07:10:35,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 513c4190 >2014-01-06 07:10:35,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 513c4190 >2014-01-06 07:10:35,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7e68e039 >2014-01-06 07:10:35,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78a2121e}, log id: 7e68e039 >2014-01-06 07:10:40,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5d03c224 >2014-01-06 07:10:41,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5d03c224 >2014-01-06 07:10:41,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3962f7b8 >2014-01-06 07:10:41,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@809fe666}, log id: 3962f7b8 >2014-01-06 07:10:46,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a690d6 >2014-01-06 07:10:46,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5a690d6 >2014-01-06 07:10:46,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15bd009f >2014-01-06 07:10:46,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e64b5cf}, log id: 15bd009f >2014-01-06 07:10:51,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b3b85cb >2014-01-06 07:10:51,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b3b85cb >2014-01-06 07:10:51,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4750a7c6 >2014-01-06 07:10:52,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15e8638e}, log id: 4750a7c6 >2014-01-06 07:10:57,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7422ffe >2014-01-06 07:10:57,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7422ffe >2014-01-06 07:10:57,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40e031ca >2014-01-06 07:10:57,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5dcdf67}, log id: 40e031ca >2014-01-06 07:11:02,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 648183 >2014-01-06 07:11:02,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 648183 >2014-01-06 07:11:02,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d8af198 >2014-01-06 07:11:02,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1a1f219}, log id: d8af198 >2014-01-06 07:11:06,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e9c2deb >2014-01-06 07:11:07,121 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:11:07,121 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:11:07,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, log id: 3e9c2deb >2014-01-06 07:11:07,121 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-46) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:11:07,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: c028ccb >2014-01-06 07:11:08,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: c028ccb >2014-01-06 07:11:08,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 413d479f >2014-01-06 07:11:08,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11edd7ab}, log id: 413d479f >2014-01-06 07:11:13,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 40da4492 >2014-01-06 07:11:13,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 40da4492 >2014-01-06 07:11:13,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 72deed7f >2014-01-06 07:11:13,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15a00983}, log id: 72deed7f >2014-01-06 07:11:18,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 58a29aef >2014-01-06 07:11:19,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 58a29aef >2014-01-06 07:11:19,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6049153e >2014-01-06 07:11:19,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6040c7d}, log id: 6049153e >2014-01-06 07:11:24,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56822b4d >2014-01-06 07:11:24,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56822b4d >2014-01-06 07:11:24,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6704181a >2014-01-06 07:11:24,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2aa38d5}, log id: 6704181a >2014-01-06 07:11:29,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1679e869 >2014-01-06 07:11:30,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1679e869 >2014-01-06 07:11:30,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 57d4c7b7 >2014-01-06 07:11:30,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40a9b6b6}, log id: 57d4c7b7 >2014-01-06 07:11:35,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2d144121 >2014-01-06 07:11:35,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2d144121 >2014-01-06 07:11:35,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1a62b2f1 >2014-01-06 07:11:35,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e6934f8}, log id: 1a62b2f1 >2014-01-06 07:11:40,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ba161c6 >2014-01-06 07:11:40,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: ba161c6 >2014-01-06 07:11:40,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d07d0bc >2014-01-06 07:11:41,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bfdaa61}, log id: 7d07d0bc >2014-01-06 07:11:46,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3359eaf5 >2014-01-06 07:11:46,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3359eaf5 >2014-01-06 07:11:46,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 71aae50f >2014-01-06 07:11:46,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad51fd40}, log id: 71aae50f >2014-01-06 07:11:51,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3ee67114 >2014-01-06 07:11:51,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3ee67114 >2014-01-06 07:11:51,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a81d120 >2014-01-06 07:11:52,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c55d1e15}, log id: 2a81d120 >2014-01-06 07:11:57,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7933e376 >2014-01-06 07:11:57,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7933e376 >2014-01-06 07:11:57,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 470ace84 >2014-01-06 07:11:57,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab127113}, log id: 470ace84 >2014-01-06 07:12:02,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 565ff97b >2014-01-06 07:12:02,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 565ff97b >2014-01-06 07:12:02,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b4bddce >2014-01-06 07:12:02,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6b995bb}, log id: 4b4bddce >2014-01-06 07:12:07,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e5142da >2014-01-06 07:12:07,458 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:12:07,458 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:12:07,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, log id: 4e5142da >2014-01-06 07:12:07,458 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-97) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:12:07,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3af9578d >2014-01-06 07:12:08,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3af9578d >2014-01-06 07:12:08,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f9cfb17 >2014-01-06 07:12:08,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31e345bb}, log id: 5f9cfb17 >2014-01-06 07:12:13,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1335ae38 >2014-01-06 07:12:13,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1335ae38 >2014-01-06 07:12:13,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53b2cc3c >2014-01-06 07:12:13,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74157f1e}, log id: 53b2cc3c >2014-01-06 07:12:18,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e8717cc >2014-01-06 07:12:19,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2e8717cc >2014-01-06 07:12:19,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 592e8f22 >2014-01-06 07:12:19,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff30fb31}, log id: 592e8f22 >2014-01-06 07:12:24,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: d006de5 >2014-01-06 07:12:24,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: d006de5 >2014-01-06 07:12:24,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 30464f44 >2014-01-06 07:12:24,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ee041dd}, log id: 30464f44 >2014-01-06 07:12:29,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 14ae5f5f >2014-01-06 07:12:30,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 14ae5f5f >2014-01-06 07:12:30,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1ec3469f >2014-01-06 07:12:30,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90a39170}, log id: 1ec3469f >2014-01-06 07:12:35,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 62eca516 >2014-01-06 07:12:35,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 62eca516 >2014-01-06 07:12:35,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c2551cc >2014-01-06 07:12:35,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98f68a90}, log id: 6c2551cc >2014-01-06 07:12:40,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4b6e04c9 >2014-01-06 07:12:41,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4b6e04c9 >2014-01-06 07:12:41,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e6f8467 >2014-01-06 07:12:41,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd0e8867}, log id: 2e6f8467 >2014-01-06 07:12:46,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c0fccb4 >2014-01-06 07:12:46,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6c0fccb4 >2014-01-06 07:12:46,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 74448a53 >2014-01-06 07:12:46,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48035dfa}, log id: 74448a53 >2014-01-06 07:12:51,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1276bcde >2014-01-06 07:12:51,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1276bcde >2014-01-06 07:12:51,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 574c7d7b >2014-01-06 07:12:52,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0922b8b}, log id: 574c7d7b >2014-01-06 07:12:57,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6646aab0 >2014-01-06 07:12:57,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6646aab0 >2014-01-06 07:12:57,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1d929bc4 >2014-01-06 07:12:57,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25120023}, log id: 1d929bc4 >2014-01-06 07:13:02,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 344888d1 >2014-01-06 07:13:02,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 344888d1 >2014-01-06 07:13:02,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 58780b3c >2014-01-06 07:13:03,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c030717f}, log id: 58780b3c >2014-01-06 07:13:07,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2a9655ec >2014-01-06 07:13:07,792 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:13:07,792 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:13:07,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, log id: 2a9655ec >2014-01-06 07:13:07,793 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-85) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:13:08,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 698de868 >2014-01-06 07:13:08,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 698de868 >2014-01-06 07:13:08,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1499b6b7 >2014-01-06 07:13:08,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c271974}, log id: 1499b6b7 >2014-01-06 07:13:13,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5741662 >2014-01-06 07:13:13,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5741662 >2014-01-06 07:13:13,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5e252d34 >2014-01-06 07:13:13,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8867637e}, log id: 5e252d34 >2014-01-06 07:13:18,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 75d4873a >2014-01-06 07:13:19,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 75d4873a >2014-01-06 07:13:19,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77dd59f4 >2014-01-06 07:13:19,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a57b097}, log id: 77dd59f4 >2014-01-06 07:13:24,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54659661 >2014-01-06 07:13:24,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 54659661 >2014-01-06 07:13:24,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 34ee55fa >2014-01-06 07:13:24,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a02bc64}, log id: 34ee55fa >2014-01-06 07:13:29,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 205044a4 >2014-01-06 07:13:30,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 205044a4 >2014-01-06 07:13:30,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6ee97d14 >2014-01-06 07:13:30,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78f7c51c}, log id: 6ee97d14 >2014-01-06 07:13:35,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c6d2863 >2014-01-06 07:13:35,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: c6d2863 >2014-01-06 07:13:35,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61801999 >2014-01-06 07:13:35,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9ce87ec}, log id: 61801999 >2014-01-06 07:13:40,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52c6871d >2014-01-06 07:13:41,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 52c6871d >2014-01-06 07:13:41,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56c5ba7b >2014-01-06 07:13:41,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffb88575}, log id: 56c5ba7b >2014-01-06 07:13:45,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 465a7e4f >2014-01-06 07:13:45,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@516c60ac, log id: 465a7e4f >2014-01-06 07:13:46,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37580260 >2014-01-06 07:13:46,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 37580260 >2014-01-06 07:13:46,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4bab6a2f >2014-01-06 07:13:46,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4054262b}, log id: 4bab6a2f >2014-01-06 07:13:51,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5100af62 >2014-01-06 07:13:51,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5100af62 >2014-01-06 07:13:51,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 669e4511 >2014-01-06 07:13:52,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1e706d}, log id: 669e4511 >2014-01-06 07:13:57,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 333a64a6 >2014-01-06 07:13:57,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 333a64a6 >2014-01-06 07:13:57,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 15e251fb >2014-01-06 07:13:57,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71766700}, log id: 15e251fb >2014-01-06 07:14:02,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f55096b >2014-01-06 07:14:02,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7f55096b >2014-01-06 07:14:02,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d49b92c >2014-01-06 07:14:03,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a1cad66}, log id: 5d49b92c >2014-01-06 07:14:07,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5425be55 >2014-01-06 07:14:08,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 47d3a03e >2014-01-06 07:14:08,121 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:14:08,121 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:14:08,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, log id: 5425be55 >2014-01-06 07:14:08,121 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-71) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:14:08,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 47d3a03e >2014-01-06 07:14:08,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2602f32f >2014-01-06 07:14:08,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e21e7176}, log id: 2602f32f >2014-01-06 07:14:13,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1b2a9a5a >2014-01-06 07:14:13,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1b2a9a5a >2014-01-06 07:14:13,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7f5feb03 >2014-01-06 07:14:13,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@533f95b0}, log id: 7f5feb03 >2014-01-06 07:14:18,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: db52e84 >2014-01-06 07:14:19,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: db52e84 >2014-01-06 07:14:19,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 69eca6ae >2014-01-06 07:14:19,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@226a3113}, log id: 69eca6ae >2014-01-06 07:14:24,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 31e10d61 >2014-01-06 07:14:24,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 31e10d61 >2014-01-06 07:14:24,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5ca9aea3 >2014-01-06 07:14:24,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2255540f}, log id: 5ca9aea3 >2014-01-06 07:14:29,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 68e516f3 >2014-01-06 07:14:30,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 68e516f3 >2014-01-06 07:14:30,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 44569f8b >2014-01-06 07:14:30,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99b7d594}, log id: 44569f8b >2014-01-06 07:14:35,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 77b543fd >2014-01-06 07:14:35,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 77b543fd >2014-01-06 07:14:35,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f8d5093 >2014-01-06 07:14:35,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ee4bfc0}, log id: 6f8d5093 >2014-01-06 07:14:40,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 270ec637 >2014-01-06 07:14:41,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 270ec637 >2014-01-06 07:14:41,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6f5125c7 >2014-01-06 07:14:41,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28786f62}, log id: 6f5125c7 >2014-01-06 07:14:46,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2de913b7 >2014-01-06 07:14:46,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2de913b7 >2014-01-06 07:14:46,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 508f4e8b >2014-01-06 07:14:46,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e663f4ea}, log id: 508f4e8b >2014-01-06 07:14:51,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 147f8543 >2014-01-06 07:14:51,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 147f8543 >2014-01-06 07:14:51,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 657b189e >2014-01-06 07:14:52,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@388c5dae}, log id: 657b189e >2014-01-06 07:14:57,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 72f00651 >2014-01-06 07:14:57,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 72f00651 >2014-01-06 07:14:57,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70ac10d2 >2014-01-06 07:14:57,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd6d5bea}, log id: 70ac10d2 >2014-01-06 07:15:02,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: c70fc4e >2014-01-06 07:15:02,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: c70fc4e >2014-01-06 07:15:02,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 30c044e >2014-01-06 07:15:03,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@876e4797}, log id: 30c044e >2014-01-06 07:15:08,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 665be834 >2014-01-06 07:15:08,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 64242b7 >2014-01-06 07:15:08,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 665be834 >2014-01-06 07:15:08,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5414bd0b >2014-01-06 07:15:08,462 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:15:08,462 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:15:08,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, log id: 64242b7 >2014-01-06 07:15:08,462 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-54) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:15:08,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e1a016c}, log id: 5414bd0b >2014-01-06 07:15:13,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1aa53afb >2014-01-06 07:15:13,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1aa53afb >2014-01-06 07:15:13,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27526aed >2014-01-06 07:15:13,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e916df}, log id: 27526aed >2014-01-06 07:15:18,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 76cb7d01 >2014-01-06 07:15:19,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 76cb7d01 >2014-01-06 07:15:19,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c78f169 >2014-01-06 07:15:19,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cbc4e70}, log id: 6c78f169 >2014-01-06 07:15:24,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e173b >2014-01-06 07:15:24,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3e173b >2014-01-06 07:15:24,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 10494413 >2014-01-06 07:15:24,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2565fc09}, log id: 10494413 >2014-01-06 07:15:29,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e435df9 >2014-01-06 07:15:30,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: e435df9 >2014-01-06 07:15:30,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a3994b2 >2014-01-06 07:15:30,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd004b60}, log id: 4a3994b2 >2014-01-06 07:15:35,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 192f82a5 >2014-01-06 07:15:35,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 192f82a5 >2014-01-06 07:15:35,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d9350ce >2014-01-06 07:15:35,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57bc0e10}, log id: 4d9350ce >2014-01-06 07:15:40,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 33c306a6 >2014-01-06 07:15:41,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 33c306a6 >2014-01-06 07:15:41,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a7d3bba >2014-01-06 07:15:41,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48abf7fe}, log id: 3a7d3bba >2014-01-06 07:15:46,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b866907 >2014-01-06 07:15:46,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5b866907 >2014-01-06 07:15:46,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19f00a >2014-01-06 07:15:46,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@511213bd}, log id: 19f00a >2014-01-06 07:15:51,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 559d6fcf >2014-01-06 07:15:52,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 559d6fcf >2014-01-06 07:15:52,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 75f6eab2 >2014-01-06 07:15:52,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffedab91}, log id: 75f6eab2 >2014-01-06 07:15:57,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 228f3578 >2014-01-06 07:15:57,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 228f3578 >2014-01-06 07:15:57,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 259afa8d >2014-01-06 07:15:57,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1eb0ad29}, log id: 259afa8d >2014-01-06 07:16:02,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f4b3618 >2014-01-06 07:16:02,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3f4b3618 >2014-01-06 07:16:02,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4100ac00 >2014-01-06 07:16:03,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d01566e3}, log id: 4100ac00 >2014-01-06 07:16:08,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 32007a10 >2014-01-06 07:16:08,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 32007a10 >2014-01-06 07:16:08,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5d097a95 >2014-01-06 07:16:08,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 432e3a0d >2014-01-06 07:16:08,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a72f6c6}, log id: 5d097a95 >2014-01-06 07:16:08,795 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:16:08,795 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:16:08,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, log id: 432e3a0d >2014-01-06 07:16:08,796 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-46) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:16:09,588 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-35) Start refreshing all users data >2014-01-06 07:16:10,567 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-01-06 07:16:10,569 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VM OVFs in Data Center Posixfs-DC-1 >2014-01-06 07:16:10,570 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated VM OVFs in Data Center Posixfs-DC-1 >2014-01-06 07:16:10,570 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update template OVFs in Data Center Posixfs-DC-1 >2014-01-06 07:16:10,572 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated templates OVFs in Data Center Posixfs-DC-1 >2014-01-06 07:16:10,572 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to remove unneeded template/vm OVFs in Data Center Posixfs-DC-1 >2014-01-06 07:16:10,573 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully removed unneeded template/vm OVFs in Data Center Posixfs-DC-1 >2014-01-06 07:16:10,573 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VM OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 07:16:10,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated VM OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 07:16:10,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update template OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 07:16:10,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated templates OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 07:16:10,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to remove unneeded template/vm OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 07:16:10,578 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully removed unneeded template/vm OVFs in Data Center rhs-gp-srv10-Local >2014-01-06 07:16:11,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) START, GlusterHooksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70b0d900 >2014-01-06 07:16:11,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-46) START, GlusterHooksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6a76c8cc >2014-01-06 07:16:11,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-46) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b11a5156, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@30b64f7a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@951eca69, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@18e6e1ea, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@fe9b4788, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ae325a55, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bbd029be, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@62d635dc, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f0ec7b76, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bcc4f1f3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f1a26eef, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@812d4d6c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ab84c204], log id: 6a76c8cc >2014-01-06 07:16:11,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5ecff42b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@87151cfa, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bbfaf92d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ed5c93f4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3957915f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6875ef48, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@382adbfb, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a285ff63, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f0e2470, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3c8849cc, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@aef1c1f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e2450105, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f8d24757], log id: 70b0d900 >2014-01-06 07:16:13,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c18fb48 >2014-01-06 07:16:13,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6c18fb48 >2014-01-06 07:16:13,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e9a71e9 >2014-01-06 07:16:14,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9208574f}, log id: 3e9a71e9 >2014-01-06 07:16:19,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 48c835ac >2014-01-06 07:16:19,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 48c835ac >2014-01-06 07:16:19,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73d9c17a >2014-01-06 07:16:19,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1146b256}, log id: 73d9c17a >2014-01-06 07:16:24,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 170adc0f >2014-01-06 07:16:24,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 170adc0f >2014-01-06 07:16:24,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21da0bc9 >2014-01-06 07:16:24,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fb54b4c}, log id: 21da0bc9 >2014-01-06 07:16:29,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4c327821 >2014-01-06 07:16:30,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4c327821 >2014-01-06 07:16:30,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 455a373d >2014-01-06 07:16:30,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c72e7a7}, log id: 455a373d >2014-01-06 07:16:35,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c6eb0a1 >2014-01-06 07:16:35,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4c6eb0a1 >2014-01-06 07:16:35,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20b18c04 >2014-01-06 07:16:35,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4046194d}, log id: 20b18c04 >2014-01-06 07:16:40,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1572e69d >2014-01-06 07:16:41,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1572e69d >2014-01-06 07:16:41,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: aca1f8f >2014-01-06 07:16:41,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36805a93}, log id: aca1f8f >2014-01-06 07:16:46,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 68bb3a9f >2014-01-06 07:16:46,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 68bb3a9f >2014-01-06 07:16:46,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 45fb61bb >2014-01-06 07:16:46,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8101b824}, log id: 45fb61bb >2014-01-06 07:16:51,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 27da811a >2014-01-06 07:16:52,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 27da811a >2014-01-06 07:16:52,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 56a57224 >2014-01-06 07:16:52,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a814513c}, log id: 56a57224 >2014-01-06 07:16:57,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 51bb1032 >2014-01-06 07:16:57,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 51bb1032 >2014-01-06 07:16:57,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3c95dce1 >2014-01-06 07:16:57,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6363a7db}, log id: 3c95dce1 >2014-01-06 07:17:02,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25af098b >2014-01-06 07:17:03,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25af098b >2014-01-06 07:17:03,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 764feb38 >2014-01-06 07:17:03,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52d4d484}, log id: 764feb38 >2014-01-06 07:17:08,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6f5dbe25 >2014-01-06 07:17:08,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6f5dbe25 >2014-01-06 07:17:08,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 60f69fc1 >2014-01-06 07:17:08,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8afb894}, log id: 60f69fc1 >2014-01-06 07:17:08,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18e85f46 >2014-01-06 07:17:09,130 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:17:09,130 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:17:09,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, log id: 18e85f46 >2014-01-06 07:17:09,130 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-42) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:17:13,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 457ba7 >2014-01-06 07:17:13,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 457ba7 >2014-01-06 07:17:13,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6b2c8519 >2014-01-06 07:17:14,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6a5e00f}, log id: 6b2c8519 >2014-01-06 07:17:19,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 601f9c96 >2014-01-06 07:17:19,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 601f9c96 >2014-01-06 07:17:19,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4be5006d >2014-01-06 07:17:19,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c0e032c}, log id: 4be5006d >2014-01-06 07:17:24,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2f1203d4 >2014-01-06 07:17:24,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2f1203d4 >2014-01-06 07:17:24,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c4986fd >2014-01-06 07:17:24,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72d037a8}, log id: 1c4986fd >2014-01-06 07:17:30,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 12c2c628 >2014-01-06 07:17:30,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 12c2c628 >2014-01-06 07:17:30,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: a019c0d >2014-01-06 07:17:30,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da8718bc}, log id: a019c0d >2014-01-06 07:17:35,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 41575c61 >2014-01-06 07:17:35,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 41575c61 >2014-01-06 07:17:35,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6ef3f30 >2014-01-06 07:17:35,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db533775}, log id: 6ef3f30 >2014-01-06 07:17:40,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4537c70a >2014-01-06 07:17:41,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4537c70a >2014-01-06 07:17:41,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 660e6033 >2014-01-06 07:17:41,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36d21d8a}, log id: 660e6033 >2014-01-06 07:17:46,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 17b5d6d1 >2014-01-06 07:17:46,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 17b5d6d1 >2014-01-06 07:17:46,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 541a505a >2014-01-06 07:17:46,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff20aeec}, log id: 541a505a >2014-01-06 07:17:51,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a394a6c >2014-01-06 07:17:52,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3a394a6c >2014-01-06 07:17:52,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f109 >2014-01-06 07:17:52,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9582df1a}, log id: f109 >2014-01-06 07:17:57,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 52a61dc5 >2014-01-06 07:17:57,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 52a61dc5 >2014-01-06 07:17:57,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31dc5c3d >2014-01-06 07:17:57,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a0cf891}, log id: 31dc5c3d >2014-01-06 07:18:02,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1aa82c28 >2014-01-06 07:18:03,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1aa82c28 >2014-01-06 07:18:03,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1fd06973 >2014-01-06 07:18:03,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c26c46aa}, log id: 1fd06973 >2014-01-06 07:18:08,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d391c73 >2014-01-06 07:18:08,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d391c73 >2014-01-06 07:18:08,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1c107337 >2014-01-06 07:18:08,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3726cc3c}, log id: 1c107337 >2014-01-06 07:18:09,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2ed146fa >2014-01-06 07:18:09,463 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:18:09,464 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:18:09,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, log id: 2ed146fa >2014-01-06 07:18:09,464 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-14) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:18:13,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 21ae64a5 >2014-01-06 07:18:14,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 21ae64a5 >2014-01-06 07:18:14,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 319fe34d >2014-01-06 07:18:14,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1513e2c}, log id: 319fe34d >2014-01-06 07:18:19,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29e2e0d9 >2014-01-06 07:18:19,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29e2e0d9 >2014-01-06 07:18:19,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35eb9e67 >2014-01-06 07:18:19,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c800183}, log id: 35eb9e67 >2014-01-06 07:18:24,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73424080 >2014-01-06 07:18:24,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73424080 >2014-01-06 07:18:24,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 71aaaf39 >2014-01-06 07:18:25,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9833c6d0}, log id: 71aaaf39 >2014-01-06 07:18:30,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 45acc948 >2014-01-06 07:18:30,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 45acc948 >2014-01-06 07:18:30,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 69b2e3b2 >2014-01-06 07:18:30,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@293ba1ca}, log id: 69b2e3b2 >2014-01-06 07:18:35,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3dc8b068 >2014-01-06 07:18:35,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3dc8b068 >2014-01-06 07:18:35,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c7e6e7e >2014-01-06 07:18:35,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40d28aa3}, log id: 4c7e6e7e >2014-01-06 07:18:41,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 22b7777 >2014-01-06 07:18:41,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 22b7777 >2014-01-06 07:18:41,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7269311a >2014-01-06 07:18:41,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@527320d0}, log id: 7269311a >2014-01-06 07:18:45,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6cb624c2 >2014-01-06 07:18:45,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@32e0102f, log id: 6cb624c2 >2014-01-06 07:18:46,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6b576de7 >2014-01-06 07:18:46,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6b576de7 >2014-01-06 07:18:46,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54547e48 >2014-01-06 07:18:46,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9afa1a40}, log id: 54547e48 >2014-01-06 07:18:51,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6742aef2 >2014-01-06 07:18:52,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6742aef2 >2014-01-06 07:18:52,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: b56b658 >2014-01-06 07:18:52,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7a987e0}, log id: b56b658 >2014-01-06 07:18:57,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3df9c749 >2014-01-06 07:18:57,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 3df9c749 >2014-01-06 07:18:57,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b600f5c >2014-01-06 07:18:57,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce98fffc}, log id: 2b600f5c >2014-01-06 07:19:02,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 639362be >2014-01-06 07:19:03,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 639362be >2014-01-06 07:19:03,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31aa4922 >2014-01-06 07:19:03,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4e05427}, log id: 31aa4922 >2014-01-06 07:19:08,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 122c95c2 >2014-01-06 07:19:08,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 122c95c2 >2014-01-06 07:19:08,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d051a19 >2014-01-06 07:19:08,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [4c34e9e] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7088492}, log id: 4d051a19 >2014-01-06 07:19:09,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7463ab4f >2014-01-06 07:19:09,794 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:19:09,794 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:19:09,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, log id: 7463ab4f >2014-01-06 07:19:09,794 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-87) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:19:13,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 40ce8a1f >2014-01-06 07:19:14,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 40ce8a1f >2014-01-06 07:19:14,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59b7168a >2014-01-06 07:19:14,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27a4fc57}, log id: 59b7168a >2014-01-06 07:19:19,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73921044 >2014-01-06 07:19:19,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73921044 >2014-01-06 07:19:19,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7ec5d69a >2014-01-06 07:19:19,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf7b2608}, log id: 7ec5d69a >2014-01-06 07:19:24,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 39c76487 >2014-01-06 07:19:24,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 39c76487 >2014-01-06 07:19:24,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5c08c17a >2014-01-06 07:19:25,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [1c60d953] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8c2cf61}, log id: 5c08c17a >2014-01-06 07:19:30,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1f4e87a0 >2014-01-06 07:19:30,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1f4e87a0 >2014-01-06 07:19:30,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 744d88f0 >2014-01-06 07:19:30,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8044b11}, log id: 744d88f0 >2014-01-06 07:19:35,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66fa63a8 >2014-01-06 07:19:35,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 66fa63a8 >2014-01-06 07:19:35,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d3434eb >2014-01-06 07:19:35,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac77bdab}, log id: 7d3434eb >2014-01-06 07:19:41,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 61e5dc >2014-01-06 07:19:41,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 61e5dc >2014-01-06 07:19:41,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2a551450 >2014-01-06 07:19:41,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4b8c46e}, log id: 2a551450 >2014-01-06 07:19:46,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1faa4376 >2014-01-06 07:19:46,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1faa4376 >2014-01-06 07:19:46,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5e75006c >2014-01-06 07:19:46,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3b44b12}, log id: 5e75006c >2014-01-06 07:19:51,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 719932e9 >2014-01-06 07:19:52,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 719932e9 >2014-01-06 07:19:52,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: ed0bfee >2014-01-06 07:19:52,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34ef2355}, log id: ed0bfee >2014-01-06 07:19:57,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 360e2b0a >2014-01-06 07:19:57,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 360e2b0a >2014-01-06 07:19:57,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3ad12a56 >2014-01-06 07:19:57,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f78f4137}, log id: 3ad12a56 >2014-01-06 07:20:02,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 674e9406 >2014-01-06 07:20:03,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 674e9406 >2014-01-06 07:20:03,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5f0f3769 >2014-01-06 07:20:03,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d7657e3}, log id: 5f0f3769 >2014-01-06 07:20:08,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 73144070 >2014-01-06 07:20:08,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 73144070 >2014-01-06 07:20:08,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: bccc94 >2014-01-06 07:20:08,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a281f38c}, log id: bccc94 >2014-01-06 07:20:09,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 62b01552 >2014-01-06 07:20:10,119 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:20:10,119 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:20:10,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, log id: 62b01552 >2014-01-06 07:20:10,119 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-9) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:20:13,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 54b6a4f8 >2014-01-06 07:20:14,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 54b6a4f8 >2014-01-06 07:20:14,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1911361 >2014-01-06 07:20:14,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26bd0eb7}, log id: 1911361 >2014-01-06 07:20:19,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: a977e0a >2014-01-06 07:20:19,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: a977e0a >2014-01-06 07:20:19,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b5dda24 >2014-01-06 07:20:19,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4599b620}, log id: 3b5dda24 >2014-01-06 07:20:24,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24a7a03b >2014-01-06 07:20:24,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 24a7a03b >2014-01-06 07:20:24,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 59faecb6 >2014-01-06 07:20:25,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@950827b0}, log id: 59faecb6 >2014-01-06 07:20:30,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7183c021 >2014-01-06 07:20:30,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7183c021 >2014-01-06 07:20:30,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4d1f24ed >2014-01-06 07:20:30,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5123cb19}, log id: 4d1f24ed >2014-01-06 07:20:35,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4e049d1c >2014-01-06 07:20:35,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 4e049d1c >2014-01-06 07:20:35,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7cb3f404 >2014-01-06 07:20:35,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bb51bdf}, log id: 7cb3f404 >2014-01-06 07:20:41,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2d25a4bb >2014-01-06 07:20:41,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2d25a4bb >2014-01-06 07:20:41,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 49e45124 >2014-01-06 07:20:41,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ed498ca}, log id: 49e45124 >2014-01-06 07:20:46,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 56352973 >2014-01-06 07:20:46,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 56352973 >2014-01-06 07:20:46,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 15e32723 >2014-01-06 07:20:46,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@facdee45}, log id: 15e32723 >2014-01-06 07:20:51,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 9a182de >2014-01-06 07:20:52,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 9a182de >2014-01-06 07:20:52,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1e2dee86 >2014-01-06 07:20:52,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9105bb3}, log id: 1e2dee86 >2014-01-06 07:20:57,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6caea919 >2014-01-06 07:20:57,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6caea919 >2014-01-06 07:20:57,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 585bf01c >2014-01-06 07:20:57,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e74432e}, log id: 585bf01c >2014-01-06 07:21:02,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18174af8 >2014-01-06 07:21:03,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 18174af8 >2014-01-06 07:21:03,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 191f2f2 >2014-01-06 07:21:03,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ad7d6e3}, log id: 191f2f2 >2014-01-06 07:21:08,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2146934d >2014-01-06 07:21:08,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2146934d >2014-01-06 07:21:08,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63f5c2a5 >2014-01-06 07:21:08,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fffaf27}, log id: 63f5c2a5 >2014-01-06 07:21:10,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6954ec38 >2014-01-06 07:21:10,441 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:21:10,441 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:21:10,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, log id: 6954ec38 >2014-01-06 07:21:10,441 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-12) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:21:11,359 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-48) START, GetIsoListVDSCommand( storagePoolId = ee718678-261f-4bad-ab5e-73b9697cb5f8, ignoreFailoverLimit = false), log id: 38fbfa28 >2014-01-06 07:21:11,361 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-48) START, HsmGetIsoListVDSCommand(HostName = rhs-client10, HostId = e80de893-f6c4-4b96-9ce1-92a74ca5869a, storagePoolId=ee718678-261f-4bad-ab5e-73b9697cb5f8), log id: 26e47552 >2014-01-06 07:21:11,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-48) FINISH, HsmGetIsoListVDSCommand, return: [en_windows_7_enterprise_with_sp1_x64_dvd_u_677651.iso], log id: 26e47552 >2014-01-06 07:21:11,376 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-48) FINISH, GetIsoListVDSCommand, return: [en_windows_7_enterprise_with_sp1_x64_dvd_u_677651.iso], log id: 38fbfa28 >2014-01-06 07:21:11,380 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (pool-4-thread-48) Finished automatic refresh process for ISO file type with success, for storage domain id cc1bba44-7b89-4b6e-acff-fb066601f8c7. >2014-01-06 07:21:13,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2926e832 >2014-01-06 07:21:14,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2926e832 >2014-01-06 07:21:14,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 24743222 >2014-01-06 07:21:14,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@521a91c6}, log id: 24743222 >2014-01-06 07:21:19,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1894168e >2014-01-06 07:21:19,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1894168e >2014-01-06 07:21:19,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6c94d37d >2014-01-06 07:21:19,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60c79a56}, log id: 6c94d37d >2014-01-06 07:21:24,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7f6f36e8 >2014-01-06 07:21:24,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7f6f36e8 >2014-01-06 07:21:24,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: d0bd39b >2014-01-06 07:21:25,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbb00868}, log id: d0bd39b >2014-01-06 07:21:30,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e13f218 >2014-01-06 07:21:30,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1e13f218 >2014-01-06 07:21:30,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 374546db >2014-01-06 07:21:30,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@748f83b1}, log id: 374546db >2014-01-06 07:21:35,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 35d65f32 >2014-01-06 07:21:35,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 35d65f32 >2014-01-06 07:21:35,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7751b303 >2014-01-06 07:21:35,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6628d71b}, log id: 7751b303 >2014-01-06 07:21:41,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7ca28681 >2014-01-06 07:21:41,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7ca28681 >2014-01-06 07:21:41,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 261358bd >2014-01-06 07:21:41,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21bdaf3b}, log id: 261358bd >2014-01-06 07:21:46,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6cd0a35c >2014-01-06 07:21:46,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6cd0a35c >2014-01-06 07:21:46,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4df3f985 >2014-01-06 07:21:46,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e024b2}, log id: 4df3f985 >2014-01-06 07:21:51,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b807139 >2014-01-06 07:21:52,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2b807139 >2014-01-06 07:21:52,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 320eec8f >2014-01-06 07:21:52,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a4bb83}, log id: 320eec8f >2014-01-06 07:21:57,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 133e8d59 >2014-01-06 07:21:57,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 133e8d59 >2014-01-06 07:21:57,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4c2deb29 >2014-01-06 07:21:57,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2869d94c}, log id: 4c2deb29 >2014-01-06 07:22:02,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 268d36ba >2014-01-06 07:22:03,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 268d36ba >2014-01-06 07:22:03,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78f4c440 >2014-01-06 07:22:03,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0e9ed6c}, log id: 78f4c440 >2014-01-06 07:22:08,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43c4b74e >2014-01-06 07:22:08,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 43c4b74e >2014-01-06 07:22:08,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 47309e8e >2014-01-06 07:22:08,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfb09aa8}, log id: 47309e8e >2014-01-06 07:22:10,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: b135156 >2014-01-06 07:22:10,773 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:22:10,773 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:22:10,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, log id: b135156 >2014-01-06 07:22:10,773 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-48) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:22:13,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 560e3330 >2014-01-06 07:22:14,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 560e3330 >2014-01-06 07:22:14,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6419e1d >2014-01-06 07:22:14,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8a951fe}, log id: 6419e1d >2014-01-06 07:22:19,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 76dc7c38 >2014-01-06 07:22:19,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 76dc7c38 >2014-01-06 07:22:19,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5c6bfcd6 >2014-01-06 07:22:19,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b4b7308}, log id: 5c6bfcd6 >2014-01-06 07:22:24,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 29a69c0e >2014-01-06 07:22:24,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 29a69c0e >2014-01-06 07:22:24,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 43736c29 >2014-01-06 07:22:25,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2479528}, log id: 43736c29 >2014-01-06 07:22:30,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2873c0b7 >2014-01-06 07:22:30,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2873c0b7 >2014-01-06 07:22:30,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3d94ba03 >2014-01-06 07:22:30,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [356eb44] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f77e1f}, log id: 3d94ba03 >2014-01-06 07:22:35,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 21ac4f56 >2014-01-06 07:22:35,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 21ac4f56 >2014-01-06 07:22:35,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 394ea534 >2014-01-06 07:22:35,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43173417}, log id: 394ea534 >2014-01-06 07:22:41,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 57fb1beb >2014-01-06 07:22:41,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 57fb1beb >2014-01-06 07:22:41,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5b782338 >2014-01-06 07:22:41,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7e585c5}, log id: 5b782338 >2014-01-06 07:22:46,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 19ed7704 >2014-01-06 07:22:46,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 19ed7704 >2014-01-06 07:22:46,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3514d9f9 >2014-01-06 07:22:46,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b057e24}, log id: 3514d9f9 >2014-01-06 07:22:51,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 396bca11 >2014-01-06 07:22:52,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 396bca11 >2014-01-06 07:22:52,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 70d3dd4 >2014-01-06 07:22:52,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba7c48bd}, log id: 70d3dd4 >2014-01-06 07:22:57,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5f5340c2 >2014-01-06 07:22:57,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5f5340c2 >2014-01-06 07:22:57,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 26d90c34 >2014-01-06 07:22:57,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2ae9704b] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34e91b1f}, log id: 26d90c34 >2014-01-06 07:23:02,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 605bf0db >2014-01-06 07:23:03,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 605bf0db >2014-01-06 07:23:03,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5152183f >2014-01-06 07:23:03,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c3d9b11}, log id: 5152183f >2014-01-06 07:23:08,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 509c5084 >2014-01-06 07:23:08,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 509c5084 >2014-01-06 07:23:08,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c2ee58b >2014-01-06 07:23:08,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c3464c2}, log id: 6c2ee58b >2014-01-06 07:23:10,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 470a2ecf >2014-01-06 07:23:11,107 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:23:11,108 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:23:11,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, log id: 470a2ecf >2014-01-06 07:23:11,108 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-41) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:23:13,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7dac0016 >2014-01-06 07:23:14,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7dac0016 >2014-01-06 07:23:14,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3a4b4f4c >2014-01-06 07:23:14,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc34b4bf}, log id: 3a4b4f4c >2014-01-06 07:23:19,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6693d46f >2014-01-06 07:23:19,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6693d46f >2014-01-06 07:23:19,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: f5be393 >2014-01-06 07:23:19,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad24c976}, log id: f5be393 >2014-01-06 07:23:24,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7dca7a1e >2014-01-06 07:23:24,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7dca7a1e >2014-01-06 07:23:24,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 229aa035 >2014-01-06 07:23:25,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e41c23d7}, log id: 229aa035 >2014-01-06 07:23:30,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2261e06b >2014-01-06 07:23:30,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2261e06b >2014-01-06 07:23:30,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 13ab1eb4 >2014-01-06 07:23:30,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a1fbd4}, log id: 13ab1eb4 >2014-01-06 07:23:35,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 1e69d7d7 >2014-01-06 07:23:35,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 1e69d7d7 >2014-01-06 07:23:35,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 205ea6f7 >2014-01-06 07:23:35,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@324b69bd}, log id: 205ea6f7 >2014-01-06 07:23:41,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 601e4ce3 >2014-01-06 07:23:41,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 601e4ce3 >2014-01-06 07:23:41,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 20468a0b >2014-01-06 07:23:41,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2aa105a}, log id: 20468a0b >2014-01-06 07:23:45,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a132bbb >2014-01-06 07:23:46,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@27cf5f4a, log id: 5a132bbb >2014-01-06 07:23:46,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2f65d8af >2014-01-06 07:23:46,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2f65d8af >2014-01-06 07:23:46,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2b076fc5 >2014-01-06 07:23:46,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19c55a96}, log id: 2b076fc5 >2014-01-06 07:23:51,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3e38422f >2014-01-06 07:23:52,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3e38422f >2014-01-06 07:23:52,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 30325467 >2014-01-06 07:23:52,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [2a46f1ee] FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c584fc31}, log id: 30325467 >2014-01-06 07:23:57,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 504645a0 >2014-01-06 07:23:57,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 504645a0 >2014-01-06 07:23:57,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2527e3d9 >2014-01-06 07:23:57,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69a07130}, log id: 2527e3d9 >2014-01-06 07:24:02,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 25eff4fe >2014-01-06 07:24:03,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 25eff4fe >2014-01-06 07:24:03,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 512e5ae2 >2014-01-06 07:24:03,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa474a4c}, log id: 512e5ae2 >2014-01-06 07:24:08,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1dd81d6b >2014-01-06 07:24:08,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1dd81d6b >2014-01-06 07:24:08,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: be7ae6f >2014-01-06 07:24:08,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b801857}, log id: be7ae6f >2014-01-06 07:24:11,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 194f54d5 >2014-01-06 07:24:11,443 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Failed in GlusterTasksListVDS method, for vds: rhsvm1; host: 10.70.37.86 >2014-01-06 07:24:11,444 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:24:11,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, log id: 194f54d5 >2014-01-06 07:24:11,444 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-78) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:24:13,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 412edcfe >2014-01-06 07:24:14,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 412edcfe >2014-01-06 07:24:14,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 77f16ef8 >2014-01-06 07:24:14,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@360f0ea2}, log id: 77f16ef8 >2014-01-06 07:24:19,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 43e8d950 >2014-01-06 07:24:19,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 43e8d950 >2014-01-06 07:24:19,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37281bb7 >2014-01-06 07:24:19,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d00f5d9c}, log id: 37281bb7 >2014-01-06 07:24:24,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 33ed654e >2014-01-06 07:24:24,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 33ed654e >2014-01-06 07:24:24,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5b6f3c8e >2014-01-06 07:24:25,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@730c6758}, log id: 5b6f3c8e >2014-01-06 07:24:30,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 639c27de >2014-01-06 07:24:30,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 639c27de >2014-01-06 07:24:30,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7fea4642 >2014-01-06 07:24:30,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12f0921b}, log id: 7fea4642 >2014-01-06 07:24:35,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2954fc90 >2014-01-06 07:24:35,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2954fc90 >2014-01-06 07:24:35,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 25643065 >2014-01-06 07:24:36,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef524fdc}, log id: 25643065 >2014-01-06 07:24:41,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 15fd2a36 >2014-01-06 07:24:41,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 15fd2a36 >2014-01-06 07:24:41,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4d98d3fd >2014-01-06 07:24:41,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eacc8221}, log id: 4d98d3fd >2014-01-06 07:24:46,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 5176e55b >2014-01-06 07:24:46,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 5176e55b >2014-01-06 07:24:46,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 63c954ac >2014-01-06 07:24:46,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc988488}, log id: 63c954ac >2014-01-06 07:24:51,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 18cbfca8 >2014-01-06 07:24:52,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 18cbfca8 >2014-01-06 07:24:52,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 54f4f0e8 >2014-01-06 07:24:52,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d9306fa}, log id: 54f4f0e8 >2014-01-06 07:24:57,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1dd7e063 >2014-01-06 07:24:57,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 1dd7e063 >2014-01-06 07:24:57,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a992522 >2014-01-06 07:24:57,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57bff787}, log id: 1a992522 >2014-01-06 07:25:02,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 35cadfe7 >2014-01-06 07:25:03,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 35cadfe7 >2014-01-06 07:25:03,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 584ecef1 >2014-01-06 07:25:03,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdc5230c}, log id: 584ecef1 >2014-01-06 07:25:08,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3caff8d5 >2014-01-06 07:25:09,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3caff8d5 >2014-01-06 07:25:09,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 24fe88e8 >2014-01-06 07:25:09,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69993aaa}, log id: 24fe88e8 >2014-01-06 07:25:11,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 70e44bd7 >2014-01-06 07:25:11,769 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:25:11,769 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:25:11,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, log id: 70e44bd7 >2014-01-06 07:25:11,770 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-94) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:25:14,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7d7c9b5e >2014-01-06 07:25:14,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 7d7c9b5e >2014-01-06 07:25:14,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 606ad796 >2014-01-06 07:25:14,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77f1165f}, log id: 606ad796 >2014-01-06 07:25:19,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5ea7d568 >2014-01-06 07:25:20,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5ea7d568 >2014-01-06 07:25:20,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7eea22e6 >2014-01-06 07:25:20,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df9be2c0}, log id: 7eea22e6 >2014-01-06 07:25:25,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4b334f50 >2014-01-06 07:25:25,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4b334f50 >2014-01-06 07:25:25,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 31362b11 >2014-01-06 07:25:25,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33f47cc3}, log id: 31362b11 >2014-01-06 07:25:30,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 78f2de98 >2014-01-06 07:25:31,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 78f2de98 >2014-01-06 07:25:31,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2157cefc >2014-01-06 07:25:31,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@646e4b8}, log id: 2157cefc >2014-01-06 07:25:36,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 190e10dd >2014-01-06 07:25:36,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 190e10dd >2014-01-06 07:25:36,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 617db503 >2014-01-06 07:25:36,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1753916d}, log id: 617db503 >2014-01-06 07:25:41,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 123c81d4 >2014-01-06 07:25:41,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 123c81d4 >2014-01-06 07:25:41,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3715fb9a >2014-01-06 07:25:42,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a24a95a}, log id: 3715fb9a >2014-01-06 07:25:47,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 11cfaa5 >2014-01-06 07:25:47,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 11cfaa5 >2014-01-06 07:25:47,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: f6055d1 >2014-01-06 07:25:47,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b224a36}, log id: f6055d1 >2014-01-06 07:25:52,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4b73f6f6 >2014-01-06 07:25:52,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4b73f6f6 >2014-01-06 07:25:52,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 57db9eb4 >2014-01-06 07:25:52,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4060a015}, log id: 57db9eb4 >2014-01-06 07:25:57,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3b0b770b >2014-01-06 07:25:58,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3b0b770b >2014-01-06 07:25:58,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4ed15dc6 >2014-01-06 07:25:58,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca09cbeb}, log id: 4ed15dc6 >2014-01-06 07:26:03,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 10934b0b >2014-01-06 07:26:03,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 10934b0b >2014-01-06 07:26:03,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 42c75b5a >2014-01-06 07:26:03,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d626157}, log id: 42c75b5a >2014-01-06 07:26:08,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4a2e9231 >2014-01-06 07:26:09,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4a2e9231 >2014-01-06 07:26:09,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3e0516d0 >2014-01-06 07:26:09,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@797df16a}, log id: 3e0516d0 >2014-01-06 07:26:11,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 3b7286f4 >2014-01-06 07:26:12,102 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:26:12,102 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:26:12,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, log id: 3b7286f4 >2014-01-06 07:26:12,102 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-10) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:26:14,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 4db06f93 >2014-01-06 07:26:14,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 4db06f93 >2014-01-06 07:26:14,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37996f9d >2014-01-06 07:26:14,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d0dfa8b}, log id: 37996f9d >2014-01-06 07:26:19,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3890f797 >2014-01-06 07:26:20,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3890f797 >2014-01-06 07:26:20,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 4a14163d >2014-01-06 07:26:20,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc7e2fe9}, log id: 4a14163d >2014-01-06 07:26:25,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2e148840 >2014-01-06 07:26:25,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2e148840 >2014-01-06 07:26:25,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 95d9979 >2014-01-06 07:26:25,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f7254ac}, log id: 95d9979 >2014-01-06 07:26:30,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6e8e77d8 >2014-01-06 07:26:31,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6e8e77d8 >2014-01-06 07:26:31,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: e5b6e07 >2014-01-06 07:26:31,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdf11ad5}, log id: e5b6e07 >2014-01-06 07:26:36,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 53479bc5 >2014-01-06 07:26:36,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 53479bc5 >2014-01-06 07:26:36,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 37f66d47 >2014-01-06 07:26:36,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce9adca7}, log id: 37f66d47 >2014-01-06 07:26:41,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3f005dad >2014-01-06 07:26:41,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 3f005dad >2014-01-06 07:26:41,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 46cd331 >2014-01-06 07:26:42,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb4c1707}, log id: 46cd331 >2014-01-06 07:26:47,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 52f9fae1 >2014-01-06 07:26:47,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 52f9fae1 >2014-01-06 07:26:47,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 7095e75 >2014-01-06 07:26:47,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98f33ef7}, log id: 7095e75 >2014-01-06 07:26:52,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 229627dd >2014-01-06 07:26:52,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 229627dd >2014-01-06 07:26:52,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3a2ed2b7 >2014-01-06 07:26:52,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b3ed829}, log id: 3a2ed2b7 >2014-01-06 07:26:58,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7a0d6b3a >2014-01-06 07:26:58,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7a0d6b3a >2014-01-06 07:26:58,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7c357f00 >2014-01-06 07:26:58,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a59c9c40}, log id: 7c357f00 >2014-01-06 07:27:03,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 16e47289 >2014-01-06 07:27:03,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 16e47289 >2014-01-06 07:27:03,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 18aa4f28 >2014-01-06 07:27:03,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7997c65}, log id: 18aa4f28 >2014-01-06 07:27:08,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2fdca382 >2014-01-06 07:27:09,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 2fdca382 >2014-01-06 07:27:09,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 145ea1eb >2014-01-06 07:27:09,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f990ab23}, log id: 145ea1eb >2014-01-06 07:27:12,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 1a815e66 >2014-01-06 07:27:12,433 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) Failed in GlusterTasksListVDS method, for vds: rhsvm2; host: 10.70.37.187 >2014-01-06 07:27:12,433 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) Command GlusterTasksListVDS execution failed. Exception: IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK >2014-01-06 07:27:12,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, log id: 1a815e66 >2014-01-06 07:27:12,434 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler_Worker-77) Failed to invoke scheduled method gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: java.lang.IllegalArgumentException: No enum constant org.ovirt.engine.core.common.asynctasks.gluster.GlusterTaskType.REPLACE_BRICK (Failed with error ENGINE and code 5001) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.runVdsCommand(GlusterTasksService.java:60) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateTasksInCluster(GlusterTasksSyncJob.java:67) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:56) [bll.jar:] > ... 6 more > >2014-01-06 07:27:14,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 6bc7cdd8 >2014-01-06 07:27:14,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 6bc7cdd8 >2014-01-06 07:27:14,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 356e26f6 >2014-01-06 07:27:14,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b12ac16b}, log id: 356e26f6 >2014-01-06 07:27:19,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 244655e3 >2014-01-06 07:27:20,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 244655e3 >2014-01-06 07:27:20,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 3aa6eda7 >2014-01-06 07:27:20,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb22e612}, log id: 3aa6eda7 >2014-01-06 07:27:25,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 2d54f908 >2014-01-06 07:27:25,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.86:CONNECTED, 10.70.37.187:CONNECTED], log id: 2d54f908 >2014-01-06 07:27:25,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = rhsvm1, HostId = bb79a79d-7388-4782-b2e4-8c6a6844b064), log id: 61f21d52 >2014-01-06 07:27:25,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de854b72}, log id: 61f21d52 >2014-01-06 07:27:30,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 6c31033d >2014-01-06 07:27:30,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 6c31033d >2014-01-06 07:27:30,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 66185154 >2014-01-06 07:27:31,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f561516}, log id: 66185154 >2014-01-06 07:27:36,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 7d48679a >2014-01-06 07:27:36,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 7d48679a >2014-01-06 07:27:36,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 2fd395fd >2014-01-06 07:27:36,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbd67382}, log id: 2fd395fd >2014-01-06 07:27:41,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 5a81d864 >2014-01-06 07:27:41,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.187:CONNECTED, 10.70.37.86:CONNECTED], log id: 5a81d864 >2014-01-06 07:27:41,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = rhsvm2, HostId = fa1b1b2e-a433-4718-b3fd-13fcafa8fddd), log id: 69b8b8fe >2014-01-06 07:27:42,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {b6e2ed30-370d-46b1-9071-fe851aa57caf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c321f7d8}, log id: 69b8b8fe
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 923196
: 845935