Bug 1697682 - 'Error processing event data' errors seen in engine.log
Summary: 'Error processing event data' errors seen in engine.log
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: ovirt-engine
Classification: oVirt
Component: BLL.Gluster
Version: 4.3.2.1
Hardware: x86_64
OS: Linux
high
medium
Target Milestone: ovirt-4.3.5
: 4.3.5.1
Assignee: Sahina Bose
QA Contact: SATHEESARAN
URL:
Whiteboard:
Depends On:
Blocks: 1697681
TreeView+ depends on / blocked
 
Reported: 2019-04-09 02:55 UTC by SATHEESARAN
Modified: 2019-07-30 14:08 UTC (History)
5 users (show)

Fixed In Version: ovirt-engine-4.3.5.1
Doc Type: Bug Fix
Doc Text:
Cause: Gluster events data was not deserialized due to abstract Map element present in Java object Consequence: Gluster events were not processed by engine Fix: Deserialization does not use strong object type mapping Result: Events are processed correctly
Clone Of: 1697681
Environment:
Last Closed: 2019-07-30 14:08:24 UTC
oVirt Team: Gluster
Embargoed:
pm-rhel: ovirt-4.3+

Attachments (Terms of Use)
engine.log (769.60 KB, application/octet-stream)
2019-04-09 02:57 UTC, SATHEESARAN 		no flags Details
View All


Links
System ID Private Priority Status Summary Last Updated
oVirt gerrit 99551 0 master MERGED gluster: Changing deserialize for GlusterEvent 2019-04-22 14:42:23 UTC
oVirt gerrit 99553 0 ovirt-engine-4.3 MERGED gluster: Changing deserialize for GlusterEvent 2019-04-23 11:03:32 UTC
oVirt gerrit 100629 0 master MERGED gluster: Fixing exception in events processing 2019-06-13 12:17:34 UTC
oVirt gerrit 100808 0 ovirt-engine-4.3 MERGED gluster: Fixing exception in events processing 2019-06-16 08:52:04 UTC

Description SATHEESARAN 2019-04-09 02:55:07 UTC 
Description of problem:
-----------------------
Engine log has re-occuring errors : 'Error processing event data'. So far these errors are harmless and doesn't affect any functionality.

Version-Release number of selected component (if applicable):
-------------------------------------------------------------
RHHI-V 1.6
RHV 4.3.3

How reproducible:
-----------------
Always

Steps to Reproduce:
--------------------
1. Install HC deployment, with HE setup
2. Manage 3 hosts in the gluster+virt cluster
3. Check engine logs

Actual results:
---------------
Errors seen in the engine.log

Expected results:
-----------------
No errors should be seen

Additional info:
----------------
[root@hostedenginesm1 ~]# grep  -i ' error processing' /var/log/ovirt-engine/engine.log 
2019-04-04 15:12:22,359+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-2) [] Error processing event data
2019-04-04 15:12:22,364+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-2) [] Error processing event data
2019-04-04 15:12:22,367+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-2) [] Error processing event data
Comment 1 SATHEESARAN 2019-04-09 02:57:35 UTC 
Created attachment 1553775 [details]
engine.log
Comment 2 bipin 2019-06-06 06:58:30 UTC 
Moving back the bug to assigned state since I could still see the error reported above. 

Tested with ovirt-engine-4.3.4.2-0.1.el7.noarch.


Snippet:
=======
2019-06-04 12:51:53,575+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-3) [] Error processing event data
2019-06-04 12:51:53,591+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-3) [] Error processing event data
2019-06-04 12:51:53,605+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-3) [] Error processing event data
2019-06-04 12:51:53,624+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-3) [] Error processing event data
2019-06-04 12:51:53,635+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-3) [] Error processing event data
2019-06-04 12:51:53,648+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-3) [] Error processing event data
2019-06-04 12:51:55,695+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-3) [] Error processing event data
2019-06-04 12:51:55,703+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-3) [] Error processing event data
2019-06-04 12:51:55,712+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-3) [] Error processing event data
2019-06-04 12:53:34,628+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-13) [] Error processing event data
2019-06-04 12:53:34,639+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-13) [] Error processing event data
2019-06-04 12:53:34,648+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-13) [] Error processing event data
2019-06-04 12:53:34,657+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-13) [] Error processing event data
2019-06-04 12:53:34,665+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-13) [] Error processing event data
2019-06-04 12:53:34,674+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-13) [] Error processing event data
2019-06-04 12:53:37,560+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-13) [] Error processing event data
2019-06-04 12:53:37,572+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-13) [] Error processing event data
2019-06-04 12:53:37,581+05 ERROR [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default task-13) [] Error processing event data
Comment 3 RHEL Program Management 2019-06-06 06:59:24 UTC 
Target release should be placed once a package build is known to fix a issue. Since this bug is not modified, the target version has been reset. Please use target milestone to plan a fix for a oVirt release.
Comment 6 Sahina Bose 2019-06-06 15:09:40 UTC 
(In reply to bipin from comment #2)
> Moving back the bug to assigned state since I could still see the error
> reported above. 
> 
> Tested with ovirt-engine-4.3.4.2-0.1.el7.noarch.
> 
> 
> Snippet:
> =======
> 2019-06-04 12:51:53,575+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-3) [] Error processing event data
> 2019-06-04 12:51:53,591+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-3) [] Error processing event data
> 2019-06-04 12:51:53,605+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-3) [] Error processing event data
> 2019-06-04 12:51:53,624+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-3) [] Error processing event data
> 2019-06-04 12:51:53,635+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-3) [] Error processing event data
> 2019-06-04 12:51:53,648+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-3) [] Error processing event data
> 2019-06-04 12:51:55,695+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-3) [] Error processing event data
> 2019-06-04 12:51:55,703+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-3) [] Error processing event data
> 2019-06-04 12:51:55,712+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-3) [] Error processing event data
> 2019-06-04 12:53:34,628+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-13) [] Error processing event data
> 2019-06-04 12:53:34,639+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-13) [] Error processing event data
> 2019-06-04 12:53:34,648+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-13) [] Error processing event data
> 2019-06-04 12:53:34,657+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-13) [] Error processing event data
> 2019-06-04 12:53:34,665+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-13) [] Error processing event data
> 2019-06-04 12:53:34,674+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-13) [] Error processing event data
> 2019-06-04 12:53:37,560+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-13) [] Error processing event data
> 2019-06-04 12:53:37,572+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-13) [] Error processing event data
> 2019-06-04 12:53:37,581+05 ERROR
> [org.ovirt.engine.core.services.GlusterEventsWebHookServlet] (default
> task-13) [] Error processing event data

Can you provide debug logs from engine?
Comment 11 SATHEESARAN 2019-07-18 07:10:41 UTC 
Tested with RHV-4.3.5.4

No more such error messages seen in engine.log

[root@rhvm-basic ~]#  grep  -i ' error processing' /var/log/ovirt-engine/engine.log
[root@rhvm-basic ~]#
Comment 12 Sandro Bonazzola 2019-07-30 14:08:24 UTC 
This bugzilla is included in oVirt 4.3.5 release, published on July 30th 2019.

Since the problem described in this bug report should be
resolved in oVirt 4.3.5 release, it has been closed with a resolution of CURRENT RELEASE.

If the solution does not work for you, please open a new bug report.
Note You need to log in before you can comment on or make changes to this bug.