Bug 1516968
| Summary: | tendrl-notifier doesn't send alerts for gluster native events for POSIX_HEALTH_CHECK_FAILED | ||
|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat Gluster Storage | Reporter: | Martin Bukatovic <mbukatov> |
| Component: | web-admin-tendrl-notifier | Assignee: | Shubhendu Tripathi <shtripat> |
| Status: | CLOSED ERRATA | QA Contact: | Martin Kudlej <mkudlej> |
| Severity: | unspecified | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | rhgs-3.3 | CC: | mbukatov, mkudlej, nthomas, rhs-bugs, sanandpa, sankarshan, shtripat |
| Target Milestone: | --- | Keywords: | ZStream |
| Target Release: | --- | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | tendrl-gluster-integration-1.5.4-6.el7rhgs.noarch tendrl-notifier-1.5.4-5.el7rhgs.noarch | Doc Type: | If docs needed, set a value |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2017-12-18 04:37:58 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | 1517468 | ||
| Bug Blocks: | |||
|
Description
Martin Bukatovic
2017-11-23 17:21:41 UTC
> Does it mean that RHGS WA failed to setup Gluster native eventing during
> cluster import?
Asking for evaluation. If that is the case, the severity of this BZ would be
higher as no gluster native events would be processed and forwarded by tendrl
notifier, not just this single one.
Did this events are raised by gluster? Whatever events are raised by gluster will be logged at /var/log/glusterfs/events.log Can you verify this and get us the required information (In reply to Nishanth Thomas from comment #3) > Did this events are raised by gluster? > Whatever events are raised by gluster will be logged at > /var/log/glusterfs/events.log > Can you verify this and get us the required information Yes, gluster tried to send the event, but it seems that the push failed. The evidence you are asking for is listed in the description of this BZ. There you can see that gluster indeed tried to send the posix health event, but it seems that the push failed, which may be the root cause of this BZ. In comment 2, I was asking you to recheck that. This was tested based on description from "List of Alerts and Notifications in Tendrl"[1], RHGS WA should be able to receive native gluster events, process them and resend some of them (as described in the list) as alerts. The event in question "Posix health check failed for brick" is listed there. [1] https://github.com/Tendrl/documentation/wiki/List-of-Alerts-and-Notifications-in-Tendrl Also see this output from gluster side: ``` # gluster-eventsapi status Webhooks: http://0.0.0.0:8697/listen +-------------------------------+-------------+-----------------------+ | NODE | NODE STATUS | GLUSTEREVENTSD STATUS | +-------------------------------+-------------+-----------------------+ | mbukatov-usm1-gl1.example.com | UP | OK | | mbukatov-usm1-gl2.example.com | UP | OK | | mbukatov-usm1-gl3.example.com | UP | OK | | mbukatov-usm1-gl4.example.com | UP | OK | | mbukatov-usm1-gl6.example.com | UP | OK | | localhost | UP | OK | +-------------------------------+-------------+-----------------------+ ``` It seems that the webhook is micronfigured. Shouldn't I see some tendrl component there, listening for these events? Nishant, I have created a separate BZ 1517468 to make my point clear. The new BZ 1517468 is not duplicate of this one, as it affects all native events. When BZ 1517468 is fixed, we would need to retest scenario in this BZ again. @martin, are you saying you are not receiving any events mentioned in https://github.com/Tendrl/documentation/wiki/List-of-Alerts-and-Notifications-in-Tendrl ? https://github.com/Tendrl/gluster-integration/pull/510 fixes this issue for native event POSIX_HEALTH_CHECK_FAILED (In reply to Nishanth Thomas from comment #7) > @martin, are you saying you are not receiving any events mentioned in > https://github.com/Tendrl/documentation/wiki/List-of-Alerts-and- > Notifications-in-Tendrl ? So far, I wasn't able to receive any gluster native event, as listed in last section in the wikipage you linked. Ask Martin K. for up to date testing status. My impression is that it could be caused by errors or misconfiguration of sending messages from gluster to tendrl, as described in BZ 1517468. I have redrafted test cases based on the wikipage you linked when it become available and I really appreciate this documentation effort upstream, because I wouldn't be able to create test case which covers gluster native test cases without it, nor I would be able to file this BZ without it. I verified this bug with: tendrl-gluster-integration-1.5.4-6.el7rhgs.noarch tendrl-notifier-1.5.4-5.el7rhgs.noarch --> VERIFIED Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2017:3478 |