Bug 1548054

Summary: presence of python-gluster package breaks tendrl-monitoring-integration service
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Daniel Horák <dahorak>
Component: web-admin-tendrl-monitoring-integrationAssignee: Nishanth Thomas <nthomas>
Status: CLOSED DUPLICATE QA Contact: sds-qe-bugs
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: rhgs-3.3CC: mbukatov, nthomas, rhs-bugs
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-06-18 12:06:28 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Daniel Horák 2018-02-22 15:44:32 UTC
Description of problem:
  If there is for some reason python-gluster package installed on RHGS WA
  (Tendrl) server, tendrl-monitoring-integration service fails to start
  with traceback in logs.

Version-Release number of selected component (if applicable):
  tendrl-monitoring-integration-1.5.4-14.el7rhgs.noarch
  python-gluster-3.8.4-54.el7rhgs.noarch

How reproducible:
  100%

Steps to Reproduce:
1. Prepare Gluster Cluster
2. On RHGS WA Server (Tendrl Server) machine, install python-gluster package
   from rh-gluster-3-for-rhel-7-server-rpms repo
3. Install and configure Tendrl Server and Tendrl Node Agents.
4. Check if tendrl-monitoring-integration service is running
   # systemctl status tendrl-monitoring-integration
5. Uninstall python-gluster package from Tendrl Server
6. Restart tendrl-monitoring-integration service and check if it is running

Actual results:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# systemctl status tendrl-monitoring-integration -l
  ● tendrl-monitoring-integration.service - Monitoring Integration
     Loaded: loaded (/usr/lib/systemd/system/tendrl-monitoring-integration.service; enabled; vendor preset: disabled)
     Active: failed (Result: start-limit) since Thu 2018-02-22 10:17:08 EST; 22min ago
    Process: 15384 ExecStart=/usr/bin/tendrl-monitoring-integration (code=exited, status=1/FAILURE)
   Main PID: 15384 (code=exited, status=1/FAILURE)

  Feb 22 10:17:08 usm1-server.example.com systemd[1]: Unit tendrl-monitoring-integration.service entered failed state.
  Feb 22 10:17:08 usm1-server.example.com systemd[1]: tendrl-monitoring-integration.service failed.
  Feb 22 10:17:08 usm1-server.example.com systemd[1]: tendrl-monitoring-integration.service holdoff time over, scheduling restart.
  Feb 22 10:17:08 usm1-server.example.com systemd[1]: start request repeated too quickly for tendrl-monitoring-integration.service
  Feb 22 10:17:08 usm1-server.example.com systemd[1]: Failed to start Monitoring Integration.
  Feb 22 10:17:08 usm1-server.example.com systemd[1]: Unit tendrl-monitoring-integration.service entered failed state.
  Feb 22 10:17:08 usm1-server.example.com systemd[1]: tendrl-monitoring-integration.service failed.

# tail -F /var/log/messages | grep tendrl | grep -Ei '.*error.*|.*fail.*|'
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: Traceback (most recent call last):
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: File "/usr/bin/tendrl-monitoring-integration", line 9, in <module>
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: load_entry_point('tendrl-monitoring-integration==1.5.4', 'console_scripts', 'tendrl-monitoring-integration')()
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: File "/usr/lib/python2.7/site-packages/tendrl/monitoring_integration/manager/__init__.py", line 177, in main
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: monitoring_integration_manager = MonitoringIntegrationManager()
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: File "/usr/lib/python2.7/site-packages/tendrl/monitoring_integration/manager/__init__.py", line 40, in __init__
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: self.webhook_receiver = webhook_receiver.WebhookReceiver()
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: File "/usr/lib/python2.7/site-packages/tendrl/monitoring_integration/grafana/webhook_receiver.py", line 20, in __init__
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: self.alert_handler = AlertHandlerManager()
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: File "/usr/lib/python2.7/site-packages/tendrl/monitoring_integration/alert/handlers/__init__.py", line 94, in __init__
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: self._load_handlers()
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: File "/usr/lib/python2.7/site-packages/tendrl/monitoring_integration/alert/handlers/__init__.py", line 73, in _load_handlers
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: mod = importlib.import_module(handler_fqdn)
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: File "/usr/lib64/python2.7/importlib/__init__.py", line 37, in import_module
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: __import__(name)
  Feb 22 10:17:08 localhost tendrl-monitoring-integration: ImportError: No module named cliutils.cliutils
  Feb 22 10:17:08 localhost systemd: tendrl-monitoring-integration.service: main process exited, code=exited, status=1/FAILURE
  Feb 22 10:17:08 localhost systemd: Unit tendrl-monitoring-integration.service entered failed state.
  Feb 22 10:17:08 localhost systemd: tendrl-monitoring-integration.service failed.
  Feb 22 10:17:08 localhost systemd: tendrl-monitoring-integration.service holdoff time over, scheduling restart.
  Feb 22 10:17:08 localhost systemd: start request repeated too quickly for tendrl-monitoring-integration.service
  Feb 22 10:17:08 localhost systemd: Unit tendrl-monitoring-integration.service entered failed state.
  Feb 22 10:17:08 localhost systemd: tendrl-monitoring-integration.service failed.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

  Once python-gluster package is uninstalled,
  tendrl-monitoring-integration service is properly running.

Expected results:
  Service tendrl-monitoring-integration should work properly
  also with python-gluster package installed.

Comment 2 Martin Bukatovic 2018-03-05 15:12:18 UTC
On today's RHGS WA with RHS One testing meeting, Nishanth stated that this is
addressed in current upstream builds.

If that's the case, could you push this BZ into POST state?

Comment 3 Nishanth Thomas 2018-03-08 12:43:36 UTC
@Martin, I need to get the acks before doing so. Will co-ordinate with the team and get this done. Meanwhile pls provide qe acks

Comment 4 Martin Bukatovic 2018-06-18 12:06:28 UTC
Marking as a duplicate of BZ 1572216. While this BZ was reported earlier, and
provides better description of the problem, the other BZ is already verified.

*** This bug has been marked as a duplicate of bug 1572216 ***