Bug 1549004

Summary: [Ceph-ansible] Failure on TASK [igw_purge | purging the gateway configuration]
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Pratik Surve <prsurve>
Component: Ceph-AnsibleAssignee: Paul Cuzner <pcuzner>
Status: CLOSED ERRATA QA Contact: Manohar Murthy <mmurthy>
Severity: high Docs Contact: Erin Donnelly <edonnell>
Priority: high    
Version: 3.0CC: adeza, aschoen, ceph-eng-bugs, edonnell, gmeno, hnallurv, nthomas, pcuzner, prsurve, sankarshan, shan, tchandra, tserlin, vashastr
Target Milestone: z4   
Target Release: 3.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: RHEL: ceph-ansible-3.0.35-1.el7cp Ubuntu: ceph-ansible_3.0.35-2redhat1 Doc Type: Known Issue
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-07-11 18:11:08 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1557269    
Attachments:
Description Flags
File contains playbook log for purge_iscsi_gateway.yml none

Description Pratik Surve 2018-02-26 08:41:56 UTC
Created attachment 1400767 [details]
File contains playbook log for purge_iscsi_gateway.yml

Description of problem:

purging iscsi-gateway playbook failed saying

TASK [igw_purge | purging the gateway configuration] **************************************************************************************************************************************************************
fatal: [ceph-prsurve-run889-node3-osd]: FAILED! => {"changed": false, "module_stderr": "Shared connection to ceph-prsurve-run889-node3-osd closed.\r\n", "module_stdout": "Traceback (most recent call last):\r\n  File \"/tmp/ansible_H3WbuA/ansible_module_igw_purge.py\", line 204, in <module>\r\n    backupCount=7)\r\n  File \"/usr/lib64/python2.7/logging/handlers.py\", line 117, in __init__\r\n    BaseRotatingHandler.__init__(self, filename, mode, encoding, delay)\r\n  File \"/usr/lib64/python2.7/logging/handlers.py\", line 64, in __init__\r\n    logging.FileHandler.__init__(self, filename, mode, encoding, delay)\r\n  File \"/usr/lib64/python2.7/logging/__init__.py\", line 902, in __init__\r\n    StreamHandler.__init__(self, self._open())\r\n  File \"/usr/lib64/python2.7/logging/__init__.py\", line 925, in _open\r\n    stream = open(self.baseFilename, self.mode)\r\nIOError: [Errno 13] Permission denied: '/var/log/ansible-module-igw_config.log'\r\n", "msg": "MODULE FAILURE", "rc": 0}
fatal: [ceph-prsurve-run889-node5-osd]: FAILED! => {"changed": false, "module_stderr": "Shared connection to ceph-prsurve-run889-node5-osd closed.\r\n", "module_stdout": "Traceback (most recent call last):\r\n  File \"/tmp/ansible_HZDr3g/ansible_module_igw_purge.py\", line 204, in <module>\r\n    backupCount=7)\r\n  File \"/usr/lib64/python2.7/logging/handlers.py\", line 117, in __init__\r\n    BaseRotatingHandler.__init__(self, filename, mode, encoding, delay)\r\n  File \"/usr/lib64/python2.7/logging/handlers.py\", line 64, in __init__\r\n    logging.FileHandler.__init__(self, filename, mode, encoding, delay)\r\n  File \"/usr/lib64/python2.7/logging/__init__.py\", line 902, in __init__\r\n    StreamHandler.__init__(self, self._open())\r\n  File \"/usr/lib64/python2.7/logging/__init__.py\", line 925, in _open\r\n    stream = open(self.baseFilename, self.mode)\r\nIOError: [Errno 13] Permission denied: '/var/log/ansible-module-igw_config.log'\r\n", "msg": "MODULE FAILURE", "rc": 0}
fatal: [ceph-prsurve-run889-node2-osd]: FAILED! => {"changed": false, "module_stderr": "Shared connection to ceph-prsurve-run889-node2-osd closed.\r\n", "module_stdout": "Traceback (most recent call last):\r\n  File \"/tmp/ansible_clatsm/ansible_module_igw_purge.py\", line 204, in <module>\r\n    backupCount=7)\r\n  File \"/usr/lib64/python2.7/logging/handlers.py\", line 117, in __init__\r\n    BaseRotatingHandler.__init__(self, filename, mode, encoding, delay)\r\n  File \"/usr/lib64/python2.7/logging/handlers.py\", line 64, in __init__\r\n    logging.FileHandler.__init__(self, filename, mode, encoding, delay)\r\n  File \"/usr/lib64/python2.7/logging/__init__.py\", line 902, in __init__\r\n    StreamHandler.__init__(self, self._open())\r\n  File \"/usr/lib64/python2.7/logging/__init__.py\", line 925, in _open\r\n    stream = open(self.baseFilename, self.mode)\r\nIOError: [Errno 13] Permission denied: '/var/log/ansible-module-igw_config.log'\r\n", "msg": "MODULE FAILURE", "rc": 0}
fatal: [ceph-prsurve-run889-node6-osd]: FAILED! => {"changed": false, "module_stderr": "Shared connection to ceph-prsurve-run889-node6-osd closed.\r\n", "module_stdout": "Traceback (most recent call last):\r\n  File \"/tmp/ansible_BGpAvT/ansible_module_igw_purge.py\", line 204, in <module>\r\n    backupCount=7)\r\n  File \"/usr/lib64/python2.7/logging/handlers.py\", line 117, in __init__\r\n    BaseRotatingHandler.__init__(self, filename, mode, encoding, delay)\r\n  File \"/usr/lib64/python2.7/logging/handlers.py\", line 64, in __init__\r\n    logging.FileHandler.__init__(self, filename, mode, encoding, delay)\r\n  File \"/usr/lib64/python2.7/logging/__init__.py\", line 902, in __init__\r\n    StreamHandler.__init__(self, self._open())\r\n  File \"/usr/lib64/python2.7/logging/__init__.py\", line 925, in _open\r\n    stream = open(self.baseFilename, self.mode)\r\nIOError: [Errno 13] Permission denied: '/var/log/ansible-module-igw_config.log'\r\n", "msg": "MODULE FAILURE", "rc": 0}


Version-Release number of selected component (if applicable):
ceph-ansible-3.0.26-1.el7cp.noarch
ceph-iscsi-config-2.3-12.el7cp.noarch

How reproducible:
always

Steps to Reproduce:
1.configure iscsi through ansible running playbook
2.run playbook for purge-iscsi-gateways.yml
3.

Actual results:


Expected results:


Additional info:
Attaching the playbook log.

Comment 3 Sébastien Han 2018-03-13 16:57:24 UTC
[Errno 13] Permission denied: '/var/log/ansible-module-igw_config.log'

Can you change the permission on the directory?
Please make sure the user running ansible can write on this directory.

Comment 5 Sébastien Han 2018-03-15 12:23:06 UTC
That's the best I could do, your new issue seems related to the module itself.
I'm assigning this to Paul since he wrote the module.

Comment 9 Paul Cuzner 2018-04-22 22:46:29 UTC
@Pratik / @Tejas - could you tell me the sequence that the iscsi purge was attempted please. For example, I've seen this sort of problem when the cluster has been purged first, which removes the rbd pool, and then the iscsi purge is run. In this scenario it will fail, since it's config object has been wiped.

Comment 19 errata-xmlrpc 2018-07-11 18:11:08 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2018:2177