Hide Forgot
Description of problem: ------------------------ Purging a un-healthy gw configuration is not happening. Version-Release number of selected component (if applicable): ------------------------------------------------------------- v-10.2.3.8 Steps to Reproduce: ------------------- 1.To an existing configuration, add few rbd images(say: more than 20) and re-run ansible playbook. 2.Creating huge number of lun fails from ansible and there is BZ to track(1387297) 3.Tried cleaning the partially created configuration by running the purge gw yaml and it's currently failing.. Due to this error I am unable to re-run playbook to modify the existing images also.. [root@Host1 ceph-ansible]# ansible-playbook purge_gateways.yml Which configuration elements should be purged? (all, lio or abort) [abort]: all PLAY [Confirm removal of the iSCSI gateway configuration] ********************* GATHERING FACTS *************************************************************** ok: [localhost] TASK: [Exit playbook if user aborted the purge] ******************************* skipping: [localhost] TASK: [set_fact ] ************************************************************* ok: [localhost] PLAY [Removing the gateway configuration] ************************************* GATHERING FACTS *************************************************************** ok: [dakota.lab.eng.blr.redhat.com] ok: [avenger.lab.eng.blr.redhat.com] ok: [catalina.lab.eng.blr.redhat.com] ok: [banshee.lab.eng.blr.redhat.com] TASK: [igw_purge | purging the gateway configuration] ************************* failed: [avenger.lab.eng.blr.redhat.com] => {"failed": true, "parsed": false} Traceback (most recent call last): File "/root/.ansible/tmp/ansible-tmp-1477309638.53-204510216405638/igw_purge", line 1873, in <module> ansible_main() File "/root/.ansible/tmp/ansible-tmp-1477309638.53-204510216405638/igw_purge", line 1798, in ansible_main cfg = Config(logger) File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/common.py", line 85, in __init__ self.config = self.get_config() File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/common.py", line 116, in _get_rbd_config cfg_dict = json.loads(cfg_data) File "/usr/lib64/python2.7/json/__init__.py", line 338, in loads return _default_decoder.decode(s) File "/usr/lib64/python2.7/json/decoder.py", line 366, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib64/python2.7/json/decoder.py", line 382, in raw_decode obj, end = self.scan_once(s, idx) ValueError: Unterminated string starting at: line 260 column 13 (char 8190) OpenSSH_6.6.1, OpenSSL 1.0.1e-fips 11 Feb 2013 debug1: Reading configuration data /etc/ssh/ssh_config debug1: /etc/ssh/ssh_config line 8: Applying options for * debug1: auto-mux: Trying existing master debug1: mux_client_request_session: master session id: 2 Shared connection to avenger.lab.eng.blr.redhat.com closed. failed: [dakota.lab.eng.blr.redhat.com] => {"failed": true, "parsed": false} Traceback (most recent call last): File "/root/.ansible/tmp/ansible-tmp-1477309638.54-257327452953782/igw_purge", line 1873, in <module> ansible_main() File "/root/.ansible/tmp/ansible-tmp-1477309638.54-257327452953782/igw_purge", line 1798, in ansible_main cfg = Config(logger) File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/common.py", line 85, in __init__ self.config = self.get_config() File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/common.py", line 116, in _get_rbd_config cfg_dict = json.loads(cfg_data) File "/usr/lib64/python2.7/json/__init__.py", line 338, in loads return _default_decoder.decode(s) File "/usr/lib64/python2.7/json/decoder.py", line 366, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib64/python2.7/json/decoder.py", line 382, in raw_decode obj, end = self.scan_once(s, idx) ValueError: Unterminated string starting at: line 260 column 13 (char 8190) OpenSSH_6.6.1, OpenSSL 1.0.1e-fips 11 Feb 2013 debug1: Reading configuration data /etc/ssh/ssh_config debug1: /etc/ssh/ssh_config line 8: Applying options for * debug1: auto-mux: Trying existing master debug1: mux_client_request_session: master session id: 2 Shared connection to dakota.lab.eng.blr.redhat.com closed. failed: [catalina.lab.eng.blr.redhat.com] => {"failed": true, "parsed": false} Traceback (most recent call last): File "/root/.ansible/tmp/ansible-tmp-1477309638.54-31197302975311/igw_purge", line 1873, in <module> ansible_main() File "/root/.ansible/tmp/ansible-tmp-1477309638.54-31197302975311/igw_purge", line 1798, in ansible_main cfg = Config(logger) File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/common.py", line 85, in __init__ self.config = self.get_config() File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/common.py", line 116, in _get_rbd_config cfg_dict = json.loads(cfg_data) File "/usr/lib64/python2.7/json/__init__.py", line 338, in loads return _default_decoder.decode(s) File "/usr/lib64/python2.7/json/decoder.py", line 366, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib64/python2.7/json/decoder.py", line 382, in raw_decode obj, end = self.scan_once(s, idx) ValueError: Unterminated string starting at: line 260 column 13 (char 8190) OpenSSH_6.6.1, OpenSSL 1.0.1e-fips 11 Feb 2013 debug1: Reading configuration data /etc/ssh/ssh_config debug1: /etc/ssh/ssh_config line 8: Applying options for * debug1: auto-mux: Trying existing master debug1: mux_client_request_session: master session id: 2 Shared connection to catalina.lab.eng.blr.redhat.com closed. failed: [banshee.lab.eng.blr.redhat.com] => {"failed": true, "parsed": false} Traceback (most recent call last): File "/root/.ansible/tmp/ansible-tmp-1477309638.53-111737696448355/igw_purge", line 1873, in <module> ansible_main() File "/root/.ansible/tmp/ansible-tmp-1477309638.53-111737696448355/igw_purge", line 1798, in ansible_main cfg = Config(logger) File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/common.py", line 85, in __init__ self.config = self.get_config() File "/usr/lib/python2.7/site-packages/ceph_iscsi_config/common.py", line 116, in _get_rbd_config cfg_dict = json.loads(cfg_data) File "/usr/lib64/python2.7/json/__init__.py", line 338, in loads return _default_decoder.decode(s) File "/usr/lib64/python2.7/json/decoder.py", line 366, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib64/python2.7/json/decoder.py", line 382, in raw_decode obj, end = self.scan_once(s, idx) ValueError: Unterminated string starting at: line 260 column 13 (char 8190) OpenSSH_6.6.1, OpenSSL 1.0.1e-fips 11 Feb 2013 debug1: Reading configuration data /etc/ssh/ssh_config debug1: /etc/ssh/ssh_config line 8: Applying options for * debug1: auto-mux: Trying existing master debug1: mux_client_request_session: master session id: 2 Shared connection to banshee.lab.eng.blr.redhat.com closed. FATAL: all hosts have already failed -- aborting PLAY RECAP ******************************************************************** to retry, use: --limit @/root/purge_gateways.retry avenger.lab.eng.blr.redhat.com : ok=1 changed=0 unreachable=0 failed=1 banshee.lab.eng.blr.redhat.com : ok=1 changed=0 unreachable=0 failed=1 catalina.lab.eng.blr.redhat.com : ok=1 changed=0 unreachable=0 failed=1 dakota.lab.eng.blr.redhat.com : ok=1 changed=0 unreachable=0 failed=1 localhost : ok=2 changed=0 unreachable=0 failed=0
This is hitting the same bug as 1387297 where we cannot read the config object. *** This bug has been marked as a duplicate of bug 1387297 ***