Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1618992

Summary: Undercloud installation fails with target ‘/etc/puppet/modules/’ is not a directory: No such file or directory
Product: Red Hat OpenStack Reporter: Tzach Shefi <tshefi>
Component: openstack-tripleoAssignee: James Slagle <jslagle>
Status: CLOSED NOTABUG QA Contact: Arik Chernetsky <achernet>
Severity: medium Docs Contact:
Priority: medium    
Version: 13.0 (Queens)CC: aschultz, kejones, mburns
Target Milestone: ---Keywords: Triaged, ZStream
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-08-20 16:42:08 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
install-undercloud.log
none
undercloud sosreport none

Description Tzach Shefi 2018-08-19 11:36:17 UTC
Created attachment 1476888 [details]
install-undercloud.log

Description of problem: While manually installing a BM deployment for FC testing, failed to complete Undercloud deployment, error listed under Actual results. 


Version-Release number of selected component (if applicable):
RHEL7.5


How reproducible:
Unsure first time I hit this

Steps to Reproduce:
1. Deploy OS, follow guide.
2. Update undercloud.conf, enable replace eth1-> ono1
3. Run -> openstack undercloud install
4. Failed to complete undercloud install. 

I've done this several times already pretty confident with steps, don't think I missed any thing along the way but again it's manual deployment. 

Actual results:

-puppet/modules/vswitch /usr/share/openstack-puppet/modules/xinetd /usr/share/openstack-puppet/modules/zaqar /usr/share/openstack-puppet/modules/zookeeper /etc/puppet/modules/
2018-08-19 14:00:29,765 INFO: ln: target ‘/etc/puppet/modules/’ is not a directory: No such file or directory
2018-08-19 14:00:29,766 INFO: INFO: 2018-08-19 14:00:29,764 -- ############### End stdout/stderr logging ###############
2018-08-19 14:00:29,766 INFO: ERROR: 2018-08-19 14:00:29,765 --     Hook FAILED.
2018-08-19 14:00:29,767 INFO: ERROR: 2018-08-19 14:00:29,765 -- Failed running command ['/usr/lib/python2.7/site-packages/diskimage_builder/lib/dib-run-parts', u'/tmp/tmpYF1cOt/install.d']
2018-08-19 14:00:29,768 INFO:   File "/usr/lib/python2.7/site-packages/instack/main.py", line 170, in main
2018-08-19 14:00:29,768 INFO:     em.run()
2018-08-19 14:00:29,769 INFO:   File "/usr/lib/python2.7/site-packages/instack/runner.py", line 108, in run
2018-08-19 14:00:29,769 INFO:     self.run_hook(hook)
2018-08-19 14:00:29,770 INFO:   File "/usr/lib/python2.7/site-packages/instack/runner.py", line 207, in run_hook
2018-08-19 14:00:29,770 INFO:     raise Exception("Failed running command %s" % command)
2018-08-19 14:00:29,770 INFO: ERROR: 2018-08-19 14:00:29,767 -- None
2018-08-19 14:00:29,803 DEBUG: An exception occurred
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2330, in install
    _run_instack(instack_env)
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1556, in _run_instack
    _run_live_command(args, instack_env, 'instack')
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 668, in _run_live_command
    raise RuntimeError('%s failed. See log for details.' % name)
RuntimeError: instack failed. See log for details.
2018-08-19 14:00:29,819 ERROR: 
#############################################################################
Undercloud install failed.

Reason: instack failed. See log for details.

See the previous output for details about what went wrong.  The full install
log can be found at /home/stack/.instack/install-undercloud.log.

#############################################################################

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2330, in install
    _run_instack(instack_env)
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1556, in _run_instack
    _run_live_command(args, instack_env, 'instack')
  File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 668, in _run_live_command
    raise RuntimeError('%s failed. See log for details.' % name)
RuntimeError: instack failed. See log for details.
Command 'instack-install-undercloud' returned non-zero exit status 1
[stack@undercloud-0 ~]$ tail /home/stack/.instack/install-undercloud.log
#############################################################################
Undercloud install failed.

Reason: instack failed. See log for details.

See the previous output for details about what went wrong.  The full install
log can be found at /home/stack/.instack/install-undercloud.log.

#############################################################################


Expected results:
openstack undercloud install should complete without issues. 

Additional info:

Comment 1 Tzach Shefi 2018-08-19 11:40:51 UTC
Created attachment 1476889 [details]
undercloud sosreport

Forgot to mention triple0 version(s) on initial comment:

openstack-tripleo-common-containers-8.6.3-10.el7ost.noarch
puppet-tripleo-8.3.4-5.el7ost.noarch
openstack-tripleo-heat-templates-8.0.4-20.el7ost.noarch
openstack-tripleo-image-elements-8.0.1-1.el7ost.noarch
openstack-tripleo-puppet-elements-8.0.1-1.el7ost.noarch
openstack-tripleo-common-8.6.3-10.el7ost.noarch
ansible-tripleo-ipsec-8.1.1-0.20180308133440.8f5369a.el7ost.noarch
python-tripleoclient-9.2.3-4.el7ost.noarch

Comment 3 Tzach Shefi 2018-08-19 11:46:46 UTC
Build puddle 2018-08-16.1

Comment 4 Tzach Shefi 2018-08-19 11:55:29 UTC
One last thing on  /home/stack/.instack/install-undercloud.log
mentions two such issues -> 

2018-08-19 12:34:49,464 ERROR: Undercloud configuration validation failed: Invalid local_interface specified. eth1 is
 not available.

I had run undercloud deploy by mistake before changing eth1 to eno1 twice, was think about lunch:)

These are safe to ignore I mean unless these two failed attempts caused the later issues.

Comment 5 Tzach Shefi 2018-08-20 10:55:58 UTC
Confused this might turn out to be a user error / notabug. 
As with infrared a virt deployment of the same puddle manged to deploy fine. 
Yet I reproduced the same error on a second BM host just now.
Reproduce the bug twice already. 

Then again if this is a user error, least consistent in my errors.

Comment 6 Alex Schultz 2018-08-20 16:42:08 UTC
I took a look at the sosreport and it appears that you have the puppetlabs version of puppet installed rather than what is provided as part of OSP.

puppet-agent-1.10.14-1.el7.x86_64	Thu Aug 16 10:38:13 2018	1534405093	Puppet Labs
puppetlabs-release-pc1-1.1.0-5.el7.noarch	Thu Aug 16 10:37:44 2018	1534405064	Puppet Labs


The puppet we ship with osp is:

puppet-4.8.2-2.el7ost.noarch

Prior to installing the undercloud you should not have the puppetlabs release installed.

Comment 7 Tzach Shefi 2018-08-21 05:56:00 UTC
Great, thanks for the pointer.

Stuck wondering where incompatible version arrives from. 
Followed the OPSD guide, almost to the word other then using rpm rhos-release to get repos instead of CDN. Don't recall installing anything myself. 

I'll redo my steps and check for puppetlabs before I start deployment maybe it arrives from Foreman/OS base deployment.

Comment 8 Tzach Shefi 2018-08-21 06:00:10 UTC
Yep, on a fresh OS deployment of my server found the wrong puppet version installed:
puppetlabs-release-pc1-1.1.0-5.el7.noarch

I'll uninstall it and redo my UC deploy steps.

Comment 9 Kevin Jones 2019-03-09 21:15:30 UTC
Just as a note, I saw this issue when I enabled rhel-7-server-satellite-tools-6.4-rpms on Director instead of rhel-7-server-satellite-tools-6.3-rpms.

The director guide for 13 does say to use rhel-7-server-satellite-tools-6.3-rpms