Bug 1875266 - A number of directories are missing from the overcloud-full.qcow2 image
Summary: A number of directories are missing from the overcloud-full.qcow2 image
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: rhosp-director-images
Version: 16.2 (Train)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ga
: 16.2 (Train on RHEL 8.4)
Assignee: OSP Team
QA Contact: David Rosenfeld
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-09-03 07:33 UTC by Michele Baldessari
Modified: 2022-08-23 22:51 UTC (History)
9 users (show)

Fixed In Version: rhosp-director-images-16.2-20201103.0.el8ost.noarch
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-09-15 10:04:34 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Launchpad 1879766 0 None None None 2020-09-11 19:13:09 UTC
Red Hat Issue Tracker OSP-3004 0 None None None 2022-08-23 22:51:59 UTC
Red Hat Product Errata RHEA-2021:3485 0 None None None 2021-09-15 10:04:39 UTC

Description Michele Baldessari 2020-09-03 07:33:07 UTC
Description of problem:
I was trying to deploy 16.2 and the deployment failed due to a number of folders missing. So far I discovered /etc/pki/CA/*, /var/lib/pcsd, /var/log/pcsd, /var/lib/corosync, /var/log/cluster, /var/lib/ipa-client*. I am not sure if more are missing.

(undercloud) [stack@undercloud-0 t]$ virt-customize -a overcloud-full.qcow2 --run-command 'rpm -V pcs ipa-client ipa-client-common openssl-perl pcs corosync'
[   0.0] Examining the guest ...                                                                                                                             
[   9.5] Setting a random seed                                                                                                                               
[   9.5] Setting the machine ID in /etc/machine-id                                                                                                           
[   9.5] Running: rpm -V pcs ipa-client ipa-client-common openssl-perl pcs corosync                                                                          
missing     /usr/lib/pcsd/vendor/bundle/ruby/doc                                                                                                             
missing     /var/lib/pcsd                                                                                                                                    
missing     /var/log/pcsd                                                                                                                                    
missing     /etc/ipa/nssdb                                                                                                                                   
missing     /var/lib/ipa-client/pki                                                                                                                          
missing     /var/lib/ipa-client/sysrestore                                                                                                                   
missing     /etc/pki/CA/certs                                                                                                                                
missing     /etc/pki/CA/crl                                                                                                                                  
missing     /etc/pki/CA/newcerts                                                                                                                             
missing     /etc/pki/CA/private                                                                                                                              
missing     /usr/lib/pcsd/vendor/bundle/ruby/doc                                                                                                             
missing     /var/lib/pcsd                                                                                                                                    
missing     /var/log/pcsd                                                                                                                                    
missing     /etc/corosync/uidgid.d                                                                                                                           
missing     /var/lib/corosync                                                                                                                                
missing     /var/log/cluster                                                                                                                                 


Those missing dirs make the deployment fail in different ways.

Version:
rhosp-director-images-x86_64-16.2-20200831.1.el8ost.noarch

Puddle: http://download-node-02.eng.bos.redhat.com/rcm-guest/puddles/OpenStack/16.2-RHEL-8/RHOS_TRUNK-16.2-RHEL-8-20200831.n.0/

Workaround:
In a pre config step do:
dnf reinstall -y ipa-client ipa-client-common openssl-perl pcs corosync

Comment 6 Ian Wienand 2020-09-08 19:49:36 UTC
This has ended up with me in a dib bucket; but from reading it appears to be that it has been root caused to a tmpfile daemon that has been clearing up files in the background on the build host?

I'm not sure what dib can do about it?  One idea is to not use the global /tmp but set DIB_TMP to some scratch location.  We usually do this anyway to avoid blowing out tmpfs.

Comment 7 wes hayutin 2020-09-08 20:14:22 UTC
I think the internal image build scripts should be updated.. not a product bug.
Perhaps a doc bug?

Comment 8 Alex Schultz 2020-09-08 21:01:22 UTC
Did we ever make sure this completely went away? Because when I was looking into it previously, it still happened after doing the /tmp shuffle.  This only started happening with RHEL8

Comment 9 Alex Schultz 2020-09-09 13:40:58 UTC
Also I was wondering if this has the same root cause as Bug 1784001 which was still a thing unless something changed?

Comment 10 Alex Schultz 2020-09-09 14:24:50 UTC
So i'll make the change to the rhosp-director-images distgit to specify DIB_TMP and we'll see if that resolves this for 16.2. Once we confirm that it resolves this we can apply to other versions.

Comment 13 wes hayutin 2020-09-11 12:20:11 UTC
IMHO this still needs to be updated in docs.. as customers may rebuild their images

Comment 14 Alex Schultz 2020-09-11 12:51:30 UTC
We can look to add the DIB_TMP into the cli command instead (if not set).

Comment 25 errata-xmlrpc 2021-09-15 10:04:34 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 16.2 deployment images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2021:3485


Note You need to log in before you can comment on or make changes to this bug.