Bug 1814667

Summary:	bootstrap.ing modifications not taken into account by OCP 4.3.5 on OSP 13 IPI installer
Product:	OpenShift Container Platform	Reporter:	Andreas Karis <akaris>
Component:	Installer	Assignee:	Mike Fedosin <mfedosin>
Installer sub component:	OpenShift on OpenStack	QA Contact:	David Sanz <dsanzmor>
Status:	CLOSED DUPLICATE	Docs Contact:
Severity:	medium
Priority:	medium	CC:	m.andre, pprinett
Version:	4.3.z	Keywords:	UpcomingSprint
Target Milestone:	---
Target Release:	4.6.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2020-07-01 22:12:22 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Andreas Karis 2020-03-18 13:42:28 UTC

Hi! 

I'm currently working on https://access.redhat.com/solutions/4909411 and https://access.redhat.com/solutions/4906341  for  OpenShift on OpenStack IPI ... 

bootstrap.ing modifications not taken into account by OCP 4.3.5 on OSP 13 IPI installer

I'm basically using this sequence:

./openshift-install destroy cluster --dir=install-config --log-level debug
rm -Rf install-configcp -a install-backup install-config
./openshift-install create ignition-configs --dir=install-config/ --log-level=debug
cd install-config
for i in *.ign ; do cp ${i} ${i}.back ; donemkdir bootstrap/etc -p
cat << EOF > bootstrap/etc/chrony.conf
server clock.corp.redhat.com iburst
driftfile /var/lib/chrony/drift
makestep 1.0 3
rtcsync
logdir /var/log/chrony
EOF
chmod 420 bootstrap/etc/chrony.confcat<<'EOF' > bootstrap/etc/motd
#############################################################
MODIFIED MOTD FILE FOR TESTING PURPOSES
#############################################################
This is the bootstrap node; it will be destroyed when the master is fully up.

The primary service is "bootkube.service". 

To watch its status, run e.g.  

journalctl -b -f -u bootkube.service
EOF

for i in *.ign ; do filetranspile  -i ${i}.back -f bootstrap -o ${i}  ; donerm -Rf bootstrap
rm -f *.backcd ../
./openshift-install create cluster --dir=install-config/ --log-level=debugMy problem is that the changes to *.ign files are not taken into account and don't make it to the bootstrap node or the masters. Also, when I inspect the data on swift, I cannot see my modifications.I got that procedure to work once today, but I don't remember what I do differently. I tried with both filetranspile and with manually modifying the .ign files, in both cases it doesn't work.Help would be appreciated so that I can document this properly.Thanks, (edited) 

The master.ign and worker.ign files are read and compiled just fine and chrony.conf and /etc/motd are updated correctly and masters and workers have updated files after launching. The bootstrap node's data, though, never updates.

It's when running cluster create and when the bootstrap.ign file is being consumed that things are not working.

E.g. this part here does not work as expected:

DEBUG The object was created.                      
INFO Consuming Worker Machines from target directory 
DEBUG Purging asset "Worker Machines" from disk    
INFO Consuming Common Manifests from target directory 
DEBUG Purging asset "Common Manifests" from disk   
INFO Consuming Bootstrap Ignition Config from target directory    <------------------------ this
DEBUG Purging asset "Bootstrap Ignition Config" from disk 
INFO Consuming Master Machines from target directory 
DEBUG Purging asset "Master Machines" from disk    
INFO Consuming OpenShift Install (Manifests) from target directory 
DEBUG Purging asset "OpenShift Install (Manifests)" from disk 
INFO Consuming Openshift Manifests from target directory 
DEBUG Purging asset "Openshift Manifests" from disk 
DEBUG Fetching Kubeconfig Admin Client...          



The nodeuser data for workers and masters contains my changes:

$ echo "eyJpZ25pdGlvbiI6eyJjb25maWciOnsiYXBwZW5kIjpbeyJzb3VyY2UiOiJkYXRhOnRleHQvcGxhaW47Y2hhcnNldD11dGYtODtiYXNlNjQsZXlKcFoyNXBkR2x2YmlJNklIc2lZMjl1Wm1sbklqb2dleUpoY0hCbGJtUWlPaUJiZXlKemIzVnlZMlVpT2lBaWFIUjBjSE02THk4eE1DNHdMakF1TlRveU1qWXlNeTlqYjI1bWFXY3ZiV0Z6ZEdWeUlpd2dJblpsY21sbWFXTmhkR2x2YmlJNklIdDlmVjE5TENBaWMyVmpkWEpwZEhraU9pQjdJblJzY3lJNklIc2lZMlZ5ZEdsbWFXTmhkR1ZCZFhSb2IzSnBkR2xsY3lJNklGdDdJbk52ZFhKalpTSTZJQ0prWVhSaE9uUmxlSFF2Y0d4aGFXNDdZMmhoY25ObGREMTFkR1l0T0R0aVlYTmxOalFzVEZNd2RFeFRNVU5TVldSS1ZHbENSRkpXU2xWVFZWcEtVVEJHVlZKVE1IUk1VekIwUTJzeFNsTlZVa1pTUlU1RVVWZGFjRm93UmpOVFZVcENXakJzU2xKSVVsUlJWMUl3VlZkNGMyUklaRE5TUmtaYVUydDBkbGRyYkc5a2JVNVBVVlpHUmxSRlNsSlJXR1JMWVd0V1ZGUlZTa0pTTUVWNFZsVlZTMUV6YUU1VGJVbDZVVzE0YVdKck5YWlpWbVJoVFVVeFUxRllaRVZhTVd4RlZteEdVbEpGVmpOYVNHeHBUV3ByZDFSR1pFOWhSVEZEVGtab1JWWkZiRE5VVlZKT1pVVTVSVkpZYUU1V1JURTFWREZhZGxkQmNFVldSVEV6VkZWU1RtVkZOWEZTV0doT1ZrVXhOVlF4V25aa01IQnhVbFpPVGxGclJraFJWRVpXVWxWT05GUlZjR2xOTUVweldXMDFUMkl5UmxoWGFrSk9WV3RHTTFKSFpGcFNSbHBTVlZWU1JtUXlValZEYlVsNVQxUkNUVll3Tlc5VVZXeEtVV3RzY1ZGVk5VTmFNblI0WVVkMGNGSjZiRE5OUlVwQ1ZWVldSMUZWUmxCUk1FWlNUMFZHVGxOVmJFTlJNbVJNVVRCR1VsSlZSbmxhYTNoVFl6Sk9iMUl6Y0ROaGFrRkxZMGQ0ZEZOVVRrbE5ia0V6Vkc1T1NXRkhPSFpoUnpWc1V6RmFSV1ZVVlRGVE1ERjNWRE5XTkdSRVdYcGpNMHBGVGxkT1VrMVhSbEJNTTFKR1VrZE9kMWxxVGtoaVZHTXdZekZvYUUxRVZsWk5NalZJVGxGd1QySkVRa2hPYlVZeFZWTjBkV1Z0ZHpKVGVscENaRmhvVW1WdGJFVmpSelF5WVRKU1NrMHhRbkpoUm5CMVlWZGFlR0pVWkZoYWEzY3lUVEJLUldOdE1UVlNhMXB1VWpCc2NWRlVTbnBXZWs1RFRVZE9WVU51VlRKaFZXUnpWRlZ2TkZReWVFMVhWR3hMWWxWNFZsSnRZM2RqYTI4MVlrZG9RbFpzYkhsa01qbDBUSHBvVDFKVk1EVlhhMmgwWkZSV2JWSXhiRmRsVkZJMVlsaHNkMDU1ZEZOamJYaExXVEJzVmxWcGMwdFVXRVUwWVVadmVXUldUazlpUjFKVlZucENVVTlVU2xkWlV6bE1VekpzVTA0eVZuWlJNR3hNVld0R1YySXphSFpTYmtwdVVWVnZkbFV3WkZSTlNFSnJZbFYzTVdKWFVqQk9XSEJ3WTBWMFVFNXJhelJaZDI4eVVXdGpNMlZyWXpGVE1WRjZVMWhDU1ZWVlVuTmtiVkV6V1cxMGRsWkVVVFJqVlRCMlVrVk9jbFV3TlhCalYyOHpVekJhZWxFeldsSlpNRXAyVjFad2Fsb3lSbnBWYlU1dVZFVmFiRTVWVWtWaGEwWXlRMmwwTWxKSVJYWmxhMUpFVmtoa1NsSkZSbEpSVlVwMlRVVnNNMVZWVWtKVU1FcHVWR3hhU1ZWVWFFTlJWMWswVWxWS1FsUlZUa0pqVmtZelVraGtXbEpHV2xOTlJsSkNWVlZuZGxGclJsWmtNRVl6VWxWSlMwd3pjRUphUlVwdVZHeGFTVlZVVWtaU2JXUlNWbGhPUmxsVGRFeGpNMmMxVmtSa2FsTnJXbGhpVld4R1VWZEdSMk5HUW5kalJrNUVaRE5rUlZWV2JFdFRNamxoVTFkb01sa3dOVUpWVlZaTlVXeEdRbEpCY0c1YU1GWkRVVlYwZDFreFZsVlBSa3A0V1RBMVQxSXdVWGRsVjFwRlRXNUtVMXBWTVc5WFJXeHVWSHByZGs1dGJGcGhSRUpyVTIxamVFMXRhRTFoUkVKaFlURkdiRkl5U1RKbFJGWnlVVmQ0ZDFKdGVFZERiVTQxWkRGR2NWSnRUbnBrUlhodlltNWtlbFp0VGxSU2JHUnpaRWhHVDFReVNsZFdNRlY2V1ZaQ1ZGbHJVWGRVVnpGTVQwZEtlRlI2V25WamJVWnJUa2h3UlZKVVozaGliV3Q2V2xkck1XUlVhSFpXTURSTFVrZFdkMkpxWkc1a01GSXhWREpPY1dKVlVsaGlhMlJPVjJ4UmNsSkdXbkZoYlhCRVN6SXhkVkV6V1RSWldGVjNWVlpHVmxwcVFUVk5iRkphVlZkWk5WVnRWWGhOYlVrelZEQk9VbUZwZEZwWmEzUlNZbEZ3UmxVeVJreE9NMVpDVlc1V05FMXJTbFJUUlVwcFVqRnNhbFp1Vm5saFJGWnpTekpaZUVzd1drWlhSVXAyWkcwMVRFNXJWazFaTWs1dFVsaEZOVTlJU1RKUFZrSTBZa2Q0VUZkSGR6UlZWMVkxWTJ0c1JrTnVRbE5pVlhnd1UyeHNVMDFXYUd0VVJFWjJWVEZCZG1WdFduTmplVGxFWTFjMVMxb3djRzVMTVZwcVZsWndiMU5JWkhkTmJWcEhZbGRzUzJGVlZrWlNhbXhOVG5wV1NXRnNRakZpTW5CdlRXMXNXR1ZJVVV0VWVrSXdVMnR6TldGdGMzaE5lVGxxWWpCbmNtTkZjSGxSVkVKNlZrVktXbUl6Y0VKUVVXOTBURk13ZEV4VlZrOVNRMEpFVWxaS1ZWTlZXa3BSTUVaVlVsTXdkRXhUTUhSRFp6MDlJaXdnSW5abGNtbG1hV05oZEdsdmJpSTZJSHQ5ZlYxOWZTd2dJblJwYldWdmRYUnpJam9nZTMwc0lDSjJaWEp6YVc5dUlqb2dJakl1TWk0d0luMHNJQ0p1WlhSM2IzSnJaQ0k2SUh0OUxDQWljR0Z6YzNka0lqb2dlMzBzSUNKemRHOXlZV2RsSWpvZ2V5Sm1hV3hsY3lJNklGdDdJbkJoZEdnaU9pQWlMMlYwWXk5amFISnZibmt1WTI5dVppSXNJQ0ptYVd4bGMzbHpkR1Z0SWpvZ0luSnZiM1FpTENBaWJXOWtaU0k2SURJM01pd2dJbU52Ym5SbGJuUnpJam9nZXlKemIzVnlZMlVpT2lBaVpHRjBZVG9zYzJWeWRtVnlKVEl3TUM1bGRYSnZjR1V1Y0c5dmJDNXVkSEF1YjNKbkpUSXdhV0oxY25OMEpUQkJaSEpwWm5SbWFXeGxKVEl3TDNaaGNpOXNhV0l2WTJoeWIyNTVMMlJ5YVdaMEpUQkJiV0ZyWlhOMFpYQWxNakF4TGpBbE1qQXpKVEJCY25SamMzbHVZeVV3UVd4dloyUnBjaVV5TUM5MllYSXZiRzluTDJOb2NtOXVlU1V3UVNKOWZTd2dleUp3WVhSb0lqb2dJaTlsZEdNdmJXOTBaQ0lzSUNKbWFXeGxjM2x6ZEdWdElqb2dJbkp2YjNRaUxDQWliVzlrWlNJNklEUXpOaXdnSW1OdmJuUmxiblJ6SWpvZ2V5SnpiM1Z5WTJVaU9pQWlaR0YwWVRvc0pUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEJCVFU5RVNVWkpSVVFsTWpCTlQxUkVKVEl3UmtsTVJTVXlNQzBsTWpCUVZWTklSVVFsTWpCRFNGSlBUbGtsTWpCRFQwNUdTVWRWVWtGVVNVOU9KVEJCSlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUSXpKVEl6SlRJekpUQkJKVEJCVkdocGN5VXlNR2x6SlRJd2RHaGxKVEl3WW05dmRITjBjbUZ3SlRJd2JtOWtaU1V6UWlVeU1HbDBKVEl3ZDJsc2JDVXlNR0psSlRJd1pHVnpkSEp2ZVdWa0pUSXdkMmhsYmlVeU1IUm9aU1V5TUcxaGMzUmxjaVV5TUdsekpUSXdablZzYkhrbE1qQjFjQzRsTUVFbE1FRlVhR1VsTWpCd2NtbHRZWEo1SlRJd2MyVnlkbWxqWlNVeU1HbHpKVEl3SlRJeVltOXZkR3QxWW1VdWMyVnlkbWxqWlNVeU1pNGxNakJVYnlVeU1IZGhkR05vSlRJd2FYUnpKVEl3YzNSaGRIVnpKVEpESlRJd2NuVnVKVEl3WlM1bkxpVXdRU1V3UVNVeU1DVXlNR3B2ZFhKdVlXeGpkR3dsTWpBdFlpVXlNQzFtSlRJd0xYVWxNakJpYjI5MGEzVmlaUzV6WlhKMmFXTmxKVEJCSW4xOVhYMHNJQ0p6ZVhOMFpXMWtJam9nZTMxOSIsInZlcmlmaWNhdGlvbiI6e319XX0sInRpbWVvdXRzIjp7fSwidmVyc2lvbiI6IjIuMS4wIn0sIm5ldHdvcmtkIjp7fSwicGFzc3dkIjp7fSwic3RvcmFnZSI6eyJmaWxlcyI6W3siZmlsZXN5c3RlbSI6InJvb3QiLCJncm91cCI6e30sInBhdGgiOiIvZXRjL2hvc3RuYW1lIiwidXNlciI6e30sImNvbnRlbnRzIjp7InNvdXJjZSI6ImRhdGE6dGV4dC9wbGFpbjtjaGFyc2V0PXV0Zi04O2Jhc2U2NCxZMngxYzNSbGNpMHlkbXRxWWkxdFlYTjBaWEl0TUFvPSIsInZlcmlmaWNhdGlvbiI6e319LCJtb2RlIjo0MjB9XX0sInN5c3RlbWQiOnt9fQ==" | base64 -d | jq
{
  "ignition": {
    "config": {
      "append": [
        {
          "source": "data:text/plain;charset=utf-8;base64,eyJpZ25pdGlvbiI6IHsiY29uZmlnIjogeyJhcHBlbmQiOiBbeyJzb3VyY2UiOiAiaHR0cHM6Ly8xMC4wLjAuNToyMjYyMy9jb25maWcvbWFzdGVyIiwgInZlcmlmaWNhdGlvbiI6IHt9fV19LCAic2VjdXJpdHkiOiB7InRscyI6IHsiY2VydGlmaWNhdGVBdXRob3JpdGllcyI6IFt7InNvdXJjZSI6ICJkYXRhOnRleHQvcGxhaW47Y2hhcnNldD11dGYtODtiYXNlNjQsTFMwdExTMUNSVWRKVGlCRFJWSlVTVVpKUTBGVVJTMHRMUzB0Q2sxSlNVUkZSRU5EUVdacFowRjNTVUpCWjBsSlJIUlRRV1IwVVd4c2RIZDNSRkZaU2t0dldrbG9kbU5PUVZGRlRFSlJRWGRLYWtWVFRVSkJSMEV4VlVVS1EzaE5TbUl6UW14aWJrNXZZVmRhTUUxU1FYZEVaMWxFVmxGUlJFVjNaSGxpTWprd1RGZE9hRTFDTkZoRVZFbDNUVVJOZUU5RVJYaE5WRTE1VDFadldBcEVWRTEzVFVSTmVFNXFSWGhOVkUxNVQxWnZkMHBxUlZOTlFrRkhRVEZWUlVONFRVcGlNMEpzWW01T2IyRlhXakJOVWtGM1JHZFpSRlpSVVVSRmQyUjVDbUl5T1RCTVYwNW9UVWxKUWtscVFVNUNaMnR4YUd0cFJ6bDNNRUpCVVVWR1FVRlBRMEZST0VGTlNVbENRMmRMUTBGUlJVRnlaa3hTYzJOb1IzcDNhakFLY0d4dFNUTklNbkEzVG5OSWFHOHZhRzVsUzFaRWVUVTFTMDF3VDNWNGREWXpjM0pFTldOUk1XRlBMM1JGUkdOd1lqTkhiVGMwYzFoaE1EVlZNMjVITlFwT2JEQkhObUYxVVN0dWVtdzJTelpCZFhoUmVtbEVjRzQyYTJSSk0xQnJhRnB1YVdaeGJUZFhaa3cyTTBKRWNtMTVSa1puUjBscVFUSnpWek5DTUdOVUNuVTJhVWRzVFVvNFQyeE1XVGxLYlV4VlJtY3dja281YkdoQlZsbHlkMjl0THpoT1JVMDVXa2h0ZFRWbVIxbFdlVFI1Ylhsd055dFNjbXhLWTBsVlVpc0tUWEU0YUZveWRWTk9iR1JVVnpCUU9USldZUzlMUzJsU04yVnZRMGxMVWtGV2IzaHZSbkpuUVVvdlUwZFRNSEJrYlV3MWJXUjBOWHBwY0V0UE5razRZd28yUWtjM2VrYzFTMVF6U1hCSVVVUnNkbVEzWW10dlZEUTRjVTB2UkVOclUwNXBjV28zUzBaelEzWlJZMEp2V1ZwaloyRnpVbU5uVEVabE5VUkVha0YyQ2l0MlJIRXZla1JEVkhkSlJFRlJRVUp2TUVsM1VVUkJUMEpuVGxaSVVUaENRV1k0UlVKQlRVTkJjVkYzUkhkWlJGWlNNRlJCVVVndlFrRlZkMEYzUlVJS0wzcEJaRUpuVGxaSVVUUkZSbWRSVlhORllTdExjM2c1VkRkalNrWlhiVWxGUVdGR2NGQndjRk5EZDNkRVVWbEtTMjlhU1doMlkwNUJVVVZNUWxGQlJBcG5aMFZDUVV0d1kxVlVPRkp4WTA1T1IwUXdlV1pFTW5KU1pVMW9XRWxuVHprdk5tbFphREJrU21jeE1taE1hREJhYTFGbFIySTJlRFZyUVd4d1JteEdDbU41ZDFGcVJtTnpkRXhvYm5kelZtTlRSbGRzZEhGT1QySldWMFV6WVZCVFlrUXdUVzFMT0dKeFR6WnVjbUZrTkhwRVJUZ3hibWt6WldrMWRUaHZWMDRLUkdWd2JqZG5kMFIxVDJOcWJVUlhia2ROV2xRclJGWnFhbXBESzIxdVEzWTRZWFV3VVZGVlpqQTVNbFJaVVdZNVVtVXhNbUkzVDBOUmFpdFpZa3RSYlFwRlUyRkxOM1ZCVW5WNE1rSlRTRUppUjFsalZuVnlhRFZzSzJZeEswWkZXRUp2ZG01TE5rVk1ZMk5tUlhFNU9ISTJPVkI0Ykd4UFdHdzRVV1Y1Y2tsRkNuQlNiVXgwU2xsU01WaGtUREZ2VTFBdmVtWnNjeTlEY1c1S1owcG5LMVpqVlZwb1NIZHdNbVpHYldsS2FVVkZSamxNTnpWSWFsQjFiMnBvTW1sWGVIUUtUekIwU2tzNWFtc3hNeTlqYjBncmNFcHlRVEJ6VkVKWmIzcEJQUW90TFMwdExVVk9SQ0JEUlZKVVNVWkpRMEZVUlMwdExTMHRDZz09IiwgInZlcmlmaWNhdGlvbiI6IHt9fV19fSwgInRpbWVvdXRzIjoge30sICJ2ZXJzaW9uIjogIjIuMi4wIn0sICJuZXR3b3JrZCI6IHt9LCAicGFzc3dkIjoge30sICJzdG9yYWdlIjogeyJmaWxlcyI6IFt7InBhdGgiOiAiL2V0Yy9jaHJvbnkuY29uZiIsICJmaWxlc3lzdGVtIjogInJvb3QiLCAibW9kZSI6IDI3MiwgImNvbnRlbnRzIjogeyJzb3VyY2UiOiAiZGF0YTosc2VydmVyJTIwMC5ldXJvcGUucG9vbC5udHAub3JnJTIwaWJ1cnN0JTBBZHJpZnRmaWxlJTIwL3Zhci9saWIvY2hyb255L2RyaWZ0JTBBbWFrZXN0ZXAlMjAxLjAlMjAzJTBBcnRjc3luYyUwQWxvZ2RpciUyMC92YXIvbG9nL2Nocm9ueSUwQSJ9fSwgeyJwYXRoIjogIi9ldGMvbW90ZCIsICJmaWxlc3lzdGVtIjogInJvb3QiLCAibW9kZSI6IDQzNiwgImNvbnRlbnRzIjogeyJzb3VyY2UiOiAiZGF0YTosJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTBBTU9ESUZJRUQlMjBNT1REJTIwRklMRSUyMC0lMjBQVVNIRUQlMjBDSFJPTlklMjBDT05GSUdVUkFUSU9OJTBBJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTBBJTBBVGhpcyUyMGlzJTIwdGhlJTIwYm9vdHN0cmFwJTIwbm9kZSUzQiUyMGl0JTIwd2lsbCUyMGJlJTIwZGVzdHJveWVkJTIwd2hlbiUyMHRoZSUyMG1hc3RlciUyMGlzJTIwZnVsbHklMjB1cC4lMEElMEFUaGUlMjBwcmltYXJ5JTIwc2VydmljZSUyMGlzJTIwJTIyYm9vdGt1YmUuc2VydmljZSUyMi4lMjBUbyUyMHdhdGNoJTIwaXRzJTIwc3RhdHVzJTJDJTIwcnVuJTIwZS5nLiUwQSUwQSUyMCUyMGpvdXJuYWxjdGwlMjAtYiUyMC1mJTIwLXUlMjBib290a3ViZS5zZXJ2aWNlJTBBIn19XX0sICJzeXN0ZW1kIjoge319",
          "verification": {}
        }
      ]
    },
    "timeouts": {},
    "version": "2.1.0"
  },
  "networkd": {},
  "passwd": {},
  "storage": {
    "files": [
      {
        "filesystem": "root",
        "group": {},
        "path": "/etc/hostname",
        "user": {},
        "contents": {
          "source": "data:text/plain;charset=utf-8;base64,Y2x1c3Rlci0ydmtqYi1tYXN0ZXItMAo=",
          "verification": {}
        },
        "mode": 420
      }
    ]
  },
  "systemd": {}
}

$ echo "eyJpZ25pdGlvbiI6IHsiY29uZmlnIjogeyJhcHBlbmQiOiBbeyJzb3VyY2UiOiAiaHR0cHM6Ly8xMC4wLjAuNToyMjYyMy9jb25maWcvbWFzdGVyIiwgInZlcmlmaWNhdGlvbiI6IHt9fV19LCAic2VjdXJpdHkiOiB7InRscyI6IHsiY2VydGlmaWNhdGVBdXRob3JpdGllcyI6IFt7InNvdXJjZSI6ICJkYXRhOnRleHQvcGxhaW47Y2hhcnNldD11dGYtODtiYXNlNjQsTFMwdExTMUNSVWRKVGlCRFJWSlVTVVpKUTBGVVJTMHRMUzB0Q2sxSlNVUkZSRU5EUVdacFowRjNTVUpCWjBsSlJIUlRRV1IwVVd4c2RIZDNSRkZaU2t0dldrbG9kbU5PUVZGRlRFSlJRWGRLYWtWVFRVSkJSMEV4VlVVS1EzaE5TbUl6UW14aWJrNXZZVmRhTUUxU1FYZEVaMWxFVmxGUlJFVjNaSGxpTWprd1RGZE9hRTFDTkZoRVZFbDNUVVJOZUU5RVJYaE5WRTE1VDFadldBcEVWRTEzVFVSTmVFNXFSWGhOVkUxNVQxWnZkMHBxUlZOTlFrRkhRVEZWUlVONFRVcGlNMEpzWW01T2IyRlhXakJOVWtGM1JHZFpSRlpSVVVSRmQyUjVDbUl5T1RCTVYwNW9UVWxKUWtscVFVNUNaMnR4YUd0cFJ6bDNNRUpCVVVWR1FVRlBRMEZST0VGTlNVbENRMmRMUTBGUlJVRnlaa3hTYzJOb1IzcDNhakFLY0d4dFNUTklNbkEzVG5OSWFHOHZhRzVsUzFaRWVUVTFTMDF3VDNWNGREWXpjM0pFTldOUk1XRlBMM1JGUkdOd1lqTkhiVGMwYzFoaE1EVlZNMjVITlFwT2JEQkhObUYxVVN0dWVtdzJTelpCZFhoUmVtbEVjRzQyYTJSSk0xQnJhRnB1YVdaeGJUZFhaa3cyTTBKRWNtMTVSa1puUjBscVFUSnpWek5DTUdOVUNuVTJhVWRzVFVvNFQyeE1XVGxLYlV4VlJtY3dja281YkdoQlZsbHlkMjl0THpoT1JVMDVXa2h0ZFRWbVIxbFdlVFI1Ylhsd055dFNjbXhLWTBsVlVpc0tUWEU0YUZveWRWTk9iR1JVVnpCUU9USldZUzlMUzJsU04yVnZRMGxMVWtGV2IzaHZSbkpuUVVvdlUwZFRNSEJrYlV3MWJXUjBOWHBwY0V0UE5razRZd28yUWtjM2VrYzFTMVF6U1hCSVVVUnNkbVEzWW10dlZEUTRjVTB2UkVOclUwNXBjV28zUzBaelEzWlJZMEp2V1ZwaloyRnpVbU5uVEVabE5VUkVha0YyQ2l0MlJIRXZla1JEVkhkSlJFRlJRVUp2TUVsM1VVUkJUMEpuVGxaSVVUaENRV1k0UlVKQlRVTkJjVkYzUkhkWlJGWlNNRlJCVVVndlFrRlZkMEYzUlVJS0wzcEJaRUpuVGxaSVVUUkZSbWRSVlhORllTdExjM2c1VkRkalNrWlhiVWxGUVdGR2NGQndjRk5EZDNkRVVWbEtTMjlhU1doMlkwNUJVVVZNUWxGQlJBcG5aMFZDUVV0d1kxVlVPRkp4WTA1T1IwUXdlV1pFTW5KU1pVMW9XRWxuVHprdk5tbFphREJrU21jeE1taE1hREJhYTFGbFIySTJlRFZyUVd4d1JteEdDbU41ZDFGcVJtTnpkRXhvYm5kelZtTlRSbGRzZEhGT1QySldWMFV6WVZCVFlrUXdUVzFMT0dKeFR6WnVjbUZrTkhwRVJUZ3hibWt6WldrMWRUaHZWMDRLUkdWd2JqZG5kMFIxVDJOcWJVUlhia2ROV2xRclJGWnFhbXBESzIxdVEzWTRZWFV3VVZGVlpqQTVNbFJaVVdZNVVtVXhNbUkzVDBOUmFpdFpZa3RSYlFwRlUyRkxOM1ZCVW5WNE1rSlRTRUppUjFsalZuVnlhRFZzSzJZeEswWkZXRUp2ZG01TE5rVk1ZMk5tUlhFNU9ISTJPVkI0Ykd4UFdHdzRVV1Y1Y2tsRkNuQlNiVXgwU2xsU01WaGtUREZ2VTFBdmVtWnNjeTlEY1c1S1owcG5LMVpqVlZwb1NIZHdNbVpHYldsS2FVVkZSamxNTnpWSWFsQjFiMnBvTW1sWGVIUUtUekIwU2tzNWFtc3hNeTlqYjBncmNFcHlRVEJ6VkVKWmIzcEJQUW90TFMwdExVVk9SQ0JEUlZKVVNVWkpRMEZVUlMwdExTMHRDZz09IiwgInZlcmlmaWNhdGlvbiI6IHt9fV19fSwgInRpbWVvdXRzIjoge30sICJ2ZXJzaW9uIjogIjIuMi4wIn0sICJuZXR3b3JrZCI6IHt9LCAicGFzc3dkIjoge30sICJzdG9yYWdlIjogeyJmaWxlcyI6IFt7InBhdGgiOiAiL2V0Yy9jaHJvbnkuY29uZiIsICJmaWxlc3lzdGVtIjogInJvb3QiLCAibW9kZSI6IDI3MiwgImNvbnRlbnRzIjogeyJzb3VyY2UiOiAiZGF0YTosc2VydmVyJTIwMC5ldXJvcGUucG9vbC5udHAub3JnJTIwaWJ1cnN0JTBBZHJpZnRmaWxlJTIwL3Zhci9saWIvY2hyb255L2RyaWZ0JTBBbWFrZXN0ZXAlMjAxLjAlMjAzJTBBcnRjc3luYyUwQWxvZ2RpciUyMC92YXIvbG9nL2Nocm9ueSUwQSJ9fSwgeyJwYXRoIjogIi9ldGMvbW90ZCIsICJmaWxlc3lzdGVtIjogInJvb3QiLCAibW9kZSI6IDQzNiwgImNvbnRlbnRzIjogeyJzb3VyY2UiOiAiZGF0YTosJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTBBTU9ESUZJRUQlMjBNT1REJTIwRklMRSUyMC0lMjBQVVNIRUQlMjBDSFJPTlklMjBDT05GSUdVUkFUSU9OJTBBJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTBBJTBBVGhpcyUyMGlzJTIwdGhlJTIwYm9vdHN0cmFwJTIwbm9kZSUzQiUyMGl0JTIwd2lsbCUyMGJlJTIwZGVzdHJveWVkJTIwd2hlbiUyMHRoZSUyMG1hc3RlciUyMGlzJTIwZnVsbHklMjB1cC4lMEElMEFUaGUlMjBwcmltYXJ5JTIwc2VydmljZSUyMGlzJTIwJTIyYm9vdGt1YmUuc2VydmljZSUyMi4lMjBUbyUyMHdhdGNoJTIwaXRzJTIwc3RhdHVzJTJDJTIwcnVuJTIwZS5nLiUwQSUwQSUyMCUyMGpvdXJuYWxjdGwlMjAtYiUyMC1mJTIwLXUlMjBib290a3ViZS5zZXJ2aWNlJTBBIn19XX0sICJzeXN0ZW1kIjoge319" | base64 -d
{"ignition": {"config": {"append": [{"source": "https://10.0.0.5:22623/config/master", "verification": {}}]}, "security": {"tls": {"certificateAuthorities": [{"source": "data:text/plain;charset=utf-8;base64,LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURFRENDQWZpZ0F3SUJBZ0lJRHRTQWR0UWxsdHd3RFFZSktvWklodmNOQVFFTEJRQXdKakVTTUJBR0ExVUUKQ3hNSmIzQmxibk5vYVdaME1SQXdEZ1lEVlFRREV3ZHliMjkwTFdOaE1CNFhEVEl3TURNeE9ERXhNVE15T1ZvWApEVE13TURNeE5qRXhNVE15T1Zvd0pqRVNNQkFHQTFVRUN4TUpiM0JsYm5Ob2FXWjBNUkF3RGdZRFZRUURFd2R5CmIyOTBMV05oTUlJQklqQU5CZ2txaGtpRzl3MEJBUUVGQUFPQ0FROEFNSUlCQ2dLQ0FRRUFyZkxSc2NoR3p3ajAKcGxtSTNIMnA3TnNIaG8vaG5lS1ZEeTU1S01wT3V4dDYzc3JENWNRMWFPL3RFRGNwYjNHbTc0c1hhMDVVM25HNQpObDBHNmF1UStuemw2SzZBdXhRemlEcG42a2RJM1BraFpuaWZxbTdXZkw2M0JEcm15RkZnR0lqQTJzVzNCMGNUCnU2aUdsTUo4T2xMWTlKbUxVRmcwcko5bGhBVllyd29tLzhORU05WkhtdTVmR1lWeTR5bXlwNytScmxKY0lVUisKTXE4aFoydVNObGRUVzBQOTJWYS9LS2lSN2VvQ0lLUkFWb3hvRnJnQUovU0dTMHBkbUw1bWR0NXppcEtPNkk4Ywo2Qkc3ekc1S1QzSXBIUURsdmQ3YmtvVDQ4cU0vRENrU05pcWo3S0ZzQ3ZRY0JvWVpjZ2FzUmNnTEZlNUREakF2Cit2RHEvekRDVHdJREFRQUJvMEl3UURBT0JnTlZIUThCQWY4RUJBTUNBcVF3RHdZRFZSMFRBUUgvQkFVd0F3RUIKL3pBZEJnTlZIUTRFRmdRVXNFYStLc3g5VDdjSkZXbUlFQWFGcFBwcFNDd3dEUVlKS29aSWh2Y05BUUVMQlFBRApnZ0VCQUtwY1VUOFJxY05OR0QweWZEMnJSZU1oWElnTzkvNmlZaDBkSmcxMmhMaDBaa1FlR2I2eDVrQWxwRmxGCmN5d1FqRmNzdExobndzVmNTRldsdHFOT2JWV0UzYVBTYkQwTW1LOGJxTzZucmFkNHpERTgxbmkzZWk1dThvV04KRGVwbjdnd0R1T2NqbURXbkdNWlQrRFZqampDK21uQ3Y4YXUwUVFVZjA5MlRZUWY5UmUxMmI3T0NRaitZYktRbQpFU2FLN3VBUnV4MkJTSEJiR1ljVnVyaDVsK2YxK0ZFWEJvdm5LNkVMY2NmRXE5OHI2OVB4bGxPWGw4UWV5cklFCnBSbUx0SllSMVhkTDFvU1AvemZscy9DcW5KZ0pnK1ZjVVpoSHdwMmZGbWlKaUVFRjlMNzVIalB1b2poMmlXeHQKTzB0Sks5amsxMy9jb0grcEpyQTBzVEJZb3pBPQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==", "verification": {}}]}}, "timeouts": {}, "version": "2.2.0"}, "networkd": {}, "passwd": {}, "storage": {"files": [{"path": "/etc/chrony.conf", "filesystem": "root", "mode": 272, "contents": {"source": "data:,server%200.europe.pool.ntp.org%20iburst%0Adriftfile%20/var/lib/chrony/drift%0Amakestep%201.0%203%0Artcsync%0Alogdir%20/var/log/chrony%0A"}}, {"path": "/etc/motd", "filesystem": "root", "mode": 436, "contents": {"source": "data:,%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%0AMODIFIED%20MOTD%20FILE%20-%20PUSHED%20CHRONY%20CONFIGURATION%0A%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%0A%0AThis%20is%20the%20bootstrap%20node%3B%20it%20will%20be%20destroyed%20when%20the%20master%20is%20fully%20up.%0A%0AThe%20primary%20service%20is%20%22bootkube.service%22.%20To%20watch%20its%20status%2C%20run%20e.g.%0A%0A%20%20journalctl%20-b%20-f%20-u%20bootkube.service%0A"}}]}, "systemd": {}}[akaris@linux git-stack-lab]$ echo "eyJpZ25pdGlvbiI6IHsiY29uZmlnIjogeyJhcHBlbmQiOiBbeyJzb3VyY2UiOiAiaHR0cHM6Ly8xMC4wLjAuNToyMjYyMy9jb25maWcvbWFzdGVyIiwgInZlcmlmaWNhdGlvbiI6IHt9fV19LCAic2VjdXJpdHkiOiB7InRscyI6IHsiY2VydGlmaWNhdGVBdXRob3JpdGllcyI6IFt7InNvdXJjZSI6ICJkYXRhOnRleHQvcGxhaW47Y2hhcnNldD11dGYtODtiYXNlNjQsTFMwdExTMUNSVWRKVGlCRFJWSlVTVVpKUTBGVVJTMHRMUzB0Q2sxSlNVUkZSRU5EUVdacFowRjNTVUpCWjBsSlJIUlRRV1IwVVd4c2RIZDNSRkZaU2t0dldrbG9kbU5PUVZGRlRFSlJRWGRLYWtWVFRVSkJSMEV4VlVVS1EzaE5TbUl6UW14aWJrNXZZVmRhTUUxU1FYZEVaMWxFVmxGUlJFVjNaSGxpTWprd1RGZE9hRTFDTkZoRVZFbDNUVVJOZUU5RVJYaE5WRTE1VDFadldBcEVWRTEzVFVSTmVFNXFSWGhOVkUxNVQxWnZkMHBxUlZOTlFrRkhRVEZWUlVONFRVcGlNMEpzWW01T2IyRlhXakJOVWtGM1JHZFpSRlpSVVVSRmQyUjVDbUl5T1RCTVYwNW9UVWxKUWtscVFVNUNaMnR4YUd0cFJ6bDNNRUpCVVVWR1FVRlBRMEZST0VGTlNVbENRMmRMUTBGUlJVRnlaa3hTYzJOb1IzcDNhakFLY0d4dFNUTklNbkEzVG5OSWFHOHZhRzVsUzFaRWVUVTFTMDF3VDNWNGREWXpjM0pFTldOUk1XRlBMM1JGUkdOd1lqTkhiVGMwYzFoaE1EVlZNMjVITlFwT2JEQkhObUYxVVN0dWVtdzJTelpCZFhoUmVtbEVjRzQyYTJSSk0xQnJhRnB1YVdaeGJUZFhaa3cyTTBKRWNtMTVSa1puUjBscVFUSnpWek5DTUdOVUNuVTJhVWRzVFVvNFQyeE1XVGxLYlV4VlJtY3dja281YkdoQlZsbHlkMjl0THpoT1JVMDVXa2h0ZFRWbVIxbFdlVFI1Ylhsd055dFNjbXhLWTBsVlVpc0tUWEU0YUZveWRWTk9iR1JVVnpCUU9USldZUzlMUzJsU04yVnZRMGxMVWtGV2IzaHZSbkpuUVVvdlUwZFRNSEJrYlV3MWJXUjBOWHBwY0V0UE5razRZd28yUWtjM2VrYzFTMVF6U1hCSVVVUnNkbVEzWW10dlZEUTRjVTB2UkVOclUwNXBjV28zUzBaelEzWlJZMEp2V1ZwaloyRnpVbU5uVEVabE5VUkVha0YyQ2l0MlJIRXZla1JEVkhkSlJFRlJRVUp2TUVsM1VVUkJUMEpuVGxaSVVUaENRV1k0UlVKQlRVTkJjVkYzUkhkWlJGWlNNRlJCVVVndlFrRlZkMEYzUlVJS0wzcEJaRUpuVGxaSVVUUkZSbWRSVlhORllTdExjM2c1VkRkalNrWlhiVWxGUVdGR2NGQndjRk5EZDNkRVVWbEtTMjlhU1doMlkwNUJVVVZNUWxGQlJBcG5aMFZDUVV0d1kxVlVPRkp4WTA1T1IwUXdlV1pFTW5KU1pVMW9XRWxuVHprdk5tbFphREJrU21jeE1taE1hREJhYTFGbFIySTJlRFZyUVd4d1JteEdDbU41ZDFGcVJtTnpkRXhvYm5kelZtTlRSbGRzZEhGT1QySldWMFV6WVZCVFlrUXdUVzFMT0dKeFR6WnVjbUZrTkhwRVJUZ3hibWt6WldrMWRUaHZWMDRLUkdWd2JqZG5kMFIxVDJOcWJVUlhia2ROV2xRclJGWnFhbXBESzIxdVEzWTRZWFV3VVZGVlpqQTVNbFJaVVdZNVVtVXhNbUkzVDBOUmFpdFpZa3RSYlFwRlUyRkxOM1ZCVW5WNE1rSlRTRUppUjFsalZuVnlhRFZzSzJZeEswWkZXRUp2ZG01TE5rVk1ZMk5tUlhFNU9ISTJPVkI0Ykd4UFdHdzRVV1Y1Y2tsRkNuQlNiVXgwU2xsU01WaGtUREZ2VTFBdmVtWnNjeTlEY1c1S1owcG5LMVpqVlZwb1NIZHdNbVpHYldsS2FVVkZSamxNTnpWSWFsQjFiMnBvTW1sWGVIUUtUekIwU2tzNWFtc3hNeTlqYjBncmNFcHlRVEJ6VkVKWmIzcEJQUW90TFMwdExVVk9SQ0JEUlZKVVNVWkpRMEZVUlMwdExTMHRDZz09IiwgInZlcmlmaWNhdGlvbiI6IHt9fV19fSwgInRpbWVvdXRzIjoge30sICJ2ZXJzaW9uIjogIjIuMi4wIn0sICJuZXR3b3JrZCI6IHt9LCAicGFzc3dkIjoge30sICJzdG9yYWdlIjogeyJmaWxlcyI6IFt7InBhdGgiOiAiL2V0Yy9jaHJvbnkuY29uZiIsICJmaWxlc3lzdGVtIjogInJvb3QiLCAibW9kZSI6IDI3MiwgImNvbnRlbnRzIjogeyJzb3VyY2UiOiAiZGF0YTosc2VydmVyJTIwMC5ldXJvcGUucG9vbC5udHAub3JnJTIwaWJ1cnN0JTBBZHJpZnRmaWxlJTIwL3Zhci9saWIvY2hyb255L2RyaWZ0JTBBbWFrZXN0ZXAlMjAxLjAlMjAzJTBBcnRjc3luYyUwQWxvZ2RpciUyMC92YXIvbG9nL2Nocm9ueSUwQSJ9fSwgeyJwYXRoIjogIi9ldGMvbW90ZCIsICJmaWxlc3lzdGVtIjogInJvb3QiLCAibW9kZSI6IDQzNiwgImNvbnRlbnRzIjogeyJzb3VyY2UiOiAiZGF0YTosJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTBBTU9ESUZJRUQlMjBNT1REJTIwRklMRSUyMC0lMjBQVVNIRUQlMjBDSFJPTlklMjBDT05GSUdVUkFUSU9OJTBBJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTIzJTBBJTBBVGhpcyUyMGlzJTIwdGhlJTIwYm9vdHN0cmFwJTIwbm9kZSUzQiUyMGl0JTIwd2lsbCUyMGJlJTIwZGVzdHJveWVkJTIwd2hlbiUyMHRoZSUyMG1hc3RlciUyMGlzJTIwZnVsbHklMjB1cC4lMEElMEFUaGUlMjBwcmltYXJ5JTIwc2VydmljZSUyMGlzJTIwJTIyYm9vdGt1YmUuc2VydmljZSUyMi4lMjBUbyUyMHdhdGNoJTIwaXRzJTIwc3RhdHVzJTJDJTIwcnVuJTIwZS5nLiUwQSUwQSUyMCUyMGpvdXJuYWxjdGwlMjAtYiUyMC1mJTIwLXUlMjBib290a3ViZS5zZXJ2aWNlJTBBIn19XX0sICJzeXN0ZW1kIjoge319" | base64 -d | jq
{
  "ignition": {
    "config": {
      "append": [
        {
          "source": "https://10.0.0.5:22623/config/master",
          "verification": {}
        }
      ]
    },
    "security": {
      "tls": {
        "certificateAuthorities": [
          {
            "source": "data:text/plain;charset=utf-8;base64,LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURFRENDQWZpZ0F3SUJBZ0lJRHRTQWR0UWxsdHd3RFFZSktvWklodmNOQVFFTEJRQXdKakVTTUJBR0ExVUUKQ3hNSmIzQmxibk5vYVdaME1SQXdEZ1lEVlFRREV3ZHliMjkwTFdOaE1CNFhEVEl3TURNeE9ERXhNVE15T1ZvWApEVE13TURNeE5qRXhNVE15T1Zvd0pqRVNNQkFHQTFVRUN4TUpiM0JsYm5Ob2FXWjBNUkF3RGdZRFZRUURFd2R5CmIyOTBMV05oTUlJQklqQU5CZ2txaGtpRzl3MEJBUUVGQUFPQ0FROEFNSUlCQ2dLQ0FRRUFyZkxSc2NoR3p3ajAKcGxtSTNIMnA3TnNIaG8vaG5lS1ZEeTU1S01wT3V4dDYzc3JENWNRMWFPL3RFRGNwYjNHbTc0c1hhMDVVM25HNQpObDBHNmF1UStuemw2SzZBdXhRemlEcG42a2RJM1BraFpuaWZxbTdXZkw2M0JEcm15RkZnR0lqQTJzVzNCMGNUCnU2aUdsTUo4T2xMWTlKbUxVRmcwcko5bGhBVllyd29tLzhORU05WkhtdTVmR1lWeTR5bXlwNytScmxKY0lVUisKTXE4aFoydVNObGRUVzBQOTJWYS9LS2lSN2VvQ0lLUkFWb3hvRnJnQUovU0dTMHBkbUw1bWR0NXppcEtPNkk4Ywo2Qkc3ekc1S1QzSXBIUURsdmQ3YmtvVDQ4cU0vRENrU05pcWo3S0ZzQ3ZRY0JvWVpjZ2FzUmNnTEZlNUREakF2Cit2RHEvekRDVHdJREFRQUJvMEl3UURBT0JnTlZIUThCQWY4RUJBTUNBcVF3RHdZRFZSMFRBUUgvQkFVd0F3RUIKL3pBZEJnTlZIUTRFRmdRVXNFYStLc3g5VDdjSkZXbUlFQWFGcFBwcFNDd3dEUVlKS29aSWh2Y05BUUVMQlFBRApnZ0VCQUtwY1VUOFJxY05OR0QweWZEMnJSZU1oWElnTzkvNmlZaDBkSmcxMmhMaDBaa1FlR2I2eDVrQWxwRmxGCmN5d1FqRmNzdExobndzVmNTRldsdHFOT2JWV0UzYVBTYkQwTW1LOGJxTzZucmFkNHpERTgxbmkzZWk1dThvV04KRGVwbjdnd0R1T2NqbURXbkdNWlQrRFZqampDK21uQ3Y4YXUwUVFVZjA5MlRZUWY5UmUxMmI3T0NRaitZYktRbQpFU2FLN3VBUnV4MkJTSEJiR1ljVnVyaDVsK2YxK0ZFWEJvdm5LNkVMY2NmRXE5OHI2OVB4bGxPWGw4UWV5cklFCnBSbUx0SllSMVhkTDFvU1AvemZscy9DcW5KZ0pnK1ZjVVpoSHdwMmZGbWlKaUVFRjlMNzVIalB1b2poMmlXeHQKTzB0Sks5amsxMy9jb0grcEpyQTBzVEJZb3pBPQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
            "verification": {}
          }
        ]
      }
    },
    "timeouts": {},
    "version": "2.2.0"
  },
  "networkd": {},
  "passwd": {},
  "storage": {
    "files": [
      {
        "path": "/etc/chrony.conf",
        "filesystem": "root",
        "mode": 272,
        "contents": {
          "source": "data:,server%200.europe.pool.ntp.org%20iburst%0Adriftfile%20/var/lib/chrony/drift%0Amakestep%201.0%203%0Artcsync%0Alogdir%20/var/log/chrony%0A"
        }
      },
      {
        "path": "/etc/motd",
        "filesystem": "root",
        "mode": 436,
        "contents": {
          "source": "data:,%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%0AMODIFIED%20MOTD%20FILE%20-%20PUSHED%20CHRONY%20CONFIGURATION%0A%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%0A%0AThis%20is%20the%20bootstrap%20node%3B%20it%20will%20be%20destroyed%20when%20the%20master%20is%20fully%20up.%0A%0AThe%20primary%20service%20is%20%22bootkube.service%22.%20To%20watch%20its%20status%2C%20run%20e.g.%0A%0A%20%20journalctl%20-b%20-f%20-u%20bootkube.service%0A"
        }
      }
    ]
  },
  "systemd": {}
}




But when I download from swift following ignition's source URL:
 curl http://172.16.0.101:8080/v1/AUTH_217b8f543e6943baa12a1487eeafa192/cluster-2vkjb/pfb78lghz5fqk7mw | jq > swift-config

This data set does not contain any of my changes to bootstrap.ign

Comment 1 Andreas Karis 2020-03-18 13:45:56 UTC

I also tried manually editing bootstrap.ign ... an even manually editing .openshift_install_state.json. This means that I opened file .openshift_install_state.json  with a text editor, and changed the following content (which is part of the bootstrap ignition configuration which was already compiled into the installation instructions):
~~~
                    {
                        "filesystem": "root",
                        "path": "/etc/motd",
                        "user": {
                            "name": "root"
                        },
                        "append": true,
                        "contents": {
                            "source": "data:text/plain;charset=utf-8;base64,VGhpcyBpcyB0aGUgYm9vdHN0cmFwIG5vZGU7IGl0IHdpbGwgYmUgZGVzdHJveWVkIHdoZW4gdGhlIG1hc3RlciBpcyBmdWxseSB1cC4KClRoZSBwcmltYXJ5IHNlcnZpY2UgaXMgImJvb3RrdWJlLnNlcnZpY2UiLiBUbyB3YXRjaCBpdHMgc3RhdHVzLCBydW4gZS5nLgoKICBqb3VybmFsY3RsIC1iIC1mIC11IGJvb3RrdWJlLnNlcnZpY2UK",
                            "verification": {}
                        },
                        "mode": 420
                    },
~~~

Replaced it with:
~~~
      {
        "filesystem": "root",
        "path": "/etc/motd",
        "user": {
          "name": "root"
        },
        "append": true,
        "contents": {
          "source": "data:,%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%0AMODIFIED%20MOTD%20FILE%20-%20PUSHED%20CHRONY%20CONFIGURATION%0A%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%0A%0AThis%20is%20the%20bootstrap%20node%3B%20it%20will%20be%20destroyed%20when%20the%20master%20is%20fully%20up.%0A%0AThe%20primary%20service%20is%20%22bootkube.service%22.%20To%20watch%20its%20status%2C%20run%20e.g.%0A%0A%20%20journalctl%20-b%20-f%20-u%20bootkube.service%0A",
          "verification": {}
        },
        "mode": 420
      },
      {
        "path": "/etc/chrony.conf",
        "filesystem": "root",
        "mode": 272,
        "contents": {
          "source": "data:,server%200.europe.pool.ntp.org%20iburst%0Adriftfile%20/var/lib/chrony/drift%0Amakestep%201.0%203%0Artcsync%0Alogdir%20/var/log/chrony%0A"
        }
      },
~~~

After the modification, ran the content of that file through jq, just to be sure:
~~~
$ cat .openshift_install_state.json | jq | less
~~~

The problem is that bootstrap.ign is consume afterwards and that the file is being overwritten

Comment 2 Pierre Prinetti 2020-03-19 15:18:06 UTC

Setting severity on "medium" under the assumption that the bug is not a blocker for disconnected-install. If it is, we have to revise

Comment 3 Pierre Prinetti 2020-03-23 11:42:54 UTC

Andreas, can you please confirm these two assumptions:

1. the use-case is indeed a disconnected installation

2. this bug is not a blocker for the use-case

Thank you!

Comment 4 Andreas Karis 2020-03-23 11:50:46 UTC

1. the use-case is indeed a disconnected installation

confirmed. but also more generally I'd like to push NFS server information into the bootstrap node so that it's synchronized with the master servers that it creates and connects to 

2. this bug is not a blocker for the use-case

absolutely not a blocker

Thanks!

Comment 5 Pierre Prinetti 2020-05-07 14:28:03 UTC

The team considers this bug as valid. Considering this bug priority and our capacity, we are deferring this bug to an upcoming sprint. If there are reasons for us to reprioritise, please let us know.

Comment 6 Pierre Prinetti 2020-05-14 14:07:58 UTC

Planning on working this in the current sprint.

Comment 9 Pierre Prinetti 2020-06-04 14:17:18 UTC

Considering the priority assigned to this bug and our team capacity, we are deferring this bug to an upcoming sprint. Please let us know if there are reasons for us to reprioritize.

Comment 10 Martin André 2020-06-25 14:31:42 UTC

Considering the priority assigned to this bug and our team capacity, we are deferring this bug to an upcoming sprint. Please let us know if there are reasons for us to reprioritize.

Comment 11 Mike Fedosin 2020-07-01 22:11:59 UTC

Hello! This bug was fixed in 4.5 with this patch: https://github.com/openshift/installer/pull/3329
It was the fix for another another bug, but the cause is the same - we generated metadata after tfvars.
I've tested this issue in ocp 4.5 and couldn't reproduce it. Now all bootstrap.ign modifications are considered before generating tfvars.
Therefore I'm going to close this bug as a duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=1812950

Comment 12 Mike Fedosin 2020-07-01 22:12:22 UTC


*** This bug has been marked as a duplicate of bug 1812950 ***