Bug 1736875

Summary: Ifcfg configuration in Ignition didn't work as expected
Product: OpenShift Container Platform Reporter: Gaoyun Pei <gpei>
Component: RHCOSAssignee: Colin Walters <walters>
Status: CLOSED ERRATA QA Contact: Gaoyun Pei <gpei>
Severity: urgent Docs Contact:
Priority: high    
Version: 4.2.0CC: bbreard, dustymabe, imcleod, jialiu, jligon, nstielau, ratamir, schoudha, scuppett, smilner, wsun, wzheng
Target Milestone: ---Keywords: TestBlocker
Target Release: 4.2.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ocs-bugs@redhat.com Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-10-16 06:34:33 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Gaoyun Pei 2019-08-02 09:11:59 UTC
Description of problem:
With /etc/sysconfig/network-scripts/ifcfg-ens192 file defined in the Ignition file, launch a vm using rhcos-42.80.20190725.1 ovf template.

The Ignition file used:
# cat test_ignition |base64 -d |jq .
{
  "ignition": {
    "config": {
      "append": [
        {
          "source": "data:text/plain;charset=utf-8;base64,eyJpZ25pdGlvbiI6eyJjb25maWciOnsiYXBwZW5kIjpbeyJzb3VyY2UiOiJodHRwczovL2FwaS1pbnQucWUtZ3BlaS10ZXN0NDIucWUuZGV2Y2x1c3Rlci5vcGVuc2hpZnQuY29tOjIyNjIzL2NvbmZpZy93b3JrZXIiLCJ2ZXJpZmljYXRpb24iOnt9fV19LCJzZWN1cml0eSI6eyJ0bHMiOnsiY2VydGlmaWNhdGVBdXRob3JpdGllcyI6W3sic291cmNlIjoiZGF0YTp0ZXh0L3BsYWluO2NoYXJzZXQ9dXRmLTg7YmFzZTY0LExTMHRMUzFDUlVkSlRpQkRSVkpVU1VaSlEwRlVSUzB0TFMwdENrMUpTVVJGUkVORFFXWnBaMEYzU1VKQlowbEpWVmhxWjBKeGFsaDBSakIzUkZGWlNrdHZXa2xvZG1OT1FWRkZURUpSUVhkS2FrVlRUVUpCUjBFeFZVVUtRM2hOU21JelFteGliazV2WVZkYU1FMVNRWGRFWjFsRVZsRlJSRVYzWkhsaU1qa3dURmRPYUUxQ05GaEVWRVUxVFVSbmQwMVVSVEZPUkVreFQwWnZXQXBFVkVrMVRVUmplVTlVUlRGT1JFa3hUMFp2ZDBwcVJWTk5Ra0ZIUVRGVlJVTjRUVXBpTTBKc1ltNU9iMkZYV2pCTlVrRjNSR2RaUkZaUlVVUkZkMlI1Q21JeU9UQk1WMDVvVFVsSlFrbHFRVTVDWjJ0eGFHdHBSemwzTUVKQlVVVkdRVUZQUTBGUk9FRk5TVWxDUTJkTFEwRlJSVUZ2WlU1NmJEWmpkV2s0U1VFS1FVNHpVRllyZVVOQlJubDRaSEp3WldZemVYaFZNVk5uUXk4Mk1HWTBVR1ZrZDFsTWVWVjNZM2xZZEROVVVscEZTMGxSWVc1d2JVNUZZWEIxV1ZVNGJ3cHJWUzlMUzB0WWEyRm1LMEpXTURjemRqTkZNVVZJWkRnMlkzUXdZazVVYTJzMlZHMXhlVlJ1Y1ZOUFJUaEZXVEY0UkRGTk1VNUdURGxXVnk5V1NEazRDazR3YUZkTU5tVnVTVTgwU3l0VFRtTXJVREZzZDJZdmJtbzVWaXRJYlVSVGVtNW9jVlZJV0RseWRtdzBWbkk1VlRFeFVUWnFOVXBISzBwVVZXY3hZM0VLV201Uk5EVm9lVlpRTUhCaVNHcElkV2RoTDJOWWRraE9hR05DYTFSRFVGbHBlV3BpVVdOd1VUZGpRVEpNZEhoblMxVktSRGRsZG1ZemJtYzRRMVJPTWdwNksydHNjM0ZrY1VkbEwwSTRNM05TV2xsVGVYaHJZVGhYZFhvNGRrOW5TREZsWkVOdkt6VlFjQzkyVm5waVJFOU5kVlZMTjJ4emVHTlJkbVZhUlZKV0Ntb3lZbTlIYlhNclNGRkpSRUZSUVVKdk1FbDNVVVJCVDBKblRsWklVVGhDUVdZNFJVSkJUVU5CY1ZGM1JIZFpSRlpTTUZSQlVVZ3ZRa0ZWZDBGM1JVSUtMM3BCWkVKblRsWklVVFJGUm1kUlZVTXhXREYwYW5SRlVtbzFRbnBUUjNOYWRWTlRSVXRvWVZwTmEzZEVVVmxLUzI5YVNXaDJZMDVCVVVWTVFsRkJSQXBuWjBWQ1FVTndOakV6WW10V1pFcDVWekpJZFRoalVVdEZaV3BQTm5GVGFWSXJVV2RXTTB4MFpXRlVOVVpKZWxSTWNHTk5Ra2xvWjBGTFpEY3JOVkIzQ21jck4wdFplVWQzUVhOQlMzY3lZVTE0VUVaeVRXODBjVzl6WjJadlNGSm1TRTEyTVhKV1lpOWhjVFJyYzJwR09VVm9UVTQwZWs5blN6Vk1kbmwyZGtNS2JIRjVRbVY1VEhacU5sZENRMjl0UzI1d1UxWTFMMVYxWlhsNFJqWkdhVTlvUTJoVU9FdFBlWH
BKTjA4clVEbERWVmRHWVVacGFXRldZVFZWZW0xMGJBcGtPRFp6ZDJ4dGMxcHlTV0ZxVVdsVkszcEJiMk5sVUVaSVN6TnFlbGcxV1RBM016RnBXV2hrUkhkaE1WZEJiRFF5VUhCNmFXUk9ZV0paTjJrd2JscGFDbkpHZUU1SmVXeG5iMUpuWkVWNlpWVXdjVWN4ZEdGVVpFVmtZek5JWm14NE1YaHJla1pYWmxGRFZIZEVUMVpCUjNKdGFqa3lOblJyVEhwM1l5dHVObEVLWlVkT2VYVldPVkpvVjNObVV6bFdOV1JSTVdKSlJFdElPWEIzUFFvdExTMHRMVVZPUkNCRFJWSlVTVVpKUTBGVVJTMHRMUzB0Q2c9PSIsInZlcmlmaWNhdGlvbiI6e319XX19LCJ0aW1lb3V0cyI6e30sInZlcnNpb24iOiIyLjIuMCJ9LCJuZXR3b3JrZCI6e30sInBhc3N3ZCI6e30sInN0b3JhZ2UiOnt9LCJzeXN0ZW1kIjp7fX0K",
          "verification": {}
        }
      ]
    },
    "timeouts": {},
    "version": "2.2.0"
  },
  "networkd": {},
  "passwd": {},
  "storage": {
    "files": [
      {
        "filesystem": "root",
        "group": {},
        "path": "/etc/hostname",
        "user": {},
        "contents": {
          "source": "data:text/plain;charset=utf-8;base64,Y29tcHV0ZS1vdmVyd3JpdGUK",
          "verification": {}
        },
        "mode": 420
      },
      {
        "filesystem": "root",
        "group": {},
        "path": "/etc/sysconfig/network-scripts/ifcfg-ens192",
        "user": {},
        "contents": {
          "source": "data:text/plain;charset=utf-8;base64,VFlQRT1FdGhlcm5ldApCT09UUFJPVE89bm9uZQpOQU1FPWVuczE5MgpERVZJQ0U9ZW5zMTkyCk9OQk9PVD15ZXMKSVBBRERSPTEzOS4xNzguNzYuNgpQUkVGSVg9MjYKR0FURVdBWT0xMzkuMTc4Ljc2LjEKRE9NQUlOPXFlLWdwZWktdGVzdDQyLnFlLmRldmNsdXN0ZXIub3BlbnNoaWZ0LmNvbQpETlMxPTguOC44LjgK",
          "verification": {}
        },
        "mode": 420
      }
    ]
  },
  "systemd": {
    "units": [
      {
        "contents": "[Unit]\nConditionFirstBoot=yes\n[Service]\nType=idle\nExecStart=/sbin/reboot\n[Install]\nWantedBy=multi-user.target\n",
        "enabled": true,
        "name": "restart.service"
      }
    ]
  }
}


The content of ifcfg-ens192 above
# echo VFlQRT1FdGhlcm5ldApCT09UUFJPVE89bm9uZQpOQU1FPWVuczE5MgpERVZJQ0U9ZW5zMTkyCk9OQk9PVD15ZXMKSVBBRERSPTEzOS4xNzguNzYuNgpQUkVGSVg9MjYKR0FURVdBWT0xMzkuMTc4Ljc2LjEKRE9NQUlOPXFlLWdwZWktdGVzdDQyLnFlLmRldmNsdXN0ZXIub3BlbnNoaWZ0LmNvbQpETlMxPTguOC44LjgK |base64 -d
TYPE=Ethernet
BOOTPROTO=none
NAME=ens192
DEVICE=ens192
ONBOOT=yes
IPADDR=139.178.76.6
PREFIX=26
GATEWAY=139.178.76.1
DOMAIN=qe-gpei-test42.qe.devcluster.openshift.com
DNS1=8.8.8.8



After vm is running, check the ifcfg-ens192 file, it's not configured as expected.

[core@compute-overwrite ~]$ cat /etc/sysconfig/network-scripts/ifcfg-ens192 
# Generated by dracut initrd
NAME="ens192"
DEVICE="ens192"
ONBOOT=yes
NETBOOT=yes
UUID="856cda07-df52-46b7-bc3e-60abc7fba36f"
IPV6INIT=yes
BOOTPROTO=dhcp
TYPE=Ethernet

The setting for /etc/hostname works.
[core@compute-overwrite ~]$ cat /etc/hostname 
compute-overwrite


Version-Release number of selected component (if applicable):
Build 42.80.20190725.1:
rhcos-42.80.20190725.1-vmware.ova


How reproducible:
Always

Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Compare with rhcos-410.8.20190516.0, no such issue, /etc/sysconfig/network-scripts/ifcfg-ens192 is not pre-existing in image, so ignition could successfully create ifcfg-ens192.

Comment 1 Steve Milner 2019-08-02 13:48:58 UTC
Thank you for the report. We are looking into this.

Comment 3 Johnny Liu 2019-08-02 14:19:10 UTC
Also hit the same issue in rhcos 42.80.20190801.1 image on openstack. Hope could get a quick fix.

Comment 12 Ben Howard 2019-08-05 20:29:08 UTC
Can you post a copy of `cat /proc/cmdline`? We suspect that putting `coreos.no_persist_ip=1` may fix this. Either way, I would like to see a the kernel commandline for an interesting edge case.

Comment 13 Gaoyun Pei 2019-08-06 00:21:44 UTC
On the bootstrap:
[core@bootstrap-0 ~]$ cat /proc/cmdline
BOOT_IMAGE=/ostree/rhcos-529e69b461fac3e465bba244eb757a14ba85d29277018bd01f8336a2640d6521/vmlinuz-4.18.0-80.4.2.el8_0.x86_64 console=tty0 console=ttyS0,115200n8 rootflags=defaults,prjquota rw root=UUID=138ead55-3c06-4d76-95f9-f671ff2ab8ab ostree=/ostree/boot.0/rhcos/529e69b461fac3e465bba244eb757a14ba85d29277018bd01f8336a2640d6521/0 coreos.oem.id=qemu coreos.oem.id=vmware ignition.platform.id=vmware

Comment 16 Ben Howard 2019-08-08 15:54:34 UTC
Can you try by appending `coreos.no_persist_ip=1` to the kernel commandline?

Comment 18 Colin Walters 2019-08-09 13:11:28 UTC
Yeah, there's no easy way for VMWare users to change the initial kernel commandline right now.
The fix for this merged in https://github.com/coreos/ignition-dracut/pull/98
and we're working on getting it into a RHCOS update.

Comment 20 Colin Walters 2019-08-09 18:07:22 UTC
Should be fixed in 42.80.20190809.0

Comment 23 errata-xmlrpc 2019-10-16 06:34:33 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:2922