Description of problem: failed to apply dns nncp on OpenStack platform Version-Release number of selected component (if applicable): % oc version Client Version: 4.10.3 Server Version: 4.11.0-0.nightly-2022-07-21-203245 Kubernetes Version: v1.24.0+9546431 kubernetes-nmstate-operator.4.11.0-202207070244 How reproducible: 100% Steps to Reproduce: 1. apply dns nncp oc apply -f dns-default.yaml --- apiVersion: nmstate.io/v1 kind: NodeNetworkConfigurationPolicy metadata: name: dns-default-w0 spec: nodeSelector: kubernetes.io/hostname: qiowang-07222-4jb4m-worker-0 desiredState: dns-resolver: config: search: - trytest.org server: - 8.8.8.8 interfaces: - name: ens3 type: ethernet state: up ipv4: auto-dns: false dhcp: true enabled: true 2.check the nncp status % oc get nncp NAME STATUS REASON dns-default-w0 Degraded FailedToConfigure qiowang@qiowang-mac nmstate % oc get nnce NAME STATUS REASON qiowang-07222-4jb4m-worker-0.dns-default-w0 Failing FailedToConfigure 3.check /etc/resolv.conf on the relevant node sh-4.4# cat /etc/resolv.conf nameserver 192.168.2.26 nameserver 10.2.32.1 nameserver 10.11.5.19 Actual results: nncp status is Degraded, file /etc/resolv.conf has no change, failed to set dns Expected results: nncp status is Available, dns changes applied to the file /etc/resolv.conf on the relevant node Additional info: ## nns of node worker0 before applying dns nncp: % oc get nns qiowang-07222-4jb4m-worker-0 -oyaml apiVersion: nmstate.io/v1beta1 kind: NodeNetworkState metadata: creationTimestamp: "2022-07-22T14:43:17Z" generation: 1 name: qiowang-07222-4jb4m-worker-0 ownerReferences: - apiVersion: v1 kind: Node name: qiowang-07222-4jb4m-worker-0 uid: b317567a-258b-459c-b936-7d1b5edca64a resourceVersion: "37810" uid: e8482f32-bf88-457a-8923-9e5d05d4754e status: currentState: dns-resolver: config: search: null server: null running: search: [] server: - 10.2.32.1 - 10.11.5.19 interfaces: - accept-all-mac-addresses: false ethtool: feature: highdma: true rx-gro: true rx-gro-list: false rx-udp-gro-forwarding: false tx-checksum-ip-generic: true tx-generic-segmentation: true tx-gre-csum-segmentation: true tx-gre-segmentation: true tx-gso-list: true tx-ipxip4-segmentation: true tx-ipxip6-segmentation: true tx-nocache-copy: false tx-scatter-gather-fraglist: true tx-sctp-segmentation: true tx-tcp-ecn-segmentation: true tx-tcp-mangleid-segmentation: true tx-tcp-segmentation: true tx-tcp6-segmentation: true tx-udp-segmentation: true tx-udp_tnl-csum-segmentation: true tx-udp_tnl-segmentation: true tx-vlan-hw-insert: true tx-vlan-stag-hw-insert: true ipv4: address: [] enabled: false ipv6: address: [] enabled: false mac-address: 86:05:03:E4:12:49 mtu: 1400 name: br0 state: down type: ovs-interface - accept-all-mac-addresses: false ethernet: auto-negotiation: false ethtool: feature: rx-gro: true rx-gro-list: false rx-udp-gro-forwarding: false tx-checksum-ip-generic: true tx-generic-segmentation: true tx-nocache-copy: false tx-tcp-ecn-segmentation: true tx-tcp-mangleid-segmentation: false tx-tcp-segmentation: true tx-tcp6-segmentation: true ring: rx: 512 tx: 256 ipv4: address: - ip: 192.168.0.7 prefix-length: 32 - ip: 192.168.2.26 prefix-length: 18 auto-dns: true auto-gateway: true auto-route-table-id: 0 auto-routes: true dhcp: true enabled: true ipv6: address: - ip: fe80::f39:2671:4fb9:3b93 prefix-length: 64 auto-dns: true auto-gateway: true auto-route-table-id: 0 auto-routes: true autoconf: true dhcp: true enabled: true lldp: enabled: false mac-address: FA:16:3E:41:6D:1C mtu: 1450 name: ens3 state: up type: ethernet - accept-all-mac-addresses: false ethtool: feature: rx-gro: true rx-gro-list: false rx-udp-gro-forwarding: false tx-generic-segmentation: true tx-gso-list: true tx-sctp-segmentation: true tx-tcp-ecn-segmentation: true tx-tcp-mangleid-segmentation: true tx-tcp-segmentation: true tx-tcp6-segmentation: true tx-udp-segmentation: true ipv4: address: - ip: 127.0.0.1 prefix-length: 8 enabled: true ipv6: address: - ip: ::1 prefix-length: 128 enabled: true mac-address: "00:00:00:00:00:00" mtu: 65536 name: lo state: up type: unknown - accept-all-mac-addresses: false ethtool: feature: highdma: true rx-gro: true rx-gro-list: false rx-udp-gro-forwarding: false tx-checksum-ip-generic: true tx-generic-segmentation: true tx-gre-csum-segmentation: true tx-gre-segmentation: true tx-gso-list: true tx-ipxip4-segmentation: true tx-ipxip6-segmentation: true tx-nocache-copy: false tx-scatter-gather-fraglist: true tx-sctp-segmentation: true tx-tcp-ecn-segmentation: true tx-tcp-mangleid-segmentation: true tx-tcp-segmentation: true tx-tcp6-segmentation: true tx-udp-segmentation: true tx-udp_tnl-csum-segmentation: true tx-udp_tnl-segmentation: true tx-vlan-hw-insert: true tx-vlan-stag-hw-insert: true ipv4: address: - ip: 10.131.0.1 prefix-length: 23 enabled: true ipv6: address: - ip: fe80::201e:1bff:fe6a:4e9b prefix-length: 64 enabled: true mac-address: 22:1E:1B:6A:4E:9B mtu: 1400 name: tun0 state: up type: ovs-interface - accept-all-mac-addresses: false ethtool: feature: rx-checksum: true rx-gro: true rx-gro-list: false rx-udp-gro-forwarding: false tx-checksum-ip-generic: true tx-generic-segmentation: true tx-gso-list: true tx-nocache-copy: false tx-scatter-gather-fraglist: true tx-sctp-segmentation: true tx-tcp-ecn-segmentation: true tx-tcp-mangleid-segmentation: true tx-tcp-segmentation: true tx-tcp6-segmentation: true tx-udp-segmentation: true ipv4: address: [] enabled: false ipv6: address: - ip: fe80::fc67:7aff:fe2f:ffae prefix-length: 64 enabled: true mac-address: FE:67:7A:2F:FF:AE mtu: 65000 name: vxlan_sys_4789 state: up type: vxlan vxlan: base-iface: "" destination-port: 4789 id: 0 remote: "" routes: config: - destination: 10.128.0.0/14 metric: 0 next-hop-address: 0.0.0.0 next-hop-interface: tun0 table-id: 254 - destination: 172.30.0.0/16 metric: 0 next-hop-address: 0.0.0.0 next-hop-interface: tun0 table-id: 254 running: - destination: fe80::/64 metric: 256 next-hop-address: '::' next-hop-interface: vxlan_sys_4789 table-id: 254 - destination: fe80::/64 metric: 256 next-hop-address: '::' next-hop-interface: tun0 table-id: 254 - destination: fe80::/64 metric: 1024 next-hop-address: '::' next-hop-interface: ens3 table-id: 254 - destination: 0.0.0.0/0 metric: 100 next-hop-address: 192.168.0.1 next-hop-interface: ens3 table-id: 254 - destination: 10.128.0.0/14 metric: 0 next-hop-address: 0.0.0.0 next-hop-interface: tun0 table-id: 254 - destination: 169.254.169.254/32 metric: 100 next-hop-address: 192.168.0.10 next-hop-interface: ens3 table-id: 254 - destination: 172.30.0.0/16 metric: 0 next-hop-address: 0.0.0.0 next-hop-interface: tun0 table-id: 254 - destination: 192.168.0.0/18 metric: 100 next-hop-address: 0.0.0.0 next-hop-interface: ens3 table-id: 254 handlerNetworkManagerVersion: 1.36.0-7.el8_6 handlerNmstateVersion: 1.2.1 hostNetworkManagerVersion: 1.36.0 lastSuccessfulUpdateTime: "2022-07-22T14:43:17Z" ## nnce of node worker0: % oc get nnce qiowang-07222-4jb4m-worker-0.dns-default-w0 -oyaml apiVersion: nmstate.io/v1beta1 kind: NodeNetworkConfigurationEnactment metadata: creationTimestamp: "2022-07-22T14:51:02Z" generation: 1 labels: nmstate.io/node: qiowang-07222-4jb4m-worker-0 nmstate.io/policy: dns-default-w0 name: qiowang-07222-4jb4m-worker-0.dns-default-w0 ownerReferences: - apiVersion: v1 kind: Node name: qiowang-07222-4jb4m-worker-0 uid: b317567a-258b-459c-b936-7d1b5edca64a resourceVersion: "40690" uid: 30c83c1d-ef13-43f6-8eaf-abe50e2a8625 status: conditions: - lastHeartbeatTime: "2022-07-22T14:51:09Z" lastTransitionTime: "2022-07-22T14:51:09Z" reason: FailedToConfigure status: "False" type: Progressing - lastHeartbeatTime: "2022-07-22T14:51:09Z" lastTransitionTime: "2022-07-22T14:51:09Z" message: | error reconciling NodeNetworkConfigurationPolicy at desired state apply: , missing name servers at 'dns-resolver.running.server' on {"dns-resolver":{"config":{},"running":{}},"interfaces":[{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-gro":true,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"tx-checksum-ip-generic":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[],"enabled":false},"mac-address":"86:05:03:E4:12:49","mtu":1400,"name":"br0","state":"down","type":"ovs-interface"},{"accept-all-mac-addresses":false,"ethernet":{"auto-negotiation":false},"ethtool":{"feature":{"rx-gro":true,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"tx-checksum-ip-generic":true,"tx-generic-segmentation":true,"tx-nocache-copy":false,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":false,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true},"ring":{"rx":512,"tx":256}},"ipv4":{"address":[{"ip":"192.168.2.26","prefix-length":18}],"dhcp":true,"enabled":true},"ipv6":{"address":[{"ip":"fe80::f39:2671:4fb9:3b93","prefix-length":64}],"enabled":true},"lldp":{"enabled":false},"mac-address":"FA:16:3E:41:6D:1C","mtu":1450,"name":"ens3","state":"up","type":"ethernet"},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"rx-gro":true,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"tx-generic-segmentation":true,"tx-gso-list":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true}},"ipv4":{"address":[{"ip":"127.0.0.1","prefix-length":8}],"enabled":true},"ipv6":{"address":[{"ip":"::1","prefix-length":128}],"enabled":true},"mac-address":"00:00:00:00:00:00","mtu":65536,"name":"lo","state":"up","type":"unknown"},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-gro":true,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"tx-checksum-ip-generic":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[{"ip":"10.131.0.1","prefix-length":23}],"enabled":true},"ipv6":{"address":[{"ip":"fe80::201e:1bff:fe6a:4e9b","prefix-length":64}],"enabled":true},"mac-address":"22:1E:1B:6A:4E:9B","mtu":1400,"name":"tun0","state":"up","type":"ovs-interface"},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-checksum":true,"rx-gro":false,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"rx-vlan-hw-parse":true,"rx-vlan-stag-hw-parse":true,"tx-checksum-ip-generic":true,"tx-checksum-sctp":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::c80a:3dff:fe45:d56","prefix-length":64}],"enabled":true},"mac-address":"CA:0A:3D:45:0D:56","mtu":1400,"name":"vethaee4576f","state":"up","type":"veth","veth":{"peer":"ovs-system"}},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-checksum":true,"rx-gro":false,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"rx-vlan-hw-parse":true,"rx-vlan-stag-hw-parse":true,"tx-checksum-ip-generic":true,"tx-checksum-sctp":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::c835:e0ff:fe1b:cd06","prefix-length":64}],"enabled":true},"mac-address":"CA:35:E0:1B:CD:06","mtu":1400,"name":"vethb2884707","state":"up","type":"veth","veth":{"peer":"ovs-system"}},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-checksum":true,"rx-gro":false,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"rx-vlan-hw-parse":true,"rx-vlan-stag-hw-parse":true,"tx-checksum-ip-generic":true,"tx-checksum-sctp":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::e47e:e2ff:fe1b:ace2","prefix-length":64}],"enabled":true},"mac-address":"E6:7E:E2:1B:AC:E2","mtu":1400,"name":"vethb2c35954","state":"up","type":"veth","veth":{"peer":"ovs-system"}},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-checksum":true,"rx-gro":false,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"rx-vlan-hw-parse":true,"rx-vlan-stag-hw-parse":true,"tx-checksum-ip-generic":true,"tx-checksum-sctp":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::540d:d5ff:fef3:8cb8","prefix-length":64}],"enabled":true},"mac-address":"56:0D:D5:F3:8C:B8","mtu":1400,"name":"vethc497a8ad","state":"up","type":"veth","veth":{"peer":"ovs-system"}},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-checksum":true,"rx-gro":false,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"rx-vlan-hw-parse":true,"rx-vlan-stag-hw-parse":true,"tx-checksum-ip-generic":true,"tx-checksum-sctp":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::68e8:87ff:fef5:3592","prefix-length":64}],"enabled":true},"mac-address":"6A:E8:87:F5:35:92","mtu":1400,"name":"vethc5ee6912","state":"up","type":"veth","veth":{"peer":"ovs-system"}},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-checksum":true,"rx-gro":false,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"rx-vlan-hw-parse":true,"rx-vlan-stag-hw-parse":true,"tx-checksum-ip-generic":true,"tx-checksum-sctp":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::6093:b2ff:fe33:928e","prefix-length":64}],"enabled":true},"mac-address":"62:93:B2:33:92:8E","mtu":1400,"name":"vethcf661e1a","state":"up","type":"veth","veth":{"peer":"ovs-system"}},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-checksum":true,"rx-gro":false,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"rx-vlan-hw-parse":true,"rx-vlan-stag-hw-parse":true,"tx-checksum-ip-generic":true,"tx-checksum-sctp":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::2829:3eff:fe4a:346e","prefix-length":64}],"enabled":true},"mac-address":"2A:29:3E:4A:34:6E","mtu":1400,"name":"vethe07d01bf","state":"up","type":"veth","veth":{"peer":"ovs-system"}},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-checksum":true,"rx-gro":false,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"rx-vlan-hw-parse":true,"rx-vlan-stag-hw-parse":true,"tx-checksum-ip-generic":true,"tx-checksum-sctp":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::7800:29ff:fef4:6ebd","prefix-length":64}],"enabled":true},"mac-address":"7A:00:29:F4:6E:BD","mtu":1400,"name":"vethe29fd7d4","state":"up","type":"veth","veth":{"peer":"ovs-system"}},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-checksum":true,"rx-gro":false,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"rx-vlan-hw-parse":true,"rx-vlan-stag-hw-parse":true,"tx-checksum-ip-generic":true,"tx-checksum-sctp":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::a893:4bff:fea3:aef2","prefix-length":64}],"enabled":true},"mac-address":"AA:93:4B:A3:AE:F2","mtu":1400,"name":"vethe3dca6b3","state":"up","type":"veth","veth":{"peer":"ovs-system"}},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"highdma":true,"rx-checksum":true,"rx-gro":false,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"rx-vlan-hw-parse":true,"rx-vlan-stag-hw-parse":true,"tx-checksum-ip-generic":true,"tx-checksum-sctp":true,"tx-generic-segmentation":true,"tx-gre-csum-segmentation":true,"tx-gre-segmentation":true,"tx-gso-list":true,"tx-ipxip4-segmentation":true,"tx-ipxip6-segmentation":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true,"tx-udp_tnl-csum-segmentation":true,"tx-udp_tnl-segmentation":true,"tx-vlan-hw-insert":true,"tx-vlan-stag-hw-insert":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::ec86:dbff:fecf:1587","prefix-length":64}],"enabled":true},"mac-address":"EE:86:DB:CF:15:87","mtu":1400,"name":"vethf89d9c43","state":"up","type":"veth","veth":{"peer":"ovs-system"}},{"accept-all-mac-addresses":false,"ethtool":{"feature":{"rx-checksum":true,"rx-gro":true,"rx-gro-list":false,"rx-udp-gro-forwarding":false,"tx-checksum-ip-generic":true,"tx-generic-segmentation":true,"tx-gso-list":true,"tx-nocache-copy":false,"tx-scatter-gather-fraglist":true,"tx-sctp-segmentation":true,"tx-tcp-ecn-segmentation":true,"tx-tcp-mangleid-segmentation":true,"tx-tcp-segmentation":true,"tx-tcp6-segmentation":true,"tx-udp-segmentation":true}},"ipv4":{"address":[],"enabled":false},"ipv6":{"address":[{"ip":"fe80::fc67:7aff:fe2f:ffae","prefix-length":64}],"enabled":true},"mac-address":"FE:67:7A:2F:FF:AE","mtu":65000,"name":"vxlan_sys_4789","state":"up","type":"vxlan","vxlan":{"base-iface":"","destination-port":4789,"id":0,"remote":""}}],"route-rules":{"config":[]},"routes":{"config":[{"destination":"10.128.0.0/14","metric":0,"next-hop-address":"0.0.0.0","next-hop-interface":"tun0","table-id":254},{"destination":"172.30.0.0/16","metric":0,"next-hop-address":"0.0.0.0","next-hop-interface":"tun0","table-id":254}],"running":[{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vxlan_sys_4789","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"tun0","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vethe07d01bf","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vethe29fd7d4","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vethaee4576f","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vethe3dca6b3","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vethf89d9c43","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vethb2884707","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vethc5ee6912","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vethcf661e1a","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vethb2c35954","table-id":254},{"destination":"fe80::/64","metric":256,"next-hop-address":"::","next-hop-interface":"vethc497a8ad","table-id":254},{"destination":"fe80::/64","metric":1024,"next-hop-address":"::","next-hop-interface":"ens3","table-id":254},{"destination":"0.0.0.0/0","metric":100,"next-hop-address":"192.168.0.1","next-hop-interface":"ens3","table-id":254},{"destination":"10.128.0.0/14","metric":0,"next-hop-address":"0.0.0.0","next-hop-interface":"tun0","table-id":254},{"destination":"169.254.169.254/32","metric":100,"next-hop-address":"192.168.0.10","next-hop-interface":"ens3","table-id":254},{"destination":"172.30.0.0/16","metric":0,"next-hop-address":"0.0.0.0","next-hop-interface":"tun0","table-id":254},{"destination":"192.168.0.0/18","metric":100,"next-hop-address":"0.0.0.0","next-hop-interface":"ens3","table-id":254}]}} messageEncoded: H4sIAAAAAAAA/+ydXW+jutbH7/spLN/0JqS8h6yLI3Vm2sujRzqXo2qLgNOioRABmXZU5bs/4t1gkxCaJtl7L+0tdYKNl03W+tlJvP5mSRInJGFeHHlBGETP5L+xz/7Lsrc4+fU9jtbB8zZxsyCO/i8OA+8PcTPiszRImE/SzM0YcTeb8A+Q2Q1J4rBoYeV6v3qVPL4lIGs3CJlPkm0UBc9kk8QrlhJ3nbGERKVp4r240TNLpXXJrR+lt+QtyF56dxUDaS0R5T/E2yYJi7L/5f0AoijKjR+lSsLSOPzNErghVeeAfOxuSGknKl8l8TZjSrINWcrX+/lUlvAXbwhR8jFnQVSNUVPnmu7M1bl6p5k3hBDyyrIk8ICoxauIvWfKS7xRXN9PWJoCUefFf93SIMpYsnY9BiTbRmVh5q5CpgQ+EN0yJZYX+txQS8v211qun5bYiTVzVIA7uzt03bIHunALcDto//d76EZ/pX/Sv8yFsxzzDE5qfuyDP+2YWfbC1IWvaqv1ZYzry7W/8M2LGHcZM62FfaGRG77n2ivjIsbXztJfeuZljK90xzEX6uIixj2LMXup6ZcxvrZtjWnuhR67Z1hL6zKh5pnLheu4/nTjmqqbU6yzKB3l5tX0dKf2rA5NZ9pSn2t2Pvdqn7Z9wWncXs51y5xXf+8M/fjhD/di9PjPt5joW26God5pzsixHzI+MOymRgo3ConcVwZkleTNZH82DEj8O21buSHlqhaIH79FN4S4nsc2meKGofLqenVnysVrmOb1WfaSxXEIhek1c7NtwsoXhLwEzy/+qwskS7asupa8K89JLLmkhEGate1WBVt/UxSu4+TNTfxi/cpXyd4V74V5v9LtqxJslGcWseI5cs1n7/VlJWXPryzKqrehVydhipc3c6jS3vK0Hkf3erB5Dzbm3luLKvbeKlHsud4LU7x480d4DKnnZhlLlGc3e2GJsk7cZ1lPUi/b7DWSeRuFedHBOq9u9ByywD9Y8UD5/iHn7/+B8r+yKDz8ztUV99X5HbqR8vKmBFHKEuHJFaVp5j5LqgSb32bp9SzKw8/n354mhH8+lVXtkVW5kAPi2KBaoBrwYIKmg5l/WHjNtkA0U1Wb0K4oUMZ2vuBLIpa1Yb3djA3q4sayn+42i5WIPcdZ0HzKPRz8Vxvoe6Pok94vaW2q+yfVp8/y+QCxquVjfmO9KpK4XXN/7TjFC4UEm3be0ee6XbW1Sdg6eFdCFj1nL0Cq2ch/8Ta8b/cddp+RciG1djQbDLZew5qZGti+5sktFguuMPQ3AzHRiYHHe8ibfYC8yR+gfW9jwGpjIIybCNhGv6JyJjs6AM7o2KOmp4GZ5Z/C82NdWV8U6yFN7lXO8X4LMNCWpjt9P1RV6P5f+6FtWYbdOGK1Hty70DqBQ+Iyq76Oy6x/3TJrLyTUuWZow5TQjanTm65qDLRVMb3ZLphsudozvXXYoeugPYD2Dex7MB9g+U26jut9U1giJL94DnLUoS4lSo8ck5GStI6wcZOU9Y11/ECsMY5ITZU8HhFXiKtL4+qIT4WHKeQ5qguGXy6yLfCtgVW9CKHv96Deg/EDTAvUH1Dc2EKIFKQp7W0YS8rFS/onzdhrh1Dcl+pIKCQUEgoJ1SeUYQFTC0JpK/B89RhEGRY8qPlS6fsPUCcjqvkBChGFiEJEIaK6iGLmggHTa0S5HtPHIurBhsUDPOg5ou6/w4M+DVHcz9SIKEQUIgoR1UWUZao++FaBqLUBjrdyxiLKsvPPdz8seDTA+Q7fnImIajcwIaIQUYgoRFQXUbbDHHAWJaIsMKzl6FWUfQ8P+b3wmN8Hy6mrqHabIyIKEYWIQkT1EKUuDViVH/QMA5a6w0YjSoelAd90KO4D52EaorikB0QUIgoRhYjqbStw9GWza84Fw7RHI0q/h/zeBzDvwTDBnoqoNjUKEYWIQkQhorqIWjiqCvqy/KBngs1W/lhELe6huBcecz7Btx8TEdXmMCKiEFGIKERUF1GuszTALDdnuga4bD36u6j7+/yDnvkN7g24f4DHid9FcZnOiChEFCIKEdXbdOA5Nvglorw1aJazGIuohwdwbPjxDb4/gmZBceOxiOqLjlSQyi+fOlVqL5GESxfPThmId4zU6GyxsfbsBSzcIjb0NazX7ugvQR4fIL/3HvRHeHyE+4c2L0stgyN38dLkyk2ZEpS587elkgOXpK9s4hwHjShP4NeyAAl7jbPyHiCvQZoG0XMRVyRlyW+WpMTNChmnRolpXmkJzcsKtySOyAfla1D4oKXcEoWP3YxWN+QvdjPapvBT+PlBh0KSQvE2zGgVkXmjVTzm/6xWDBTyd2BGy3jrvipcv2lGGnhNqTzm6vYGwo0vlk3PvfKhorTuaXNJMh/3S+2hUj62+eENhDV3pxDRXJksmHvF0jju1RkuGhxPP3C7RfLZVVJnoLg7p/YLutNpWVq48Oa3mTth5awUfj7NaMWE6pmXtezDtTinp0CFtHg6o6/ZlkI+Hc5oHpgU6CpR6YwWExsF6sdvEZ3RfNajQDuJmXQ3GxdhRX580dlednzbUXkcXjrwhtx9usN22zjOY3PYlaSjyTsFS9Pz2hR0y5b7zQcNNhRoK6GyoDPamRgoGHr+Lnbq6XPdFitqzu5pRv0Xb1P3tPG2qnOiS1YND6a5i1Zsc/ckthyG/iZv+YB/CynvrX9brX+zKDU4B99uWvdufHWsZ3+Nzx6aDkSm/53out9X61x10TUcmWcM+hyApAlNlzbS9SIhYb32oiJhvXGjMB5wokpH4TM+hOsPXH9c0fqjjs0mRVyMLN04KjoHM8PHzgjdkBXyxKULm2wbqQMxO21dMypy68jrB3MbuUdGc/8rRa5h8dtE7k3fj4DOd4iIBkTDKT+adKJezMSeFvRCXrY06HlxiIHgz6vQWfkHPuiGsaRCQvldIN0hEBAICISvA4KQ+DyZCN006EEi1GIMSAQkAhLh6oggyTOeRgQh63gPEUrtAyQCEgGJcHVEkKT1TiOCkOQ7SIRaagCJgERAIlwdESRZtNOIIOTUDhOhyuxHIiARkAjXRwQxaXUiEfoprMNEqBLpkQhIBCTC1RFBkiM68QfGfsboIBHqvHUkAhIBiXB1RJCkZE4jgpCgOUyEKk0ciYBEQCJcHREkGZDTiCDkQw4TocrKRiIgEZAIV0cEScLhxF8f++mHg0Sok6AvQYQ9COBfnXXDsRh5/47oOZkPSxIDp/mwkCbY7oZXeSfupMkOuXFeKffj4i980DavkAKlM9pPKqSQtzajgU9BndEynTCvuss7nsTbjCnJNsxdvE0K/Pm0q8q6lz/45qvtzM2ZzvmoimOFC0P9E4Up0OpIYcoVthuGm73F9XnCFHTLzGOyZ5I/RvlLTD5xCZHCiJtzuznTumVLjQMM2RXe6gODPo3VcQ/4RCPsfo9zPpvtJ8Wz2eT2xp5vnO3692w2uRn2bDa5XYZns8n9Rnk+m+2vIGd8ts1+rfONs90RMsGmpurmkUarVMUDxqp54k7tGJPPKW0uqPY5o5eYPe3lXLfMefX3ztCPG/Cg+ZEj/vLJWzTZdF6905wRoz1gVTrQp90OyNoNQuaTau1ANkm8Yilx1xlLSBKH4cr1fnVrVZUK+YZb8hZkL1X1iGVvcfKLJKxcem2TYjhE+Q/xtknCoux/pWiKoig3vLID3BBS3gLkY3dD6t4Ur7jFHl/v51NZwl+8IUTh9SnKw00bZy2UKcoHWetU9J8kkOpBdkubR9kcV0xI/SyB6MXBWX3LvNN8reX6aYmdaGjU6YBeHYEoduEW4HbQviCIc/AZnNT82Ad/2jF3BakvYLyVmj2/ce5s3QuMvFWwPL9xTpvu/Ma5A0PPb5w7xOYCxtvjKS7x2JtDEC8w8vZ4s4nG81XmFOv50mCM1Wax2bM6NJ1x669P277gNC4sPY8f/nAvRo//fIuJvuXOQnTk2A8ZHxh2K+EFjQrfKlEb6b1Orn4rwefHb9FXSYVeqQAfqnb+nbQAyT9ItXOoakdhUJAb66hv1qFdUaCM7VqAaYqyZnFj2c++zthoBc7rDPS9UfRJ75e0NtX9k+rTZ/l8gFia3txYr4okbpftUbnkJcmqtnrCltVs5L94G963J0hpGkvQ7YUG5nq1BGO1NOQGi/VWGPqbgZDoimz2FcnaELDaEAjjJgAq8ahTK8ue2K8/Iw/7T8H5sZ5cC5vJvco53m0BBtrSdKfvh4KmWSv2ahl244jVcnDvOuvrBNmvE764yvpbhSW59lXWXkg0CmvyyNaNyadliVJre6a37mlZfXE16TKu90UhHuWARzkgrv4BuDqpXL0o/TYWQoLY27TDZrjv1JFQSCgkFBKqTyhBi+4IRHXV56Yiqvn9CRGFiEJEIaJ652GJ4nhjESXI4U1DFPcrNSIKEYWIQkR1ESVR6xuLKEGfbyKi2v1LiChEFCIKEdVFlEQ+cCyiBMHAiYhqdzkiohBRiChEVA9Rop7haET1FQynIYrLeUBEIaIQUYio3rYCUWBxLKIEScWJiGozoxBRiChEFCKqiyiJ4uNYRAkajxMR1aYwIqIQUYgoRFQXURIJyrGIEkQnpyGKS3RGRCGiEFGIqN6mA1ETcyyiBBXMCYjqa45UkMovnzpVai+RhEsXz04ZiHeM1OhssSHR2hwbG4K6ZpuXpZbBkbt4abIVywRyWwo59PUygTSaPIFfqwKUqpnFPUBegzQNoucirkjKkt8sSYmbFSpOjRDTvJISmpcVbkkckQ/K1+CFNT92nObkR6Fg2mTwFyKUJ1OqvqwmLQpJo5D0QRFeWa2uoK6QFS8VhV4lKiei68dvUSuj20nMpGOVn4v0+KKzveT4tqOD+tAXDbwhd5/usN02jvPYHHYl6WjyTsHS9Lx2oSgp95tKlpnPZBeVmDVn9zSj/ovXKNv3VZkP6T0L2etj5Z7D0N/kDR9wWyGTvXVbq3XbSmBQJv7cuODnpMo/64rHK4//naC53wXrFHTRNRyZZwy6HICkCU2XNtL1IiEPvVUTtwy7caMwHnCiSh7hMz6EywpcVlzRsqKOzSbzW4ws3TgqOgcTvicefddP/5auVyo9W1nMTluu4NE1iIZ/ORomHPshJlhPC3oh3Xrw5Bru/AA8ywqBgEC4NiAI+cyTidDNbh4kAnfqBRIBiYBEuC4iSNKHJ55u108m3kOE5qwWJAISAYlwXUSQZOtOI4KQuztIBO4kJSQCEgGJcF1EkCTHTiOCkCo7TIT23DokAhIBiXBlRBBzUScSoZ+ZOkyE9lRJJAISAYlwXUSQpH5O/IGxnwg6SATuTGYkAhIBiXBdRJBkWk4jgpB3OUyE9sR0JAISAYlwXUSQJDZOI4KQ5jhMhCrZGomAREAiXB0RJHmEE3997GcVDhKhzm2+BBH2IIB/ddYNx2Lk/Tui52Q+LMn3m+bDQvZfuxte5Z24k/065MZ5pdyPi7/wQdt0QQqUzmg/V5BC3tqMBj4FdUbLLMG86i7veBJvM6Yk2zB38TbX7+fTrirrXv7gm6+2MzcnNeejKg4LLgz1zwmmQKuDgilX2G4YbvYW16cEU9AtM4/Jnkn+cOQvMfnE5TkKI25O4+ZM65YtNQ4wZFd4qw8M+jRWxz3gE42w+z3O+Wy2nxTPZpPbG3u+cbbr37PZ5GbYs9nkdhmezSb3G+X5bLa/gpzx2Tb7tc43znZHyASbmqqbRxqtUhUPGKvmiTu1Y0w+p3Bn/X/O6CVmT3s51y1zXv29M/TjBjxofuSIv3zyFk02nVfvNGfEaA9YlQ70abf7/wAAAP//WPCcflwXAQA= reason: FailedToConfigure status: "True" type: Failing - lastHeartbeatTime: "2022-07-22T14:51:09Z" lastTransitionTime: "2022-07-22T14:51:09Z" reason: FailedToConfigure status: "False" type: Available - lastHeartbeatTime: "2022-07-22T14:51:09Z" lastTransitionTime: "2022-07-22T14:51:02Z" reason: FailedToConfigure status: "False" type: Pending - lastHeartbeatTime: "2022-07-22T14:51:09Z" lastTransitionTime: "2022-07-22T14:51:02Z" reason: SuccessfullyConfigured status: "False" type: Aborted desiredState: dns-resolver: config: search: - trytest.org server: - 8.8.8.8 interfaces: - ipv4: auto-dns: false dhcp: true enabled: true name: ens3 state: up type: ethernet desiredStateMetaInfo: time: "2022-07-22T14:51:02Z" version: "0" policyGeneration: 1
Found similar issue on vsphere platform. % oc version Client Version: 4.10.3 Server Version: 4.12.0-0.nightly-2022-09-19-200722 Kubernetes Version: v1.24.0+07c9eb7 csv: kubernetes-nmstate-operator.4.12.0-202209162207 % oc get nncp NAME STATUS REASON dns-default-w2 Degraded FailedToConfigure % oc get nnce qiowang-09205-cx28r-worker-n626s.dns-default-w2 -oyaml apiVersion: nmstate.io/v1beta1 kind: NodeNetworkConfigurationEnactment metadata: creationTimestamp: "2022-09-20T15:41:14Z" generation: 1 labels: nmstate.io/node: qiowang-09205-cx28r-worker-n626s nmstate.io/policy: dns-default-w2 name: qiowang-09205-cx28r-worker-n626s.dns-default-w2 ownerReferences: - apiVersion: v1 kind: Node name: qiowang-09205-cx28r-worker-n626s uid: 6138e9e6-c0f1-4ddb-8c3a-0c7d9d28230a resourceVersion: "201865" uid: a2cba544-261e-4d9f-89fc-60077c3dfaa0 status: conditions: - lastHeartbeatTime: "2022-09-20T15:41:23Z" lastTransitionTime: "2022-09-20T15:41:23Z" reason: FailedToConfigure status: "False" type: Progressing - lastHeartbeatTime: "2022-09-20T15:41:23Z" lastTransitionTime: "2022-09-20T15:41:23Z" message: | error reconciling NodeNetworkConfigurationPolicy at desired state apply: , missing name servers at 'dns-resolver.running.server' on {"dns-resolver":{"config":{},"running":{}}... ... ... ... desiredState: dns-resolver: config: search: - trytest.org server: - 8.8.8.8 interfaces: - ipv4: auto-dns: false dhcp: true enabled: true name: ens192 state: up type: ethernet Try similar steps as Comment8: Patched and rebooted the node with the new rpms(https://brewweb.engineering.redhat.com/brew/buildinfo?buildID=2086775). Waited until node was back and nnce was applied successfully on this node: % oc get nncp NAME STATUS REASON dns-default-w2 Available SuccessfullyConfigured
*** Bug 2105069 has been marked as a duplicate of this bug. ***
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Moderate: OpenShift Container Platform 4.12.0 bug fix and security update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2022:7399
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days