Bug 1809018 - [OCP 4.2] metadata.annotations: Too long: must have at most 262144 characters
Summary: [OCP 4.2] metadata.annotations: Too long: must have at most 262144 characters
Keywords:
Status: CLOSED DUPLICATE of bug 1792914
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Machine Config Operator
Version: 4.2.z
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: ---
Assignee: Antonio Murdaca
QA Contact: Michael Nguyen
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-03-02 09:42 UTC by Mario Abajo
Modified: 2023-09-07 22:08 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-03-04 13:44:23 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)

Description Mario Abajo 2020-03-02 09:42:32 UTC
Description of problem:
Machine-config-daemon refuses to run because of the following error:
E0301 12:58:27.535629 3165818 writer.go:127] Marking Degraded due to: machineconfiguration.openshift.io/desiredConfig annotation not found in &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name: .......
E0301 16:08:36.224319 3165818 writer.go:142] Error setting Degraded annotation for node <<node>>: unable to update node "&Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:,DoNotUse_ExternalID:,ProviderID:,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{},Allocatable:ResourceList{},Phase:,Conditions:[],Addresses:[],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:0,},},NodeInfo:NodeSystemInfo{MachineID:,SystemUUID:,BootID:,KernelVersion:,OSImage:,ContainerRuntimeVersion:,KubeletVersion:,KubeProxyVersion:,OperatingSystem:,Architecture:,},Images:[],VolumesInUse:[],VolumesAttached:[],Config:nil,},}": Node "<<node>>" is invalid: metadata.annotations: Too long: must have at most 262144 characters

Inside the nodes definitions (not all of them) the field "machineconfiguration.openshift.io/reason" is unexpectedly big (attaching file).

The problem is why is this field filled with so much data?

Version-Release number of selected component (if applicable):
4.2.8

How reproducible:
Not yet tested in lab, but i think that what triggers this is an edition of the file "/etc/containers/registries.conf" outside of the cluster scope (manual editing). But restoring the file is not enough as the daemon refuses to work with such a big metadata field.


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:
"machineconfiguration.openshift.io/reason" field having a manageable size.

Additional info:
Attaching some files

Comment 2 Mario Abajo 2020-03-02 10:15:48 UTC
I used this command to clean the "machineconfiguration.openshift.io/reason" field:

$ oc patch node <node> --type merge --patch '{"metadata": {"annotations": {"machineconfiguration.openshift.io/reason": ""}}}'


Note You need to log in before you can comment on or make changes to this bug.