Bug 1949957

Summary: [cephadm] 5.0 - Ceph orch upgrade check command shows need update for monitoring stack daemons which do not depend on ceph image for upgrade
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Preethi <pnataraj>
Component: CephadmAssignee: Adam King <adking>
Status: CLOSED ERRATA QA Contact: Vasishta <vashastr>
Severity: high Docs Contact: Karen Norteman <knortema>
Priority: high    
Version: 5.0CC: adking, jolmomar, kdreyer, sewagner, tserlin, vereddy
Target Milestone: ---   
Target Release: 5.0   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: ceph-16.2.0-20.el8cp Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-08-30 08:29:49 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Preethi 2021-04-15 13:27:15 UTC
Description of problem:[cephadm] 5.0 - Ceph orch upgrade check command shows need update for monitoring stack daemons which do not depend on ceph image for upgrade


Version-Release number of selected component (if applicable):

Using recent ceph image registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:da1af73dc9e5c3061975c6bb37badf0990cc555e0c9ecf705b0ec4cd2c137294
ceph version 16.2.0-10.el8cp (e84b678f68605de54156f957685d0b7fee77ddf8) pacific (stable)


How reproducible:


Steps to Reproduce:
1. Perform build upgrade to latest version 
using "ceph orch upgrade start --image <image name>
2. Check ceph orch upgrade status
3. We see upgrade completes in Ceph orch upgrade status but in Ceph orch upgrade check --image <image name> command we see needs_update for the monitoring stack daemons which do not depend on ceph images for upgrade. 


Actual output:

[ceph: root@ceph-5x-build-1618473165973-node1-mon-mgr-installer-node-export /]# ceph orch upgrade check --image registry-proxy.engineering.redhat.com/rh-osbs/rhceph:ceph-5.0-rhel-8-containers-candidate-55227-20210414224300
{
    "needs_update": {
        "alertmanager.ceph-5x-build-1618473165973-node1-mon-mgr-installer-node-export": {
            "current_id": "a6d8bb89b5e4e0b4903431dffd1961702ab74ba5168b8af184122e22bf0cbfc7",
            "current_name": "registry.redhat.io/openshift4/ose-prometheus-alertmanager:v4.5",
            "current_version": "0.20.0"
        },
        "grafana.ceph-5x-build-1618473165973-node1-mon-mgr-installer-node-export": {
            "current_id": "11da1f9bfab5f6e7fffe94c0e2813128464c1d1a142117c88a183d2e5ac348af",
            "current_name": "registry.redhat.io/rhceph-beta/rhceph-5-dashboard-rhel8:latest",
            "current_version": "6.7.4"
        },
        "node-exporter.ceph-5x-build-1618473165973-node1-mon-mgr-installer-node-export": {
            "current_id": "8846086cd87ba11094ca84360a90a3656785ac9453210474935cabde2a830e7e",
            "current_name": "registry.redhat.io/openshift4/ose-prometheus-node-exporter:v4.5",
            "current_version": "0.18.1"
        },
        "node-exporter.ceph-5x-build-1618473165973-node2-mon-mds-node-exporter-alertma": {
            "current_id": "8846086cd87ba11094ca84360a90a3656785ac9453210474935cabde2a830e7e",
            "current_name": "registry.redhat.io/openshift4/ose-prometheus-node-exporter:v4.5",
            "current_version": "0.18.1"
        },
        "node-exporter.ceph-5x-build-1618473165973-node3-osd-node-exporter-crash": {
            "current_id": "8846086cd87ba11094ca84360a90a3656785ac9453210474935cabde2a830e7e",
            "current_name": "registry.redhat.io/openshift4/ose-prometheus-node-exporter:v4.5",
            "current_version": "0.18.1"
        },
        "node-exporter.ceph-5x-build-1618473165973-node4-osd-node-exporter-crash": {
            "current_id": "8846086cd87ba11094ca84360a90a3656785ac9453210474935cabde2a830e7e",
            "current_name": "registry.redhat.io/openshift4/ose-prometheus-node-exporter:v4.5",
            "current_version": "0.18.1"
        },
        "node-exporter.ceph-5x-build-1618473165973-node5-osd-node-exporter-crash": {
            "current_id": "8846086cd87ba11094ca84360a90a3656785ac9453210474935cabde2a830e7e",
            "current_name": "registry.redhat.io/openshift4/ose-prometheus-node-exporter:v4.5",
            "current_version": "0.18.1"
        },
        "node-exporter.ceph-5x-build-1618473165973-node6-mon-rgw-node-exporter-crash": {
            "current_id": "8846086cd87ba11094ca84360a90a3656785ac9453210474935cabde2a830e7e",
            "current_name": "registry.redhat.io/openshift4/ose-prometheus-node-exporter:v4.5",
            "current_version": "0.18.1"
        },
        "node-exporter.ceph-5x-build-1618473165973-node7-rgw-node-exporter-crash": {
            "current_id": "8846086cd87ba11094ca84360a90a3656785ac9453210474935cabde2a830e7e",
            "current_name": "registry.redhat.io/openshift4/ose-prometheus-node-exporter:v4.5",
            "current_version": "0.18.1"
        },
        "node-exporter.ceph-5x-build-1618473165973-node8-nfs-node-exporter-iscsi-crash": {
            "current_id": "8846086cd87ba11094ca84360a90a3656785ac9453210474935cabde2a830e7e",
            "current_name": "registry.redhat.io/openshift4/ose-prometheus-node-exporter:v4.5",
            "current_version": "0.18.1"
        },
        "prometheus.ceph-5x-build-1618473165973-node1-mon-mgr-installer-node-export": {
            "current_id": "c1f3defdd8fdb40a4a46554d06f7d5cfe30d617b75a973b620168a8d4cb34ab6",
            "current_name": "registry.redhat.io/openshift4/ose-prometheus:v4.6",
            "current_version": "2.22.2"
        }
    },
    "target_digest": "registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:ac082e8a9ff15a6da6f483cfcf1df5e1f47bfe7c3cc8baa54c091d4a1982c102",
    "target_id": "7edc9396ced6c87ba01efc27913f43a13c640dcab5e2087cca63202ee58c24bc",
    "target_name": "registry-proxy.engineering.redhat.com/rh-osbs/rhceph:ceph-5.0-rhel-8-containers-candidate-55227-20210414224300",
    "target_version": "ceph version 16.2.0-10.el8cp (e84b678f68605de54156f957685d0b7fee77ddf8) pacific (stable)",
    "up_to_date": [
        "mon.ceph-5x-build-1618473165973-node1-mon-mgr-installer-node-export",
        "mgr.ceph-5x-build-1618473165973-node1-mon-mgr-installer-node-export.fnbebd",
        "mon.ceph-5x-build-1618473165973-node2-mon-mds-node-exporter-alertma",
        "mds.cephfs.ceph-5x-build-1618473165973-node2-mon-mds-node-exporter-alertma.pbhjfd",
        "mgr.ceph-5x-build-1618473165973-node2-mon-mds-node-exporter-alertma.pfeyvw",
        "osd.11",
        "osd.2",
        "osd.4",
        "osd.8",
        "osd.1",
        "osd.10",
        "osd.5",
        "osd.7",
        "osd.0",
        "osd.3",
        "osd.6",
        "osd.9",
        "mon.ceph-5x-build-1618473165973-node6-mon-rgw-node-exporter-crash",
        "mds.cephfs.ceph-5x-build-1618473165973-node8-nfs-node-exporter-iscsi-crash.bojfnd"
    ]
}





Expected results: We should not see needs_update attribute for monitoring stack daemons which is not depending on ceph images


Additional info:
magna004
cephuser.208.40
password : cephuser

Comment 1 Adam King 2021-04-20 14:10:54 UTC
Fixed in master https://github.com/ceph/ceph/pull/40893 and awaiting backport to Pacific https://github.com/ceph/ceph/pull/40922

Comment 8 Vasishta 2021-05-08 07:56:44 UTC
Working fine with 16.2.0-33.el8cp 
Moving to VERIFIED state.

Comment 10 errata-xmlrpc 2021-08-30 08:29:49 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 5.0 bug fix and enhancement), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:3294