2236385 – The command `ceph mds metadata` doesn't list information for the active MDS server

Bug 2236385 - The command `ceph mds metadata` doesn't list information for the active MDS server

Summary: The command `ceph mds metadata` doesn't list information for the active MDS s...

Keywords:
Status:	VERIFIED
Alias:	None
Product:	Red Hat Ceph Storage
Classification:	Red Hat Storage
Component:	CephFS
Sub Component:
Version:	5.2
Hardware:	Unspecified
OS:	Linux
Priority:	unspecified
Severity:	low
Target Milestone:	---
Target Release:	6.1z2
Assignee:	Patrick Donnelly
QA Contact:	Hemanth Kumar
Docs Contact:	Akash Raj
URL:
Whiteboard:
Depends On:
Blocks:	2235257
TreeView+	depends on / blocked

Reported:	2023-08-31 05:59 UTC by Milind Changire
Modified:	2023-09-15 08:19 UTC (History)
CC List:	13 users (show)
Fixed In Version:	ceph-17.2.6-128.el9cp
Doc Type:	Bug Fix
Doc Text:	.`ceph mds metadata` command now functions as expected across upgrades Previously, monitors could lose track of MDS metadata during upgrades and cancel the PAXOS transactions causing the MDS metadata to be unavailable. With this fix, MDS metadata is added in batches with FSMap changes to ensure consistency. The `ceph mds metadata` command now functions as expected across upgrades.
Clone Of:	2144472
Environment:
Last Closed:
Embargoed:
Dependent Products:

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Red Hat Issue Tracker	RHCEPH-7295	0	None	None	None	2023-08-31 06:12:13 UTC

Comment 1 Venky Shankar 2023-09-05 09:08:05 UTC

Milind, please post a MR.

Comment 7 Amarnath 2023-09-11 11:52:28 UTC

Hi All,

We are observing details on all the mds servers

[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph versions
{
    "mon": {
        "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)": 3
    },
    "mgr": {
        "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)": 2
    },
    "osd": {
        "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)": 12
    },
    "mds": {
        "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)": 3
    },
    "overall": {
        "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)": 20
    }
}
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph mds metadata
[
    {
        "name": "cephfs.ceph-fs-6-bz-gebvp1-node6.kgmbmg",
        "addr": "[v2:10.0.210.120:6800/1495934188,v1:10.0.210.120:6801/1495934188]",
        "arch": "x86_64",
        "ceph_release": "quincy",
        "ceph_version": "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)",
        "ceph_version_short": "17.2.6-136.el9cp",
        "container_hostname": "ceph-fs-6-bz-gebvp1-node6",
        "container_image": "registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f",
        "cpu": "Intel Xeon Processor (Cascadelake)",
        "distro": "rhel",
        "distro_description": "Red Hat Enterprise Linux 9.2 (Plow)",
        "distro_version": "9.2",
        "hostname": "ceph-fs-6-bz-gebvp1-node6",
        "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jul 20 09:11:28 EDT 2023",
        "kernel_version": "5.14.0-284.25.1.el9_2.x86_64",
        "mem_swap_kb": "0",
        "mem_total_kb": "3750064",
        "os": "Linux"
    },
    {
        "name": "cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm",
        "addr": "[v2:10.0.209.2:6800/4207929190,v1:10.0.209.2:6801/4207929190]",
        "arch": "x86_64",
        "ceph_release": "quincy",
        "ceph_version": "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)",
        "ceph_version_short": "17.2.6-136.el9cp",
        "container_hostname": "ceph-fs-6-bz-gebvp1-node4",
        "container_image": "registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f",
        "cpu": "Intel Xeon Processor (Icelake)",
        "distro": "rhel",
        "distro_description": "Red Hat Enterprise Linux 9.2 (Plow)",
        "distro_version": "9.2",
        "hostname": "ceph-fs-6-bz-gebvp1-node4",
        "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jul 20 09:11:28 EDT 2023",
        "kernel_version": "5.14.0-284.25.1.el9_2.x86_64",
        "mem_swap_kb": "0",
        "mem_total_kb": "3748036",
        "os": "Linux"
    },
    {
        "name": "cephfs.ceph-fs-6-bz-gebvp1-node5.kbimfq",
        "addr": "[v2:10.0.208.24:6832/3072745219,v1:10.0.208.24:6833/3072745219]",
        "arch": "x86_64",
        "ceph_release": "quincy",
        "ceph_version": "ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)",
        "ceph_version_short": "17.2.6-136.el9cp",
        "container_hostname": "ceph-fs-6-bz-gebvp1-node5",
        "container_image": "registry-proxy.engineering.redhat.com/rh-osbs/rhceph@sha256:a59c0b2dfbe038c85ad5c8358fc3016f84da7670874d0e9a3b395056fabb8c5f",
        "cpu": "Intel Xeon Processor (Cascadelake)",
        "distro": "rhel",
        "distro_description": "Red Hat Enterprise Linux 9.2 (Plow)",
        "distro_version": "9.2",
        "hostname": "ceph-fs-6-bz-gebvp1-node5",
        "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jul 20 09:11:28 EDT 2023",
        "kernel_version": "5.14.0-284.25.1.el9_2.x86_64",
        "mem_swap_kb": "0",
        "mem_total_kb": "3750056",
        "os": "Linux"
    }
]
[root@ceph-fs-6-bz-gebvp1-node7 ~]# 
[root@ceph-fs-6-bz-gebvp1-node7 ~]# ceph fs status
cephfs - 2 clients
======
RANK  STATE                     MDS                       ACTIVITY     DNS    INOS   DIRS   CAPS  
 0    active  cephfs.ceph-fs-6-bz-gebvp1-node4.dipxkm  Reqs:    0 /s  46.2k  46.2k  7204   34.0k  
 1    active  cephfs.ceph-fs-6-bz-gebvp1-node6.kgmbmg  Reqs:    0 /s  14.2k  14.2k  3222   14.1k  
       POOL           TYPE     USED  AVAIL  
cephfs.cephfs.meta  metadata  1160M  54.0G  
cephfs.cephfs.data    data    3586M  54.0G  
              STANDBY MDS                
cephfs.ceph-fs-6-bz-gebvp1-node5.kbimfq  
MDS version: ceph version 17.2.6-136.el9cp (24003d91a44631e46f9397ab1b9c5b77dc9223bc) quincy (stable)

Regards,
Amarnath

Note You need to log in before you can comment on or make changes to this bug.