Bug 2192270 - Ceph Common: "rgw-orphan-list" and "ceph-diff-sorted" missing from package
Summary: Ceph Common: "rgw-orphan-list" and "ceph-diff-sorted" missing from package
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: Build
Version: 5.3
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 5.3z3
Assignee: tserlin
QA Contact: Manisha Saini
URL:
Whiteboard:
Depends On:
Blocks: 2204479
TreeView+ depends on / blocked
 
Reported: 2023-05-01 02:56 UTC by Manny
Modified: 2023-06-14 20:50 UTC (History)
7 users (show)

Fixed In Version: ceph-16.2.10-172.el8cp
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 2204479 (view as bug list)
Environment:
Last Closed: 2023-05-23 00:19:11 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHCEPH-6594 0 None None None 2023-05-01 02:58:53 UTC
Red Hat Knowledge Base (Solution) 4544621 0 None None None 2023-05-06 16:57:16 UTC
Red Hat Product Errata RHBA-2023:3259 0 None None None 2023-05-23 00:19:41 UTC

Description Manny 2023-05-01 02:56:37 UTC
Description of problem:  Ceph Common: "rgw-orphan-list" and "ceph-diff-sorted" missing from package

[root@osds-5 ~]# cat /etc/redhat-release 
Red Hat Enterprise Linux release 9.1 (Plow)


[root@mgmt-0 ~]# rpm -ql ceph-common-16.2.10-138.el8cp.x86_64 | grep orphan
/usr/share/man/man8/rgw-orphan-list.8.gz

[root@mgmt-0 ~]# rpm -ql ceph-common-16.2.10-138.el8cp.x86_64 | grep diff
/usr/share/man/man8/ceph-diff-sorted.8.gz


[root@osds-5 ~]# rpm -qa | grep ceph-common
ceph-common-17.2.6-0.el9.x86_64

[root@osds-5 ~]# rpm -ql ceph-common-17.2.6-0.el9.x86_64 | grep orphan
/usr/share/man/man8/rgw-orphan-list.8.gz

[root@osds-5 ~]# rpm -ql ceph-common-17.2.6-0.el9.x86_64 | grep diff
/usr/bin/crushdiff
/usr/share/man/man8/ceph-diff-sorted.8.gz
/usr/share/man/man8/crushdiff.8.gz



Version-Release number of selected component (if applicable):  RHCS 5.3.1 and Upstream 17.2.6


How reproducible:  Install Ceph Common observer the same as above


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

I have a customer who needs to run this, I was able to get the orphan list from here, but I need "ceph-diff-sorted"

Comment 1 RHEL Program Management 2023-05-01 02:56:46 UTC
Please specify the severity of this bug. Severity is defined here:
https://bugzilla.redhat.com/page.cgi?id=fields.html#bug_severity.

Comment 2 Manny 2023-05-01 10:58:16 UTC
Same, regardless of RHEL version

[root@mgmt-0 ~]# cat /etc/redhat-release 
Red Hat Enterprise Linux release 8.7 (Ootpa)

[root@mgmt-0 ~]# rpm -ql ceph-common-16.2.10-138.el8cp.x86_64 | grep orphan
/usr/share/man/man8/rgw-orphan-list.8.gz

[root@mgmt-0 ~]# rpm -ql ceph-common-16.2.10-138.el8cp.x86_64 | grep diff
/usr/share/man/man8/ceph-diff-sorted.8.gz

BR
Manny

Comment 3 Manny 2023-05-01 20:00:07 UTC
Spoke with Linuxkidd and these binaries are part of "ceph-radosgw" RPM and not Ceph Common. Closing as "Not A Bug"

BR
Manny

Comment 6 Manny 2023-05-02 19:57:10 UTC
Hey, hello,

Sorry for the needs info, but @adking , @tserlin , @kdreyer ,

First off, I'll apologize, I know this seems like an extremely esoteric issue. The script `rgw-orphan-list` is not often used. However, I have these factors

* I have a customer that needs to use the script to find orphans so they can remove them
* The script was recently hardened by Linuxkidd to avoid erroneous results when /tmp is too full/too small
* Cisco lost data because of the issue Linuxkidd addressed.
* The docs for the script are vague, I'd like to write a BZ for that.
* The KCS needs to be improved, just like the docs

With that background in mind, I wanted to add the improved `rgw-orphan-list` and do all the things in the list above

I know I closed this as `Not a Bug`. I am opening the BZ again.

Please see the output below. We start withe RHCS 5.3.1 Ceph Common (16.2.10-138.el9cp) and upgrade it to RHCS 5.3.2, (16.2.10-160.el9cp).

We start out with `rgw-orphan-list` and `ceph-diff-sorted` both missing from /usr/bin. Then, after the Ceph Common upgrade, we only find `rgw-orphan-list` in /usr/bin. However, the script `rgw-orphan-list` relies on `ceph-diff-sorted`.

I guess it would have been `nice` if this issue did not exist so I could simply update the KCS with instructions on how to replace /usr/bin/rgw-orphan-list` and go from there. Given that we are here, would it be possible to fix this upstream so the files exist and the `rgw-orphan-lits` is the latest and greatest from Linuxkidd? How about Ceph Common in 5.3.2?

I'm trying to avoid a knowledge article with needless complication. Please let me know what can be done, thank you

Best regards,
Manny


Evidence:
~~~
[root@osds-2 ~]# cat /etc/redhat-release 
Red Hat Enterprise Linux release 9.1 (Plow)

[root@osds-2 ~]# ls -l /usr/bin/rgw-or* /usr/bin/ceph-diff*
ls: cannot access '/usr/bin/rgw-or*': No such file or directory
ls: cannot access '/usr/bin/ceph-diff*': No such file or directory

[root@mgmt-0 ~]# ceph versions
{
    "mon": {
        "ceph version 16.2.10-138.el8cp (a63ae467c8e1f7503ea3855893f1e5ca189a71b9) pacific (stable)": 5
    },
    "mgr": {
        "ceph version 16.2.10-138.el8cp (a63ae467c8e1f7503ea3855893f1e5ca189a71b9) pacific (stable)": 2
    },
    "osd": {
        "ceph version 16.2.10-138.el8cp (a63ae467c8e1f7503ea3855893f1e5ca189a71b9) pacific (stable)": 24
    },
    "mds": {},
    "rgw": {
        "ceph version 16.2.10-138.el8cp (a63ae467c8e1f7503ea3855893f1e5ca189a71b9) pacific (stable)": 2
    },
    "overall": {
        "ceph version 16.2.10-138.el8cp (a63ae467c8e1f7503ea3855893f1e5ca189a71b9) pacific (stable)": 33
    }
}

[root@osds-2 ~]# ls -l /usr/bin/rgw-or* /usr/bin/ceph-diff*
ls: cannot access '/usr/bin/rgw-or*': No such file or directory
ls: cannot access '/usr/bin/ceph-diff*': No such file or directory
 
[root@osds-2 ~]# rpm -qa | grep ceph-common
python3-ceph-common-16.2.10-138.el9cp.x86_64
ceph-common-16.2.10-138.el9cp.x86_64
 
[root@osds-2 ~]# dnf install -y ceph-common
Updating Subscription Management repositories.
Last metadata expiration check: 2:16:13 ago on Tue May  2 11:34:36 2023.
Package ceph-common-2:16.2.10-138.el9cp.x86_64 is already installed.
Dependencies resolved.
=============================================================================================================================================================================================================================================================================================================================
 Package                                                                      Architecture                                                  Version                                                                       Repository                                                                                    Size
=============================================================================================================================================================================================================================================================================================================================
Upgrading:
 ceph-common                                                                  x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                         22 M
 libcephfs2                                                                   x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        964 k
 librados2                                                                    x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        3.7 M
 libradosstriper1                                                             x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        672 k
 librbd1                                                                      x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        3.9 M
 librgw2                                                                      x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        4.2 M
 python3-ceph-argparse                                                        x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        198 k
 python3-ceph-common                                                          x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        247 k
 python3-cephfs                                                               x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        345 k
 python3-rados                                                                x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        493 k
 python3-rbd                                                                  x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        472 k
 python3-rgw                                                                  x86_64                                                        2:16.2.10-160.el9cp                                                           rhceph-5-tools-for-rhel-9-x86_64-rpms                                                        258 k

Transaction Summary
=============================================================================================================================================================================================================================================================================================================================
Upgrade  12 Packages

Total download size: 37 M
Downloading Packages:
(1/12): python3-cephfs-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                          4.2 MB/s | 345 kB     00:00    
(2/12): librgw2-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                                  21 MB/s | 4.2 MB     00:00    
(3/12): python3-rados-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                            10 MB/s | 493 kB     00:00    
(4/12): librados2-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                                17 MB/s | 3.7 MB     00:00    
(5/12): python3-ceph-argparse-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                   3.1 MB/s | 198 kB     00:00    
(6/12): libradosstriper1-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                         12 MB/s | 672 kB     00:00    
(7/12): python3-rbd-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                             7.8 MB/s | 472 kB     00:00    
(8/12): python3-rgw-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                             5.8 MB/s | 258 kB     00:00    
(9/12): libcephfs2-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                               17 MB/s | 964 kB     00:00    
(10/12): python3-ceph-common-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                    6.1 MB/s | 247 kB     00:00    
(11/12): librbd1-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                                 30 MB/s | 3.9 MB     00:00    
(12/12): ceph-common-16.2.10-160.el9cp.x86_64.rpm                                                                                                                                                                                                                                             32 MB/s |  22 MB     00:00    
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                                                                                                                                                                         54 MB/s |  37 MB     00:00     
Red Hat Ceph Storage Tools 5 for RHEL 9 x86_64 (RPMs)                                                                                                                                                                                                                                        2.6 MB/s | 3.6 kB     00:00    
Importing GPG key 0xFD431D51:
 Userid     : "Red Hat, Inc. (release key 2) <security>"
 Fingerprint: 567E 347A D004 4ADE 55BA 8A5F 199E 2F91 FD43 1D51
 From       : /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
Key imported successfully
Importing GPG key 0x5A6340B3:
 Userid     : "Red Hat, Inc. (auxiliary key 3) <security>"
 Fingerprint: 7E46 2425 8C40 6535 D56D 6F13 5054 E4A4 5A63 40B3
 From       : /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
Key imported successfully
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                                                                                                                                                                                                                                                                     1/1 
  Upgrading        : librados2-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                               1/24 
  Running scriptlet: librados2-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                               1/24 
  Upgrading        : python3-rados-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                           2/24 
  Upgrading        : libcephfs2-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                              3/24 
  Running scriptlet: libcephfs2-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                              3/24 
  Upgrading        : librbd1-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                                 4/24 
  Running scriptlet: librbd1-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                                 4/24 
  Upgrading        : python3-ceph-argparse-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                   5/24 
  Upgrading        : python3-cephfs-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                          6/24 
  Upgrading        : python3-rbd-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                             7/24 
  Upgrading        : librgw2-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                                 8/24 
  Running scriptlet: librgw2-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                                 8/24 
  Upgrading        : python3-rgw-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                             9/24 
  Upgrading        : libradosstriper1-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                       10/24 
  Running scriptlet: libradosstriper1-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                       10/24 
  Upgrading        : python3-ceph-common-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                    11/24 
  Running scriptlet: ceph-common-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                            12/24 
  Upgrading        : ceph-common-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                            12/24 
  Running scriptlet: ceph-common-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                            12/24 
  Cleanup          : ceph-common-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                            13/24 
  Running scriptlet: ceph-common-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                            13/24 
  Cleanup          : libradosstriper1-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                       14/24 
  Running scriptlet: libradosstriper1-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                       14/24 
  Cleanup          : python3-cephfs-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                         15/24 
  Cleanup          : python3-rbd-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                            16/24 
  Cleanup          : librbd1-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                                17/24 
  Running scriptlet: librbd1-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                                17/24 
  Cleanup          : python3-rgw-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                            18/24 
  Cleanup          : python3-ceph-argparse-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                  19/24 
  Cleanup          : python3-ceph-common-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                    20/24 
  Cleanup          : librgw2-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                                21/24 
  Running scriptlet: librgw2-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                                21/24 
  Cleanup          : python3-rados-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                          22/24 
  Cleanup          : libcephfs2-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                             23/24 
  Running scriptlet: libcephfs2-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                             23/24 
  Cleanup          : librados2-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                              24/24 
  Running scriptlet: librados2-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                              24/24 
  Verifying        : python3-cephfs-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                          1/24 
  Verifying        : python3-cephfs-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                          2/24 
  Verifying        : librgw2-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                                 3/24 
  Verifying        : librgw2-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                                 4/24 
  Verifying        : ceph-common-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                             5/24 
  Verifying        : ceph-common-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                             6/24 
  Verifying        : librados2-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                               7/24 
  Verifying        : librados2-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                               8/24 
  Verifying        : python3-rados-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                           9/24 
  Verifying        : python3-rados-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                          10/24 
  Verifying        : python3-ceph-argparse-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                  11/24 
  Verifying        : python3-ceph-argparse-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                  12/24 
  Verifying        : libradosstriper1-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                       13/24 
  Verifying        : libradosstriper1-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                       14/24 
  Verifying        : python3-rbd-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                            15/24 
  Verifying        : python3-rbd-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                            16/24 
  Verifying        : python3-rgw-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                            17/24 
  Verifying        : python3-rgw-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                            18/24 
  Verifying        : libcephfs2-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                             19/24 
  Verifying        : libcephfs2-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                             20/24 
  Verifying        : python3-ceph-common-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                    21/24 
  Verifying        : python3-ceph-common-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                    22/24 
  Verifying        : librbd1-2:16.2.10-160.el9cp.x86_64                                                                                                                                                                                                                                                                23/24 
  Verifying        : librbd1-2:16.2.10-138.el9cp.x86_64                                                                                                                                                                                                                                                                24/24 
Installed products updated.
Last metadata expiration check: 2:16:24 ago on Tue May  2 11:34:36 2023.
                              
Upgraded:
  ceph-common-2:16.2.10-160.el9cp.x86_64           libcephfs2-2:16.2.10-160.el9cp.x86_64       librados2-2:16.2.10-160.el9cp.x86_64       libradosstriper1-2:16.2.10-160.el9cp.x86_64   librbd1-2:16.2.10-160.el9cp.x86_64       librgw2-2:16.2.10-160.el9cp.x86_64   python3-ceph-argparse-2:16.2.10-160.el9cp.x86_64  
  python3-ceph-common-2:16.2.10-160.el9cp.x86_64   python3-cephfs-2:16.2.10-160.el9cp.x86_64   python3-rados-2:16.2.10-160.el9cp.x86_64   python3-rbd-2:16.2.10-160.el9cp.x86_64        python3-rgw-2:16.2.10-160.el9cp.x86_64  

Complete!

[root@osds-2 ~]# rpm -qa | grep ceph-common
python3-ceph-common-16.2.10-160.el9cp.x86_64
ceph-common-16.2.10-160.el9cp.x86_64

[root@osds-2 ~]# ls -l /usr/bin/rgw-or* /usr/bin/ceph-diff*
ls: cannot access '/usr/bin/ceph-diff*': No such file or directory
-rwxr-xr-x. 1 root root 5013 Jul 21  2022  /usr/bin/rgw-orphan-list
~~~

Comment 11 Manny 2023-05-03 10:47:24 UTC
Linked SFDC #03449220
.

Comment 12 Manny 2023-05-06 16:57:16 UTC
FYI, linked KCS #4544621, (https://access.redhat.com/solutions/4544621)

/MC

Comment 18 errata-xmlrpc 2023-05-23 00:19:11 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 5.3 Bug Fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2023:3259


Note You need to log in before you can comment on or make changes to this bug.