Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
This project is now read‑only. Starting Monday, February 2, please use https://ibm-ceph.atlassian.net/ for all bug tracking management.

Bug 1433470

Summary: RHCS 2.1 and 2.2 ceph-debuginfo packages are not available in CDN
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Vikhyat Umrao <vumrao>
Component: DistributionAssignee: Andrew Hills <ahills>
Status: CLOSED CURRENTRELEASE QA Contact: ceph-qe-bugs <ceph-qe-bugs>
Severity: high Docs Contact:
Priority: high    
Version: 2.1CC: icolle, kdreyer
Target Milestone: rcKeywords: Regression
Target Release: 2.2   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-03-23 14:32:26 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Vikhyat Umrao 2017-03-17 17:28:02 UTC
Description of problem:
RHCS 2.1 and 2.2 ceph-debuginfo package is not available in CDN

Version-Release number of selected component (if applicable):
Red Hat Ceph Storage 2.1 and 2.2
2.1 - ceph-debuginfo-10.2.3-17.el7cp.x86_64.rpm
2.2 - ceph-debuginfo-10.2.5-37.el7cp.x86_64.rpm

How reproducible:
Always

- we are already hitting this bug: https://bugzilla.redhat.com/show_bug.cgi?id=1375425 (debuginfo-install ceph command does not work on RHCS2)


# debuginfo-install ceph
Loaded plugins: product-id
enabling rhel-7-server-debug-rpms
enabling rhel-7-server-rhceph-2-tools-debug-rpms
enabling rhel-7-server-rhscon-2-agent-debug-rpms
enabling rhel-7-server-rhceph-2-osd-debug-rpms
enabling rhel-7-server-rhceph-2-mon-debug-rpms
rhel-7-server-debug-rpms                                                                                                                                                                    | 3.3 kB  00:00:00     
rhel-7-server-rhceph-2-mon-debug-rpms                                                                                                                                                       | 3.8 kB  00:00:00     
rhel-7-server-rhceph-2-mon-rpms                                                                                                                                                             | 4.0 kB  00:00:00     
rhel-7-server-rhceph-2-osd-debug-rpms                                                                                                                                                       | 3.8 kB  00:00:00     
rhel-7-server-rhceph-2-osd-rpms                                                                                                                                                             | 4.0 kB  00:00:00     
rhel-7-server-rhceph-2-tools-debug-rpms                                                                                                                                                     | 3.8 kB  00:00:00     
rhel-7-server-rhceph-2-tools-rpms                                                                                                                                                           | 4.0 kB  00:00:00     
rhel-7-server-rhscon-2-agent-debug-rpms                                                                                                                                                     | 3.8 kB  00:00:00     
rhel-7-server-rhscon-2-agent-rpms                                                                                                                                                           | 4.0 kB  00:00:00     
rhel-7-server-rpms                                                                                                                                                                          | 3.5 kB  00:00:00     
(1/15): rhel-7-server-debug-rpms/7Server/x86_64/group                                                                                                                                       |  104 B  00:00:01     
(2/15): rhel-7-server-debug-rpms/7Server/x86_64/updateinfo                                                                                                                                  | 1.2 MB  00:00:02     
(3/15): rhel-7-server-rhceph-2-mon-debug-rpms/7Server/x86_64/group                                                                                                                          |  104 B  00:00:01     
(4/15): rhel-7-server-rhceph-2-mon-debug-rpms/7Server/x86_64/updateinfo                                                                                                                     |  13 kB  00:00:01     
(5/15): rhel-7-server-debug-rpms/7Server/x86_64/primary_db                                                                                                                                  | 2.2 MB  00:00:02     
(6/15): rhel-7-server-rhceph-2-mon-debug-rpms/7Server/x86_64/primary_db                                                                                                                     |  14 kB  00:00:01     
(7/15): rhel-7-server-rhceph-2-osd-debug-rpms/7Server/x86_64/group                                                                                                                          |  104 B  00:00:01     
(8/15): rhel-7-server-rhceph-2-osd-debug-rpms/7Server/x86_64/updateinfo                                                                                                                     |  12 kB  00:00:01     
(9/15): rhel-7-server-rhceph-2-osd-debug-rpms/7Server/x86_64/primary_db                                                                                                                     |  13 kB  00:00:01     
(10/15): rhel-7-server-rhceph-2-tools-debug-rpms/7Server/x86_64/updateinfo                                                                                                                  |  14 kB  00:00:01     
(11/15): rhel-7-server-rhceph-2-tools-debug-rpms/7Server/x86_64/group                                                                                                                       |  104 B  00:00:01     
(12/15): rhel-7-server-rhscon-2-agent-debug-rpms/7Server/x86_64/group                                                                                                                       |  104 B  00:00:01     
(13/15): rhel-7-server-rhceph-2-tools-debug-rpms/7Server/x86_64/primary_db                                                                                                                  |  13 kB  00:00:01     
(14/15): rhel-7-server-rhscon-2-agent-debug-rpms/7Server/x86_64/updateinfo                                                                                                                  | 6.6 kB  00:00:01     
(15/15): rhel-7-server-rhscon-2-agent-debug-rpms/7Server/x86_64/primary_db                                                                                                                  | 4.4 kB  00:00:01     
Could not find a package for: ceph
No debuginfo packages available to install


============= 

Now if we want to install via CDN in OSD node:

# subscription-manager repos --enable=rhel-7-server-rhceph-2-osd-debug-rpms
Repository 'rhel-7-server-rhceph-2-osd-debug-rpms' is enabled for this system.

# yum install ceph-debuginfo
Loaded plugins: product-id, search-disabled-repos, subscription-manager
Resolving Dependencies
--> Running transaction check
---> Package ceph-debuginfo.x86_64 1:10.2.2-38.el7cp will be installed
--> Finished Dependency Resolution

Dependencies Resolved

===================================================================================================================================================================================================================
 Package                                       Arch                                  Version                                            Repository                                                            Size
===================================================================================================================================================================================================================
Installing:
 ceph-debuginfo                                x86_64                                1:10.2.2-38.el7cp                                  rhel-7-server-rhceph-2-osd-debug-rpms                                1.2 G

Transaction Summary
===================================================================================================================================================================================================================
Install  1 Package

Total download size: 1.2 G
Installed size: 5.1 G
Is this ok [y/d/N]: 

We are getting package version as '10.2.2-38.el7cp' which is 2.0 package and this osd node has RHCS 2.2 - 10.2.5-37.el7cp.

If I try to install with specific version then also it is not working.


# rpm -qa | grep ceph
ceph-test-10.2.5-37.el7cp.x86_64
python-cephfs-10.2.5-37.el7cp.x86_64
ceph-osd-10.2.5-37.el7cp.x86_64
libcephfs1-10.2.5-37.el7cp.x86_64
ceph-base-10.2.5-37.el7cp.x86_64
ceph-radosgw-10.2.5-37.el7cp.x86_64
ceph-mon-10.2.5-37.el7cp.x86_64
ceph-common-10.2.5-37.el7cp.x86_64
ceph-selinux-10.2.5-37.el7cp.x86_64
ceph-mds-10.2.5-37.el7cp.x86_64

# yum install ceph-debuginfo-10.2.5-37.el7cp.x86_64
Loaded plugins: product-id, search-disabled-repos, subscription-manager
No package ceph-debuginfo-10.2.5-37.el7cp.x86_64 available.
Error: Nothing to do

# yum install ceph-debuginfo-10.2.3-17.el7cp.x86_64
Loaded plugins: product-id, search-disabled-repos, subscription-manager
No package ceph-debuginfo-10.2.3-17.el7cp.x86_64 available.
Error: Nothing to do

# yum install ceph-debuginfo-10.2.5-37.el7cp.x86_64.rpm
Loaded plugins: product-id, search-disabled-repos, subscription-manager
No package ceph-debuginfo-10.2.5-37.el7cp.x86_64.rpm available.
Error: Nothing to do

# yum install ceph-debuginfo-10.2.3-17.el7cp.x86_64.rpm
Loaded plugins: product-id, search-disabled-repos, subscription-manager
No package ceph-debuginfo-10.2.3-17.el7cp.x86_64.rpm available.
Error: Nothing to do

Comment 5 Ian Colle 2017-03-20 21:53:42 UTC
Andrew - please take a look.

Comment 6 Andrew Hills 2017-03-20 22:18:30 UTC
As indicated in https://projects.engineering.redhat.com/browse/RCM-14090 "Red Hat Ceph Storage 2.1 and 2.2 ceph-debuginfo packages are not available in CDN", the content has been pushed. Please verify that it's accessible and modify the state of this bug per your workflow.

Comment 8 Vikhyat Umrao 2017-03-20 22:53:42 UTC
(In reply to Andrew Hills from comment #6)
> As indicated in https://projects.engineering.redhat.com/browse/RCM-14090
> "Red Hat Ceph Storage 2.1 and 2.2 ceph-debuginfo packages are not available
> in CDN", the content has been pushed. Please verify that it's accessible and
> modify the state of this bug per your workflow.

RHCS 2.2:
==========

# yum install ceph-debuginfo
Loaded plugins: product-id, search-disabled-repos, subscription-manager
[...]

Resolving Dependencies
--> Running transaction check
---> Package ceph-debuginfo.x86_64 1:10.2.5-37.el7cp will be installed
--> Finished Dependency Resolution

Dependencies Resolved

==================================================================================================================================================================================================
 Package                                   Arch                              Version                                       Repository                                                        Size
==================================================================================================================================================================================================
Installing:
 ceph-debuginfo                            x86_64                            1:10.2.5-37.el7cp                             rhel-7-server-rhceph-2-osd-debug-rpms                            1.2 G

Transaction Summary
==================================================================================================================================================================================================
Install  1 Package

Total download size: 1.2 G
Installed size: 5.2 G
Is this ok [y/d/N]: 

now 2.2 ceph-debuginfo package is available, earlier it was only for 2.0.


RHCS 2.1:
==========

# yum install ceph-debuginfo-10.2.3-17.el7cp.x86_64
Loaded plugins: product-id, search-disabled-repos, subscription-manager
No package ceph-debuginfo-10.2.3-17.el7cp.x86_64 available.
Error: Nothing to do

For 2.1 it is still not working.

Comment 9 Andrew Hills 2017-03-21 15:29:41 UTC
Is it still working for 2.0?

Comment 10 Andrew Hills 2017-03-21 15:30:13 UTC
I was under the impression that 2.2 deprecated 2.1, which deprecated 2.0. Please correct me if I'm wrong.

Comment 11 Vikhyat Umrao 2017-03-21 15:42:28 UTC
hmm packages won't get deprecated in CDN repositories.
For example, we have three different Customers running:

Customer 1. 2.0 - 10.2.2-38.el7cp  
Customer 2. 2.1 - 10.2.3-17.el7cp
Customer 3. 2.2 - 10.2.5-37.el7cp 

All will have the same subscription repositories for Red Hat Ceph Storage 2 release but CDN should contain all three releases packages.

Now because the customer 2 is running 2.1 then he needs ceph-debuginfo for similar version and he will run command $yum install ceph-debuginfo-10.2.3-17.el7cp to get the 2.1 ceph-debuginfo package.

Comment 14 Andrew Hills 2017-03-21 16:01:38 UTC
An older version of the 2.1 packages was pushed. I'll push the newer one now.

Comment 15 Vikhyat Umrao 2017-03-21 16:14:25 UTC
(In reply to Andrew Hills from comment #14)
> An older version of the 2.1 packages was pushed. I'll push the newer one now.

Thanks Andrew for your help. Sounds good.

Yep, 2.0 is working fine but for 10.2.2-38.el7cp not for async version - 10.2.2-41.el7cp.

2.0 - 10.2.2-38.el7cp - wokring
2.0 async - 10.2.2-41.el7cp - not working

2.1 - 10.2.3-13.el7cp - working
2.1 async - 10.2.3-17.el7cp - not working

2.2 - 10.2.5-37.el7cp - working

Comment 16 Andrew Hills 2017-03-21 21:46:54 UTC
OK, all five releases should have debuginfo packages on CDN now. Could you please verify you can access them?

Comment 18 Vikhyat Umrao 2017-03-23 14:10:09 UTC
(In reply to Andrew Hills from comment #16)
> OK, all five releases should have debuginfo packages on CDN now. Could you
> please verify you can access them?

Thanks Andrew! All five works.

2.0 - 10.2.2-38.el7cp - wokring
2.0 async - 10.2.2-41.el7cp - working

2.1 - 10.2.3-13.el7cp - working
2.1 async - 10.2.3-17.el7cp - working

2.2 - 10.2.5-37.el7cp - working

Comment 19 Vikhyat Umrao 2017-03-23 14:12:17 UTC
Ken, should we close this one. As issue is fixed?

Comment 20 Ken Dreyer (Red Hat) 2017-03-23 14:32:26 UTC
Thanks Vikhyat, yes.

Comment 21 Vikhyat Umrao 2017-03-23 14:34:29 UTC
Perfect. Thank you :)