Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1353666

Summary: Ceph fails dependencies with latest bits from CDN
Product: Red Hat OpenStack Reporter: Kurt Hey <kurt_hey>
Component: cephAssignee: Ian Colle <icolle>
Status: CLOSED NOTABUG QA Contact: Warren <wusui>
Severity: high Docs Contact:
Priority: unspecified    
Version: 8.0 (Liberty)CC: arkady_kanevsky, cdevine, christopher_dearborn, david_paterson, dcain, flucifre, gael_rehault, goneri, jdurgin, jefbrown, John_walsh, jomurphy, kazen, kbader, kschinck, kurt_hey, lhh, morazi, nlevine, pkesavar, randy_perryman, scohen, sreichar, srevivo, wayne_allen
Target Milestone: ---Keywords: Reopened, ZStream
Target Release: 10.0 (Newton)   
Hardware: Unspecified   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-08-09 08:39:07 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1365591    

Description Kurt Hey 2016-07-07 16:20:50 UTC
Description of problem:


Performing an automation install on 7-6-16 using Dell's automation scripts with version locking set to False and pull latest from CDN set to True, the overcloud deployment fails with the following error:

--> Finished Dependency Resolution^M
Error: Package: 1:ceph-osd-0.94.5-13.el7cp.x86_64 (@rhos-8.0-director-ceph-1.3-osd-signed)^M
Requires: ceph = 1:0.94.5-13.el7cp^M
Removing: 1:ceph-0.94.5-13.el7cp.x86_64 (@rhos-8.0-director-ceph-1.3-mon-signed)^M
ceph = 1:0.94.5-13.el7cp^M
Updated By: 1:ceph-0.94.5-14.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)^M
ceph = 1:0.94.5-14.el7cp^M
Available: 1:ceph-0.94.1-13.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)^M
ceph = 1:0.94.1-13.el7cp^M
Available: 1:ceph-0.94.1-15.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)^M
ceph = 1:0.94.1-15.el7cp^M
Available: 1:ceph-0.94.1-16.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)^M
ceph = 1:0.94.1-16.el7cp^M
Available: 1:ceph-0.94.1-18.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)^M
ceph = 1:0.94.1-18.el7cp^M
Available: 1:ceph-0.94.1-19.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)^M
ceph = 1:0.94.1-19.el7cp^M
Available: 1:ceph-0.94.3-3.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)^M
ceph = 1:0.94.3-3.el7cp^M
Available: 1:ceph-0.94.3-6.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)^M
ceph = 1:0.94.3-6.el7cp^M
Available: 1:ceph-0.94.5-9.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)^M
ceph = 1:0.94.5-9.el7cp^M



Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1. Install the undercloud
2. Deploy the overcloud
3.

Actual results:


Expected results:


Additional info:

Comment 2 Kurt Hey 2016-07-07 16:34:03 UTC
Version # of the images from the /usr/share//rhosp-director-images directory is:

version-8.0-20160603.2.el7ost.txt

Comment 3 Gael Rehault 2016-07-08 15:14:37 UTC
The above errors is thrown while trying to install the ceph-radosgw package on the overcloud image.

Comment 4 Wayne Allen 2016-07-08 16:47:37 UTC
Here are the repos used and their order in our subscription.json file. Steve R mentioned there might be order dependencies. These were initially provided (in this order) by Mike Burns, I believe.

    "roles": {
        "control": {
            "pool_ids": [ "CHANGEME_openstack_pool_id" ],
            "repos": [ "rhel-7-server-rpms",
                       "rhel-7-server-extras-rpms",
                       "rhel-7-server-openstack-8-rpms",
                       "rhel-7-server-openstack-8-director-rpms",
                       "rhel-7-server-rh-common-rpms",
                       "rhel-ha-for-rhel-7-server-rpms",
                       "rhel-7-server-rhceph-1.3-mon-rpms" ]
        },
        "compute": {
            "pool_ids": [ "CHANGEME_openstack_pool_id" ],
            "repos": [ "rhel-7-server-rpms",
                       "rhel-7-server-extras-rpms",
                       "rhel-7-server-openstack-8-rpms",
                       "rhel-7-server-openstack-8-director-rpms",
                       "rhel-7-server-rh-common-rpms",
                       "rhel-ha-for-rhel-7-server-rpms" ]
        },
        "ceph-storage": {
            "pool_ids": [ "CHANGEME_openstack_pool_id",
                          "CHANGEME_ceph_pool_id" ],
            "repos": [ "rhel-7-server-rpms",
                       "rhel-7-server-extras-rpms",
                       "rhel-7-server-openstack-8-rpms",
                       "rhel-7-server-openstack-8-director-rpms",
                       "rhel-7-server-rh-common-rpms",
                       "rhel-ha-for-rhel-7-server-rpms",
                       "rhel-7-server-rhceph-1.3-osd-rpms" ]
        }
    }

Comment 6 Karl Hastings 2016-07-08 18:05:32 UTC
ceph-osd-0.94.5-14.el7cp.x86_64 is in the "rhel-7-server-rhceph-1.3-osd-rpms" channel.

It looks to me that you need to add that channel to the "control" role's channels.

Comment 7 Gael Rehault 2016-07-11 14:30:11 UTC
the above json is not quite right, the error is encountered when updating the overcloud image, prior to the overcloud deployment 
This is the repos we enabled : 
     rhel-7-server-rhceph-1.3-mon-rpms
     rhel-7-server-rhceph-1.3-tools-rpms
And the list of packages we install (in that order ) : 
    ceph-radosgw
    diamond
    salt-minion

The errors is as follow : 

---> Package ceph-radosgw.x86_64 1:0.94.5-14.el7cp will be installed
.....
Error: Package: 1:ceph-osd-0.94.5-13.el7cp.x86_64 (@rhos-8.0-director-ceph-1.3-osd-signed)
           Requires: ceph = 1:0.94.5-13.el7cp
           Removing: 1:ceph-0.94.5-13.el7cp.x86_64 (@rhos-8.0-director-ceph-1.3-mon-signed)
               ceph = 1:0.94.5-13.el7cp
           Updated By: 1:ceph-0.94.5-14.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)
               ceph = 1:0.94.5-14.el7cp
           Available: 1:ceph-0.94.1-13.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)
               ceph = 1:0.94.1-13.el7cp
           Available: 1:ceph-0.94.1-15.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)
               ceph = 1:0.94.1-15.el7cp
           Available: 1:ceph-0.94.1-16.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)
               ceph = 1:0.94.1-16.el7cp
           Available: 1:ceph-0.94.1-18.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)
               ceph = 1:0.94.1-18.el7cp
           Available: 1:ceph-0.94.1-19.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)
               ceph = 1:0.94.1-19.el7cp
           Available: 1:ceph-0.94.3-3.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)
               ceph = 1:0.94.3-3.el7cp
           Available: 1:ceph-0.94.3-6.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)
               ceph = 1:0.94.3-6.el7cp
           Available: 1:ceph-0.94.5-9.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)
               ceph = 1:0.94.5-9.el7cp
           Available: 1:ceph-0.94.5-12.el7cp.x86_64 (rhel-7-server-rhceph-1.3-mon-rpms)
               ceph = 1:0.94.5-12.el7cp

Comment 8 Karl Hastings 2016-07-11 15:40:39 UTC
TL;DR version:  You need to subscribe to "rhel-7-server-rhceph-1.3-osd-rpms" in addition to the other two.

----

What this error is saying is:

I'm trying to complete your request (Installing ceph-radosgw.x86_64 1:0.94.5-14.el7cp), but I'm unable to do so because there is a package installed (1:ceph-osd-0.94.5-13.el7cp.x86_64) which requires a package you are trying to remove (1:ceph-0.94.5-13.el7cp.x86_64).

So if you were to also upgrade ceph-osd to the same version there shouldn't be a problem.  ceph-osd is in the "rhel-7-server-rhceph-1.3-osd-rpms" channel.

So wherever it is that you are trying to execute that transaction, that system needs to be subscribed to "rhel-7-server-rhceph-1.3-osd-rpms" in addition to whatever channels it is already subscribed to.

Comment 9 Gael Rehault 2016-07-11 22:34:25 UTC
thanks Karl, adding rhel-7-server-rhceph-1.3-osd-rpms resolves the issue.

Comment 10 Federico Lucifredi 2016-07-13 19:04:31 UTC
Keith, do we need to do anything else on our side, or can we close this bug? Just checking, please go ahead if so.

Comment 11 Karl Hastings 2016-07-14 07:29:31 UTC
Federico,

There is still some discussion about how this happened.  

As I understand Dell's position, this channel dependency is new, with our more recent images.  They are concerned that this could happen again and break upgrades for customers some time after the initial deployment.

Comment 12 Sean Cohen 2016-07-22 12:49:16 UTC
Feel free to reopen is surface again,
Sean

Comment 13 Gonéri Le Bouder 2016-08-08 15:18:11 UTC
I face the same issue even if with rhel-7-server-rhceph-1.3-osd-rpms:

sudo subscription-manager repos '--disable=*' --enable=rhel-7-server-rpms --enable=rhel-7-server-rhceph-1.3-calamari-rpms --enable=rhel-7-server-rhceph-1.3-installer-rpms --enable=rhel-7-server-rhceph-1.3-mon-rpms --enable=rhel-7-server-rhceph-1.3-osd-rpms --enable=rhel-7-server-rhceph-1.3-tools-rpms

[root@director ~]# yum install -y ceph-radosgw
Loaded plugins: priorities, product-id, search-disabled-repos, subscription-manager, versionlock
233 packages excluded due to repository priority protections
Resolving Dependencies
--> Running transaction check
---> Package ceph-radosgw.x86_64 1:0.94.5-14.el7cp will be installed
--> Processing Dependency: ceph-common = 1:0.94.5-14.el7cp for package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64
--> Processing Dependency: librados2 = 1:0.94.5-14.el7cp for package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64
--> Processing Dependency: libfcgi.so.0()(64bit) for package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64
--> Running transaction check
---> Package ceph-radosgw.x86_64 1:0.94.5-14.el7cp will be installed
--> Processing Dependency: ceph-common = 1:0.94.5-14.el7cp for package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64
--> Processing Dependency: librados2 = 1:0.94.5-14.el7cp for package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64
---> Package fcgi.x86_64 0:2.4.0-25.el7cp will be installed
--> Finished Dependency Resolution
Error: Package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64 (rhel-7-server-rhceph-1.3-tools-rpms)
           Requires: ceph-common = 1:0.94.5-14.el7cp
           Available: 1:ceph-common-0.80.7-2.el7.x86_64 (rhel-7-server-rpms)
               ceph-common = 1:0.80.7-2.el7
           Available: 1:ceph-common-0.80.7-3.el7.x86_64 (rhel-7-server-rpms)
               ceph-common = 1:0.80.7-3.el7
Error: Package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64 (rhel-7-server-rhceph-1.3-tools-rpms)
           Requires: librados2 = 1:0.94.5-14.el7cp
           Installed: 1:librados2-0.80.7-3.el7.x86_64 (@rhel-7-server-rpms)
               librados2 = 1:0.80.7-3.el7
           Available: 1:librados2-0.80.7-2.el7.x86_64 (rhel-7-server-rpms)
               librados2 = 1:0.80.7-2.el7
**********************************************************************
yum can be configured to try to resolve such errors by temporarily enabling
disabled repos and searching for missing dependencies.
To enable this functionality please set 'notify_only=0' in /etc/yum/pluginconf.d/search-disabled-repos.conf
**********************************************************************

Error: Package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64 (rhel-7-server-rhceph-1.3-tools-rpms)
           Requires: ceph-common = 1:0.94.5-14.el7cp
           Available: 1:ceph-common-0.80.7-2.el7.x86_64 (rhel-7-server-rpms)
               ceph-common = 1:0.80.7-2.el7
           Available: 1:ceph-common-0.80.7-3.el7.x86_64 (rhel-7-server-rpms)
               ceph-common = 1:0.80.7-3.el7
Error: Package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64 (rhel-7-server-rhceph-1.3-tools-rpms)
           Requires: librados2 = 1:0.94.5-14.el7cp
           Installed: 1:librados2-0.80.7-3.el7.x86_64 (@rhel-7-server-rpms)
               librados2 = 1:0.80.7-3.el7
           Available: 1:librados2-0.80.7-2.el7.x86_64 (rhel-7-server-rpms)
               librados2 = 1:0.80.7-2.el7
 You could try using --skip-broken to work around the problem

Comment 14 Gonéri Le Bouder 2016-08-08 15:22:59 UTC
[root@director ~]# subscription-manager repos --list-enabled
+----------------------------------------------------------+
    Available Repositories in /etc/yum.repos.d/redhat.repo
+----------------------------------------------------------+
Repo ID:   rhel-7-server-rhceph-1.3-tools-rpms
Repo Name: Red Hat Ceph Storage Tools 1.3 for Red Hat Enterprise Linux 7 Server (RPMs)
Repo URL:  https://cdn.redhat.com/content/dist/rhel/server/7/$releasever/$basearch/ceph-tools/1.3/os
Enabled:   1

Repo ID:   rhel-7-server-rhceph-1.3-installer-rpms
Repo Name: Red Hat Ceph Storage Installer 1.3 for Red Hat Enterprise Linux 7 Server (RPMs)
Repo URL:  https://cdn.redhat.com/content/dist/rhel/server/7/$releasever/$basearch/ceph-installer/1.3/os
Enabled:   1

Repo ID:   rhel-7-server-rhceph-1.3-calamari-rpms
Repo Name: Red Hat Ceph Storage Calamari 1.3 for Red Hat Enterprise Linux 7 Server (RPMs)
Repo URL:  https://cdn.redhat.com/content/dist/rhel/server/7/$releasever/$basearch/ceph-calamari/1.3/os
Enabled:   1

Repo ID:   rhel-7-server-rhceph-1.3-mon-rpms
Repo Name: Red Hat Ceph Storage MON 1.3 for Red Hat Enterprise Linux 7 Server (RPMs)
Repo URL:  https://cdn.redhat.com/content/dist/rhel/server/7/$releasever/$basearch/ceph-mon/1.3/os
Enabled:   1

Repo ID:   rhel-7-server-rpms
Repo Name: Red Hat Enterprise Linux 7 Server (RPMs)
Repo URL:  https://cdn.redhat.com/content/dist/rhel/server/7/$releasever/$basearch/os
Enabled:   1

Repo ID:   rhel-7-server-rhceph-1.3-osd-rpms
Repo Name: Red Hat Ceph Storage OSD 1.3 for Red Hat Enterprise Linux 7 Server (RPMs)
Repo URL:  https://cdn.redhat.com/content/dist/rhel/server/7/$releasever/$basearch/ceph-osd/1.3/os
Enabled:   1

Comment 15 Karl Hastings 2016-08-08 21:39:49 UTC
Gonéri,

I think the key is in the "233 packages excluded due to repository priority protections" in your above log.  You may want to try the command again once you disable the protections.  (I'm not 100% sure if its the priorities, versionlock, or something else that is causing this specific problem).  

You could try 'yum install --disableplugin=priorities --disableplugin=versionlock ceph-radosgw'

---------------------------

On my system it works fine:
~~~
[root@rhel7 ~]# subscription-manager repos '--disable=*' --enable=rhel-7-server-rpms --enable=rhel-7-server-rhceph-1.3-calamari-rpms --enable=rhel-7-server-rhceph-1.3-installer-rpms --enable=rhel-7-server-rhceph-1.3-mon-rpms --enable=rhel-7-server-rhceph-1.3-osd-rpms --enable=rhel-7-server-rhceph-1.3-tools-rpms
[...]
[root@rhel7 ~]# yum install ceph-radosgw
Loaded plugins: product-id, search-disabled-repos, subscription-manager
Resolving Dependencies
--> Running transaction check
---> Package ceph-radosgw.x86_64 1:0.94.5-14.el7cp will be installed
--> Processing Dependency: ceph-common = 1:0.94.5-14.el7cp for package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64
--> Processing Dependency: librados2 = 1:0.94.5-14.el7cp for package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64
--> Processing Dependency: libfcgi.so.0()(64bit) for package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64
--> Processing Dependency: librados.so.2()(64bit) for package: 1:ceph-radosgw-0.94.5-14.el7cp.x86_64
--> Running transaction check
---> Package ceph-common.x86_64 1:0.94.5-14.el7cp will be installed
--> Processing Dependency: librbd1 = 1:0.94.5-14.el7cp for package: 1:ceph-common-0.94.5-14.el7cp.x86_64
--> Processing Dependency: python-rados = 1:0.94.5-14.el7cp for package: 1:ceph-common-0.94.5-14.el7cp.x86_64
--> Processing Dependency: python-rbd = 1:0.94.5-14.el7cp for package: 1:ceph-common-0.94.5-14.el7cp.x86_64
--> Processing Dependency: python-requests for package: 1:ceph-common-0.94.5-14.el7cp.x86_64
--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 1:ceph-common-0.94.5-14.el7cp.x86_64
--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 1:ceph-common-0.94.5-14.el7cp.x86_64
--> Processing Dependency: librbd.so.1()(64bit) for package: 1:ceph-common-0.94.5-14.el7cp.x86_64
---> Package fcgi.x86_64 0:2.4.0-25.el7cp will be installed
---> Package librados2.x86_64 1:0.94.5-14.el7cp will be installed
--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 1:librados2-0.94.5-14.el7cp.x86_64
--> Running transaction check
---> Package libbabeltrace.x86_64 0:1.2.4-3.el7cp will be installed
---> Package librbd1.x86_64 1:0.94.5-14.el7cp will be installed
---> Package lttng-ust.x86_64 0:2.4.1-1.el7cp will be installed
--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-1.el7cp.x86_64
--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-1.el7cp.x86_64
---> Package python-rados.x86_64 1:0.94.5-14.el7cp will be installed
---> Package python-rbd.x86_64 1:0.94.5-14.el7cp will be installed
---> Package python-requests.noarch 0:2.6.0-1.el7_1 will be installed
--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-1.el7_1.noarch
--> Running transaction check
---> Package python-urllib3.noarch 0:1.10.2-2.el7_1 will be installed
--> Processing Dependency: python-six for package: python-urllib3-1.10.2-2.el7_1.noarch
---> Package userspace-rcu.x86_64 0:0.7.9-2.el7rhgs will be installed
--> Running transaction check
---> Package python-six.noarch 0:1.9.0-2.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

===================================================================================================================================
 Package                    Arch              Version                         Repository                                      Size
===================================================================================================================================
Installing:
 ceph-radosgw               x86_64            1:0.94.5-14.el7cp               rhel-7-server-rhceph-1.3-tools-rpms            2.3 M
Installing for dependencies:
 ceph-common                x86_64            1:0.94.5-14.el7cp               rhel-7-server-rhceph-1.3-mon-rpms              6.8 M
 fcgi                       x86_64            2.4.0-25.el7cp                  rhel-7-server-rhceph-1.3-tools-rpms             47 k
 libbabeltrace              x86_64            1.2.4-3.el7cp                   rhel-7-server-rhceph-1.3-mon-rpms              147 k
 librados2                  x86_64            1:0.94.5-14.el7cp               rhel-7-server-rhceph-1.3-mon-rpms              1.8 M
 librbd1                    x86_64            1:0.94.5-14.el7cp               rhel-7-server-rhceph-1.3-mon-rpms              1.9 M
 lttng-ust                  x86_64            2.4.1-1.el7cp                   rhel-7-server-rhceph-1.3-mon-rpms              176 k
 python-rados               x86_64            1:0.94.5-14.el7cp               rhel-7-server-rhceph-1.3-mon-rpms               48 k
 python-rbd                 x86_64            1:0.94.5-14.el7cp               rhel-7-server-rhceph-1.3-mon-rpms               38 k
 python-requests            noarch            2.6.0-1.el7_1                   rhel-7-server-rpms                              93 k
 python-six                 noarch            1.9.0-2.el7                     rhel-7-server-rpms                              29 k
 python-urllib3             noarch            1.10.2-2.el7_1                  rhel-7-server-rpms                             100 k
 userspace-rcu              x86_64            0.7.9-2.el7rhgs                 rhel-7-server-rhceph-1.3-mon-rpms               70 k

Transaction Summary
===================================================================================================================================
Install  1 Package (+12 Dependent packages)

Total download size: 14 M
Installed size: 50 M
~~~

Comment 16 Gonéri Le Bouder 2016-08-09 08:39:07 UTC
Oh gosh! Thanks Karl.

Comment 17 Red Hat Bugzilla 2023-09-14 03:27:44 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days