Bug 1564232
| Summary: | ceph-ansible unable to upgrade ceph-base when ceph-test is installed | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat Ceph Storage | Reporter: | Coady LaCroix <clacroix> | ||||
| Component: | Ceph-Ansible | Assignee: | Ken Dreyer (Red Hat) <kdreyer> | ||||
| Status: | CLOSED ERRATA | QA Contact: | Parikshith <pbyregow> | ||||
| Severity: | medium | Docs Contact: | |||||
| Priority: | medium | ||||||
| Version: | 3.0 | CC: | adeza, aschoen, ceph-eng-bugs, edonnell, gmeno, kdreyer, nthomas, pbyregow, rperiyas, sankarshan, tserlin, vakulkar | ||||
| Target Milestone: | z2 | Keywords: | Regression | ||||
| Target Release: | 3.0 | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | RHEL: ceph-ansible-3.0.30-1.el7cp Ubuntu: ceph-ansible_3.0.30-2redhat1 | Doc Type: | Known Issue | ||||
| Doc Text: |
.Upgrading a node in a Ceph cluster installed with `ceph-test` packages must have `ceph_test = true` in `/etc/ansible/hosts` file
When using the `ceph-ansible` `rolling_update.yml` playbook to upgrade a Ceph node in a RHEL cluster that was installed with `ceph-test` packages, set `ceph_test = true` in the `/etc/ansible/hosts` file for each node that has `ceph-test` package installed:
----
[mons]
mon_node1 ceph_test=true
[osds]
osd_node1 ceph_test=true
----
Not applicable for clients and MDS nodes.
|
Story Points: | --- | ||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2018-04-26 17:38:40 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Bug Depends On: | |||||||
| Bug Blocks: | 1557269, 1600697 | ||||||
| Attachments: |
|
||||||
Discussed with Coady & Vasu in #rh-ceph-qe. The problem is that when ceph_test is true, we try to upgrade ceph-base before upgrading ceph-test. I can't reproduce on Ubuntu, so https://github.com/ceph/ceph-ansible/pull/2500 is just for RHEL for now. I have reproduced this issue on ubuntu as well. Logs are located here: http://magna002.ceph.redhat.com/cephci-jenkins/cephci-run-1523306398/upgrade_to_3.x_0.log. Initial install logs can also be found in that same directory. 10.2.10-1xenial is in that log, and that is an upstream (download.ceph.com) version number scheme. Would you please let us know the entire contents of /etc/apt.sources.d/* ? Observing conflict failure while upgrading cluster to 3.0z2 package.
Moving this bug to assigned state.
Steps followed:
1. Configured cluster with 3.0 live package.
2. Installed ceph-test pacakge manually in cluster
3. Tried to upgrade the cluster to latest 3.0z2 package.
Note: ceph-test pacakges are available in live, also in latest 3.0z2 repos, package versions also correct.
ceph-ansible version: ceph-ansible-3.0.30-1.el7cp.noarch
ceph-ansible failure message:
TASK [ceph-common : install redhat ceph-common] *************************************
fatal: [magna034]: FAILED! => {"changed": true, "msg": "\n\nTransaction check error:\n file /usr/bin/ceph-kvstore-tool from install of ceph-base-2:12.2.4-6.el7cp.x86_64 conflicts with file from package ceph-test-2:12.2.1-46.el7cp.x86_64\n file /usr/bin/ceph-monstore-tool from install of ceph-mon-2:12.2.4-6.el7cp.x86_64 conflicts with file from package ceph-test-2:12.2.1-46.el7cp.x86_64\n\nError Summary\n-------------\n\n", "rc": 1, "results": ["Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\n : disabled-repos, subscription-manager\nLoading mirror speeds from cached hostfile\nResolving Dependencies\n--> Running transaction check\n---> Package ceph-common.x86_64 2:12.2.1-46.el7cp will be updated\n--> Processing Dependency: ceph-common = 2:12.2.1-46.el7cp for package: 2:ceph-base-12.2.1-46.el7cp.x86_64\n---> Package ceph-common.x86_64 2:12.2.4-6.el7cp will be an update\n--> Processing Dependency: libcephfs2 = 2:12.2.4-6.el7cp for package: 2:ceph-common-12.2.4-6.el7cp.x86_64\n--> Processing Dependency: librados2 = 2:12.2.4-6.el7cp for package: 2:ceph-common-12.2.4-6.el7cp.x86_64\n--> Processing Dependency: librbd1 = 2:12.2.4-6.el7cp for package: 2:ceph-common-12.2.4-6.el7cp.x86_64\n--> Processing Dependency: python-cephfs = 2:12.2.4-6.el7cp for package: 2:ceph-common-12.2.4-6.el7cp.x86_64\n--> Processing Dependency: python-rados = 2:12.2.4-6.el7cp for package: 2:ceph-common-12.2.4-6.el7cp.x86_64\n--> Processing Dependency: python-rbd = 2:12.2.4-6.el7cp for package: 2:ceph-common-12.2.4-6.el7cp.x86_64\n--> Processing Dependency: python-rgw = 2:12.2.4-6.el7cp for package: 2:ceph-common-12.2.4-6.el7cp.x86_64\n--> Running transaction check\n---> Package ceph-base.x86_64 2:12.2.1-46.el7cp will be updated\n--> Processing Dependency: ceph-base = 2:12.2.1-46.el7cp for package: 2:ceph-mgr-12.2.1-46.el7cp.x86_64\n--> Processing Dependency: ceph-base = 2:12.2.1-46.el7cp for package: 2:ceph-mon-12.2.1-46.el7cp.x86_64\n--> Processing Dependency: ceph-base = 2:12.2.1-46.el7cp for package: 2:ceph-selinux-12.2.1-46.el7cp.x86_64\n--> Processing Dependency: ceph-base = 2:12.2.1-46.el7cp for package: 2:ceph-selinux-12.2.1-46.el7cp.x86_64\n---> Package ceph-base.x86_64 2:12.2.4-6.el7cp will be an update\n--> Processing Dependency: librgw2 = 2:12.2.4-6.el7cp for package: 2:ceph-base-12.2.4-6.el7cp.x86_64\n---> Package libcephfs2.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package libcephfs2.x86_64 2:12.2.4-6.el7cp will be an update\n---> Package librados2.x86_64 2:12.2.1-46.el7cp will be updated\n--> Processing Dependency: librados2 = 2:12.2.1-46.el7cp for package: 2:libradosstriper1-12.2.1-46.el7cp.x86_64\n---> Package librados2.x86_64 2:12.2.4-6.el7cp will be an update\n---> Package librbd1.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package librbd1.x86_64 2:12.2.4-6.el7cp will be an update\n---> Package python-cephfs.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package python-cephfs.x86_64 2:12.2.4-6.el7cp will be an update\n---> Package python-rados.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package python-rados.x86_64 2:12.2.4-6.el7cp will be an update\n---> Package python-rbd.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package python-rbd.x86_64 2:12.2.4-6.el7cp will be an update\n---> Package python-rgw.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package python-rgw.x86_64 2:12.2.4-6.el7cp will be an update\n--> Running transaction check\n---> Package ceph-mgr.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package ceph-mgr.x86_64 2:12.2.4-6.el7cp will be an update\n---> Package ceph-mon.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package ceph-mon.x86_64 2:12.2.4-6.el7cp will be an update\n---> Package ceph-selinux.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package ceph-selinux.x86_64 2:12.2.4-6.el7cp will be an update\n---> Package libradosstriper1.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package libradosstriper1.x86_64 2:12.2.4-6.el7cp will be an update\n---> Package librgw2.x86_64 2:12.2.1-46.el7cp will be updated\n---> Package librgw2.x86_64 2:12.2.4-6.el7cp will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n ceph-common x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 15 M\nUpdating for dependencies:\n ceph-base x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 3.9 M\n ceph-mgr x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 3.6 M\n ceph-mon x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 5.0 M\n ceph-selinux x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 37 k\n libcephfs2 x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 446 k\n librados2 x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 2.9 M\n libradosstriper1 x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 346 k\n librbd1 x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 1.1 M\n librgw2 x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 1.7 M\n python-cephfs x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 98 k\n python-rados x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 189 k\n python-rbd x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 122 k\n python-rgw x86_64 2:12.2.4-6.el7cp download-node-02.eng.bos.redhat.com_composes_auto_ceph-3.0-rhel-7_latest-RHCEPH-3-RHEL-7_compose_MON_x86_64_os_\n 89 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+13 Dependent packages)\n\nTotal download size: 34 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 9.2 MB/s | 34 MB 00:03 \nRunning transaction check\nRunning transaction test\n"]}
PLAY RECAP **************************************************************************
localhost : ok=1 changed=0 unreachable=0 failed=0
magna034 : ok=31 changed=1 unreachable=0 failed=1
Updated the doc text. Moving this bz to verified. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2018:1259 The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days |
Created attachment 1417865 [details] error during install_redhat_packages Description of problem: During an upgrade from 3.0 to 3.x using ceph-ansible the install_redhat_packages task fails with the attached error. Essentially, ceph-base is failing to install due to conflicts with the ceph-test package. When manually attempting to install ceph-base on the node, I see the following: Transaction check error: file /usr/bin/ceph-kvstore-tool from install of ceph-base-2:12.2.4-4.el7cp.x86_64 conflicts with file from package ceph-test-2:12.2.1-46.el7cp.x86_64 file /usr/bin/ceph-monstore-tool from install of ceph-mon-2:12.2.4-4.el7cp.x86_64 conflicts with file from package ceph-test-2:12.2.1-46.el7cp.x86_64 Error Summary Version-Release number of selected component (if applicable): How reproducible: Every attempt at upgrading to latest 3.x Steps to Reproduce: 1. Install ceph 3.0 using ceph-ansible 2. Upgrade to latest using ceph-ansible Actual results: Failure during install_redhat_packages Expected results: Successful upgrade to latest ceph version. Additional info: