Description of problem: - ceph-common package in rhel-7-server-rpms is 0.94.5. In other words, rbd --version is too old. [root@knakayam-ose39-crs ~]# yum info ceph-common-0.94.5-2.el7.x86_64 Loaded plugins: product-id, search-disabled-repos, subscription-manager Installed Packages Name : ceph-common Arch : x86_64 Epoch : 1 Version : 0.94.5 Release : 2.el7 Size : 24 M Repo : installed From repo : rhel-7-server-rpms Summary : Ceph Common URL : http://ceph.com/ License : GPLv2 Description : Common utilities to mount and interact with a ceph storage cluster. [root@knakayam-ose39-crs ~]# rbd --version ceph version 0.94.5 (9764da52395923e0b32908d83a9f7304401fee43) - This causes some issues. Especially on OpenShift, all openshift nodes need to install ceph-common and runs rbd command internally. At that time, if we installed the latest Ceph(RHCS 3), the version mismatch causes error. For example, this is a report on upstream https://github.com/openshift/origin/issues/20363, but it also happened on RHEL7. Version-Release number of selected component (if applicable): ceph-common 0.94.5 installed from rhel-7-server-rpms How reproducible: 100% Steps to Reproduce: - This is a steps to prove that old ceph-common produes the error reported https://github.com/openshift/origin/issues/20363 1. Install current RHCS 3 2. Run following commands with rbd 0.94.5 # rbd create foo --size=1 --image-format=2 -m 10.64.222.2 --key="AQBQwz5bH2KKJBAAM5tlqKLOAqft2hR+l2p+nQ==" --id=admin --pool=kube --image-feature="" Actual results: - Causes error "rbd: extraneous parameter --image-feature" Expected results: - No error. - I confirmed that the latest rbd 12.2.4-30.el7cp does not cause any error. Additional info: - Please forward this ticket to proper team if RHCS/Unclassified was wrong.
RHEL 7.6 should include a newer version of ceph-common, tracked in bug 1421783 . However, OpenShift really needs to use the packages in rhel-7-server-rhceph-3-tools-rpms, instead of rhel-7-server-rpms.
> However, OpenShift really needs to use the packages in rhel-7-server-rhceph-3-tools-rpms, instead of rhel-7-server-rpms. Ken, I think that rhel-7-server-rhceph-3-tools-rpms needs ceph subscription. It is difficult for openshift users to buy(?) ceph subscription for all Nodes to install only ceph-common from rhel-7-server-rhceph-3-tools-rpms. (I think that that is why RH provides ceph-common via rhel-7-server-rpms repo.)
Ceph's -tools repository does not require a Ceph product subscription; only the -mon and -osd repositories do. The -tools repo is available to all RHEL customers. The idea is to make the Ceph client free to anyone with a RHEL subscription. (If you find a particular case where a customer cannot access that repo using their RHEL SKUs, please contact our Ceph product managers to resolve that.)
Thank you, Ken. I misunderstood about the subscription for the -tools repo.