Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
This project is now read‑only. Starting Monday, February 2, please use https://ibm-ceph.atlassian.net/ for all bug tracking management.

Bug 1939239

Summary: [RBD]: PWL cache not enabled in RHCS 5
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Harish Munjulur <hmunjulu>
Component: BuildAssignee: Ken Dreyer (Red Hat) <kdreyer>
Status: CLOSED ERRATA QA Contact: Veera Raghava Reddy <vereddy>
Severity: high Docs Contact:
Priority: unspecified    
Version: 5.0CC: kdreyer
Target Milestone: ---   
Target Release: 5.0   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: ceph-16.1.0-1084.el8cp Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-08-30 08:29:07 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Harish Munjulur 2021-03-15 19:26:20 UTC
Description of problem:
PWL cache not enabled in RHCS 5 


[ceph: root@magna031 /]# rbd status rbd_pool/rbd_image
2021-03-15T18:08:09.776+0000 7f878dfb3700 -1 load failed dlopen(): "/usr/lib64/ceph/librbd/libceph_librbd_pwl_cache.so: cannot open shared object file: No such file or directory" or "/usr/lib64/ceph/libceph_librbd_pwl_cache.so: cannot open shared object file: No such file or directory"
2021-03-15T18:08:09.776+0000 7f878dfb3700 -1 librbd::PluginRegistry: 0x55e31a517cd0 init: failed to load plugin: pwl_cache
2021-03-15T18:08:09.776+0000 7f878dfb3700 -1 librbd::image::OpenRequest: failed to initialize plugin registry: (38) Function not implemented
2021-03-15T18:08:09.776+0000 7f878dfb3700 -1 librbd::ImageState: 0x55e31a5183e0 failed to open image: (38) Function not implemented
rbd: error opening image rbd_image: (38) Function not implemented

Comment 3 Veera Raghava Reddy 2021-03-22 11:03:17 UTC
Add needinfo on Ken to refer comment #2.

@Harish - Did you try with latest RHCS 5 build mentioned in Comment #1?

Comment 4 Harish Munjulur 2021-03-22 19:07:08 UTC
Tested on the latest build - FAIL

[ceph: root@ceph-schcephadm-1616435441627-node1-mon-mgr-installer-node-expo ~]# ceph -v
ceph version 16.1.0-736.el8cp (a45d35696b02c10722a5e887f7a59895a4868dfb) pacific (rc)

[ceph: root@ceph-schcephadm-1616435441627-node1-mon-mgr-installer-node-expo ~]# rbd status rbd_pool/rbd_image
2021-03-22T19:05:02.278+0000 7fe062ffd700 -1 load failed dlopen(): "/usr/lib64/ceph/librbd/libceph_librbd_pwl_cache.so: cannot open shared object file: No such file or directory" or "/usr/lib64/ceph/libceph_librbd_pwl_cache.so: cannot open shared object file: No such file or directory"
2021-03-22T19:05:02.278+0000 7fe062ffd700 -1 librbd::PluginRegistry: 0x55a105040cb0 init: failed to load plugin: pwl_cache
2021-03-22T19:05:02.278+0000 7fe062ffd700 -1 librbd::image::OpenRequest: failed to initialize plugin registry: (38) Function not implemented
2021-03-22T19:05:02.279+0000 7fe0637fe700 -1 librbd::ImageState: 0x7fe06400a4b0 failed to open image: (38) Function not implemented
rbd: error opening image rbd_image: (38) Function not implemented

Comment 5 Ken Dreyer (Red Hat) 2021-03-23 02:17:03 UTC
When I set enable rbd_rwl_cache and rbd_ssd_cache, the build fails because the Brew builders are firewalled off from the internet:

fatal: unable to access 'https://github.com/ceph/pmdk.git/': Failed to connect to github.com port 443: Connection refused
-- Had to git clone more than once:
          3 times.
CMake Error at pmdk_ext-prefix/tmp/pmdk_ext-gitclone.cmake:66 (message):
  Failed to clone repository: 'https://github.com/ceph/pmdk.git'
make[2]: *** [src/CMakeFiles/pmdk_ext.dir/build.make:90: src/pmdk_ext-prefix/src/pmdk_ext-stamp/pmdk_ext-download] Error 1
make[1]: *** [CMakeFiles/Makefile2:1014: src/CMakeFiles/pmdk_ext.dir/all] Error 2

Comment 6 Jason Dillaman 2021-03-23 12:43:52 UTC
Ken: doesn't downstream have a different spec file from upstream? Upstream has switched RHEL and Fedora to use the system PMDK libraries [1] so I suspect the same could be done for RHCS?

[1] https://github.com/ceph/ceph/commit/75b58115ead7a42495b60cccf43e7a433fcc4a5f

Comment 8 Ken Dreyer (Red Hat) 2021-03-23 14:40:29 UTC
Ok, I missed this latest information. Yeah, I'm sync'ing ceph.spec, but I was following Pacific instead of master. Thanks for https://github.com/ceph/ceph/pull/40339 - it's clearer to me now. I'll pull those changes in and build again this week.

Comment 16 Harish Munjulur 2021-04-26 11:21:49 UTC
QA Verified with latest build.

Comment 18 errata-xmlrpc 2021-08-30 08:29:07 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 5.0 bug fix and enhancement), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:3294