Bug 1462011
| Summary: | changes for enabling rocksdb for filestore in RHCS 2.y | |||
|---|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat Ceph Storage | Reporter: | Vikhyat Umrao <vumrao> | |
| Component: | RADOS | Assignee: | Josh Durgin <jdurgin> | |
| Status: | CLOSED ERRATA | QA Contact: | ceph-qe-bugs <ceph-qe-bugs> | |
| Severity: | high | Docs Contact: | Bara Ancincova <bancinco> | |
| Priority: | high | |||
| Version: | 2.3 | CC: | ceph-eng-bugs, ceph-qe-bugs, dzafman, edonnell, gmeno, jdurgin, kchai, kdreyer, mhackett, skinjo, tserlin, uboppana, vakulkar, wusui | |
| Target Milestone: | rc | |||
| Target Release: | 2.4 | |||
| Hardware: | x86_64 | |||
| OS: | Linux | |||
| Whiteboard: | ||||
| Fixed In Version: | RHEL: ceph-10.2.7-48.el7cp Ubuntu: ceph_10.2.7-48redhat1 | Doc Type: | Enhancement | |
| Doc Text: |
.`RocksDB` is enabled as an option to replace `levelDB`
This update enables an option to use the `RocksDB` back end for the `omap` database as opposed to `levelDB`. `RocksDB` uses the multi-threading mechanism in compaction so that it better handles the situation when the `omap` directories become very large (more than 40 G). `LevelDB` compaction takes a lot of time in such a situation and causes OSD daemons to time out.
For details about conversion from `levelDB` to `RocksDB`, see the link:https://access.redhat.com/solutions/3210951[Ceph - Steps to convert OSD omap backend from leveldb to rocksdb] solution on Red Hat Customer Portal.
|
Story Points: | --- | |
| Clone Of: | ||||
| : | 1462012 1500100 (view as bug list) | Environment: | ||
| Last Closed: | 2017-10-17 18:12:51 UTC | Type: | Bug | |
| Regression: | --- | Mount Type: | --- | |
| Documentation: | --- | CRM: | ||
| Verified Versions: | Category: | --- | ||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
| Cloudforms Team: | --- | Target Upstream Version: | ||
| Embargoed: | ||||
| Bug Depends On: | ||||
| Bug Blocks: | 1479701 | |||
|
Comment 3
Vikhyat Umrao
2017-09-29 14:57:25 UTC
Doing some final scale testing this week before pulling this in. I am marking this verified because it works on a newly installed system. However on an osd after I performed the operations in step 10, I then tried to run the new compact command for ceph (https://bugzilla.redhat.com/show_bug.cgi?id=1483224). I got: [root@magna007 ceph-5]# ceph daemon osd.5 compact admin_socket: exception getting command descriptions: [Errno 2] No such file or directory admin_socket: exception getting command descriptions: [Errno 2] No such file or directory I am not sure if this is a problem or not. I am also updating bz 1483224 as well. This does not seem to work on Ubuntu. After running the steps in Comment 10: ID WEIGHT TYPE NAME UP/DOWN REWEIGHT PRIMARY-AFFINITY -1 8.13950 root default -2 2.71317 host magna038 0 0.90439 osd.0 up 1.00000 1.00000 3 0.90439 osd.3 up 1.00000 1.00000 6 0.90439 osd.6 up 1.00000 1.00000 -3 2.71317 host magna096 1 0.90439 osd.1 up 1.00000 1.00000 4 0.90439 osd.4 up 1.00000 1.00000 7 0.90439 osd.7 up 1.00000 1.00000 -4 2.71317 host magna024 2 0.90439 osd.2 up 1.00000 1.00000 5 0.90439 osd.5 down 0 1.00000 8 0.90439 osd.8 up 1.00000 1.00000 Passed on both Ubuntu and Rhel. I ran into a slight gotcha in that I ran some of the commands as root rather than the ceph user. Josh helped me a bit and things worked after we changed permissions and ran as the correct user. This comment also applies to bugzilla #1483224 Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2017:2903 *** Bug 1480720 has been marked as a duplicate of this bug. *** |