Bug 1462011 - changes for enabling rocksdb for filestore in RHCS 2.y
Summary: changes for enabling rocksdb for filestore in RHCS 2.y
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RADOS
Version: 2.3
Hardware: x86_64
OS: Linux
high
high
Target Milestone: rc
: 2.4
Assignee: Josh Durgin
QA Contact: ceph-qe-bugs
Bara Ancincova
URL:
Whiteboard:
: 1480720 (view as bug list)
Depends On:
Blocks: 1479701
TreeView+ depends on / blocked
 
Reported: 2017-06-15 22:15 UTC by Vikhyat Umrao
Modified: 2021-06-10 12:26 UTC (History)
14 users (show)

Fixed In Version: RHEL: ceph-10.2.7-48.el7cp Ubuntu: ceph_10.2.7-48redhat1
Doc Type: Enhancement
Doc Text:
.`RocksDB` is enabled as an option to replace `levelDB` This update enables an option to use the `RocksDB` back end for the `omap` database as opposed to `levelDB`. `RocksDB` uses the multi-threading mechanism in compaction so that it better handles the situation when the `omap` directories become very large (more than 40 G). `LevelDB` compaction takes a lot of time in such a situation and causes OSD daemons to time out. For details about conversion from `levelDB` to `RocksDB`, see the link:https://access.redhat.com/solutions/3210951[Ceph - Steps to convert OSD omap backend from leveldb to rocksdb] solution on Red Hat Customer Portal.
Clone Of:
: 1462012 1500100 (view as bug list)
Environment:
Last Closed: 2017-10-17 18:12:51 UTC
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Ceph Project Bug Tracker 20324 0 None None None 2017-06-15 22:29:00 UTC
Red Hat Knowledge Base (Solution) 2971581 0 None None None 2017-10-24 15:21:47 UTC
Red Hat Knowledge Base (Solution) 3210951 0 None None None 2017-10-09 22:14:40 UTC
Red Hat Product Errata RHBA-2017:2903 0 normal SHIPPED_LIVE Red Hat Ceph Storage 2.4 enhancement and bug fix update 2017-10-17 22:12:30 UTC

Comment 3 Vikhyat Umrao 2017-09-29 14:57:25 UTC 
jewel rocksdb backport: https://github.com/ceph/ceph/pull/18010
Comment 4 Josh Durgin 2017-10-02 15:41:33 UTC 
Doing some final scale testing this week before pulling this in.
Comment 27 Warren 2017-10-13 01:29:52 UTC 
I am marking this verified because it works on a newly installed system.

However on an osd after I performed the operations in step 10, I then tried to run the new compact command for ceph (https://bugzilla.redhat.com/show_bug.cgi?id=1483224).  I got:

[root@magna007 ceph-5]# ceph daemon osd.5 compact
admin_socket: exception getting command descriptions: [Errno 2] No such file or directory
admin_socket: exception getting command descriptions: [Errno 2] No such file or directory

I am not sure if this is a problem or not.  I am also updating bz 1483224 as well.
Comment 28 Warren 2017-10-13 03:36:17 UTC 
This does not seem to work on Ubuntu.  After running the steps in Comment 10:

ID WEIGHT  TYPE NAME         UP/DOWN REWEIGHT PRIMARY-AFFINITY 
-1 8.13950 root default                                        
-2 2.71317     host magna038                                   
 0 0.90439         osd.0          up  1.00000          1.00000 
 3 0.90439         osd.3          up  1.00000          1.00000 
 6 0.90439         osd.6          up  1.00000          1.00000 
-3 2.71317     host magna096                                   
 1 0.90439         osd.1          up  1.00000          1.00000 
 4 0.90439         osd.4          up  1.00000          1.00000 
 7 0.90439         osd.7          up  1.00000          1.00000 
-4 2.71317     host magna024                                   
 2 0.90439         osd.2          up  1.00000          1.00000 
 5 0.90439         osd.5        down        0          1.00000 
 8 0.90439         osd.8          up  1.00000          1.00000
Comment 31 Warren 2017-10-16 20:19:35 UTC 
Passed on both Ubuntu and Rhel.  I ran into a slight gotcha in that I ran some of the commands as root rather than the ceph user.  Josh helped me a bit and things worked after we changed permissions and ran as the correct user.  This comment also applies to bugzilla #1483224
Comment 36 errata-xmlrpc 2017-10-17 18:12:51 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:2903
Comment 38 Vikhyat Umrao 2017-10-24 15:21:48 UTC 
*** Bug 1480720 has been marked as a duplicate of this bug. ***
Note You need to log in before you can comment on or make changes to this bug.