Bug 1611850

Summary: [RFE] bluestore: add total osd memory target
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Josh Durgin <jdurgin>
Component: RADOSAssignee: Mark Nelson <mnelson>
Status: CLOSED ERRATA QA Contact: Parikshith <pbyregow>
Severity: high Docs Contact: Bara Ancincova <bancinco>
Priority: high    
Version: 3.2CC: anharris, ceph-eng-bugs, ceph-qe-bugs, dzafman, edonnell, gabrioux, hnallurv, kchai, kdreyer, mnelson, nojha, pasik, pbyregow, vumrao
Target Milestone: rcKeywords: FutureFeature
Target Release: 3.2   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: RHEL: ceph-ansible-3.2.0-0.1.rc5.el7cp Ubuntu: ceph-ansible_3.2.0~rc5-2redhat1 Doc Type: Enhancement
Doc Text:
.New option: `osd_memory_target` A new option, `osd_memory_target`, has been added with the release. This option sets a target memory size for OSDs. The BlueStore back end adjusts its cache size and attempts to stay close to this target. The `ceph-ansible` utility automatically adjusts `osd_memory_target` based on host memory. The default value is 4 GiB. The `osd_memory_target` option is set differently for Hyper-converged infrastructure (HCI) and non-HCI setups. To differentiate between them, use the `is_hci` configuration parameter. This parameter is set to `false` by default. To change the default values of `osd_memory_target` and `is_hci`, set them in the `all.yml` file.
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-01-03 19:01:46 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1595003, 1629656    

Description Josh Durgin 2018-08-02 23:43:10 UTC
Add a configurable to set a target for OSD memory usage, and adjust bluestore's cache size to stay within that limit.

Comment 11 Neha Ojha 2018-11-13 07:12:41 UTC
Hi Parikshith,

Do we have any ceph-ansible logs that show what the values of non_hci_safety_factor, is_hci etc. are? Maybe, try changing them and see if they reflect correctly. 

Just want to make sure that the required parameters have been added to the yaml.

Comment 17 Neha Ojha 2018-11-14 10:06:38 UTC
is_hci: false
hci_safety_factor: 0.2
non_hci_safety_factor: 0.7
osd_memory_target: 4000000000

These values need to provided in all.yml for them to be used.

Comment 19 Neha Ojha 2018-11-19 07:00:03 UTC
https://github.com/ceph/ceph-ansible/pull/3340 should fix this issue.

Comment 29 errata-xmlrpc 2019-01-03 19:01:46 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:0020