Bug 1602921

Summary:	Recommended settings for RGW users and procedure for applying
Product:	[Red Hat Storage] Red Hat Ceph Storage	Reporter:	John Harrigan <jharriga>
Component:	Documentation	Assignee:	John Wilkins <jowilkin>
Status:	CLOSED CURRENTRELEASE	QA Contact:	Tiffany Nguyen <tunguyen>
Severity:	unspecified	Docs Contact:
Priority:	unspecified
Version:	3.1	CC:	asriram, jharriga, jowilkin, kdreyer, vakulkar
Target Milestone:	rc
Target Release:	3.1
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2019-02-26 07:25:19 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1581350, 1591822, 1591873, 1591877, 1593418

Description John Harrigan 2018-07-18 20:00:07 UTC

Description of problem:
The "Ceph Object Gateway for Production" guide currently does not
provide a list of recommended settings or a procedure for applying
them. 

Additional info:
Settings specific to RGW production beahvior should be listed and
recommended settings provided. In addition, there needs to a well
documented procedure which details for users how to apply Ceph settings. 
Currently users can use ceph-ansible, 'ceph tell/inject', direct edits
to ceph.conf'.
Determine best practices, verify procedure and document.
Provide examples for several scenarios.

Comment 3 John Harrigan 2018-08-09 14:57:47 UTC

My request here is that provide a succinct procedure for RHCS admins
I am unable to find that in the current the docs (Admin and RGW Production)
This is not RGW specific.

note that several of the recommended settings now have new, more appropriate default values for RGW users as of RHCS 3.1
* filestore_merge_threshold: key to mitigating splitting activity slowdown
Performance penalty of over 60% was observed.
* objecter_inflight_ops: increased the number for better scalability
* rgw_thread_pool_size : increased the size for better scalability

Comment 4 John Wilkins 2018-08-23 23:34:02 UTC

https://access.qa.redhat.com/documentation/en-us/red_hat_ceph_storage/3/html-single/ceph_object_gateway_for_production/#assembly-configuring-ceph-rgw-adv

Comment 5 Tiffany Nguyen 2018-08-27 16:52:22 UTC

Section 4.4.5 and 4.4.6, both don't have enough content.  As a user, I don't see the clear picture of recommended setting for objecter_inflight_ops and rgw_thread_pool_size.  

Also, doc should include the default settings which are recently changed in 3.1 build:
objecter_inflight_ops = 24576 - Bug 1591877
rgw_thread_pool_size = 512 - Bug 1591822
filestore_merge_threshold = -10 - Bug 1591873

Please update the doc with additional default settings.

Comment 6 John Wilkins 2018-08-29 15:51:03 UTC

https://access.qa.redhat.com/documentation/en-us/red_hat_ceph_storage/3/html-single/ceph_object_gateway_for_production/#assembly-configuring-ceph-rgw-adv