Bug 1591877

Summary:	Set objecter_inflight_ops = 24576 for bulk RGW deployments
Product:	[Red Hat Storage] Red Hat Ceph Storage	Reporter:	Douglas Fuller <dfuller>
Component:	RGW	Assignee:	Matt Benjamin (redhat) <mbenjamin>
Status:	CLOSED ERRATA	QA Contact:	Tiffany Nguyen <tunguyen>
Severity:	high	Docs Contact:	Aron Gunn <agunn>
Priority:	high
Version:	3.1	CC:	agunn, cbodley, ceph-eng-bugs, ceph-qe-bugs, hnallurv, jharriga, kbader, kdreyer, mbenjamin, owasserm, sweil, tserlin, tunguyen, vakulkar
Target Milestone:	rc	Keywords:	CodeChange
Target Release:	3.1
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	RHEL: ceph-12.2.5-42.el7cp Ubuntu: ceph_12.2.5-26redhat1xenial	Doc Type:	Enhancement
Doc Text:	.Increased the default value for the `objecter_inflight_ops` option The default value for the `objecter_inflight_ops` option was changed from 1024 to 24576. The original default value was insufficient to support a typical Object Gateway workload. With this enhancement, larger workloads are supported by default.	Story Points:	---
Clone Of:		Environment:
Last Closed:	2018-09-26 18:22:08 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1602921
Bug Blocks:	1581350, 1584264

Description Douglas Fuller 2018-06-15 17:53:05 UTC

Increasing objecter_inflight_ops has shown performance gains on larger deployments. For these deployments, set:

[global]
objecter_inflight_ops = 24576

Comment 3 Douglas Fuller 2018-06-28 14:36:18 UTC

https://github.com/ceph/ceph/pull/22581

Comment 4 Douglas Fuller 2018-06-28 14:41:59 UTC

Reverting previous changes; applied to wrong bug

Comment 16 Tiffany Nguyen 2018-08-30 02:09:45 UTC

Verified with build 12.2.5-39, when query objecter_inflight_ops, it returns 1024.  
I'm expecting to see objecter_inflight_ops = 24576 instead.

[root@c04-h05-6048r ceph]# ceph -v
ceph version 12.2.5-39.el7cp (f12d44e46a54948a86dd27b16c77d97475ba2d4e) luminous (stable)
[root@c04-h05-6048r ceph]# ceph daemon client.rgw.c04-h05-6048r config get objecter_inflight_ops
{
    "objecter_inflight_ops": "1024"
}

Comment 22 Tiffany Nguyen 2018-08-31 19:24:22 UTC

With build 12.2.5-42, objecter_inflight_ops is now set to 24576.

[root@c04-h01-6048r run]# ceph -v
ceph version 12.2.5-42.el7cp (82d52d7efa6edec70f6a0fc306f40b89265535fb) luminous (stable)
[root@c04-h01-6048r run]# ceph daemon client.rgw.c04-h01-6048r config get objecter_inflight_ops
{
    "objecter_inflight_ops": "24576"
}

Comment 24 errata-xmlrpc 2018-09-26 18:22:08 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2018:2819