Bug 1481821 – Ceph pg_num and pgp_num default is too low for any user

Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.

Bug 1481821 - Ceph pg_num and pgp_num default is too low for any user

Summary:	Ceph pg_num and pgp_num default is too low for any user

Status:	CLOSED ERRATA

Aliases:	None

Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	openstack-tripleo-heat-templates (Show other bugs)
Sub Component:
Version:	10.0 (Newton)
Hardware:	x86_64 Linux

Priority	high Severity high
Target Milestone:	z6
Target Release:	10.0 (Newton)
Assigned To:	Giulio Fidente
QA Contact:	Yogev Rabl
Docs Contact:

URL:
Whiteboard:
Keywords:	Reopened, Triaged, ZStream

Depends On:
Blocks:	1481685 1489120 1489121
	Show dependency tree / graph

Reported:	2017-08-15 15:38 EDT by Yogev Rabl
Modified:	2018-01-04 08:28 EST (History)
CC List:	9 users (show)

See Also:
Fixed In Version:	openstack-tripleo-heat-templates-5.3.3-1.el7ost
Doc Type:	Known Issue
Doc Text:	The default value of `pg_num` and `pgp_num` has been set to 128 instead of 32. Consequently, the existing Ceph pools will be updated so that their `pg_num` and `pgp_num` changes to 128 and the data will be rebalanced on the OSDs. Customized values previously set in custom Heat environment files will be preserved. To keep `pg_num` and `pgp_num` set to their previous default values, add an extra environment file to the update or upgrade command. The command should have the following contents: parameter_defaults: ExtraConfig: ceph::profile::params::osd_pool_default_pg_num: 32 ceph::profile::params::osd_pool_default_pgp_num: 32
Story Points:	---
Clone Of:
Clones:	1489120 1489121 (view as bug list)
Environment:
Last Closed:	2018-01-04 08:27:18 EST
Type:	Bug
Regression:	---
Mount Type:	---
Documentation:	---
CRM:
Verified Versions:
Category:	---
oVirt Team:	---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---

Attachments	(Terms of Use)
Add an attachment (proposed patch, testcase, etc.)

External Trackers
Tracker	ID	Priority	Status	Summary	Last Updated
OpenStack gerrit	507779	None	None	None	2017-09-29 08:02 EDT
Red Hat Product Errata	RHBA-2017:3231	normal	SHIPPED_LIVE	Red Hat OpenStack Platform 10 director Bug Fix Advisory	2017-11-15 13:36:45 EST

Groups: None (edit)

Description Yogev Rabl 2017-08-15 15:38:33 EDT

Description of problem:
OSP director defaults set Ceph's pg_num and pgp_num to 32 which is too low. This will cause performance issues for any costumer that will use it.

Version-Release number of selected component (if applicable):


How reproducible:
100%

Steps to Reproduce:
1.
2.
3.

Actual results:
The pg_num and pgp_num for all the pools is 32

Expected results:
pg_num and pgp_num default should be 128, which is the right number for the minimum deployment of 3 OSDs in a cluster

Additional info:

Comment 1 Jeff Brown 2017-08-29 14:11:34 EDT

We need to set this to 128 by default. It will potentially overwritten by derived parameters or customers that  read the documentation.

Comment 4 Yogev Rabl 2017-11-07 13:04:46 EST

verification passed: 
# ceph osd pool get volumes pg_num
pg_num: 128

rpm -qa |grep openstack-tripleo-heat-templates
openstack-tripleo-heat-templates-5.3.3-1.el7ost.noarch

grep ceph::profile::params::osd_pool_default_pg_num /usr/share/openstack-tripleo-heat-templates/ -r
/usr/share/openstack-tripleo-heat-templates/puppet/services/ceph-mon.yaml:            ceph::profile::params::osd_pool_default_pg_num: 128

Comment 6 errata-xmlrpc 2017-11-15 08:45:13 EST

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:3231

Note You need to log in before you can comment on or make changes to this bug.