Bug 1481821 - Ceph pg_num and pgp_num default is too low for any user
Summary: Ceph pg_num and pgp_num default is too low for any user
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-tripleo-heat-templates
Version: 10.0 (Newton)
Hardware: x86_64
OS: Linux
high
high
Target Milestone: z6
: 10.0 (Newton)
Assignee: Giulio Fidente
QA Contact: Yogev Rabl
URL:
Whiteboard:
Depends On:
Blocks: 1481685 1489120 1489121
TreeView+ depends on / blocked
 
Reported: 2017-08-15 19:38 UTC by Yogev Rabl
Modified: 2021-03-11 15:36 UTC (History)
9 users (show)

Fixed In Version: openstack-tripleo-heat-templates-5.3.3-1.el7ost
Doc Type: Known Issue
Doc Text:
The default value of `pg_num` and `pgp_num` has been set to 128 instead of 32. Consequently, the existing Ceph pools will be updated so that their `pg_num` and `pgp_num` changes to 128 and the data will be rebalanced on the OSDs. Customized values previously set in custom Heat environment files will be preserved. To keep `pg_num` and `pgp_num` set to their previous default values, add an extra environment file to the update or upgrade command. The command should have the following contents: parameter_defaults: ExtraConfig: ceph::profile::params::osd_pool_default_pg_num: 32 ceph::profile::params::osd_pool_default_pgp_num: 32
Clone Of:
: 1489120 1489121 (view as bug list)
Environment:
Last Closed: 2018-01-04 13:27:18 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 507779 0 None MERGED Default Ceph pg_num and pgp_num to 128 2020-05-26 12:51:53 UTC
Red Hat Product Errata RHBA-2017:3231 0 normal SHIPPED_LIVE Red Hat OpenStack Platform 10 director Bug Fix Advisory 2017-11-15 18:36:45 UTC

Description Yogev Rabl 2017-08-15 19:38:33 UTC
Description of problem:
OSP director defaults set Ceph's pg_num and pgp_num to 32 which is too low. This will cause performance issues for any costumer that will use it.

Version-Release number of selected component (if applicable):


How reproducible:
100%

Steps to Reproduce:
1.
2.
3.

Actual results:
The pg_num and pgp_num for all the pools is 32

Expected results:
pg_num and pgp_num default should be 128, which is the right number for the minimum deployment of 3 OSDs in a cluster

Additional info:

Comment 1 Jeff Brown 2017-08-29 18:11:34 UTC
We need to set this to 128 by default. It will potentially overwritten by derived parameters or customers that  read the documentation.

Comment 4 Yogev Rabl 2017-11-07 18:04:46 UTC
verification passed: 
# ceph osd pool get volumes pg_num
pg_num: 128

rpm -qa |grep openstack-tripleo-heat-templates
openstack-tripleo-heat-templates-5.3.3-1.el7ost.noarch

grep ceph::profile::params::osd_pool_default_pg_num /usr/share/openstack-tripleo-heat-templates/ -r
/usr/share/openstack-tripleo-heat-templates/puppet/services/ceph-mon.yaml:            ceph::profile::params::osd_pool_default_pg_num: 128

Comment 6 errata-xmlrpc 2017-11-15 13:45:13 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:3231


Note You need to log in before you can comment on or make changes to this bug.