Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1481821

Summary: Ceph pg_num and pgp_num default is too low for any user
Product: Red Hat OpenStack Reporter: Yogev Rabl <yrabl>
Component: openstack-tripleo-heat-templatesAssignee: Giulio Fidente <gfidente>
Status: CLOSED ERRATA QA Contact: Yogev Rabl <yrabl>
Severity: high Docs Contact:
Priority: high    
Version: 10.0 (Newton)CC: dbecker, dhill, gfidente, jjoyce, jomurphy, lruzicka, mburns, morazi, rhel-osp-director-maint
Target Milestone: z6Keywords: Reopened, Triaged, ZStream
Target Release: 10.0 (Newton)   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: openstack-tripleo-heat-templates-5.3.3-1.el7ost Doc Type: Known Issue
Doc Text:
The default value of `pg_num` and `pgp_num` has been set to 128 instead of 32. Consequently, the existing Ceph pools will be updated so that their `pg_num` and `pgp_num` changes to 128 and the data will be rebalanced on the OSDs. Customized values previously set in custom Heat environment files will be preserved. To keep `pg_num` and `pgp_num` set to their previous default values, add an extra environment file to the update or upgrade command. The command should have the following contents: parameter_defaults: ExtraConfig: ceph::profile::params::osd_pool_default_pg_num: 32 ceph::profile::params::osd_pool_default_pgp_num: 32
Story Points: ---
Clone Of:
: 1489120 1489121 (view as bug list) Environment:
Last Closed: 2018-01-04 13:27:18 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1481685, 1489120, 1489121    

Description Yogev Rabl 2017-08-15 19:38:33 UTC
Description of problem:
OSP director defaults set Ceph's pg_num and pgp_num to 32 which is too low. This will cause performance issues for any costumer that will use it.

Version-Release number of selected component (if applicable):


How reproducible:
100%

Steps to Reproduce:
1.
2.
3.

Actual results:
The pg_num and pgp_num for all the pools is 32

Expected results:
pg_num and pgp_num default should be 128, which is the right number for the minimum deployment of 3 OSDs in a cluster

Additional info:

Comment 1 Jeff Brown 2017-08-29 18:11:34 UTC
We need to set this to 128 by default. It will potentially overwritten by derived parameters or customers that  read the documentation.

Comment 4 Yogev Rabl 2017-11-07 18:04:46 UTC
verification passed: 
# ceph osd pool get volumes pg_num
pg_num: 128

rpm -qa |grep openstack-tripleo-heat-templates
openstack-tripleo-heat-templates-5.3.3-1.el7ost.noarch

grep ceph::profile::params::osd_pool_default_pg_num /usr/share/openstack-tripleo-heat-templates/ -r
/usr/share/openstack-tripleo-heat-templates/puppet/services/ceph-mon.yaml:            ceph::profile::params::osd_pool_default_pg_num: 128

Comment 6 errata-xmlrpc 2017-11-15 13:45:13 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:3231