Bug 1310178 - undercloud's nova.conf scheduler_max_attempts should be dynamic depending on the number of nodes
Summary: undercloud's nova.conf scheduler_max_attempts should be dynamic depending on ...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: instack-undercloud
Version: 8.0 (Liberty)
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: ga
: 10.0 (Newton)
Assignee: Dmitry Tantsur
QA Contact: Omri Hochman
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-02-19 16:35 UTC by Sylvain Bauza
Modified: 2019-10-10 11:16 UTC (History)
9 users (show)

Fixed In Version: instack-undercloud-2.2.7-3.el7ost.noarch
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2016-06-23 18:21:06 UTC
Target Upstream Version:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 284762 0 None None None 2016-02-25 15:24:18 UTC

Description Sylvain Bauza 2016-02-19 16:35:43 UTC
Description of problem:

At the moment, we only set scheduler_max_attempts=3 in nova.conf (default).
Given that we have a design problem between Ironic and Nova, we most of time end up with some undercloud provisioning failing because the placement is suboptimal and we hit a upper bound of retries.

Increasing that retry number doesn't really fix the problem but it's a nice workaround for helping customers to deploy Director.

Since we can't really assume which max number we should cap the number of retries, we should ideally try to figure out the number of hosts to provision in the undercloud and set that number as a value for scheduler_max_attempts.

Comment 2 Dmitry Tantsur 2016-02-25 15:17:47 UTC
Hi! I don't think we can realistically reconfigure Nova just before deployment (it will even require root access). So I think increasing the retries number e.g. to 30 would do the trick. Anyway I know that people prefer to deploy in bulks of 20-30.

Comment 3 Dmitry Tantsur 2016-02-25 15:24:18 UTC
Upstream patch posted.

Comment 5 Dmitry Tantsur 2016-03-02 14:07:25 UTC
Patches merged upstream, waiting for the next rebase now.

Comment 7 Mike Burns 2016-04-07 21:11:06 UTC
This bug did not make the OSP 8.0 release.  It is being deferred to OSP 10.

Comment 8 Dmitry Tantsur 2016-04-08 07:58:23 UTC
Sigh, I'm so bad at updating my bugs.... Mike, I'm sorry again, this bug did make it in OSPd8...

Comment 14 Omri Hochman 2016-05-29 22:38:39 UTC
(In reply to Dmitry Tantsur from comment #2)
> Hi! I don't think we can realistically reconfigure Nova just before
> deployment (it will even require root access). So I think increasing the
> retries number e.g. to 30 would do the trick. Anyway I know that people
> prefer to deploy in bulks of 20-30.

Verified with ospd-9 

[stack@undercloud72 ~]$ rpm -qa | grep undercloud
instack-undercloud-4.0.0-2.el7ost.noarch

vi /etc/nova/nova.conf

# * Services that use this:
#
#     ``nova-scheduler``
#
# * Related options:
#
#     None
#  (integer value)
#scheduler_max_attempts=3
scheduler_max_attempts=30


Note You need to log in before you can comment on or make changes to this bug.