Bug 1572836

Summary: nova-compute should log messages about stale resource allocations at warning priority
Product: Red Hat OpenStack Reporter: Lars Kellogg-Stedman <lars>
Component: openstack-novaAssignee: Artom Lifshitz <alifshit>
Status: CLOSED ERRATA QA Contact: OSP DFG:Compute <osp-dfg-compute>
Severity: medium Docs Contact:
Priority: medium    
Version: 12.0 (Pike)CC: alifshit, berrange, dasmith, eglynn, jhakimra, kchamart, sbauza, sferdjao, sgordon, slinaber, srevivo, vromanso
Target Milestone: z3Keywords: Triaged, ZStream
Target Release: 12.0 (Pike)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-nova-16.0.4-16.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-08-20 12:55:30 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1572787    

Description Lars Kellogg-Stedman 2018-04-28 02:48:42 UTC 
Description of problem:

We ran into a situation with an OSP12 deployment (upgraded from OSP11) in which new instances were failing to schedule on a target compute node that was empty. Nova-conductor would throw a NoValidHost exception without any details, and there were no other error messages related to the failure. It turns out this was due to a number of stale resource allocations on the target compute node.

If nova-compute finds stale allocations, it logs a message at DEBUG priority that says:

  There are allocations remaining against the source host that might need to be removed:

Since this is logged at DEBUG priority, the message will not typically be seen by operators in a production environment. However, stale allocations can prevent Nova from scheduling new instances on the compute node, leading to mysterious failures for which there are no obvious errors.

This message should be logged at WARNING priority so that it is visible.

Version-Release number of selected component (if applicable):

openstack-nova-compute-16.0.4-5.el7ost.noarch
Comment 6 Artom Lifshitz 2018-07-24 15:35:00 UTC 
Bug filed by a Red Hatter with no customer case and is a simple logging level change, don't think we need doc text for this.
Comment 10 errata-xmlrpc 2018-08-20 12:55:30 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2018:2332