Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1635666

Summary: InvalidInventory Error post undercloud upgrade from Rhos 10->11
Product: Red Hat OpenStack Reporter: Archit Modi <amodi>
Component: openstack-novaAssignee: OSP DFG:Compute <osp-dfg-compute>
Status: CLOSED WONTFIX QA Contact: OSP DFG:Compute <osp-dfg-compute>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 11.0 (Ocata)CC: berrange, dasmith, eglynn, jhakimra, kchamart, mschuppe, sbauza, sferdjao, sgordon, vromanso
Target Milestone: ---Keywords: Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-10-12 14:12:24 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
undercloud sosreport none

Description Archit Modi 2018-10-03 13:03:38 UTC
Created attachment 1490040 [details]
undercloud sosreport

Description of problem: After u[grading undercloud from Rhos-10 to Rhos-11, there are many n-placement-api.log logs showing InvalidInventory error


Version-Release number of selected component (if applicable):
openstack-nova-placement-api-15.1.0-3.el7ost.noarch

Steps to Reproduce:
1. Deploy Rhos-10 and start the upgrade procedure to Rhos-11
2. openstack undercloud upgrade
3. Check nova logs post upgrade for InvalidInventory error

Actual results:

Undercloud upgrade completed at the below time:
2018-10-02 18:44:59,249 INFO: 
#############################################################################
Undercloud upgrade complete.

The file containing this installation's passwords is at
/home/stack/undercloud-passwords.conf.

There is also a stackrc file at /home/stack/stackrc.

These files are needed to interact with the OpenStack services, and should be
secured.

#############################################################################

n-placement-api.log:
DISK_GB' on resource provider '23a188a8-2848-4295-a431-4a032d1baf7a' invalid.
./nova-placement-api.log:2018-10-02 18:48:27.317 21815 ERROR nova.api.openstack.placement.handlers.allocation
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation [req-1db09db0-02de-45bf-b7dd-c8c71b29b15f 6323208a5b1e4d6db5af073c078884a6 29128a5f62ef42afb0e8fdff43e4419a - default default] Bad inventory
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation Traceback (most recent call last):
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation   File "/usr/lib/python2.7/site-packages/nova/api/openstack/placement/handlers/allocation.py", line 255, in set_allocations
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation     allocations.create_all()
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation   File "/usr/lib/python2.7/site-packages/nova/objects/resource_provider.py", line 1187, in create_all
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation     self._set_allocations(self._context, self.objects)
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 894, in wrapper
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation     return fn(*args, **kwargs)
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation   File "/usr/lib/python2.7/site-packages/nova/objects/resource_provider.py", line 1149, in _set_allocations
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation     before_gens = _check_capacity_exceeded(conn, allocs)
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation   File "/usr/lib/python2.7/site-packages/nova/objects/resource_provider.py", line 1024, in _check_capacity_exceeded
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation     resource_provider=provider_str)
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation InvalidInventory: Inventory for 'VCPU, MEMORY_MB, DISK_GB' on resource provider '16f833c3-51ac-4fc4-a35d-85b2e4a38d82' invalid.
./nova-placement-api.log:2018-10-02 18:48:27.494 21815 ERROR nova.api.openstack.placement.handlers.allocation


Expected results:
No errors

Additional info:

Comment 10 Martin Schuppert 2018-10-12 14:12:24 UTC
* this only happens after upgrade from OSP10 -> OSP11
* this does not happen on a fresh OSP11 install
* this issue is fixed when upgrade OSP11 -> OSP12

[root@undercloud-0 ~]# mysql -u root nova_api -e " select * from inventories limit 2 \G;"
*************************** 1. row ***************************
          created_at: 2018-10-11 11:07:13
          updated_at: NULL
                  id: 1
resource_provider_id: 1
   resource_class_id: 0
               total: 4
            reserved: 0
            min_unit: 1
            max_unit: 4
           step_size: 1
    allocation_ratio: 1
*************************** 2. row ***************************
          created_at: 2018-10-11 11:07:13
          updated_at: NULL
                  id: 2
resource_provider_id: 1
   resource_class_id: 1
               total: 6144
            reserved: 0
            min_unit: 1
            max_unit: 6144
           step_size: 1
    allocation_ratio: 1

[root@undercloud-0 ~]# mysql -u root nova_api -e "select * from allocations limit 2\G;"
*************************** 1. row ***************************
          created_at: 2018-10-11 11:07:13
          updated_at: NULL
                  id: 1
resource_provider_id: 1
         consumer_id: af68b024-4ed8-4d33-b865-4b5b7de41278
   resource_class_id: 0
                used: 3
*************************** 2. row ***************************
          created_at: 2018-10-11 11:07:13
          updated_at: NULL
                  id: 2
resource_provider_id: 1
         consumer_id: af68b024-4ed8-4d33-b865-4b5b7de41278
   resource_class_id: 1
                used: 6144

Since this seem to not affect FFU from 10 -> 13 as we do not see errors when we are on OSP12 and OSP11 is EOL we close this as wont fix.