Bug 1458044

Summary: rhosp-director: failed to deploy overcloud: resource CREATE failed: 'Client' object has no attribute 'networks'
Product: Red Hat OpenStack Reporter: Alexander Chuzhoy <sasha>
Component: openstack-heatAssignee: Zane Bitter <zbitter>
Status: CLOSED ERRATA QA Contact: Alexander Chuzhoy <sasha>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 12.0 (Pike)CC: aarapov, afazekas, aschultz, dbecker, jhakimra, jsaucier, jschluet, mburns, morazi, rhel-osp-director-maint, sbaker, scohen, shardy, srevivo, tvignaud, zbitter
Target Milestone: Upstream M2Keywords: AutomationBlocker, Triaged
Target Release: 12.0 (Pike)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-heat-9.0.0-0.20170612043222.a289f55.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-12-13 21:31:55 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Alexander Chuzhoy 2017-06-01 20:50:02 UTC
rhosp-director: failed to deploy overcloud: resource CREATE failed: 'Client' object has no attribute 'networks'

Environment:
openstack-tripleo-heat-templates-7.0.0-0.20170521033302.el7ost.noarch
openstack-puppet-modules-10.0.0-0.20170315222135.0333c73.el7.1.noarch
instack-undercloud-7.0.0-0.20170521005009.el7ost.noarch

Try to deploy overcloud with:
openstack overcloud deploy --templates --libvirt-type kvm -e /usr/share/openstack-tripleo-heat-templates/environments/docker.yaml -e /home/stack/templates/docker-osp12.yaml -e /home/stack/templates/nodes_data.yaml --log-file overcloud_deployment_0.log



Result:
Deployment fails:


(undercloud) [stack@undercloud-0 ~]$ openstack stack failures list overcloud
overcloud.Controller.0:
  resource_type: OS::TripleO::Controller
  physical_resource_id: 79381fa5-4d8c-4858-8cc3-b0a0d4eb0cf1
  status: CREATE_FAILED
  status_reason: |
    resources[0]: Resource CREATE failed: 'Client' object has no attribute 'networks'
overcloud.Compute.0:
  resource_type: OS::TripleO::Compute
  physical_resource_id: d9107fcd-21e7-4628-8dad-f7295f8fb14a
  status: CREATE_FAILED
  status_reason: |
    CREATE aborted


The issue reproduces.

Comment 2 Alexander Chuzhoy 2017-06-02 13:58:17 UTC
(undercloud) [stack@undercloud-0 ~]$ heat resource-list -n5 overcloud|grep -v COMPLE
WARNING (shell) "heat resource-list" is deprecated, please use "openstack stack resource list" instead
+-------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------+-----------------+----------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| resource_name                             | physical_resource_id                                                                                                                                                                 | resource_type                                                                                                                  | resource_status | updated_time         | stack_name                                                                                                                                                       |
+-------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------+-----------------+----------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Compute                                   | 28774126-1bb3-40a9-b1b0-4be25fe11b56                                                                                                                                                 | OS::Heat::ResourceGroup                                                                                                        | CREATE_FAILED   | 2017-06-01T23:34:54Z | overcloud                                                                                                                                                        |
| Controller                                | 4dc1ddd0-4b96-46ff-8936-1b935ad42a66                                                                                                                                                 | OS::Heat::ResourceGroup                                                                                                        | CREATE_FAILED   | 2017-06-01T23:34:54Z | overcloud                                                                                                                                                        |
| 0                                         | b98f5f22-a5ab-4f1c-8ba9-36ce992272d6                                                                                                                                                 | OS::TripleO::Compute                                                                                                           | CREATE_FAILED   | 2017-06-01T23:40:10Z | overcloud-Compute-f22caox6ea3n                                                                                                                                   |
| 0                                         | fd08271e-cc7a-43d7-a684-5e31390fff70                                                                                                                                                 | OS::TripleO::Controller                                                                                                        | CREATE_FAILED   | 2017-06-01T23:40:15Z | overcloud-Controller-vpavogwnaszv                                                                                                                                |
+-------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------+-----------------+----------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+
(undercloud) [stack@undercloud-0 ~]$ heat resource-show overcloud Controller
WARNING (shell) "heat resource-show" is deprecated, please use "openstack stack resource show" instead
+------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+
| Property               | Value                                                                                                                                               |
+------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+
| attributes             | {                                                                                                                                                   |
|                        |   "attributes": null,                                                                                                                               |
|                        |   "refs": null,                                                                                                                                     |
|                        |   "refs_map": null,                                                                                                                                 |
|                        |   "removed_rsrc_list": []                                                                                                                           |
|                        | }                                                                                                                                                   |
| creation_time          | 2017-06-01T23:34:54Z                                                                                                                                |
| description            |                                                                                                                                                     |
| links                  | http://192.168.24.1:8004/v1/26266e71bf0447de8efdc712cb12412b/stacks/overcloud/4f0529c3-700a-4962-924f-09daf21f8ae0/resources/Controller (self)      |
|                        | http://192.168.24.1:8004/v1/26266e71bf0447de8efdc712cb12412b/stacks/overcloud/4f0529c3-700a-4962-924f-09daf21f8ae0 (stack)                          |
|                        | http://192.168.24.1:8004/v1/26266e71bf0447de8efdc712cb12412b/stacks/overcloud-Controller-vpavogwnaszv/4dc1ddd0-4b96-46ff-8936-1b935ad42a66 (nested) |
| logical_resource_id    | Controller                                                                                                                                          |
| physical_resource_id   | 4dc1ddd0-4b96-46ff-8936-1b935ad42a66                                                                                                                |
| required_by            | AllNodesDeploySteps                                                                                                                                 |
|                        | hostsConfig                                                                                                                                         |
|                        | AllNodesExtraConfig                                                                                                                                 |
|                        | ControllerIpListMap                                                                                                                                 |
|                        | ControllerAllNodesValidationDeployment                                                                                                              |
|                        | SshKnownHostsConfig                                                                                                                                 |
|                        | ControllerSshKnownHostsDeployment                                                                                                                   |
|                        | UpdateWorkflow                                                                                                                                      |
|                        | AllNodesValidationConfig                                                                                                                            |
|                        | allNodesConfig                                                                                                                                      |
|                        | ControllerAllNodesDeployment                                                                                                                        |
|                        | ControllerHostsDeployment                                                                                                                           |
| resource_name          | Controller                                                                                                                                          |
| resource_status        | CREATE_FAILED                                                                                                                                       |
| resource_status_reason | resources.Controller: resources[0]: Resource CREATE failed: 'Client' object has no attribute 'networks'                                             |
| resource_type          | OS::Heat::ResourceGroup                                                                                                                             |
| updated_time           | 2017-06-01T23:34:54Z                                                                                                                                |
+------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+

Comment 3 Alexander Chuzhoy 2017-06-02 13:59:02 UTC
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource Traceback (most recent call last):
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 803, in _action_recorder
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource     yield
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 911, in _do_action
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource     yield self.action_handler_task(action, args=handler_args)
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/scheduler.py", line 351, in wrapper
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource     step = next(subtask)
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 862, in action_handler_task
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource     done = check(handler_data)
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resources/openstack/heat/resource_group.py", line 376, in check_create_complete
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource     if not checker.step():
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/scheduler.py", line 217, in step
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource     poll_period = next(self._runner)
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resources/openstack/heat/resource_group.py", line 385, in _run_to_completion
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource     self).check_update_complete(updater):
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py", line 515, in check_update_complete
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource     cookie=cookie)
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py", line 417, in _check_status_complete
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource     action=action)
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource ResourceFailure: resources.Controller: resources[0]: Resource CREATE failed: 'Client' object has no attribute 'networks'
2017-06-01 19:43:09.092 3482 ERROR heat.engine.resource

Comment 5 Alexander Chuzhoy 2017-06-02 15:58:46 UTC
python-novaclient-8.0.0-0.20170517113627.e1b9e76.el7ost.noarch

Comment 6 Zane Bitter 2017-06-02 16:00:56 UTC
This is due to using novaclient 8.0.0, which is incompatible with released versions of Heat.

This is fixed upstream already for Pike in heat master, but the fix may not have trickled down to the build you're using yet.

Comment 8 Jon Schlueter 2017-06-19 15:22:58 UTC
moving back to POST

from https://bugs.launchpad.net/heat/+bug/1690936 another patch for heat is required to address python-novaclient issue.

https://review.openstack.org/#/c/466187/

Comment 9 Zane Bitter 2017-06-19 15:34:26 UTC
This is for all intents and purposes fixed.

The additional patch fixes OS::Nova::FloatingIP resources which hardly anybody uses (as opposed to OS::Neutron::FloatingIP). Specifically, they're not used in Director (in fact, I don't think Director uses any floating IPs). The second patch has merged upstream, so it will be in the final release and is not affecting testing in the meantime, so I don't think we need to track it specifically.

Comment 12 Alexander Chuzhoy 2017-06-19 18:21:47 UTC
Verified:
Environment:
openstack-heat-engine-9.0.0-0.20170612043222.a289f55.el7ost.noarch


The reported issue doesn't reproduce.

Comment 16 errata-xmlrpc 2017-12-13 21:31:55 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2017:3462