Bug 1582284
| Summary: | OSP10 minor update fails on compute nodes with: Error: We couldn't get the live value of the neutron agent, please contact support. at /etc/puppet/modules/tripleo/manifests/profile/base/neutron.pp:77 on node compute-0.localdomain | ||
|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Marius Cornea <mcornea> |
| Component: | rhosp-director | Assignee: | RHOS Maint <rhos-maint> |
| Status: | CLOSED DUPLICATE | QA Contact: | Amit Ugol <augol> |
| Severity: | urgent | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | 10.0 (Newton) | CC: | dbecker, mburns, morazi |
| Target Milestone: | --- | Keywords: | ZStream |
| Target Release: | --- | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2018-05-24 18:19:33 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
*** This bug has been marked as a duplicate of bug 1579184 *** |
Description of problem: OSP10 minor update from z8 to latest fails on compute nodes with: Error: We couldn't get the live value of the neutron agent, please contact support. at /etc/puppet/modules/tripleo/manifests/profile/base/neutron.pp:77 on node compute-0.localdomain [stack@undercloud-0 ~]$ openstack stack failures list overcloud overcloud.AllNodesDeploySteps.ControllerDeployment_Step3.1: resource_type: OS::Heat::StructuredDeployment physical_resource_id: 69afb84f-5fe7-4700-87da-4b6ce8f33de3 status: UPDATE_FAILED status_reason: | UPDATE aborted deploy_stdout: | ... Debug: Using settings: adding file resource 'rrddir': 'File[/var/lib/puppet/rrd]{:path=>"/var/lib/puppet/rrd", :mode=>"750", :owner=>"puppet", :group=>"puppet", :ensure=>:directory, :loglevel=>:debug, :links=>:follow, :backup=>false}' Debug: /File[/var/lib/puppet/rrd]/seluser: Found seluser default 'system_u' for /var/lib/puppet/rrd Debug: /File[/var/lib/puppet/rrd]/selrole: Found selrole default 'object_r' for /var/lib/puppet/rrd Debug: /File[/var/lib/puppet/rrd]/seltype: Found seltype default 'puppet_var_lib_t' for /var/lib/puppet/rrd Debug: /File[/var/lib/puppet/rrd]/selrange: Found selrange default 's0' for /var/lib/puppet/rrd Debug: Finishing transaction 78747940 Debug: Received report to process from controller-1.localdomain Debug: Evicting cache entry for environment 'production' Debug: Caching environment 'production' (ttl = 0 sec) Debug: Processing report from controller-1.localdomain with processor Puppet::Reports::Store (truncated, view all with --long) deploy_stderr: | e review the documentation regarding the implications. overcloud.AllNodesDeploySteps.ControllerDeployment_Step3.0: resource_type: OS::Heat::StructuredDeployment physical_resource_id: fa459b36-92e0-4636-89ab-1c85a4aa61f9 status: UPDATE_FAILED status_reason: | UPDATE aborted deploy_stdout: | ... Debug: hiera(): Looking for data source heat_config_ControllerDeployment_Step3 Debug: hiera(): Cannot find datafile /etc/puppet/hieradata/heat_config_ControllerDeployment_Step3.yaml, skipping Debug: hiera(): Looking for data source controller_extraconfig Debug: hiera(): Looking for data source extraconfig Debug: hiera(): Looking for data source service_configs Debug: hiera(): Looking for data source service_names Debug: hiera(): Looking for data source controller Debug: hiera(): Looking for data source bootstrap_node Debug: hiera(): Looking for data source all_nodes Debug: hiera(): Found stack_action in all_nodes (truncated, view all with --long) deploy_stderr: | c/puppet/modules/tripleo/manifests/profile/base/nova.pp:97 on node controller-0.localdomain overcloud.AllNodesDeploySteps.ControllerDeployment_Step3.2: resource_type: OS::Heat::StructuredDeployment physical_resource_id: dc721152-339b-4a5a-8b43-d3d7a05c3a65 status: UPDATE_FAILED status_reason: | UPDATE aborted deploy_stdout: | ... Debug: Using settings: adding file resource 'rrddir': 'File[/var/lib/puppet/rrd]{:path=>"/var/lib/puppet/rrd", :mode=>"750", :owner=>"puppet", :group=>"puppet", :ensure=>:directory, :loglevel=>:debug, :links=>:follow, :backup=>false}' Debug: /File[/var/lib/puppet/rrd]/seluser: Found seluser default 'system_u' for /var/lib/puppet/rrd Debug: /File[/var/lib/puppet/rrd]/selrole: Found selrole default 'object_r' for /var/lib/puppet/rrd Debug: /File[/var/lib/puppet/rrd]/seltype: Found seltype default 'puppet_var_lib_t' for /var/lib/puppet/rrd Debug: /File[/var/lib/puppet/rrd]/selrange: Found selrange default 's0' for /var/lib/puppet/rrd Debug: Finishing transaction 74936720 Debug: Received report to process from controller-2.localdomain Debug: Evicting cache entry for environment 'production' Debug: Caching environment 'production' (ttl = 0 sec) Debug: Processing report from controller-2.localdomain with processor Puppet::Reports::Store (truncated, view all with --long) deploy_stderr: | e review the documentation regarding the implications. overcloud.AllNodesDeploySteps.ComputeDeployment_Step3.1: resource_type: OS::Heat::StructuredDeployment physical_resource_id: 7c72c6d6-ac4b-4a5d-83e1-3f0ebe62772c status: UPDATE_FAILED status_reason: | Error: resources[1]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1 deploy_stdout: | ... Debug: hiera(): Looking for data source heat_config_ComputeDeployment_Step3 Debug: hiera(): Cannot find datafile /etc/puppet/hieradata/heat_config_ComputeDeployment_Step3.yaml, skipping Debug: hiera(): Looking for data source compute_extraconfig Debug: hiera(): Looking for data source extraconfig Debug: hiera(): Looking for data source service_names Debug: hiera(): Looking for data source service_configs Debug: hiera(): Looking for data source compute Debug: hiera(): Looking for data source bootstrap_node Debug: hiera(): Looking for data source all_nodes Debug: hiera(): Found stack_action in all_nodes (truncated, view all with --long) deploy_stderr: | host', resolution='<anonymous>': uninitialized constant Tempfile Could not retrieve fact='current_nova_host', resolution='<anonymous>': uninitialized constant Tempfile Error: We couldn't get the live value of the neutron agent, please contact support. at /etc/puppet/modules/tripleo/manifests/profile/base/neutron.pp:77 on node compute-1.localdomain Error: We couldn't get the live value of the neutron agent, please contact support. at /etc/puppet/modules/tripleo/manifests/profile/base/neutron.pp:77 on node compute-1.localdomain overcloud.AllNodesDeploySteps.ComputeDeployment_Step3.0: resource_type: OS::Heat::StructuredDeployment physical_resource_id: 3bbea783-deb3-4df6-aa87-7ffb997613f1 status: UPDATE_FAILED status_reason: | UPDATE aborted deploy_stdout: | ... Debug: hiera(): Looking for data source heat_config_ComputeDeployment_Step3 Debug: hiera(): Cannot find datafile /etc/puppet/hieradata/heat_config_ComputeDeployment_Step3.yaml, skipping Debug: hiera(): Looking for data source compute_extraconfig Debug: hiera(): Looking for data source extraconfig Debug: hiera(): Looking for data source service_names Debug: hiera(): Looking for data source service_configs Debug: hiera(): Looking for data source compute Debug: hiera(): Looking for data source bootstrap_node Debug: hiera(): Looking for data source all_nodes Debug: hiera(): Found stack_action in all_nodes (truncated, view all with --long) deploy_stderr: | host', resolution='<anonymous>': uninitialized constant Tempfile Could not retrieve fact='current_nova_host', resolution='<anonymous>': uninitialized constant Tempfile Error: We couldn't get the live value of the neutron agent, please contact support. at /etc/puppet/modules/tripleo/manifests/profile/base/neutron.pp:77 on node compute-0.localdomain Error: We couldn't get the live value of the neutron agent, please contact support. at /etc/puppet/modules/tripleo/manifests/profile/base/neutron.pp:77 on node compute-0.localdomain Version-Release number of selected component (if applicable): puppet-tripleo-5.6.8-6.el7ost.noarch How reproducible: 100% Steps to Reproduce: 1. Deploy OSP10 z8 with 3 controller + 2 computes + 3 ceph OSD nodes 2. #!/bin/bash openstack overcloud deploy \ --timeout 100 \ --templates /usr/share/openstack-tripleo-heat-templates \ --stack overcloud \ --libvirt-type kvm \ --ntp-server clock.redhat.com \ --control-scale 3 \ --control-flavor controller \ --compute-scale 2 \ --compute-flavor compute \ --environment-file /usr/share/openstack-tripleo-heat-templates/environments/cinder-backup.yaml \ --environment-file /usr/share/openstack-tripleo-heat-templates/environments/services/sahara.yaml \ --ceph-storage-scale 3 \ --ceph-storage-flavor ceph \ -e /usr/share/openstack-tripleo-heat-templates/environments/storage-environment.yaml \ -e /home/stack/virt/internal.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml \ -e /home/stack/virt/network/network-environment.yaml \ -e /home/stack/virt/enable-tls.yaml \ -e /home/stack/virt/inject-trust-anchor.yaml \ -e /home/stack/virt/public_vip.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/tls-endpoints-public-ip.yaml \ -e /home/stack/virt/hostnames.yml \ -e /home/stack/virt/debug.yaml \ --log-file overcloud_deployment_46.log --update-plan-only 3. openstack overcloud update stack -i overcloud Actual results: stack update fails Expected results: stack update completes fine Additional info: Attaching sosreports