| Summary: | Deployment with containerised compute hangs if docker images not found | ||
|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Ramon Acedo <racedoro> |
| Component: | openstack-containers | Assignee: | Martin André <m.andre> |
| Status: | CLOSED EOL | QA Contact: | Jaroslav Henner <jhenner> |
| Severity: | unspecified | Docs Contact: | Andrew Burden <aburden> |
| Priority: | unspecified | ||
| Version: | 8.0 (Liberty) | CC: | aschultz, jpeeler, m.andre |
| Target Milestone: | --- | Keywords: | ZStream |
| Target Release: | --- | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | Bug Fix | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2017-05-22 13:50:47 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
I don't think the images are available in the public registry just yet. Jeff, are we close to having them public? Ryan, you are right, this occurs due the images not being available. The intention of this bug is to highlight the fact that if the images are not available the deployment hangs for hours instead of raising an error as soon as the docker pull command fails. Clearing needinfo. I'm sure upon leaving tech preview error handling and faster deployment will be looked at. The deployment now fails fast when images cannot be downloaded from a registry. |
When trying to deploy with containerised compute the deployment will hang if the images required are not found. The compute node will show this process: root 34347 0.0 0.1 161500 8828 ? Ssl 15:43 0:00 /usr/bin/docker pull registry.access.redhat.com/openstack-heat-docker-agents:latest If tried manually we can see that the image doesn't exist and docker exists with error: [heat-admin@overcloud-novacompute-0 ~]$ sudo docker pull registry.access.redhat.com/openstack-heat-docker-agents:latest Trying to pull repository registry.access.redhat.com/openstack-heat-docker-agents ... not found Error: image openstack-heat-docker-agents:latest not found In the docker logs I can see this: Apr 15 15:52:05 overcloud-novacompute-0.localdomain docker[10677]: time="2016-04-15T15:52:05.489290302Z" level=error msg="HTTP Error" err="Cannot kill container heat-agents: no such id: heat-agents" statusCode=404 Apr 15 15:52:05 overcloud-novacompute-0.localdomain docker[10677]: time="2016-04-15T15:52:05.503636079Z" level=info msg="DELETE /v1.20/containers/heat-agents" Apr 15 15:52:05 overcloud-novacompute-0.localdomain docker[10677]: time="2016-04-15T15:52:05.503790112Z" level=error msg="Handler for DELETE /containers/{name:.*} returned error: no such id: heat-agents" Apr 15 15:52:05 overcloud-novacompute-0.localdomain docker[10677]: time="2016-04-15T15:52:05.503806669Z" level=error msg="HTTP Error" err="no such id: heat-agents" statusCode=404 Apr 15 15:52:05 overcloud-novacompute-0.localdomain docker[10677]: time="2016-04-15T15:52:05.537334266Z" level=info msg="POST /v1.20/images/create?fromImage=registry.access.redhat.com%2Fopenstack-heat-docker-agents%3Alatest" To reproduce just deploy a basic deployment with 1 controller and 1 compute: [stack@undercloud ~]$ openstack overcloud deploy --templates -e /usr/share/openstack-tripleo-heat-templates/environments/docker.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/docker-network.yaml This is the output and then it hangs, it's been almost 3h now: openstack overcloud deploy --templates -e /usr/share/openstack-tripleo-heat-templates/environments/docker.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/docker-network.yaml Deploying templates in the directory /usr/share/openstack-tripleo-heat-templates 2016-04-15 13:44:27 [overcloud]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:27 [MysqlRootPassword]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:27 [Networks]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:28 [MysqlClusterUniquePart]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:28 [HeatAuthEncryptionKey]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:28 [HorizonSecret]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:28 [RabbitCookie]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:28 [PcsdPassword]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:28 [VipConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:28 [overcloud-Networks-h4qzxwquf2d5]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:28 [ExternalNetwork]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:29 [TenantNetwork]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:29 [overcloud-Networks-h4qzxwquf2d5-ExternalNetwork-aw3k3svl2mxz]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:29 [overcloud-Networks-h4qzxwquf2d5-ExternalNetwork-aw3k3svl2mxz]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:30 [MysqlRootPassword]: CREATE_COMPLETE state changed 2016-04-15 13:44:30 [MysqlClusterUniquePart]: CREATE_COMPLETE state changed 2016-04-15 13:44:30 [HorizonSecret]: CREATE_COMPLETE state changed 2016-04-15 13:44:30 [RabbitCookie]: CREATE_COMPLETE state changed 2016-04-15 13:44:30 [PcsdPassword]: CREATE_COMPLETE state changed 2016-04-15 13:44:30 [HeatAuthEncryptionKey]: CREATE_COMPLETE state changed 2016-04-15 13:44:30 [InternalNetwork]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:30 [overcloud-Networks-h4qzxwquf2d5-TenantNetwork-3dyuejzzi6y3]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:30 [overcloud-Networks-h4qzxwquf2d5-TenantNetwork-3dyuejzzi6y3]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:30 [overcloud-VipConfig-jah4etyyul6e]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:30 [VipConfigImpl]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:30 [VipConfigImpl]: CREATE_COMPLETE state changed 2016-04-15 13:44:30 [overcloud-VipConfig-jah4etyyul6e]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:31 [VipConfig]: CREATE_COMPLETE state changed 2016-04-15 13:44:31 [ManagementNetwork]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:31 [StorageMgmtNetwork]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:31 [overcloud-Networks-h4qzxwquf2d5-ManagementNetwork-chzryqp4rxml]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:31 [overcloud-Networks-h4qzxwquf2d5-ManagementNetwork-chzryqp4rxml]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:31 [overcloud-Networks-h4qzxwquf2d5-InternalNetwork-ojsxv2qn4vo2]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:31 [overcloud-Networks-h4qzxwquf2d5-InternalNetwork-ojsxv2qn4vo2]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:32 [StorageNetwork]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:32 [overcloud-Networks-h4qzxwquf2d5-StorageMgmtNetwork-727pm4f3ufhb]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:32 [overcloud-Networks-h4qzxwquf2d5-StorageMgmtNetwork-727pm4f3ufhb]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:33 [overcloud-Networks-h4qzxwquf2d5-StorageNetwork-xt6hvf7eqofx]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:33 [overcloud-Networks-h4qzxwquf2d5-StorageNetwork-xt6hvf7eqofx]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:33 [TenantNetwork]: CREATE_COMPLETE state changed 2016-04-15 13:44:33 [InternalNetwork]: CREATE_COMPLETE state changed 2016-04-15 13:44:33 [ManagementNetwork]: CREATE_COMPLETE state changed 2016-04-15 13:44:33 [ExternalNetwork]: CREATE_COMPLETE state changed 2016-04-15 13:44:33 [StorageNetwork]: CREATE_COMPLETE state changed 2016-04-15 13:44:33 [StorageMgmtNetwork]: CREATE_COMPLETE state changed 2016-04-15 13:44:33 [overcloud-Networks-h4qzxwquf2d5]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:34 [Networks]: CREATE_COMPLETE state changed 2016-04-15 13:44:34 [ControlVirtualIP]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:35 [ObjectStorage]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:35 [overcloud-ObjectStorage-37awhfzdiqe2]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:35 [overcloud-ObjectStorage-37awhfzdiqe2]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:37 [CephStorage]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:37 [overcloud-ObjectStorage-37awhfzdiqe2]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 13:44:37 [overcloud-ObjectStorage-37awhfzdiqe2]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 13:44:37 [overcloud-CephStorage-zll7znpxo5bu]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:37 [overcloud-CephStorage-zll7znpxo5bu]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:39 [overcloud-CephStorage-zll7znpxo5bu]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 13:44:39 [overcloud-CephStorage-zll7znpxo5bu]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 13:44:40 [ControlVirtualIP]: CREATE_COMPLETE state changed 2016-04-15 13:44:40 [ObjectStorage]: CREATE_COMPLETE state changed 2016-04-15 13:44:40 [CephStorage]: CREATE_COMPLETE state changed 2016-04-15 13:44:40 [InternalApiVirtualIP]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:40 [PublicVirtualIP]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:40 [overcloud-InternalApiVirtualIP-ix2yazlphyab]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:40 [overcloud-InternalApiVirtualIP-ix2yazlphyab]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:41 [StorageVirtualIP]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:41 [StorageMgmtVirtualIP]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:41 [overcloud-StorageVirtualIP-afncqenjbd64]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:41 [overcloud-StorageVirtualIP-afncqenjbd64]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:41 [overcloud-PublicVirtualIP-rfh4dqw3lq4m]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:41 [overcloud-PublicVirtualIP-rfh4dqw3lq4m]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:42 [RedisVirtualIP]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:42 [overcloud-RedisVirtualIP-3ky4g7ncq6kw]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:42 [VipPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:42 [overcloud-StorageMgmtVirtualIP-s72wj2sofpzi]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:42 [overcloud-StorageMgmtVirtualIP-s72wj2sofpzi]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:43 [InternalApiVirtualIP]: CREATE_COMPLETE state changed 2016-04-15 13:44:43 [VipPort]: CREATE_COMPLETE state changed 2016-04-15 13:44:44 [PublicVirtualIP]: CREATE_COMPLETE state changed 2016-04-15 13:44:44 [StorageVirtualIP]: CREATE_COMPLETE state changed 2016-04-15 13:44:44 [StorageMgmtVirtualIP]: CREATE_COMPLETE state changed 2016-04-15 13:44:44 [RedisVirtualIP]: CREATE_COMPLETE state changed 2016-04-15 13:44:44 [VipMap]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:44 [overcloud-RedisVirtualIP-3ky4g7ncq6kw]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:44 [overcloud-VipMap-fge36lrbavb2]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:44 [overcloud-VipMap-fge36lrbavb2]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:45 [VipMap]: CREATE_COMPLETE state changed 2016-04-15 13:44:45 [EndpointMap]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:46 [overcloud-EndpointMap-bov3g2fkdjkh]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:46 [overcloud-EndpointMap-bov3g2fkdjkh]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:47 [EndpointMap]: CREATE_COMPLETE state changed 2016-04-15 13:44:47 [Compute]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:48 [overcloud-Compute-j2m4clpvoxbb]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:48 [overcloud-Compute-j2m4clpvoxbb]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:51 [BlockStorage]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:51 [overcloud-BlockStorage-fxt5ptl5hphv]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:51 [overcloud-BlockStorage-fxt5ptl5hphv]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:51 [overcloud-Compute-j2m4clpvoxbb]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 13:44:51 [0]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:52 [Controller]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:52 [overcloud-BlockStorage-fxt5ptl5hphv]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 13:44:52 [overcloud-BlockStorage-fxt5ptl5hphv]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 13:44:53 [overcloud-Controller-fwww2gp3guj7]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:53 [overcloud-Controller-fwww2gp3guj7]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 13:44:57 [overcloud-Controller-fwww2gp3guj7]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 13:44:57 [overcloud-Compute-j2m4clpvoxbb-0-s4gf3rl4eg66]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:44:57 [NovaComputeConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:58 [NodeAdminUserData]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:58 [BlockStorage]: CREATE_COMPLETE state changed 2016-04-15 13:44:58 [UpdateConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 13:44:59 [NodeUserData]: CREATE_IN_PROGRESS state changed 2016-04-15 13:45:00 [NovaComputeConfig]: CREATE_COMPLETE state changed 2016-04-15 13:45:00 [UpdateConfig]: CREATE_COMPLETE state changed 2016-04-15 13:45:01 [overcloud-Controller-fwww2gp3guj7-0-s62epa2rr3uu]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 13:45:01 [UpdateConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 13:45:01 [NodeUserData]: CREATE_COMPLETE state changed 2016-04-15 13:45:02 [NodeUserData]: CREATE_IN_PROGRESS state changed 2016-04-15 13:45:02 [NodeAdminUserData]: CREATE_IN_PROGRESS state changed 2016-04-15 13:45:02 [NodeAdminUserData]: CREATE_COMPLETE state changed 2016-04-15 13:45:03 [UpdateConfig]: CREATE_COMPLETE state changed 2016-04-15 13:45:03 [UserData]: CREATE_IN_PROGRESS state changed 2016-04-15 13:45:04 [UserData]: CREATE_COMPLETE state changed 2016-04-15 13:45:04 [NovaCompute]: CREATE_IN_PROGRESS state changed 2016-04-15 13:45:05 [NodeUserData]: CREATE_COMPLETE state changed 2016-04-15 13:45:05 [NodeAdminUserData]: CREATE_COMPLETE state changed 2016-04-15 13:45:05 [UserData]: CREATE_IN_PROGRESS state changed 2016-04-15 13:45:07 [UserData]: CREATE_COMPLETE state changed 2016-04-15 13:45:07 [Controller]: CREATE_IN_PROGRESS state changed 2016-04-15 13:56:55 [NovaCompute]: CREATE_COMPLETE state changed 2016-04-15 13:56:55 [TenantPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:56:57 [ManagementPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:56:58 [InternalApiPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:56:59 [StoragePort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:00 [ExternalPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:00 [UpdateDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:01 [StorageMgmtPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:03 [ManagementPort]: CREATE_COMPLETE state changed 2016-04-15 13:57:04 [StoragePort]: CREATE_COMPLETE state changed 2016-04-15 13:57:04 [TenantPort]: CREATE_COMPLETE state changed 2016-04-15 13:57:04 [InternalApiPort]: CREATE_COMPLETE state changed 2016-04-15 13:57:05 [StorageMgmtPort]: CREATE_COMPLETE state changed 2016-04-15 13:57:05 [ExternalPort]: CREATE_COMPLETE state changed 2016-04-15 13:57:05 [NetIpMap]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:06 [NetworkConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:08 [NetworkConfig]: CREATE_COMPLETE state changed 2016-04-15 13:57:08 [NetIpMap]: CREATE_COMPLETE state changed 2016-04-15 13:57:08 [NetworkDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:45 [Controller]: CREATE_COMPLETE state changed 2016-04-15 13:57:45 [InternalApiPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:46 [ExternalPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:46 [StoragePort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:47 [StorageMgmtPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:47 [UpdateDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:47 [ManagementPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:48 [TenantPort]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:49 [ExternalPort]: CREATE_COMPLETE state changed 2016-04-15 13:57:49 [StoragePort]: CREATE_COMPLETE state changed 2016-04-15 13:57:50 [InternalApiPort]: CREATE_COMPLETE state changed 2016-04-15 13:57:50 [StorageMgmtPort]: CREATE_COMPLETE state changed 2016-04-15 13:57:50 [ManagementPort]: CREATE_COMPLETE state changed 2016-04-15 13:57:50 [TenantPort]: CREATE_COMPLETE state changed 2016-04-15 13:57:50 [NetIpSubnetMap]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:51 [NetworkConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:51 [NetIpMap]: CREATE_IN_PROGRESS state changed 2016-04-15 13:57:53 [NetIpMap]: CREATE_COMPLETE state changed 2016-04-15 13:57:54 [NetIpSubnetMap]: CREATE_COMPLETE state changed 2016-04-15 13:57:54 [NetworkConfig]: CREATE_COMPLETE state changed 2016-04-15 13:57:54 [NetworkDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:29 [UpdateDeployment]: SIGNAL_IN_PROGRESS Signal: deployment succeeded 2016-04-15 14:00:30 [UpdateDeployment]: CREATE_COMPLETE state changed 2016-04-15 14:00:30 [NetworkDeployment]: SIGNAL_IN_PROGRESS Signal: deployment succeeded 2016-04-15 14:00:31 [NetworkDeployment]: CREATE_COMPLETE state changed 2016-04-15 14:00:31 [NodeTLSCAData]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:32 [NodeTLSCAData]: CREATE_COMPLETE state changed 2016-04-15 14:00:32 [NodeTLSData]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:35 [NodeTLSData]: CREATE_COMPLETE state changed 2016-04-15 14:00:35 [ControllerConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:36 [ControllerConfig]: CREATE_COMPLETE state changed 2016-04-15 14:00:36 [ControllerDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:52 [ControllerDeployment]: SIGNAL_IN_PROGRESS Signal: deployment succeeded 2016-04-15 14:00:52 [ControllerDeployment]: CREATE_COMPLETE state changed 2016-04-15 14:00:52 [ControllerExtraConfigPre]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:54 [ControllerExtraConfigPre]: CREATE_COMPLETE state changed 2016-04-15 14:00:54 [NodeExtraConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:55 [NetworkDeployment]: SIGNAL_COMPLETE Unknown 2016-04-15 14:00:55 [NodeExtraConfig]: CREATE_COMPLETE state changed 2016-04-15 14:00:55 [overcloud-Controller-fwww2gp3guj7-0-s62epa2rr3uu]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:00:56 [0]: CREATE_COMPLETE state changed 2016-04-15 14:00:56 [overcloud-Controller-fwww2gp3guj7]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 14:00:57 [Controller]: CREATE_COMPLETE state changed 2016-04-15 14:00:57 [VipDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:57 [overcloud-VipDeployment-65vwzlscfawg]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:00:57 [overcloud-VipDeployment-65vwzlscfawg]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:00:58 [AllNodesValidationConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:58 [overcloud-VipDeployment-65vwzlscfawg]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 14:00:58 [0]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:58 [overcloud-AllNodesValidationConfig-mbnoyaxu6gcf]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:00:58 [AllNodesValidationsImpl]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:59 [ControllerBootstrapNodeConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:59 [SwiftDevicesAndProxyConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:59 [AllNodesValidationsImpl]: CREATE_COMPLETE state changed 2016-04-15 14:00:59 [overcloud-AllNodesValidationConfig-mbnoyaxu6gcf]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:00:59 [overcloud-ControllerBootstrapNodeConfig-heaautgaasjq]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:00:59 [BootstrapNodeConfigImpl]: CREATE_IN_PROGRESS state changed 2016-04-15 14:00:59 [BootstrapNodeConfigImpl]: CREATE_COMPLETE state changed 2016-04-15 14:00:59 [overcloud-ControllerBootstrapNodeConfig-heaautgaasjq]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:01:00 [ControllerClusterConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:00 [ControllerIpListMap]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:00 [overcloud-SwiftDevicesAndProxyConfig-w6v3fb54j7l6]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:01:00 [SwiftDevicesAndProxyConfigImpl]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:00 [SwiftDevicesAndProxyConfigImpl]: CREATE_COMPLETE state changed 2016-04-15 14:01:00 [overcloud-SwiftDevicesAndProxyConfig-w6v3fb54j7l6]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:01:01 [overcloud-ControllerIpListMap-tchpbj2zxha3]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:01:01 [overcloud-ControllerIpListMap-tchpbj2zxha3]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:01:02 [SwiftDevicesAndProxyConfig]: CREATE_COMPLETE state changed 2016-04-15 14:01:03 [AllNodesValidationConfig]: CREATE_COMPLETE state changed 2016-04-15 14:01:03 [ControllerBootstrapNodeConfig]: CREATE_COMPLETE state changed 2016-04-15 14:01:03 [ControllerIpListMap]: CREATE_COMPLETE state changed 2016-04-15 14:01:03 [ControllerClusterConfig]: CREATE_COMPLETE state changed 2016-04-15 14:01:03 [ControllerBootstrapNodeDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:04 [overcloud-ControllerBootstrapNodeDeployment-sbxrnyos6j5d]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:01:04 [overcloud-ControllerBootstrapNodeDeployment-sbxrnyos6j5d]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:01:06 [ControllerSwiftDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:06 [overcloud-ControllerSwiftDeployment-wua37g4cmqkt]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:01:06 [overcloud-ControllerSwiftDeployment-wua37g4cmqkt]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:01:06 [overcloud-ControllerBootstrapNodeDeployment-sbxrnyos6j5d]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 14:01:06 [0]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:08 [overcloud-ControllerSwiftDeployment-wua37g4cmqkt]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 14:01:09 [0]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:09 [ObjectStorageSwiftDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:10 [overcloud-ObjectStorageSwiftDeployment-qstl5ledir7c]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:01:10 [overcloud-ObjectStorageSwiftDeployment-qstl5ledir7c]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:01:11 [ControllerClusterDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:11 [overcloud-ObjectStorageSwiftDeployment-qstl5ledir7c]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 14:01:12 [CephClusterConfig]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:12 [overcloud-ObjectStorageSwiftDeployment-qstl5ledir7c]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 14:01:12 [overcloud-ControllerClusterDeployment-n5sbtuook326]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:01:12 [overcloud-ControllerClusterDeployment-n5sbtuook326]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:01:12 [overcloud-ControllerClusterDeployment-n5sbtuook326]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 14:01:13 [0]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:13 [overcloud-CephClusterConfig-7z3bsawifmpa]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:01:13 [CephClusterConfigImpl]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:13 [CephClusterConfigImpl]: CREATE_COMPLETE state changed 2016-04-15 14:01:13 [overcloud-CephClusterConfig-7z3bsawifmpa]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:01:14 [CephClusterConfig]: CREATE_COMPLETE state changed 2016-04-15 14:01:14 [ObjectStorageSwiftDeployment]: CREATE_COMPLETE state changed 2016-04-15 14:01:14 [CephStorageCephDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:15 [overcloud-CephStorageCephDeployment-gid7bzufisy4]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:01:15 [overcloud-CephStorageCephDeployment-gid7bzufisy4]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:01:16 [ControllerCephDeployment]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:16 [overcloud-CephStorageCephDeployment-gid7bzufisy4]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 14:01:16 [overcloud-CephStorageCephDeployment-gid7bzufisy4]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 14:01:17 [overcloud-ControllerCephDeployment-k3giqvi7fzbc]: CREATE_IN_PROGRESS Stack CREATE started 2016-04-15 14:01:17 [overcloud-ControllerCephDeployment-k3giqvi7fzbc]: CREATE_COMPLETE Stack CREATE completed successfully 2016-04-15 14:01:17 [overcloud-ControllerCephDeployment-k3giqvi7fzbc]: UPDATE_IN_PROGRESS Stack UPDATE started 2016-04-15 14:01:17 [0]: CREATE_IN_PROGRESS state changed 2016-04-15 14:01:18 [CephStorageCephDeployment]: CREATE_COMPLETE state changed 2016-04-15 14:01:18 [ControllerDeployment]: SIGNAL_COMPLETE Unknown 2016-04-15 14:01:20 [NetworkDeployment]: SIGNAL_COMPLETE Unknown 2016-04-15 14:01:20 [0]: SIGNAL_IN_PROGRESS Signal: deployment succeeded 2016-04-15 14:01:21 [0]: CREATE_COMPLETE state changed 2016-04-15 14:01:21 [overcloud-VipDeployment-65vwzlscfawg]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 14:01:21 [VipDeployment]: CREATE_COMPLETE state changed 2016-04-15 14:01:49 [0]: SIGNAL_IN_PROGRESS Signal: deployment succeeded 2016-04-15 14:01:51 [0]: CREATE_COMPLETE state changed 2016-04-15 14:01:53 [overcloud-ControllerBootstrapNodeDeployment-sbxrnyos6j5d]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 14:01:54 [ControllerBootstrapNodeDeployment]: CREATE_COMPLETE state changed 2016-04-15 14:01:56 [0]: SIGNAL_IN_PROGRESS Signal: deployment succeeded 2016-04-15 14:01:57 [0]: CREATE_COMPLETE state changed 2016-04-15 14:01:57 [overcloud-ControllerCephDeployment-k3giqvi7fzbc]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 14:01:57 [0]: SIGNAL_IN_PROGRESS Signal: deployment succeeded 2016-04-15 14:01:58 [0]: CREATE_COMPLETE state changed 2016-04-15 14:01:58 [overcloud-ControllerClusterDeployment-n5sbtuook326]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 14:01:59 [ControllerClusterDeployment]: CREATE_COMPLETE state changed 2016-04-15 14:01:59 [ControllerCephDeployment]: CREATE_COMPLETE state changed 2016-04-15 14:01:59 [0]: SIGNAL_IN_PROGRESS Signal: deployment succeeded 2016-04-15 14:01:59 [ControllerDeployment]: SIGNAL_COMPLETE Unknown 2016-04-15 14:02:00 [0]: CREATE_COMPLETE state changed 2016-04-15 14:02:00 [overcloud-ControllerSwiftDeployment-wua37g4cmqkt]: UPDATE_COMPLETE Stack UPDATE completed successfully 2016-04-15 14:02:00 [NetworkDeployment]: SIGNAL_COMPLETE Unknown 2016-04-15 14:02:00 [0]: SIGNAL_COMPLETE Unknown 2016-04-15 14:02:02 [ControllerSwiftDeployment]: CREATE_COMPLETE state changed