1327684 – Deployment with containerised compute hangs if docker images not found

Bug 1327684 - Deployment with containerised compute hangs if docker images not found

Summary: Deployment with containerised compute hangs if docker images not found

Keywords:
Status:	CLOSED EOL
Alias:	None
Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	openstack-containers
Sub Component:
Version:	8.0 (Liberty)
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	unspecified
Target Milestone:	---
Target Release:	---
Assignee:	Martin André
QA Contact:	Jaroslav Henner
Docs Contact:	Andrew Burden
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2016-04-15 15:55 UTC by Ramon Acedo
Modified:	2017-05-22 14:32 UTC (History)
CC List:	3 users (show)
Fixed In Version:
Doc Type:	Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:	2017-05-22 13:50:47 UTC
Target Upstream Version:

Attachments	(Terms of Use)
Add an attachment (proposed patch, testcase, etc.)

Description Ramon Acedo 2016-04-15 15:55:04 UTC

When trying to deploy with containerised compute the deployment will hang if the images required are not found.

The compute node will show this process:

  root      34347  0.0  0.1 161500  8828 ?        Ssl  15:43   0:00 /usr/bin/docker pull registry.access.redhat.com/openstack-heat-docker-agents:latest

If tried manually we can see that the image doesn't exist and docker exists with error:

  [heat-admin@overcloud-novacompute-0 ~]$ sudo docker pull registry.access.redhat.com/openstack-heat-docker-agents:latest
  Trying to pull repository registry.access.redhat.com/openstack-heat-docker-agents ... not found
  Error: image openstack-heat-docker-agents:latest not found


In the docker logs I can see this:

Apr 15 15:52:05 overcloud-novacompute-0.localdomain docker[10677]: time="2016-04-15T15:52:05.489290302Z" level=error msg="HTTP Error" err="Cannot kill container heat-agents: no such id: heat-agents" statusCode=404
Apr 15 15:52:05 overcloud-novacompute-0.localdomain docker[10677]: time="2016-04-15T15:52:05.503636079Z" level=info msg="DELETE /v1.20/containers/heat-agents"
Apr 15 15:52:05 overcloud-novacompute-0.localdomain docker[10677]: time="2016-04-15T15:52:05.503790112Z" level=error msg="Handler for DELETE /containers/{name:.*} returned error: no such id: heat-agents"
Apr 15 15:52:05 overcloud-novacompute-0.localdomain docker[10677]: time="2016-04-15T15:52:05.503806669Z" level=error msg="HTTP Error" err="no such id: heat-agents" statusCode=404
Apr 15 15:52:05 overcloud-novacompute-0.localdomain docker[10677]: time="2016-04-15T15:52:05.537334266Z" level=info msg="POST /v1.20/images/create?fromImage=registry.access.redhat.com%2Fopenstack-heat-docker-agents%3Alatest"

To reproduce just deploy a basic deployment with 1 controller and 1 compute:

[stack@undercloud ~]$ openstack overcloud deploy --templates -e /usr/share/openstack-tripleo-heat-templates/environments/docker.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/docker-network.yaml

This is the output and then it hangs, it's been almost 3h now:

openstack overcloud deploy --templates -e /usr/share/openstack-tripleo-heat-templates/environments/docker.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/docker-network.yaml
Deploying templates in the directory /usr/share/openstack-tripleo-heat-templates
2016-04-15 13:44:27 [overcloud]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:27 [MysqlRootPassword]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:27 [Networks]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:28 [MysqlClusterUniquePart]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:28 [HeatAuthEncryptionKey]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:28 [HorizonSecret]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:28 [RabbitCookie]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:28 [PcsdPassword]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:28 [VipConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:28 [overcloud-Networks-h4qzxwquf2d5]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:28 [ExternalNetwork]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:29 [TenantNetwork]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:29 [overcloud-Networks-h4qzxwquf2d5-ExternalNetwork-aw3k3svl2mxz]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:29 [overcloud-Networks-h4qzxwquf2d5-ExternalNetwork-aw3k3svl2mxz]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:30 [MysqlRootPassword]: CREATE_COMPLETE  state changed
2016-04-15 13:44:30 [MysqlClusterUniquePart]: CREATE_COMPLETE  state changed
2016-04-15 13:44:30 [HorizonSecret]: CREATE_COMPLETE  state changed
2016-04-15 13:44:30 [RabbitCookie]: CREATE_COMPLETE  state changed
2016-04-15 13:44:30 [PcsdPassword]: CREATE_COMPLETE  state changed
2016-04-15 13:44:30 [HeatAuthEncryptionKey]: CREATE_COMPLETE  state changed
2016-04-15 13:44:30 [InternalNetwork]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:30 [overcloud-Networks-h4qzxwquf2d5-TenantNetwork-3dyuejzzi6y3]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:30 [overcloud-Networks-h4qzxwquf2d5-TenantNetwork-3dyuejzzi6y3]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:30 [overcloud-VipConfig-jah4etyyul6e]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:30 [VipConfigImpl]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:30 [VipConfigImpl]: CREATE_COMPLETE  state changed
2016-04-15 13:44:30 [overcloud-VipConfig-jah4etyyul6e]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:31 [VipConfig]: CREATE_COMPLETE  state changed
2016-04-15 13:44:31 [ManagementNetwork]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:31 [StorageMgmtNetwork]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:31 [overcloud-Networks-h4qzxwquf2d5-ManagementNetwork-chzryqp4rxml]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:31 [overcloud-Networks-h4qzxwquf2d5-ManagementNetwork-chzryqp4rxml]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:31 [overcloud-Networks-h4qzxwquf2d5-InternalNetwork-ojsxv2qn4vo2]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:31 [overcloud-Networks-h4qzxwquf2d5-InternalNetwork-ojsxv2qn4vo2]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:32 [StorageNetwork]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:32 [overcloud-Networks-h4qzxwquf2d5-StorageMgmtNetwork-727pm4f3ufhb]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:32 [overcloud-Networks-h4qzxwquf2d5-StorageMgmtNetwork-727pm4f3ufhb]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:33 [overcloud-Networks-h4qzxwquf2d5-StorageNetwork-xt6hvf7eqofx]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:33 [overcloud-Networks-h4qzxwquf2d5-StorageNetwork-xt6hvf7eqofx]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:33 [TenantNetwork]: CREATE_COMPLETE  state changed
2016-04-15 13:44:33 [InternalNetwork]: CREATE_COMPLETE  state changed
2016-04-15 13:44:33 [ManagementNetwork]: CREATE_COMPLETE  state changed
2016-04-15 13:44:33 [ExternalNetwork]: CREATE_COMPLETE  state changed
2016-04-15 13:44:33 [StorageNetwork]: CREATE_COMPLETE  state changed
2016-04-15 13:44:33 [StorageMgmtNetwork]: CREATE_COMPLETE  state changed
2016-04-15 13:44:33 [overcloud-Networks-h4qzxwquf2d5]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:34 [Networks]: CREATE_COMPLETE  state changed
2016-04-15 13:44:34 [ControlVirtualIP]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:35 [ObjectStorage]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:35 [overcloud-ObjectStorage-37awhfzdiqe2]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:35 [overcloud-ObjectStorage-37awhfzdiqe2]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:37 [CephStorage]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:37 [overcloud-ObjectStorage-37awhfzdiqe2]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 13:44:37 [overcloud-ObjectStorage-37awhfzdiqe2]: UPDATE_COMPLETE  Stack UPDATE completed successfully
2016-04-15 13:44:37 [overcloud-CephStorage-zll7znpxo5bu]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:37 [overcloud-CephStorage-zll7znpxo5bu]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:39 [overcloud-CephStorage-zll7znpxo5bu]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 13:44:39 [overcloud-CephStorage-zll7znpxo5bu]: UPDATE_COMPLETE  Stack UPDATE completed successfully
2016-04-15 13:44:40 [ControlVirtualIP]: CREATE_COMPLETE  state changed
2016-04-15 13:44:40 [ObjectStorage]: CREATE_COMPLETE  state changed
2016-04-15 13:44:40 [CephStorage]: CREATE_COMPLETE  state changed
2016-04-15 13:44:40 [InternalApiVirtualIP]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:40 [PublicVirtualIP]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:40 [overcloud-InternalApiVirtualIP-ix2yazlphyab]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:40 [overcloud-InternalApiVirtualIP-ix2yazlphyab]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:41 [StorageVirtualIP]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:41 [StorageMgmtVirtualIP]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:41 [overcloud-StorageVirtualIP-afncqenjbd64]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:41 [overcloud-StorageVirtualIP-afncqenjbd64]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:41 [overcloud-PublicVirtualIP-rfh4dqw3lq4m]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:41 [overcloud-PublicVirtualIP-rfh4dqw3lq4m]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:42 [RedisVirtualIP]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:42 [overcloud-RedisVirtualIP-3ky4g7ncq6kw]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:42 [VipPort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:42 [overcloud-StorageMgmtVirtualIP-s72wj2sofpzi]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:42 [overcloud-StorageMgmtVirtualIP-s72wj2sofpzi]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:43 [InternalApiVirtualIP]: CREATE_COMPLETE  state changed
2016-04-15 13:44:43 [VipPort]: CREATE_COMPLETE  state changed
2016-04-15 13:44:44 [PublicVirtualIP]: CREATE_COMPLETE  state changed
2016-04-15 13:44:44 [StorageVirtualIP]: CREATE_COMPLETE  state changed
2016-04-15 13:44:44 [StorageMgmtVirtualIP]: CREATE_COMPLETE  state changed
2016-04-15 13:44:44 [RedisVirtualIP]: CREATE_COMPLETE  state changed
2016-04-15 13:44:44 [VipMap]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:44 [overcloud-RedisVirtualIP-3ky4g7ncq6kw]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:44 [overcloud-VipMap-fge36lrbavb2]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:44 [overcloud-VipMap-fge36lrbavb2]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:45 [VipMap]: CREATE_COMPLETE  state changed
2016-04-15 13:44:45 [EndpointMap]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:46 [overcloud-EndpointMap-bov3g2fkdjkh]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:46 [overcloud-EndpointMap-bov3g2fkdjkh]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:47 [EndpointMap]: CREATE_COMPLETE  state changed
2016-04-15 13:44:47 [Compute]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:48 [overcloud-Compute-j2m4clpvoxbb]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:48 [overcloud-Compute-j2m4clpvoxbb]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:51 [BlockStorage]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:51 [overcloud-BlockStorage-fxt5ptl5hphv]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:51 [overcloud-BlockStorage-fxt5ptl5hphv]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:51 [overcloud-Compute-j2m4clpvoxbb]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 13:44:51 [0]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:52 [Controller]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:52 [overcloud-BlockStorage-fxt5ptl5hphv]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 13:44:52 [overcloud-BlockStorage-fxt5ptl5hphv]: UPDATE_COMPLETE  Stack UPDATE completed successfully
2016-04-15 13:44:53 [overcloud-Controller-fwww2gp3guj7]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:53 [overcloud-Controller-fwww2gp3guj7]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 13:44:57 [overcloud-Controller-fwww2gp3guj7]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 13:44:57 [overcloud-Compute-j2m4clpvoxbb-0-s4gf3rl4eg66]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:44:57 [NovaComputeConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:58 [NodeAdminUserData]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:58 [BlockStorage]: CREATE_COMPLETE  state changed
2016-04-15 13:44:58 [UpdateConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:44:59 [NodeUserData]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:45:00 [NovaComputeConfig]: CREATE_COMPLETE  state changed
2016-04-15 13:45:00 [UpdateConfig]: CREATE_COMPLETE  state changed
2016-04-15 13:45:01 [overcloud-Controller-fwww2gp3guj7-0-s62epa2rr3uu]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 13:45:01 [UpdateConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:45:01 [NodeUserData]: CREATE_COMPLETE  state changed
2016-04-15 13:45:02 [NodeUserData]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:45:02 [NodeAdminUserData]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:45:02 [NodeAdminUserData]: CREATE_COMPLETE  state changed
2016-04-15 13:45:03 [UpdateConfig]: CREATE_COMPLETE  state changed
2016-04-15 13:45:03 [UserData]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:45:04 [UserData]: CREATE_COMPLETE  state changed
2016-04-15 13:45:04 [NovaCompute]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:45:05 [NodeUserData]: CREATE_COMPLETE  state changed
2016-04-15 13:45:05 [NodeAdminUserData]: CREATE_COMPLETE  state changed
2016-04-15 13:45:05 [UserData]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:45:07 [UserData]: CREATE_COMPLETE  state changed
2016-04-15 13:45:07 [Controller]: CREATE_IN_PROGRESS  state changed


2016-04-15 13:56:55 [NovaCompute]: CREATE_COMPLETE  state changed
2016-04-15 13:56:55 [TenantPort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:56:57 [ManagementPort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:56:58 [InternalApiPort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:56:59 [StoragePort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:00 [ExternalPort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:00 [UpdateDeployment]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:01 [StorageMgmtPort]: CREATE_IN_PROGRESS  state changed

2016-04-15 13:57:03 [ManagementPort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:04 [StoragePort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:04 [TenantPort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:04 [InternalApiPort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:05 [StorageMgmtPort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:05 [ExternalPort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:05 [NetIpMap]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:06 [NetworkConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:08 [NetworkConfig]: CREATE_COMPLETE  state changed
2016-04-15 13:57:08 [NetIpMap]: CREATE_COMPLETE  state changed
2016-04-15 13:57:08 [NetworkDeployment]: CREATE_IN_PROGRESS  state changed


2016-04-15 13:57:45 [Controller]: CREATE_COMPLETE  state changed
2016-04-15 13:57:45 [InternalApiPort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:46 [ExternalPort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:46 [StoragePort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:47 [StorageMgmtPort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:47 [UpdateDeployment]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:47 [ManagementPort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:48 [TenantPort]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:49 [ExternalPort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:49 [StoragePort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:50 [InternalApiPort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:50 [StorageMgmtPort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:50 [ManagementPort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:50 [TenantPort]: CREATE_COMPLETE  state changed
2016-04-15 13:57:50 [NetIpSubnetMap]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:51 [NetworkConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:51 [NetIpMap]: CREATE_IN_PROGRESS  state changed
2016-04-15 13:57:53 [NetIpMap]: CREATE_COMPLETE  state changed
2016-04-15 13:57:54 [NetIpSubnetMap]: CREATE_COMPLETE  state changed
2016-04-15 13:57:54 [NetworkConfig]: CREATE_COMPLETE  state changed
2016-04-15 13:57:54 [NetworkDeployment]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:29 [UpdateDeployment]: SIGNAL_IN_PROGRESS  Signal: deployment succeeded
2016-04-15 14:00:30 [UpdateDeployment]: CREATE_COMPLETE  state changed
2016-04-15 14:00:30 [NetworkDeployment]: SIGNAL_IN_PROGRESS  Signal: deployment succeeded
2016-04-15 14:00:31 [NetworkDeployment]: CREATE_COMPLETE  state changed
2016-04-15 14:00:31 [NodeTLSCAData]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:32 [NodeTLSCAData]: CREATE_COMPLETE  state changed
2016-04-15 14:00:32 [NodeTLSData]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:35 [NodeTLSData]: CREATE_COMPLETE  state changed
2016-04-15 14:00:35 [ControllerConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:36 [ControllerConfig]: CREATE_COMPLETE  state changed
2016-04-15 14:00:36 [ControllerDeployment]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:52 [ControllerDeployment]: SIGNAL_IN_PROGRESS  Signal: deployment succeeded
2016-04-15 14:00:52 [ControllerDeployment]: CREATE_COMPLETE  state changed
2016-04-15 14:00:52 [ControllerExtraConfigPre]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:54 [ControllerExtraConfigPre]: CREATE_COMPLETE  state changed
2016-04-15 14:00:54 [NodeExtraConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:55 [NetworkDeployment]: SIGNAL_COMPLETE  Unknown
2016-04-15 14:00:55 [NodeExtraConfig]: CREATE_COMPLETE  state changed
2016-04-15 14:00:55 [overcloud-Controller-fwww2gp3guj7-0-s62epa2rr3uu]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:00:56 [0]: CREATE_COMPLETE  state changed
2016-04-15 14:00:56 [overcloud-Controller-fwww2gp3guj7]: UPDATE_COMPLETE  Stack UPDATE completed successfully
2016-04-15 14:00:57 [Controller]: CREATE_COMPLETE  state changed
2016-04-15 14:00:57 [VipDeployment]: CREATE_IN_PROGRESS  state changed


2016-04-15 14:00:57 [overcloud-VipDeployment-65vwzlscfawg]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:00:57 [overcloud-VipDeployment-65vwzlscfawg]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:00:58 [AllNodesValidationConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:58 [overcloud-VipDeployment-65vwzlscfawg]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 14:00:58 [0]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:58 [overcloud-AllNodesValidationConfig-mbnoyaxu6gcf]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:00:58 [AllNodesValidationsImpl]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:59 [ControllerBootstrapNodeConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:59 [SwiftDevicesAndProxyConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:59 [AllNodesValidationsImpl]: CREATE_COMPLETE  state changed
2016-04-15 14:00:59 [overcloud-AllNodesValidationConfig-mbnoyaxu6gcf]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:00:59 [overcloud-ControllerBootstrapNodeConfig-heaautgaasjq]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:00:59 [BootstrapNodeConfigImpl]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:00:59 [BootstrapNodeConfigImpl]: CREATE_COMPLETE  state changed
2016-04-15 14:00:59 [overcloud-ControllerBootstrapNodeConfig-heaautgaasjq]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:01:00 [ControllerClusterConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:00 [ControllerIpListMap]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:00 [overcloud-SwiftDevicesAndProxyConfig-w6v3fb54j7l6]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:01:00 [SwiftDevicesAndProxyConfigImpl]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:00 [SwiftDevicesAndProxyConfigImpl]: CREATE_COMPLETE  state changed
2016-04-15 14:01:00 [overcloud-SwiftDevicesAndProxyConfig-w6v3fb54j7l6]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:01:01 [overcloud-ControllerIpListMap-tchpbj2zxha3]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:01:01 [overcloud-ControllerIpListMap-tchpbj2zxha3]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:01:02 [SwiftDevicesAndProxyConfig]: CREATE_COMPLETE  state changed
2016-04-15 14:01:03 [AllNodesValidationConfig]: CREATE_COMPLETE  state changed
2016-04-15 14:01:03 [ControllerBootstrapNodeConfig]: CREATE_COMPLETE  state changed
2016-04-15 14:01:03 [ControllerIpListMap]: CREATE_COMPLETE  state changed
2016-04-15 14:01:03 [ControllerClusterConfig]: CREATE_COMPLETE  state changed
2016-04-15 14:01:03 [ControllerBootstrapNodeDeployment]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:04 [overcloud-ControllerBootstrapNodeDeployment-sbxrnyos6j5d]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:01:04 [overcloud-ControllerBootstrapNodeDeployment-sbxrnyos6j5d]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:01:06 [ControllerSwiftDeployment]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:06 [overcloud-ControllerSwiftDeployment-wua37g4cmqkt]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:01:06 [overcloud-ControllerSwiftDeployment-wua37g4cmqkt]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:01:06 [overcloud-ControllerBootstrapNodeDeployment-sbxrnyos6j5d]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 14:01:06 [0]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:08 [overcloud-ControllerSwiftDeployment-wua37g4cmqkt]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 14:01:09 [0]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:09 [ObjectStorageSwiftDeployment]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:10 [overcloud-ObjectStorageSwiftDeployment-qstl5ledir7c]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:01:10 [overcloud-ObjectStorageSwiftDeployment-qstl5ledir7c]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:01:11 [ControllerClusterDeployment]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:11 [overcloud-ObjectStorageSwiftDeployment-qstl5ledir7c]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 14:01:12 [CephClusterConfig]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:12 [overcloud-ObjectStorageSwiftDeployment-qstl5ledir7c]: UPDATE_COMPLETE  Stack UPDATE completed successfully
2016-04-15 14:01:12 [overcloud-ControllerClusterDeployment-n5sbtuook326]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:01:12 [overcloud-ControllerClusterDeployment-n5sbtuook326]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:01:12 [overcloud-ControllerClusterDeployment-n5sbtuook326]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 14:01:13 [0]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:13 [overcloud-CephClusterConfig-7z3bsawifmpa]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:01:13 [CephClusterConfigImpl]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:13 [CephClusterConfigImpl]: CREATE_COMPLETE  state changed
2016-04-15 14:01:13 [overcloud-CephClusterConfig-7z3bsawifmpa]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:01:14 [CephClusterConfig]: CREATE_COMPLETE  state changed
2016-04-15 14:01:14 [ObjectStorageSwiftDeployment]: CREATE_COMPLETE  state changed
2016-04-15 14:01:14 [CephStorageCephDeployment]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:15 [overcloud-CephStorageCephDeployment-gid7bzufisy4]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:01:15 [overcloud-CephStorageCephDeployment-gid7bzufisy4]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:01:16 [ControllerCephDeployment]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:16 [overcloud-CephStorageCephDeployment-gid7bzufisy4]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 14:01:16 [overcloud-CephStorageCephDeployment-gid7bzufisy4]: UPDATE_COMPLETE  Stack UPDATE completed successfully
2016-04-15 14:01:17 [overcloud-ControllerCephDeployment-k3giqvi7fzbc]: CREATE_IN_PROGRESS  Stack CREATE started
2016-04-15 14:01:17 [overcloud-ControllerCephDeployment-k3giqvi7fzbc]: CREATE_COMPLETE  Stack CREATE completed successfully
2016-04-15 14:01:17 [overcloud-ControllerCephDeployment-k3giqvi7fzbc]: UPDATE_IN_PROGRESS  Stack UPDATE started
2016-04-15 14:01:17 [0]: CREATE_IN_PROGRESS  state changed
2016-04-15 14:01:18 [CephStorageCephDeployment]: CREATE_COMPLETE  state changed
2016-04-15 14:01:18 [ControllerDeployment]: SIGNAL_COMPLETE  Unknown
2016-04-15 14:01:20 [NetworkDeployment]: SIGNAL_COMPLETE  Unknown
2016-04-15 14:01:20 [0]: SIGNAL_IN_PROGRESS  Signal: deployment succeeded
2016-04-15 14:01:21 [0]: CREATE_COMPLETE  state changed
2016-04-15 14:01:21 [overcloud-VipDeployment-65vwzlscfawg]: UPDATE_COMPLETE  Stack UPDATE completed successfully

2016-04-15 14:01:21 [VipDeployment]: CREATE_COMPLETE  state changed
2016-04-15 14:01:49 [0]: SIGNAL_IN_PROGRESS  Signal: deployment succeeded
2016-04-15 14:01:51 [0]: CREATE_COMPLETE  state changed
2016-04-15 14:01:53 [overcloud-ControllerBootstrapNodeDeployment-sbxrnyos6j5d]: UPDATE_COMPLETE  Stack UPDATE completed successfully
2016-04-15 14:01:54 [ControllerBootstrapNodeDeployment]: CREATE_COMPLETE  state changed
2016-04-15 14:01:56 [0]: SIGNAL_IN_PROGRESS  Signal: deployment succeeded
2016-04-15 14:01:57 [0]: CREATE_COMPLETE  state changed
2016-04-15 14:01:57 [overcloud-ControllerCephDeployment-k3giqvi7fzbc]: UPDATE_COMPLETE  Stack UPDATE completed successfully
2016-04-15 14:01:57 [0]: SIGNAL_IN_PROGRESS  Signal: deployment succeeded
2016-04-15 14:01:58 [0]: CREATE_COMPLETE  state changed
2016-04-15 14:01:58 [overcloud-ControllerClusterDeployment-n5sbtuook326]: UPDATE_COMPLETE  Stack UPDATE completed successfully
2016-04-15 14:01:59 [ControllerClusterDeployment]: CREATE_COMPLETE  state changed
2016-04-15 14:01:59 [ControllerCephDeployment]: CREATE_COMPLETE  state changed
2016-04-15 14:01:59 [0]: SIGNAL_IN_PROGRESS  Signal: deployment succeeded
2016-04-15 14:01:59 [ControllerDeployment]: SIGNAL_COMPLETE  Unknown
2016-04-15 14:02:00 [0]: CREATE_COMPLETE  state changed
2016-04-15 14:02:00 [overcloud-ControllerSwiftDeployment-wua37g4cmqkt]: UPDATE_COMPLETE  Stack UPDATE completed successfully
2016-04-15 14:02:00 [NetworkDeployment]: SIGNAL_COMPLETE  Unknown
2016-04-15 14:02:00 [0]: SIGNAL_COMPLETE  Unknown
2016-04-15 14:02:02 [ControllerSwiftDeployment]: CREATE_COMPLETE  state changed

Comment 2 Ryan Hallisey 2016-04-18 11:47:15 UTC

I don't think the images are available in the public registry just yet.

Jeff, are we close to having them public?

Comment 3 Ramon Acedo 2016-04-18 13:17:37 UTC

Ryan, you are right, this occurs due the images not being available. The intention of this bug is to highlight the fact that if the images are not available the deployment hangs for hours instead of raising an error as soon as the docker pull command fails.

Comment 4 Jeff Peeler 2016-05-03 16:12:39 UTC

Clearing needinfo. I'm sure upon leaving tech preview error handling and faster deployment will be looked at.

Comment 5 Martin André 2017-05-22 13:50:47 UTC

The deployment now fails fast when images cannot be downloaded from a registry.

Note You need to log in before you can comment on or make changes to this bug.