Bug 1315753

Summary:	keystone error in latest ospd-8 poodle, No auth_url configured, overcloudrc not created
Product:	Red Hat OpenStack	Reporter:	wes hayutin <whayutin>
Component:	rhosp-director	Assignee:	Angus Thomas <athomas>
Status:	CLOSED INSUFFICIENT_DATA	QA Contact:	Arik Chernetsky <achernet>
Severity:	high	Docs Contact:
Priority:	high
Version:	8.0 (Liberty)	CC:	dbecker, jcoufal, mburns, morazi, rhel-osp-director-maint
Target Milestone:	---	Keywords:	Automation, AutomationBlocker
Target Release:	10.0 (Newton)
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2016-10-05 20:04:54 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:

Description wes hayutin 2016-03-08 14:16:10 UTC

Description of problem:

Mar 08 07:17:08 overcloud-controller-0.localdomain os-collect-config[4878]: Notice: /Stage[main]/Heat/Heat_config[keystone_authtoken/admin_user]/ensure: created

Mar 08 07:17:08 overcloud-controller-0.localdomain os-collect-config[4878]: Notice: /Stage[main]/Heat/Heat_config[keystone_authtoken/admin_password]/ensure: created
Mar 08 07:17:08 overcloud-controller-0.localdomain os-collect-config[4878]: Notice: /Stage[main]/Heat/Heat_config[keystone_authtoken/admin_tenant_name]/ensure: created

[stack@host15 ~]$ cat tripleo-overcloud-passwords 
OVERCLOUD_SWIFT_HASH=BkysmhQBXAETNRTN3v7awB67z
OVERCLOUD_HEAT_STACK_DOMAIN_PASSWORD=FweTNEw9WZWhHCUhbDADyHxnG
OVERCLOUD_CEILOMETER_PASSWORD=cpBeHHjNzAC8rF6sh7adrR6wm
NEUTRON_METADATA_PROXY_SHARED_SECRET=yEdtmVCKyWRqa4jRNj6CQyKkz
OVERCLOUD_ADMIN_TOKEN=AYU2KGKdWkQpTDFe4nxctUBmZ
OVERCLOUD_CEILOMETER_SECRET=ZVmTve3aPcqpMkdvd72bXvAu4
OVERCLOUD_GLANCE_PASSWORD=7jDpjBTKQEkmhRvTefNArdk2B
OVERCLOUD_CINDER_PASSWORD=tPYafmpbUMjatQTNbYB8NRNsd
OVERCLOUD_NOVA_PASSWORD=rtjGawYCXTsuUttraznDKszZu
OVERCLOUD_ADMIN_PASSWORD=sXyQC2kWbzjaGkdPvrqxhQEkh
OVERCLOUD_NEUTRON_PASSWORD=Yaauurx4GCbj2xmcrHcDQxedH
OVERCLOUD_SWIFT_PASSWORD=7HWUtYxReDFDW69uf7z6AR7f4
OVERCLOUD_DEMO_PASSWORD=E2kkCbvWhtwxEmjCMQJHHCYPk
OVERCLOUD_HEAT_PASSWORD=yq3ek93yB7qb4gH8Z6BuqgBr9

cat /etc/keystone/keystone.conf
# value)
#admin_token = ADMIN
admin_token = AYU2KGKdWkQpTDFe4nxctUBmZ


Error:

Mar 08 07:26:16 overcloud-controller-0.localdomain os-collect-config[4878]: --------------------- END PROFILING ---------------------
Mar 08 07:26:16 overcloud-controller-0.localdomain os-collect-config[4878]: [2016-03-08 07:26:16,248] (os-refresh-config) [INFO] Completed phase post-configure
Mar 08 07:26:19 overcloud-controller-0.localdomain os-collect-config[4878]: 2016-03-08 07:26:19.029 4878 WARNING os-collect-config [-] Source [request] Unavailable.
Mar 08 07:26:19 overcloud-controller-0.localdomain os-collect-config[4878]: 2016-03-08 07:26:19.032 4878 WARNING os_collect_config.local [-] /var/lib/os-collect-config/local-data not found. Skipping
Mar 08 07:26:19 overcloud-controller-0.localdomain os-collect-config[4878]: 2016-03-08 07:26:19.033 4878 WARNING os_collect_config.local [-] No local metadata found (['/var/lib/os-collect-config/local-data'])
Mar 08 07:26:19 overcloud-controller-0.localdomain os-collect-config[4878]: 2016-03-08 07:26:19.034 4878 WARNING os_collect_config.zaqar [-] No auth_url configured.
Mar 08 07:26:21 overcloud-controller-0.localdomain os-collect-config[4878]: 2016-03-08 07:26:21.132 4878 WARNING os-collect-config [-] Source [request] Unavailable.
Mar 08 07:26:21 overcloud-controller-0.localdomain os-collect-config[4878]: 2016-03-08 07:26:21.132 4878 WARNING os_collect_config.local [-] /var/lib/os-collect-config/local-data not found. Skipping
Mar 08 07:26:21 overcloud-controller-0.localdomain os-collect-config[4878]: 2016-03-08 07:26:21.132 4878 WARNING os_collect_config.local [-] No local metadata found (['/var/lib/os-collect-config/local-data'])

Comment 1 wes hayutin 2016-03-08 14:16:23 UTC

[root@overcloud-controller-0 log]# pcs status
Cluster name: tripleo_cluster
Last updated: Tue Mar  8 14:15:43 2016		Last change: Tue Mar  8 07:24:50 2016 by root via cibadmin on overcloud-controller-0
Stack: corosync
Current DC: overcloud-controller-2 (version 1.1.13-10.el7_2.2-44eb2dd) - partition with quorum
3 nodes and 112 resources configured

Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]

Full list of resources:

 ip-172.21.35.10	(ocf::heartbeat:IPaddr2):	Started overcloud-controller-0
 ip-172.21.33.10	(ocf::heartbeat:IPaddr2):	Started overcloud-controller-1
 ip-10.8.147.6	(ocf::heartbeat:IPaddr2):	Started overcloud-controller-2
 Clone Set: haproxy-clone [haproxy]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 ip-172.21.33.11	(ocf::heartbeat:IPaddr2):	Started overcloud-controller-0
 Master/Slave Set: redis-master [redis]
     Masters: [ overcloud-controller-2 ]
     Slaves: [ overcloud-controller-0 overcloud-controller-1 ]
 ip-172.21.36.10	(ocf::heartbeat:IPaddr2):	Started overcloud-controller-1
 ip-10.8.149.10	(ocf::heartbeat:IPaddr2):	Started overcloud-controller-2
 Master/Slave Set: galera-master [galera]
     Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: mongod-clone [mongod]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: rabbitmq-clone [rabbitmq]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: memcached-clone [memcached]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-nova-scheduler-clone [openstack-nova-scheduler]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: neutron-l3-agent-clone [neutron-l3-agent]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-ceilometer-alarm-notifier-clone [openstack-ceilometer-alarm-notifier]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-heat-engine-clone [openstack-heat-engine]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-ceilometer-api-clone [openstack-ceilometer-api]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: neutron-metadata-agent-clone [neutron-metadata-agent]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: neutron-ovs-cleanup-clone [neutron-ovs-cleanup]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: neutron-netns-cleanup-clone [neutron-netns-cleanup]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-heat-api-clone [openstack-heat-api]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-cinder-scheduler-clone [openstack-cinder-scheduler]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-nova-api-clone [openstack-nova-api]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-heat-api-cloudwatch-clone [openstack-heat-api-cloudwatch]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-ceilometer-collector-clone [openstack-ceilometer-collector]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-keystone-clone [openstack-keystone]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-nova-consoleauth-clone [openstack-nova-consoleauth]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-glance-registry-clone [openstack-glance-registry]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-ceilometer-notification-clone [openstack-ceilometer-notification]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-cinder-api-clone [openstack-cinder-api]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: neutron-dhcp-agent-clone [neutron-dhcp-agent]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-glance-api-clone [openstack-glance-api]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: neutron-openvswitch-agent-clone [neutron-openvswitch-agent]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-nova-novncproxy-clone [openstack-nova-novncproxy]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: delay-clone [delay]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: neutron-server-clone [neutron-server]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: httpd-clone [httpd]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-ceilometer-central-clone [openstack-ceilometer-central]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-ceilometer-alarm-evaluator-clone [openstack-ceilometer-alarm-evaluator]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: openstack-heat-api-cfn-clone [openstack-heat-api-cfn]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 openstack-cinder-volume	(systemd:openstack-cinder-volume):	Started overcloud-controller-0
 Clone Set: openstack-nova-conductor-clone [openstack-nova-conductor]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]

PCSD Status:
  overcloud-controller-0: Online
  overcloud-controller-1: Online
  overcloud-controller-2: Online

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled
[root@overcloud-controller-0 log]#

Comment 3 wes hayutin 2016-03-08 18:34:12 UTC

[stack@host15 ~]$ cat overcloudrc-wes 
export OS_NO_CACHE=True
export COMPUTE_API_VERSION=1.1
export OS_USERNAME=admin
export no_proxy=,10.8.149.10
export OS_TENANT_NAME=admin
export OS_CLOUDNAME=overcloud
export OS_AUTH_URL=http://10.8.149.10:5000/v2.0
export NOVA_VERSION=1.1
export OS_PASSWORD=AYU2KGKdWkQpTDFe4nxctUBmZ
[stack@host15 ~]$ 


ERROR (Unauthorized): The request you have made requires authentication. (HTTP 401) (Request-ID: req-c7cb824d-9d02-408b-8cb4-9031a2542931)
[stack@host15 ~]$

Comment 4 wes hayutin 2016-03-08 18:34:54 UTC

[root@overcloud-controller-2 ~]# cat /etc/keystone/keystone.conf | grep AYU2KGKdWkQpTDFe4nxctUBmZ
admin_token = AYU2KGKdWkQpTDFe4nxctUBmZ
connection = mysql+pymysql://keystone:AYU2KGKdWkQpTDFe4nxctUBmZ.33.11/keystone
[root@overcloud-controller-2 ~]#

Comment 5 Mike Burns 2016-04-07 21:14:44 UTC

This bug did not make the OSP 8.0 release.  It is being deferred to OSP 10.

Comment 6 Jaromir Coufal 2016-10-05 20:04:54 UTC

Seems obsolete, we did not reproduce in our CI anymore. Please re-open if still valid.