1217999 – metadata service not responsive to 2004-04-04 requests

RDO tickets are now tracked in Jira https://issues.redhat.com/projects/RDO/issues/

Bug 1217999 - metadata service not responsive to 2004-04-04 requests

Summary: metadata service not responsive to 2004-04-04 requests

Keywords:
Status:	CLOSED NOTABUG
Alias:	None
Product:	RDO
Classification:	Community
Component:	openstack-puppet-modules
Sub Component:
Version:	Juno
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	unspecified
Target Milestone:	---
Target Release:	Kilo
Assignee:	Ivan Chavero
QA Contact:	Ami Jeain
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2015-05-04 00:00 UTC by Steven Dake
Modified:	2016-04-27 01:59 UTC (History)
CC List:	3 users (show)
Fixed In Version:
Clone Of:
Environment:
Last Closed:	2015-05-04 14:00:14 UTC
Embargoed:
Dependent Products:

Attachments	(Terms of Use)
logs of failure with 404s (731.35 KB, text/plain) 2015-05-04 00:33 UTC, Steven Dake	no flags	Details
View All

Description Steven Dake 2015-05-04 00:00:50 UTC

Description of problem:
Inside a cirros image launched in Kilo RC2, the metadata service is responsive to a GET at / but not a GET at /2009-04-04 as it should be.

Version-Release number of selected component (if applicable):


How reproducible:
100%

Steps to Reproduce:
1. Create VM using neutron networking and a floating IP
2. ssh into neutron VM
3. curl http://169.254.169.254
4. curl http://169.254.169.254/2009-04-04

Actual results:
$ curl http://169.254.169.254/
1.0
2007-01-19
2007-03-01
2007-08-29
2007-10-10
2007-12-15
2008-02-01
2008-09-01
2009-04-04

$ curl http://169.254.169.254/2009-04-04
<html>
 <head>
  <title>404 Not Found</title>
 </head>
 <body>
  <h1>404 Not Found</h1>
  The resource could not be found.<br /><br />



 </body>


Expected results:
I would expect 2009-04-04 to actually return some data rather then "resource could not be found".

Additional info:

Comment 1 Steven Dake 2015-05-04 00:31:59 UTC

I launched two vms;

[sdake@bigiron heat]$ grep 2009 l2 | grep HTTP | grep -v Request
neutron-metadata-agent stderr | 2015-05-03 23:25:58.289 243 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:25:58] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.118604
neutron-metadata-agent stderr | 2015-05-03 23:25:58.302 243 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:25:58] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.250730
neutron-metadata-agent stderr | 2015-05-03 23:26:00.525 246 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:00] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.208875
neutron-metadata-agent stderr | 2015-05-03 23:26:00.545 243 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:00] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.239306
neutron-metadata-agent stderr | 2015-05-03 23:26:02.759 243 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:02] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.215626
neutron-metadata-agent stderr | 2015-05-03 23:26:02.775 243 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:02] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.214471
neutron-metadata-agent stderr | 2015-05-03 23:26:05.057 243 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:05] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.280840
neutron-metadata-agent stderr | 2015-05-03 23:26:05.075 244 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:05] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.282524
neutron-metadata-agent stderr | 2015-05-03 23:26:07.138 244 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:07] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.046356
neutron-metadata-agent stderr | 2015-05-03 23:26:07.169 244 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:07] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.095058
neutron-metadata-agent stderr | 2015-05-03 23:26:09.249 244 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:09] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.068346
neutron-metadata-agent stderr | 2015-05-03 23:26:09.265 244 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:09] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.114541
neutron-metadata-agent stderr | 2015-05-03 23:26:11.304 244 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:11] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.038754
neutron-metadata-agent stderr | 2015-05-03 23:26:11.383 246 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:11] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.103215
neutron-metadata-agent stderr | 2015-05-03 23:26:13.403 246 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:13] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.080992
neutron-metadata-agent stderr | 2015-05-03 23:26:13.430 246 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:13] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.032318
neutron-metadata-agent stderr | 2015-05-03 23:26:15.460 246 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:15] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.041704
neutron-metadata-agent stderr | 2015-05-03 23:26:15.481 246 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:15] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.037009
neutron-metadata-agent stderr | 2015-05-03 23:26:17.764 246 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:17] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.269393
neutron-metadata-agent stderr | 2015-05-03 23:26:17.789 246 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:17] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.310771
neutron-metadata-agent stderr | 2015-05-03 23:26:19.819 246 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:19] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.036564
neutron-metadata-agent stderr | 2015-05-03 23:26:20.142 239 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:20] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.340204
neutron-metadata-agent stderr | 2015-05-03 23:26:21.997 245 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:21] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.160481
neutron-metadata-agent stderr | 2015-05-03 23:26:22.235 245 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:22] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.074207
neutron-metadata-agent stderr | 2015-05-03 23:26:24.128 239 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:24] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.113690
neutron-metadata-agent stderr | 2015-05-03 23:26:24.374 241 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:24] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.124984
neutron-metadata-agent stderr | 2015-05-03 23:26:26.194 239 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:26] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.047700
neutron-metadata-agent stderr | 2015-05-03 23:26:26.466 239 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:26] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.075222
neutron-metadata-agent stderr | 2015-05-03 23:26:28.324 245 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:28] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.110901
neutron-metadata-agent stderr | 2015-05-03 23:26:28.549 245 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:28] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.066334
neutron-metadata-agent stderr | 2015-05-03 23:26:30.451 244 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:30] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.110169
neutron-metadata-agent stderr | 2015-05-03 23:26:30.614 244 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:30] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.052774
neutron-metadata-agent stderr | 2015-05-03 23:26:32.514 244 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:32] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.045038
neutron-metadata-agent stderr | 2015-05-03 23:26:32.679 244 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:32] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.048410
neutron-metadata-agent stderr | 2015-05-03 23:26:34.645 245 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:34] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.110718
neutron-metadata-agent stderr | 2015-05-03 23:26:34.759 245 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:34] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.061827
neutron-metadata-agent stderr | 2015-05-03 23:26:36.774 246 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:36] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.112912
neutron-metadata-agent stderr | 2015-05-03 23:26:36.819 246 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:36] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.049296
neutron-metadata-agent stderr | 2015-05-03 23:26:38.933 244 INFO eventlet.wsgi.server [-] 10.0.0.3,<local> - - [03/May/2015 23:26:38] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.140691
neutron-metadata-agent stderr | 2015-05-03 23:26:38.957 244 INFO eventlet.wsgi.server [-] 10.0.0.4,<local> - - [03/May/2015 23:26:38] "GET /2009-04-04/meta-data/instance-id HTTP/1.1" 404 176 0.122463


All 404's.  I have attached the agent logs.

Comment 2 Steven Dake 2015-05-04 00:33:39 UTC

Created attachment 1021445 [details]
logs of failure with 404s

Comment 3 Steven Dake 2015-05-04 02:05:27 UTC

this gem is in the nova-api log

2015-05-04 01:44:07.241 153 ERROR nova.api.metadata.handler [req-fb396682-ec64-473e-a362-5e1bafe6c162 - - - - -] Failed to get metadata for ip: 11.11.11.100
2015-05-04 01:44:07.242 153 INFO nova.api.ec2 [-] 0.22107s 11.11.11.100 GET /2009-04-04/meta-data/instance-id None:None 404 [Python-httplib2/0.7.7 (gzip)] text/plain text/plain
2015-05-04 01:44:07.242 153 INFO nova.metadata.wsgi.server [req-fb396682-ec64-473e-a362-5e1bafe6c162 - - - - -] 10.0.0.4,11.11.11.100 "GET /2009-04-04/meta-data/instance-id HTTP/1.1" status: 404 len: 176 time: 0.0226159

Comment 4 Steven Dake 2015-05-04 03:11:50 UTC

fixed by this:
https://review.openstack.org/#/c/179683/

feel free to close.

Comment 5 Alan Pevec 2015-05-04 14:00:14 UTC

In packstack installation service_metadata_proxy is set in [neutron] section, this was fixed in Nova puppet module:
https://github.com/stackforge/puppet-nova/commit/e39cc688cd9a979b99e0ef62750b11dd5730801f

Note You need to log in before you can comment on or make changes to this bug.