Bug 1028693

Summary: openstack-glance: unable to create an image (any) when glance located on a remote machine (out side the controller)
Product: Red Hat OpenStack Reporter: Haim <hateya>
Component: openstack-glanceAssignee: RHOS Maint <rhos-maint>
Status: CLOSED DUPLICATE QA Contact: Haim <hateya>
Severity: urgent Docs Contact:
Priority: unspecified    
Version: 4.0CC: eglynn, fpercoco, hateya, lars, yeylon
Target Milestone: ---Keywords: TestBlocker
Target Release: 4.0   
Hardware: x86_64   
OS: Linux   
Whiteboard: storage
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-11-11 10:38:36 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
controller.log
none
glance logs. none

Description Haim 2013-11-09 16:47:24 UTC
Description of problem:

in short: glance doesn't work when located remotely sitting out-side the controller.

trying to create an image leads to horizon get stuck and image goes in to queued for good. 
while trying to understand the problem, I tried to turn off iptables on all nodes but it doesn't seem to solve the problem.

I keep getting this WARN on the glance API log:

how reproducible: always on latest bits. 

repro steps:

- deploy Openstack when glance is located on a remote virtual machine. 


Additional info:2013-11-09 18:41:58.033 12633 WARNING qpid.messaging [-] recoverable error[attempt 8]: [Errno 111] ECONNREFUSED
2013-11-09 18:41:58.033 12633 WARNING qpid.messaging [-] sleeping 120 seconds
2013-11-09 18:41:58.978 12633 WARNING qpid.messaging [-] trying: localhost:5672
2013-11-09 18:41:58.979 12633 WARNING qpid.messaging [-] recoverable error[attempt 5]: [Errno 111] ECONNREFUSED
2013-11-09 18:41:58.980 12633 WARNING qpid.messaging [-] sleeping 16 seconds
2013-11-09 18:42:14.980 12633 WARNING qpid.messaging [-] trying: localhost:5672
2013-11-09 18:42:14.982 12633 WARNING qpid.messaging [-] recoverable error[attempt 6]: [Errno 111] ECONNREFUSED
2013-11-09 18:42:14.982 12633 WARNING qpid.messaging [-] sleeping 32 seconds
2013-11-09 18:42:46.983 12633 WARNING qpid.messaging [-] trying: localhost:5672
2013-11-09 18:42:46.985 12633 WARNING qpid.messaging [-] recoverable error[attempt 7]: [Errno 111] ECONNREFUSED
2013-11-09 18:42:46.986 12633 WARNING qpid.messaging [-] sleeping 64 seconds
2013-11-09 18:43:50.986 12633 WARNING qpid.messaging [-] trying: localhost:5672
2013-11-09 18:43:50.988 12633 WARNING qpid.messaging [-] recoverable error[attempt 8]: [Errno 111] ECONNREFUSED
2013-11-09 18:43:50.988 12633 WARNING qpid.messaging [-] sleeping 120 seconds
2013-11-09 18:43:58.034 12633 WARNING qpid.messaging [-] trying: localhost:5672
2013-11-09 18:43:58.036 12633 WARNING qpid.messaging [-] recoverable error[attempt 9]: [Errno 111] ECONNREFUSED
2013-11-09 18:43:58.037 12633 WARNING qpid.messaging [-] sleeping 120 seconds
2013-11-09 18:45:50.989 12633 WARNING qpid.messaging [-] trying: localhost:5672
2013-11-09 18:45:50.991 12633 WARNING qpid.messaging [-] recoverable error[attempt 9]: [Errno 111] ECONNREFUSED
2013-11-09 18:45:50.991 12633 WARNING qpid.messaging [-] sleeping 120 seconds
2013-11-09 18:45:58.037 12633 WARNING qpid.messaging [-] trying: localhost:5672
2013-11-09 18:45:58.038 12633 WARNING qpid.messaging [-] recoverable error[attempt 10]: [Errno 111] ECONNREFUSED
2013-11-09 18:45:58.039 12633 WARNING qpid.messaging [-] sleeping 120 seconds

Comment 1 Haim 2013-11-09 17:06:33 UTC
Created attachment 821931 [details]
controller.log

Comment 2 Haim 2013-11-09 17:07:27 UTC
Created attachment 821932 [details]
glance logs.

Comment 3 Lars Kellogg-Stedman 2013-11-10 03:05:18 UTC
Haim,

I have a few questions for you:

- How did you deploy OpenStack? Using packstack? Can you attach your answers file?
- What is the value of "qpid_host" in /etc/glance/glance-api.conf?
- Is it the same as the machine actually running qpid?
- What is the output of "netstat -tlnp | grep 5672" on the host
  running qpid?
- If you run "tcpdump -i <interface> port 5672" on the host running
  qpid, where <interface> is the interface on which qpid is listening,
  do you see the connection attempts from your glance host?

Comment 4 Flavio Percoco 2013-11-11 10:38:36 UTC

*** This bug has been marked as a duplicate of bug 1020025 ***