Bug 1139959
| Summary: | [CISCO RHEL-OSP] image-create from --file fails with ceph backed glance | ||||||
|---|---|---|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Britt Houser <bhouser> | ||||
| Component: | openstack-glance | Assignee: | Flavio Percoco <fpercoco> | ||||
| Status: | CLOSED NOTABUG | QA Contact: | nlevinki <nlevinki> | ||||
| Severity: | unspecified | Docs Contact: | |||||
| Priority: | unspecified | ||||||
| Version: | 5.0 (RHEL 7) | CC: | eglynn, fpercoco, jdurgin, scohen, yeylon | ||||
| Target Milestone: | --- | Keywords: | ZStream | ||||
| Target Release: | 5.0 (RHEL 7) | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | Doc Type: | Bug Fix | |||||
| Doc Text: | Story Points: | --- | |||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2014-09-15 07:27:54 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Bug Depends On: | |||||||
| Bug Blocks: | 1154145, 1154159, 1154162 | ||||||
| Attachments: |
|
||||||
|
Description
Britt Houser
2014-09-10 05:16:53 UTC
Hi Britt, Based on the traceback, it looks like Glance is not able to connect to ceph correctly. Is it possible for you to share your glance config file? I'm interested in how the rbd store was configured. Created attachment 936178 [details]
Glance Config File
Britt, Glance's config looks ok. Based on the error message returned by rados, there's probably something wrong in Ceph's configs/setup. Is it possible to have your ceph config file as well? @Josh, could you please help debugging this issue? That is a failure to connect to the ceph cluster, most likely due to missing/unreadable auth info. Are /etc/ceph/ceph.client.glance.keyring and /etc/ceph/ceph.conf on the node running glance-api, and are they readable by the user glance-api is running as? Yes and Yes. I figurd out the problem. When I created the auth user I issued the command with line wraps like this: -- ceph auth get-or-create client.glance mon 'allow r' \ osd 'allow class-read object_prefix rbd_children, \ allow rwx pool=images' -o /etc/ceph/client.glance.keyring -- the line wrap in the middle of the OSD parameter didn't get unwrapped correctly and I ended up with: -- client.glance key: AQDebhJUyI0JNxAA8IeaonS/g/WvBM1oQhp/0A== caps: [mon] allow r caps: [osd] allow class-read object_prefix rbd_children, \ allow rwx pool=images -- When it should have looked like: -- client.glance key: AQDO1BJUmNAgNRAAV1Nve2AruiCvGg7EITA60w== caps: [mon] allow r caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=images -- So it looks like the issue as I have reported it was user error. Only question remaining in my mind is why did --location work? Was glance storing files from --location in a different backend? IIRC with --location glance does not check that the location is actually accessible, it just checks that it's a valid url for one of its stores, so it would only have a problem once you tried to download the image. Ok that is good to know. When we specified --location, however, the image successfully made it into glance and we booted VMs from it, even though ceph authentication was misconfigured... If you were using a version with rbd cloning enabled for nova, or creating a volume from an image onto ceph, glance would never actually access ceph. Ok that is good to know. This was for initial image creation. When Ceph was mis-configured, then creating a image from --file failed, whereas from --location worked. And the image created from --location could boot up just fine. FWIW, the `--location` behavior described by Josh is correct. I'll close this report! Thanks for bringing this up, Britt. |