Bug 1172033

Summary: 5.0-RHEL-7-ADV-Beta: can not upload glance ceph image
Product: Red Hat OpenStack Reporter: bkopilov <bkopilov>
Component: openstack-glanceAssignee: Flavio Percoco <fpercoco>
Status: CLOSED NOTABUG QA Contact: nlevinki <nlevinki>
Severity: high Docs Contact:
Priority: unspecified    
Version: 5.0 (RHEL 7)CC: eglynn, fpercoco, yeylon
Target Milestone: ---Keywords: Reopened
Target Release: 6.0 (Juno)   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-12-10 13:45:38 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
glance logs
none
glance log 2 - automation run 2 none

Description bkopilov 2014-12-09 09:27:34 UTC 
Description of problem:
Hi , 
Running automation with OpenStack-5.0-RHEL-7-ADV-Beta Puddle: 2014-12-05.3 .
Glance and cinder tests are failed due to glance upload issues .

From glance logs :
2014-12-08 16:47:42.458 22424 DEBUG glance.api.v1.images [ef01441e-8c17-4109-af9f-1bc58190837d 7017080c788f447d95dd848a4fd6af06 cc23095247db42f2bfb11a5e294fc8c6 - - -] Uploading image data for image 8e8a8411-3268-4b35-8682-d3916d6a1d75 to rbd store _upload /usr/lib/python2.7/site-packages/glance/api/v1/images.py:594
2014-12-08 16:47:42.480 22424 ERROR glance.api.v1.upload_utils [ef01441e-8c17-4109-af9f-1bc58190837d 7017080c788f447d95dd848a4fd6af06 cc23095247db42f2bfb11a5e294fc8c6 - - -] Failed to upload image 8e8a8411-3268-4b35-8682-d3916d6a1d75
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils Traceback (most recent call last):
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils   File "/usr/lib/python2.7/site-packages/glance/api/v1/upload_utils.py", line 105, in upload_data_to_store
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils     store)
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils   File "/usr/lib/python2.7/site-packages/glance/store/__init__.py", line 380, in store_add_to_backend
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils     (location, size, checksum, metadata) = store.add(image_id, data, size)
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils   File "/usr/lib/python2.7/site-packages/glance/store/rbd.py", line 319, in add
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils     with rados.Rados(conffile=self.conf_file, rados_id=self.user) as conn:
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils   File "/usr/lib/python2.7/site-packages/rados.py", line 256, in __enter__
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils     self.connect()
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils   File "/usr/lib/python2.7/site-packages/rados.py", line 419, in connect
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils     raise make_ex(ret, "error calling connect")
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils ObjectNotFound: error calling connect
2014-12-08 16:47:42.480 22424 TRACE glance.api.v1.upload_utils 
2014-12-08 16:47:42.481 22424 DEBUG glance.registry.client.v1.api [ef01441e-8c17-4109-af9f-1bc58190837d 7017080c788f447d95dd848a4fd6af06 cc23095247db42f2bfb11a5e294fc8c6 - - -] Updating image metadata for image 8e8a8411-3268-4b35-8682-d3916d6a1d75... update_image_metadata /usr/lib/python2.7/site-packages/glance/registry/client/v1/api.py:166


Version-Release number of selected component (if applicable):


How reproducible:
Install openstack  , glance and cinder are configured with ceph backend .
Run automation test - tempest api tests .

Attaching logs from test :   /var/log/   /etc/ 

Benny

Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 1 bkopilov 2014-12-09 09:31:45 UTC 
Created attachment 966160 [details]
glance logs
Comment 3 bkopilov 2014-12-09 09:33:26 UTC 
Created attachment 966163 [details]
glance log 2  - automation run 2
Comment 4 Flavio Percoco 2014-12-09 15:11:10 UTC 
Hey Benny,

This normally happens when glance's configs for ceph are wrong. Due to the latest changes, I'd doubt that's the issue and think it may be related to some configs not being loaded correctly. Nonetheless, would you mind checking your environment and making sure those ceph credentials are correct?

I'll do some debugging on my side as well.
Comment 5 bkopilov 2014-12-09 15:20:32 UTC 
Hi , 
It looks like rhos5_adv supports juno configuration style and not rhos5 .

juno glance configuration:
"glance": {
        "glance_store": {
            "swift_store_auth_address": "http://localhost:35357/v2.0/",
            "swift_store_user": "admin:admin",
            "swift_store_key": "redhat",
            "swift_store_create_container_on_put": "True",
            "stores": "glance.store.swift.Store, glance.store.filesystem.Store, glance.store.http.Store"
        },
        "DEFAULT": {
            "default_store": "swift"
        }


rhos5 glance configuration:

    "glance": {
        "DEFAULT": {
            "swift_store_auth_address": "http://localhost:35357/v2.0/",
            "swift_store_user": "admin:admin",
            "swift_store_key": "redhat",
            "swift_store_create_container_on_put": "True",
            "default_store": "swift"
        }
    }





I am closing this bug for now

Benny
Comment 6 bkopilov 2014-12-10 09:48:47 UTC 
Hi , 
I will keep this bug open till issue will be solved.

Benny
Comment 7 bkopilov 2014-12-10 10:15:17 UTC 
the configuration style should be rhos5 , same code is running on rhos5  sucessfully
Comment 8 bkopilov 2014-12-10 13:45:38 UTC 
Closed , its not a bug .