Bug 1328837 - Image Uploader: uploading large files fails
Summary: Image Uploader: uploading large files fails
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: ovirt-engine
Classification: oVirt
Component: BLL.Storage
Version: 4.0.0
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ovirt-4.0.0-rc
: 4.0.0
Assignee: Amit Aviram
QA Contact: Natalie Gavrielov
URL:
Whiteboard:
Depends On: 1348993
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-04-20 11:55 UTC by Natalie Gavrielov
Modified: 2016-08-01 12:26 UTC (History)
4 users (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed: 2016-08-01 12:26:22 UTC
oVirt Team: Storage
Embargoed:
rule-engine: ovirt-4.0.0+
rule-engine: blocker+
rule-engine: planning_ack+
amureini: devel_ack+
acanan: testing_ack+


Attachments (Terms of Use)
engine.log, vdsm.log (1.03 MB, application/x-gzip)
2016-04-20 11:55 UTC, Natalie Gavrielov
no flags Details
image-proxy.log (10.49 MB, text/plain)
2016-04-20 12:16 UTC, Natalie Gavrielov
no flags Details

Description Natalie Gavrielov 2016-04-20 11:55:34 UTC
Created attachment 1149045 [details]
engine.log, vdsm.log

Description of problem:
I was able to upload small files - 10mb and so..
but uploading 3.2GB disks fail pretty much immediately.  

Version-Release number of selected component:
ovirt-engine-4.0.0-0.0.master.20160310051350.git3151c66.el7.centos.noarch
ovirt-image-common-0.1-1.noarch
vdsm-4.17.999-724.gitb8cb30a.el7.centos.noarch
ovirt-image-daemon-0.1-1.noarch

How reproducible:
100%

Steps to Reproduce:

Upload an image ~3GB (local file).

Actual results:
fails after a short period of time.

Expected results:
to pass the whole file as it does with a few mb.

Comment 1 Natalie Gavrielov 2016-04-20 11:57:38 UTC
One more thing - I was advised to change the default value of UploadImageChunkSizeKB from 8192 to 1024.. and I did, so this is not a solution or a workaround.

Comment 2 Natalie Gavrielov 2016-04-20 12:16:27 UTC
Created attachment 1149067 [details]
image-proxy.log

image-proxy.log

Note: The upload pauses - but only when refreshing the browser it's visible.

Comment 3 Allon Mureinik 2016-04-20 12:42:12 UTC
Seems as though the session renewal failed. 
Amit, can you take a look please?

(Thread-6300) ERROR 2016-04-20 15:12:14,686 session:116:root:(start_session) Error starting session: Unable to verify proxy ticket
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/ovirt_image_proxy/session.py", line 114, in start_session
    session_id = _create_update_session(token, session_id)
  File "/usr/lib/python2.7/site-packages/ovirt_image_proxy/session.py", line 173, in _create_update_session
    ticket_vars = _decode_proxy_ticket(authorization)
  File "/usr/lib/python2.7/site-packages/ovirt_image_proxy/session.py", line 217, in _decode_proxy_ticket
    payload = _decode_ovirt_token(ticket)
  File "/usr/lib/python2.7/site-packages/ovirt_image_proxy/session.py", line 295, in _decode_ovirt_token
    raise ValueError("Unable to verify proxy ticket")
ValueError: Unable to verify proxy ticket

Comment 4 Amit Aviram 2016-04-20 20:19:44 UTC
Thanks Allon.

This doesn't happens in my env

The ticket is not renewed. we need to see why the engine didn't call extend_image_ticket, might be an invalid config value.
 
Will have conclusions soon.

Comment 5 Sandro Bonazzola 2016-05-02 10:07:30 UTC
Moving from 4.0 alpha to 4.0 beta since 4.0 alpha has been already released and bug is not ON_QA.

Comment 6 Yaniv Lavi 2016-05-23 13:22:04 UTC
oVirt 4.0 beta has been released, moving to RC milestone.

Comment 7 Yaniv Lavi 2016-05-23 13:24:49 UTC
oVirt 4.0 beta has been released, moving to RC milestone.

Comment 8 Allon Mureinik 2016-06-14 10:29:21 UTC
The recent work for the beta and rc releases handled this issue. Moving to on QA to verify.

Comment 9 Natalie Gavrielov 2016-07-25 14:30:18 UTC
I was able to upload files >1GB (qcow file size 3.2 and raw file size 5.4)

Verified using:
rhevm-4.0.2-0.1.rc.el7ev.noarch
ovirt-imageio-proxy-0.3.0-0.el7ev.noarch
ovirt-imageio-common-0.3.0-0.el7ev.noarch
vdsm-4.18.8-1.el7ev.x86_64
ovirt-imageio-daemon-0.3.0-0.el7ev.noarch


Note You need to log in before you can comment on or make changes to this bug.