Bug 1352676 - When a disk finished uploading to a storage domain, it's status turns to Illegal
Summary: When a disk finished uploading to a storage domain, it's status turns to Illegal
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: ovirt-engine
Classification: oVirt
Component: BLL.Storage
Version: 4.0.2
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ovirt-4.0.2
: 4.0.2
Assignee: Amit Aviram
QA Contact: Natalie Gavrielov
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-07-04 17:06 UTC by Natalie Gavrielov
Modified: 2016-08-12 14:21 UTC (History)
4 users (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed: 2016-08-12 14:21:41 UTC
oVirt Team: Storage
Embargoed:
rule-engine: ovirt-4.0.z+
rule-engine: planning_ack+
rule-engine: devel_ack+
acanan: testing_ack+


Attachments (Terms of Use)
engine.log, vdsm.log, image-proxy.log (1.44 MB, application/x-gzip)
2016-07-04 17:06 UTC, Natalie Gavrielov
no flags Details
engine.log, vdsm.log, image-proxy.log (1.46 MB, application/x-gzip)
2016-07-06 10:41 UTC, Natalie Gavrielov
no flags Details


Links
System ID Private Priority Status Summary Last Updated
oVirt gerrit 60192 0 master MERGED engine: Teardown image after verifying upload. 2020-06-18 06:50:03 UTC
oVirt gerrit 60210 0 ovirt-engine-4.0 MERGED engine: Teardown image after verifying upload. 2020-06-18 06:50:03 UTC

Description Natalie Gavrielov 2016-07-04 17:06:31 UTC
Created attachment 1176118 [details]
engine.log, vdsm.log, image-proxy.log

Description of problem:
After uploading process finishes, in the disks view, the uploaded disk's status changes to "Illegal".

Version-Release number of selected component:
hosts:
vdsm-4.18.5.1-1.el7ev.x86_64
ovirt-imageio-daemon-0.3.0-0.el7ev.noarch
ovirt-imageio-common-0.3.0-0.el7ev.noarch

engine:
rhevm-4.0.2-0.2.rc1.el7ev.noarch
ovirt-imageio-proxy-0.3.0-0.el7ev.noarch

How reproducible:
100%

Steps to Reproduce:
1. Go to webadmin: Disks -> Upload
fill in the fields (choose a file to upload):
Image type: Raw
Size: 3 GB
Data center: Default
Storage domain: iscsi (block type)
Allocation Policy: Preallocated
Disk Profile: iscsi
Click OK.

Actual results:
Upload starts, the progress bar displays progress.. and when the upload finishes it displays "Illegal"

engine.log:
2016-07-04 19:50:49,189 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-5-thread-7) [6b459b64] START, CreateImageVDSCommand( CreateImageVDSCommandParameters:{runAsync='true', storagePoolId='00000001-0001-0001-0001-0000000000fe', ignoreFailoverLimit='false', storageDomainId='32fcda0d-ba29-486e-9920-7afe36341f84', imageGroupId='212c75b0-b707-4882-8a89-d39756e8039d', imageSizeInBytes='3221225472', volumeFormat='RAW', newImageId='3b84243c-371a-4449-8439-c8d7fa585e2d', newImageDescription='{"DiskAlias":"test1950","DiskDescription":""}', imageInitialSizeInBytes='0'}), log id: 388d7364

2016-07-04 19:50:57,135 INFO  [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler5) [194c8aa5] Successfully added disk 'test1950' (id '212c75b0-b707-4882-8a89-d39756e8039d') for image transfer command '23518995-feed-4a42-89cc-e3075f68c6d6'


2016-07-04 19:57:19,083 INFO  [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler10) [194c8aa5] Finalizing successful upload to disk 'test1950' (id '212c75b0-b707-4882-8a89-d39756e8039d')

2016-07-04 19:57:20,463 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler10) [194c8aa5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM aqua-vds4.scl.lab.tlv.redhat.com command failed: ecode=1, stdout=[], stderr=["qemu-img: Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': No such file or directory"], message=None

2016-07-04 19:57:20,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VerifyUntrustedVolumeVDSCommand] (DefaultQuartzScheduler10) [194c8aa5] Command 'VerifyUntrustedVolumeVDSCommand(HostName = aqua-vds4.scl.lab.tlv.redhat.com, ImageActionsVDSCommandParameters:{runAsync='true', hostId='583260d5-efd0-4ad4-ad11-5aa8a00380ba'})' execution failed: VDSGenericException: VDSErrorException: Failed to VerifyUntrustedVolumeVDS, error = ecode=1, stdout=[], stderr=["qemu-img: Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': No such file or directory"], message=None, code = 100

2016-07-04 19:57:20,463 ERROR [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler10) [194c8aa5] Failed to verify uploaded image: {}: org.ovirt.engine.core.common.errors.EngineException: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to VerifyUntrustedVolumeVDS, error = ecode=1, stdout=[], stderr=["qemu-img: Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': No such file or directory"], message=None, code = 100 (Failed with error GeneralException and code 100)

2016-07-04 19:57:20,473 INFO  [org.ovirt.engine.core.bll.storage.disk.image.UploadImageCommand] (DefaultQuartzScheduler10) [194c8aa5] Updating image upload 23518995-feed-4a42-89cc-e3075f68c6d6 (image 212c75b0-b707-4882-8a89-d39756e8039d) phase to Finalizing Failure (message: 'Finalizing success...')

2016-07-04 19:57:30,509 ERROR [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler8) [194c8aa5] Finalizing failed upload to disk 'test1950' (id '212c75b0-b707-4882-8a89-d39756e8039d')

2016-07-04 19:57:30,509 WARN  [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler8) [194c8aa5] Failed to stop image transfer session. Ticket does not exist for image '212c75b0-b707-4882-8a89-d39756e8039d'

2016-07-04 19:57:30,510 INFO  [org.ovirt.engine.core.bll.storage.disk.image.UploadImageCommand] (DefaultQuartzScheduler8) [194c8aa5] Updating image upload 23518995-feed-4a42-89cc-e3075f68c6d6 (image 212c75b0-b707-4882-8a89-d39756e8039d) phase to Finished Failure (message: 'Finalizing success...')

2016-07-04 19:57:40,542 ERROR [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler1) [194c8aa5] Upload to disk 'test1950' (id '212c75b0-b707-4882-8a89-d39756e8039d') failed

2016-07-04 19:57:41,558 INFO  [org.ovirt.engine.core.bll.storage.disk.image.UploadImageCommand] (DefaultQuartzScheduler7) [194c8aa5] Updating image upload 23518995-feed-4a42-89cc-e3075f68c6d6 (image 212c75b0-b707-4882-8a89-d39756e8039d) phase to Finished Failure (message: 'Finalizing success...')

2016-07-04 19:57:41,600 ERROR [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler7) [194c8aa5] Failed to upload disk 'test1950' (id '212c75b0-b707-4882-8a89-d39756e8039d') (command id '23518995-feed-4a42-89cc-e3075f68c6d6')


Expected results:
When upload finishes it should display "OK".

Comment 1 Natalie Gavrielov 2016-07-06 10:41:45 UTC
Created attachment 1176836 [details]
engine.log, vdsm.log, image-proxy.log

Same happens for file storage (nfs).
ID: 03b56d23-2d04-4fef-afa5-9f9568490ccd

Comment 2 Amit Aviram 2016-07-06 14:22:01 UTC
Natalie, in my environment it happens only on block storage (e.g iscsi). does it happens on any type of storage in yours? (I'm asking because of the summary change)

Comment 3 Amit Aviram 2016-07-06 14:30:00 UTC
Sorry, didn't see your message.
anyway the patch should solve it.

Comment 4 Natalie Gavrielov 2016-08-02 16:37:44 UTC
Verified:
rhevm-4.0.2.3-0.1.el7ev.noarch
ovirt-imageio-common-0.3.0-0.el7ev.noarch
ovirt-imageio-proxy-0.3.0-0.el7ev.noarch
vdsm-4.18.9-1.el7ev.x86_64
ovirt-imageio-daemon-0.3.0-0.el7ev.noarch


Note You need to log in before you can comment on or make changes to this bug.