Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1352676

Summary: When a disk finished uploading to a storage domain, it's status turns to Illegal
Product: [oVirt] ovirt-engine Reporter: Natalie Gavrielov <ngavrilo>
Component: BLL.StorageAssignee: Amit Aviram <aaviram>
Status: CLOSED CURRENTRELEASE QA Contact: Natalie Gavrielov <ngavrilo>
Severity: high Docs Contact:
Priority: unspecified    
Version: 4.0.2CC: acanan, bugs, ngavrilo, tnisan
Target Milestone: ovirt-4.0.2Flags: rule-engine: ovirt-4.0.z+
rule-engine: planning_ack+
rule-engine: devel_ack+
acanan: testing_ack+
Target Release: 4.0.2   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-08-12 14:21:41 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Storage RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
engine.log, vdsm.log, image-proxy.log
none
engine.log, vdsm.log, image-proxy.log none

Description Natalie Gavrielov 2016-07-04 17:06:31 UTC
Created attachment 1176118 [details]
engine.log, vdsm.log, image-proxy.log

Description of problem:
After uploading process finishes, in the disks view, the uploaded disk's status changes to "Illegal".

Version-Release number of selected component:
hosts:
vdsm-4.18.5.1-1.el7ev.x86_64
ovirt-imageio-daemon-0.3.0-0.el7ev.noarch
ovirt-imageio-common-0.3.0-0.el7ev.noarch

engine:
rhevm-4.0.2-0.2.rc1.el7ev.noarch
ovirt-imageio-proxy-0.3.0-0.el7ev.noarch

How reproducible:
100%

Steps to Reproduce:
1. Go to webadmin: Disks -> Upload
fill in the fields (choose a file to upload):
Image type: Raw
Size: 3 GB
Data center: Default
Storage domain: iscsi (block type)
Allocation Policy: Preallocated
Disk Profile: iscsi
Click OK.

Actual results:
Upload starts, the progress bar displays progress.. and when the upload finishes it displays "Illegal"

engine.log:
2016-07-04 19:50:49,189 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-5-thread-7) [6b459b64] START, CreateImageVDSCommand( CreateImageVDSCommandParameters:{runAsync='true', storagePoolId='00000001-0001-0001-0001-0000000000fe', ignoreFailoverLimit='false', storageDomainId='32fcda0d-ba29-486e-9920-7afe36341f84', imageGroupId='212c75b0-b707-4882-8a89-d39756e8039d', imageSizeInBytes='3221225472', volumeFormat='RAW', newImageId='3b84243c-371a-4449-8439-c8d7fa585e2d', newImageDescription='{"DiskAlias":"test1950","DiskDescription":""}', imageInitialSizeInBytes='0'}), log id: 388d7364

2016-07-04 19:50:57,135 INFO  [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler5) [194c8aa5] Successfully added disk 'test1950' (id '212c75b0-b707-4882-8a89-d39756e8039d') for image transfer command '23518995-feed-4a42-89cc-e3075f68c6d6'


2016-07-04 19:57:19,083 INFO  [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler10) [194c8aa5] Finalizing successful upload to disk 'test1950' (id '212c75b0-b707-4882-8a89-d39756e8039d')

2016-07-04 19:57:20,463 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler10) [194c8aa5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM aqua-vds4.scl.lab.tlv.redhat.com command failed: ecode=1, stdout=[], stderr=["qemu-img: Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': No such file or directory"], message=None

2016-07-04 19:57:20,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VerifyUntrustedVolumeVDSCommand] (DefaultQuartzScheduler10) [194c8aa5] Command 'VerifyUntrustedVolumeVDSCommand(HostName = aqua-vds4.scl.lab.tlv.redhat.com, ImageActionsVDSCommandParameters:{runAsync='true', hostId='583260d5-efd0-4ad4-ad11-5aa8a00380ba'})' execution failed: VDSGenericException: VDSErrorException: Failed to VerifyUntrustedVolumeVDS, error = ecode=1, stdout=[], stderr=["qemu-img: Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': No such file or directory"], message=None, code = 100

2016-07-04 19:57:20,463 ERROR [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler10) [194c8aa5] Failed to verify uploaded image: {}: org.ovirt.engine.core.common.errors.EngineException: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to VerifyUntrustedVolumeVDS, error = ecode=1, stdout=[], stderr=["qemu-img: Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': Could not open '/rhev/data-center/mnt/blockSD/32fcda0d-ba29-486e-9920-7afe36341f84/images/212c75b0-b707-4882-8a89-d39756e8039d/3b84243c-371a-4449-8439-c8d7fa585e2d': No such file or directory"], message=None, code = 100 (Failed with error GeneralException and code 100)

2016-07-04 19:57:20,473 INFO  [org.ovirt.engine.core.bll.storage.disk.image.UploadImageCommand] (DefaultQuartzScheduler10) [194c8aa5] Updating image upload 23518995-feed-4a42-89cc-e3075f68c6d6 (image 212c75b0-b707-4882-8a89-d39756e8039d) phase to Finalizing Failure (message: 'Finalizing success...')

2016-07-04 19:57:30,509 ERROR [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler8) [194c8aa5] Finalizing failed upload to disk 'test1950' (id '212c75b0-b707-4882-8a89-d39756e8039d')

2016-07-04 19:57:30,509 WARN  [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler8) [194c8aa5] Failed to stop image transfer session. Ticket does not exist for image '212c75b0-b707-4882-8a89-d39756e8039d'

2016-07-04 19:57:30,510 INFO  [org.ovirt.engine.core.bll.storage.disk.image.UploadImageCommand] (DefaultQuartzScheduler8) [194c8aa5] Updating image upload 23518995-feed-4a42-89cc-e3075f68c6d6 (image 212c75b0-b707-4882-8a89-d39756e8039d) phase to Finished Failure (message: 'Finalizing success...')

2016-07-04 19:57:40,542 ERROR [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler1) [194c8aa5] Upload to disk 'test1950' (id '212c75b0-b707-4882-8a89-d39756e8039d') failed

2016-07-04 19:57:41,558 INFO  [org.ovirt.engine.core.bll.storage.disk.image.UploadImageCommand] (DefaultQuartzScheduler7) [194c8aa5] Updating image upload 23518995-feed-4a42-89cc-e3075f68c6d6 (image 212c75b0-b707-4882-8a89-d39756e8039d) phase to Finished Failure (message: 'Finalizing success...')

2016-07-04 19:57:41,600 ERROR [org.ovirt.engine.core.bll.storage.disk.image.UploadDiskImageCommand] (DefaultQuartzScheduler7) [194c8aa5] Failed to upload disk 'test1950' (id '212c75b0-b707-4882-8a89-d39756e8039d') (command id '23518995-feed-4a42-89cc-e3075f68c6d6')


Expected results:
When upload finishes it should display "OK".

Comment 1 Natalie Gavrielov 2016-07-06 10:41:45 UTC
Created attachment 1176836 [details]
engine.log, vdsm.log, image-proxy.log

Same happens for file storage (nfs).
ID: 03b56d23-2d04-4fef-afa5-9f9568490ccd

Comment 2 Amit Aviram 2016-07-06 14:22:01 UTC
Natalie, in my environment it happens only on block storage (e.g iscsi). does it happens on any type of storage in yours? (I'm asking because of the summary change)

Comment 3 Amit Aviram 2016-07-06 14:30:00 UTC
Sorry, didn't see your message.
anyway the patch should solve it.

Comment 4 Natalie Gavrielov 2016-08-02 16:37:44 UTC
Verified:
rhevm-4.0.2.3-0.1.el7ev.noarch
ovirt-imageio-common-0.3.0-0.el7ev.noarch
ovirt-imageio-proxy-0.3.0-0.el7ev.noarch
vdsm-4.18.9-1.el7ev.x86_64
ovirt-imageio-daemon-0.3.0-0.el7ev.noarch