Bug 1403581 - WebGui - Force Ovf Store (update OVFs) does not create ovf files until first scheduled OVF update occurs
Summary: WebGui - Force Ovf Store (update OVFs) does not create ovf files until first ...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: ovirt-engine
Classification: oVirt
Component: BLL.Storage
Version: 4.1.0
Hardware: Unspecified
OS: Unspecified
medium
high
Target Milestone: ovirt-4.1.3
: 4.1.3.3
Assignee: Maor
QA Contact: Avihai
URL:
Whiteboard:
Depends On:
Blocks: 1270562
TreeView+ depends on / blocked
 
Reported: 2016-12-11 16:30 UTC by Avihai
Modified: 2017-07-06 13:57 UTC (History)
7 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-07-06 13:57:29 UTC
oVirt Team: Storage
Embargoed:
rule-engine: ovirt-4.1+


Attachments (Terms of Use)
engine and 2 hosts logs (vdsm_host.log and vdsm_host2.log) (1.13 MB, application/x-gzip)
2016-12-11 16:30 UTC, Avihai
no flags Details


Links
System ID Private Priority Status Summary Last Updated
oVirt gerrit 75608 0 'None' 'MERGED' 'core: Print success audit log when action ends with success' 2019-12-05 14:02:21 UTC
oVirt gerrit 76906 0 'None' 'MERGED' 'core: refactor OVF_STORE update on deactivate' 2019-12-05 14:02:21 UTC
oVirt gerrit 76907 0 'None' 'MERGED' 'webadmin: Call UpdateOvfStoreForStorageDomain from webadmin' 2019-12-05 14:02:21 UTC
oVirt gerrit 76908 0 'None' 'MERGED' 'restapi: Call UpdateOvfStoreForStorageDomain from REST' 2019-12-05 14:02:21 UTC
oVirt gerrit 78053 0 'None' 'MERGED' 'core:Remove redundant parameter class.' 2019-12-05 14:02:21 UTC
oVirt gerrit 78086 0 'None' 'MERGED' 'core:Remove redundant parameter class.' 2019-12-05 14:02:21 UTC
oVirt gerrit 78087 0 'None' 'MERGED' 'core: refactor OVF_STORE update on deactivate' 2019-12-05 14:02:22 UTC
oVirt gerrit 78088 0 'None' 'MERGED' 'restapi: Call UpdateOvfStoreForStorageDomain from REST' 2019-12-05 14:02:22 UTC
oVirt gerrit 78089 0 'None' 'MERGED' 'webadmin: Call UpdateOvfStoreForStorageDomain from webadmin' 2019-12-05 14:02:22 UTC
oVirt gerrit 78090 0 'None' 'MERGED' 'core: Print success audit log when action ends with success' 2019-12-05 14:02:22 UTC

Description Avihai 2016-12-11 16:30:25 UTC
Created attachment 1230626 [details]
engine and 2 hosts logs (vdsm_host.log and vdsm_host2.log)

Description of problem:
Issue occurs after starting the engine from scratch , no previous storage domains .
Force Ovf Store (update OVFs) does not create ovf files until first scheduled OVF update occurs

Version-Release number of selected component (if applicable):
4.1.0-0.2.master.20161210231201.git26a385e.el7.centos

How reproducible:
100%


Steps to Reproduce:
1.Start the engine from scratch , no previous storage domains or OVF_STORE disks.
2.create 3 storage domains (NFS,iscsi,gluster)
3.create VM
4.create 3 disks on that VM , each disk from a different storage domain(NFS,iscsi,gluster)
5.Force Ovf Store (update OVFs) on each of the storage domains(NFS,iscsi,gluster)

Actual results:
OVF_STORE images is created but they do not contain OVF files .


Expected results:
OVF_STORE images should contain OVF files 


Additional info:
Only info.json files are in the images .

Important work around :
From the point Scheduled OVF update occurred (I forced Scheduled OVF update to occur by moving a storage domain to maintenance and back to activate ) Force Ovf Store worked .

Comment 1 Avihai 2016-12-11 17:19:54 UTC
relevant time frame in the logs are 2016-12-11 17:04 - 17:42 .

From engine.log:

2016-12-11 17:04:14,941+02 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-13) [eb1a79d0-34dc-48f1-baf0-78ed2b790687] Correlation ID: eb1a79d0-34dc-48f1-baf0-78ed2b790687, Call Stack: null, Custom Event ID: -1, Message: Storage Domain nfs_domain was updated by admin@internal-authz
2016-12-11 17:20:52,972+02 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [4420becb] Correlation ID: 7651f3a6-a9a4-4015-952a-6000d3c70b23, Job ID: e78675c2-228e-4201-bee5-752e3a6d48bf, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain gluster_dom was updated by admin@internal-authz.
2016-12-11 17:26:57,769+02 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [bc4b74e] Correlation ID: 22fafc55-cee5-4bb7-a102-8bf346806efc, Job ID: 27d12ff2-5862-4722-87bf-8178b984ef2d, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain gluster_dom was updated by admin@internal-authz.
2016-12-11 17:34:50,860+02 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-13) [3a050cdb] Correlation ID: 1c374e0e-da16-485a-8c6a-fb5d12480b08, Job ID: ce9e8ad1-1002-4c9e-a452-28ed72b6aec3, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain gluster_dom was updated by admin@internal-authz.
2016-12-11 17:39:18,095+02 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [2af20877] Correlation ID: 13f11ea6-80e9-4c9f-9d07-869eaf32c8d1, Job ID: 5d509954-899f-4f60-a794-016b781c25ec, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain iscsi_domain was updated by admin@internal-authz.
 OVF data won't be updated meanwhile for that domain.
 OVF data won't be updated meanwhile for that domain.
2016-12-11 17:41:08,223+02 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-4) [7a4004c1] Correlation ID: 259c6c41-651c-4a18-b829-4497771d711e, Job ID: 5ccdfd19-a757-4f47-b6a1-682bca4933c7, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain nfs_domain was updated by admin@internal-authz.
2016-12-11 17:41:38,735+02 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-16) [b5198ab4-661c-4e9a-8e85-d3cbf399d443] Correlation ID: b5198ab4-661c-4e9a-8e85-d3cbf399d443, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi_domain was updated by admin@internal-authz
2016-12-11 17:41:46,035+02 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [66e3731a] Correlation ID: 0ad60619-ebb4-4548-9adc-92d36be262f5, Job ID: c70032fd-d041-4438-989a-a6fc7268ebe1, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain iscsi_domain was updated by admin@internal-authz.

Comment 2 Avihai 2016-12-11 17:21:23 UTC
from vdsm_host2.log (SPM host camel_vdsc) :

2016-12-11 17:20:49,379 INFO  (jsonrpc/4) [dispatcher] Run and protect: createVolume(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49)
2016-12-11 17:20:51,694 INFO  (jsonrpc/5) [dispatcher] Run and protect: createVolume(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='22e62245-35cc-4402-acec-769442eabfbb', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49)
2016-12-11 17:21:46,365 INFO  (jsonrpc/3) [storage.VolumeManifest] 6fb7f1f1-fcbd-4404-8713-b97cbfc23700/8900bdb1-03c3-44ee-b48d-9badbd57df2d/d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 info is {'status': 'OK', 'domain': '6fb7f1f1-fcbd-4404-8713-b97cbfc23700', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '8900bdb1-03c3-44ee-b48d-9badbd57df2d', 'ctime': '1481469688', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': 'd07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249)
2016-12-11 17:21:46,365 INFO  (jsonrpc/3) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '6fb7f1f1-fcbd-4404-8713-b97cbfc23700', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '8900bdb1-03c3-44ee-b48d-9badbd57df2d', 'ctime': '1481469688', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': 'd07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52)
2016-12-11 17:21:49,197 INFO  (jsonrpc/4) [storage.VolumeManifest] 6fb7f1f1-fcbd-4404-8713-b97cbfc23700/be7e7bbe-ecb7-481f-b784-46bf859c134e/22e62245-35cc-4402-acec-769442eabfbb info is {'status': 'OK', 'domain': '6fb7f1f1-fcbd-4404-8713-b97cbfc23700', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'be7e7bbe-ecb7-481f-b784-46bf859c134e', 'ctime': '1481469694', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '22e62245-35cc-4402-acec-769442eabfbb', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249)
2016-12-11 17:21:49,197 INFO  (jsonrpc/4) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '6fb7f1f1-fcbd-4404-8713-b97cbfc23700', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'be7e7bbe-ecb7-481f-b784-46bf859c134e', 'ctime': '1481469694', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '22e62245-35cc-4402-acec-769442eabfbb', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52)
2016-12-11 17:21:51,371 INFO  (jsonrpc/5) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:21:51,421 INFO  (jsonrpc/5) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:21:52,823 INFO  (jsonrpc/6) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:21:52,857 INFO  (jsonrpc/6) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:21:53,896 INFO  (jsonrpc/7) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:21:53,942 INFO  (jsonrpc/7) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:21:55,607 INFO  (jsonrpc/3) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:21:55,645 INFO  (jsonrpc/3) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:26:52,654 INFO  (jsonrpc/5) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":false,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:26:52,697 INFO  (jsonrpc/5) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":false,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:26:54,159 INFO  (jsonrpc/4) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:26:54,197 INFO  (jsonrpc/4) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:26:55,238 INFO  (jsonrpc/6) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":false,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:26:55,283 INFO  (jsonrpc/6) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":false,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:26:56,690 INFO  (jsonrpc/7) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:26:56,727 INFO  (jsonrpc/7) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:34:44,064 INFO  (jsonrpc/5) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":false,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:34:44,115 INFO  (jsonrpc/5) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":false,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:34:45,587 INFO  (jsonrpc/4) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:34:44 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:34:45,630 INFO  (jsonrpc/4) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:34:44 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:34:46,660 INFO  (jsonrpc/6) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":false,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:34:46,706 INFO  (jsonrpc/6) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":false,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:34:49,845 INFO  (jsonrpc/0) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:34:44 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:34:49,890 INFO  (jsonrpc/0) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:34:44 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:41:05,167 INFO  (jsonrpc/1) [dispatcher] Run and protect: createVolume(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='5c1aeba9-89a9-4a00-8a09-97911489a2c8', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='95b0b215-dd6e-4f92-93fc-fd935be7a87d', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49)
2016-12-11 17:41:05,892 INFO  (jsonrpc/4) [dispatcher] Run and protect: createVolume(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='c6bbae7f-b64e-4325-a17e-52c505098da5', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='4c34cc22-91f6-4753-a48f-1ede9d59ff3f', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49)
2016-12-11 17:41:21,674 INFO  (jsonrpc/0) [storage.VolumeManifest] 81505d02-420e-4748-aabb-8daf39c037dc/c6bbae7f-b64e-4325-a17e-52c505098da5/4c34cc22-91f6-4753-a48f-1ede9d59ff3f info is {'status': 'OK', 'domain': '81505d02-420e-4748-aabb-8daf39c037dc', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'c6bbae7f-b64e-4325-a17e-52c505098da5', 'ctime': '1481470868', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '4c34cc22-91f6-4753-a48f-1ede9d59ff3f', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249)
2016-12-11 17:41:21,674 INFO  (jsonrpc/0) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '81505d02-420e-4748-aabb-8daf39c037dc', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'c6bbae7f-b64e-4325-a17e-52c505098da5', 'ctime': '1481470868', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '4c34cc22-91f6-4753-a48f-1ede9d59ff3f', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52)
2016-12-11 17:41:25,011 INFO  (jsonrpc/5) [storage.VolumeManifest] 81505d02-420e-4748-aabb-8daf39c037dc/5c1aeba9-89a9-4a00-8a09-97911489a2c8/95b0b215-dd6e-4f92-93fc-fd935be7a87d info is {'status': 'OK', 'domain': '81505d02-420e-4748-aabb-8daf39c037dc', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '5c1aeba9-89a9-4a00-8a09-97911489a2c8', 'ctime': '1481470867', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '95b0b215-dd6e-4f92-93fc-fd935be7a87d', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249)
2016-12-11 17:41:25,011 INFO  (jsonrpc/5) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '81505d02-420e-4748-aabb-8daf39c037dc', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '5c1aeba9-89a9-4a00-8a09-97911489a2c8', 'ctime': '1481470867', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '95b0b215-dd6e-4f92-93fc-fd935be7a87d', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52)
2016-12-11 17:41:26,596 INFO  (jsonrpc/4) [dispatcher] Run and protect: setVolumeDescription(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='c6bbae7f-b64e-4325-a17e-52c505098da5', volUUID='4c34cc22-91f6-4753-a48f-1ede9d59ff3f', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:41:26,620 INFO  (jsonrpc/4) [storage.VolumeManifest] volUUID = 4c34cc22-91f6-4753-a48f-1ede9d59ff3f descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:41:27,154 INFO  (jsonrpc/7) [dispatcher] Run and protect: setVolumeDescription(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='c6bbae7f-b64e-4325-a17e-52c505098da5', volUUID='4c34cc22-91f6-4753-a48f-1ede9d59ff3f', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:41:26 IST 2016","Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:41:27,192 INFO  (jsonrpc/7) [storage.VolumeManifest] volUUID = 4c34cc22-91f6-4753-a48f-1ede9d59ff3f descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:41:26 IST 2016","Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:41:27,249 INFO  (jsonrpc/3) [dispatcher] Run and protect: setVolumeDescription(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='5c1aeba9-89a9-4a00-8a09-97911489a2c8', volUUID='95b0b215-dd6e-4f92-93fc-fd935be7a87d', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:41:27,274 INFO  (jsonrpc/3) [storage.VolumeManifest] volUUID = 95b0b215-dd6e-4f92-93fc-fd935be7a87d descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:41:28,161 INFO  (jsonrpc/2) [dispatcher] Run and protect: setVolumeDescription(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='5c1aeba9-89a9-4a00-8a09-97911489a2c8', volUUID='95b0b215-dd6e-4f92-93fc-fd935be7a87d', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:41:26 IST 2016","Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:41:28,199 INFO  (jsonrpc/2) [storage.VolumeManifest] volUUID = 95b0b215-dd6e-4f92-93fc-fd935be7a87d descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:41:26 IST 2016","Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:41:43,456 INFO  (jsonrpc/1) [dispatcher] Run and protect: createVolume(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='b12d8d10-0fbf-45fd-918a-ebedabb25db9', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='1d4065b1-3c23-4c77-82d4-80c84ce1ccd3', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49)
2016-12-11 17:41:44,976 INFO  (jsonrpc/4) [dispatcher] Run and protect: createVolume(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='6daf81e1-38af-4d2c-ae56-a4c34d07e768', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='b7cc014f-8e4a-4641-b13d-cea64693760d', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49)
2016-12-11 17:41:54,509 INFO  (jsonrpc/6) [storage.VolumeManifest] 9f7b50fe-3dbe-43f8-932e-1814f4c2e007/6daf81e1-38af-4d2c-ae56-a4c34d07e768/b7cc014f-8e4a-4641-b13d-cea64693760d info is {'status': 'OK', 'domain': '9f7b50fe-3dbe-43f8-932e-1814f4c2e007', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '6daf81e1-38af-4d2c-ae56-a4c34d07e768', 'ctime': '1481470905', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': 'b7cc014f-8e4a-4641-b13d-cea64693760d', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249)
2016-12-11 17:41:54,509 INFO  (jsonrpc/6) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9f7b50fe-3dbe-43f8-932e-1814f4c2e007', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '6daf81e1-38af-4d2c-ae56-a4c34d07e768', 'ctime': '1481470905', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': 'b7cc014f-8e4a-4641-b13d-cea64693760d', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52)
2016-12-11 17:42:02,925 INFO  (jsonrpc/2) [storage.VolumeManifest] 9f7b50fe-3dbe-43f8-932e-1814f4c2e007/b12d8d10-0fbf-45fd-918a-ebedabb25db9/1d4065b1-3c23-4c77-82d4-80c84ce1ccd3 info is {'status': 'OK', 'domain': '9f7b50fe-3dbe-43f8-932e-1814f4c2e007', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'b12d8d10-0fbf-45fd-918a-ebedabb25db9', 'ctime': '1481470904', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '1d4065b1-3c23-4c77-82d4-80c84ce1ccd3', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249)
2016-12-11 17:42:02,926 INFO  (jsonrpc/2) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9f7b50fe-3dbe-43f8-932e-1814f4c2e007', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'b12d8d10-0fbf-45fd-918a-ebedabb25db9', 'ctime': '1481470904', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '1d4065b1-3c23-4c77-82d4-80c84ce1ccd3', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52)
2016-12-11 17:42:04,069 INFO  (jsonrpc/0) [dispatcher] Run and protect: setVolumeDescription(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='b12d8d10-0fbf-45fd-918a-ebedabb25db9', volUUID='1d4065b1-3c23-4c77-82d4-80c84ce1ccd3', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:42:04,138 INFO  (jsonrpc/0) [storage.VolumeManifest] volUUID = 1d4065b1-3c23-4c77-82d4-80c84ce1ccd3 descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:42:05,928 INFO  (jsonrpc/1) [dispatcher] Run and protect: setVolumeDescription(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='b12d8d10-0fbf-45fd-918a-ebedabb25db9', volUUID='1d4065b1-3c23-4c77-82d4-80c84ce1ccd3', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:42:04 IST 2016","Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:42:06,000 INFO  (jsonrpc/1) [storage.VolumeManifest] volUUID = 1d4065b1-3c23-4c77-82d4-80c84ce1ccd3 descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:42:04 IST 2016","Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:42:07,036 INFO  (jsonrpc/6) [dispatcher] Run and protect: setVolumeDescription(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='6daf81e1-38af-4d2c-ae56-a4c34d07e768', volUUID='b7cc014f-8e4a-4641-b13d-cea64693760d', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:42:07,105 INFO  (jsonrpc/6) [storage.VolumeManifest] volUUID = b7cc014f-8e4a-4641-b13d-cea64693760d descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}  (volume:366)
2016-12-11 17:42:08,897 INFO  (jsonrpc/3) [dispatcher] Run and protect: setVolumeDescription(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='6daf81e1-38af-4d2c-ae56-a4c34d07e768', volUUID='b7cc014f-8e4a-4641-b13d-cea64693760d', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:42:04 IST 2016","Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49)
2016-12-11 17:42:08,971 INFO  (jsonrpc/3) [storage.VolumeManifest] volUUID = b7cc014f-8e4a-4641-b13d-cea64693760d descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:42:04 IST 2016","Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}  (volume:366)

Comment 3 Yaniv Kaul 2016-12-12 07:46:12 UTC
1. Does the reproduction needs all the storage domains? Aren't there simpler steps to reproduce? 
2. No need for such long copy-paste of logs. It's impossible to work with and just clutters bugzilla. 
3. Not sure why the severity is high? A simple workaround, not a P1 feature, etc...

Comment 4 Avihai 2016-12-12 17:33:53 UTC
Answering Yaniv Q's :


"1. Does the reproduction needs all the storage domains? Aren't there simpler steps to reproduce? "

No , we do not need all the storage domains , one is sufficient to reproduce this issue .

The reason I tested added the multiple different input was to show this issue is not related to a storage domain specific type. 

"2. No need for such long copy-paste of logs. It's impossible to work with and just clutters bugzilla."

Sorry about that, My intention was to give you all relevant data ( I grep only OFVupdate messages) in the relevant time frame so you can have all the data in-front of you.
Next time I will put it in a file .

"3. Not sure why the severity is high? A simple workaround, not a P1 feature, etc..."

IMHO a customer not having OVF backup meaning no REAL VM backup/export + import storage domain not working for the first hour after a fresh install is a high severity issue.

About the workaround although it is easy to perform it means that the costumer will have to put all its storage domain in maintenance & reactivate them which is very disruptive.

Comment 5 Yaniv Kaul 2016-12-27 10:21:05 UTC
If the user will wait for the 1st scheduled OVF update (1h by default), then all is well, no? Sounds like a simple workaround to me and therefore not a high severity bug.

Comment 6 Yaniv Lavi 2017-02-23 11:25:44 UTC
Moving out all non blocker\exceptions.

Comment 7 Maor 2017-04-18 17:11:37 UTC
I tried it now myself and it seems to work.
I suspect that there was a problem in the audit log which states that the operation succeeded although it was not finished yet.

Avihai, how did you test it?
How did you know what files was the OVF_STORE disk contain?
Did you check it once the audit log indicated the operation was finished?

Comment 8 Avihai 2017-04-18 20:00:47 UTC
(In reply to Maor from comment #7)
> I tried it now myself and it seems to work.
Did you do it right after engine-cleanup ? 
***Clean configuration is the key for reproduction here ***

1) first move all hosts to Maintenance 
2) from engine CLI run -> engine-cleanup

> I suspect that there was a problem in the audit log which states that the
> operation succeeded although it was not finished yet.
> 
> Avihai, how did you test it?
Look at my first comment for exact scenario.

> How did you know what files was the OVF_STORE disk contain?

Explanation with an example to clarify:

1) Find the OVFStore id easiest way is in the UI -> disks

For example in UI -> disks ->OVF_STORE ID = 1e0c5df6-8ab9-4e87-9b4d-f4f4ab41a885

2) Find relevant device in host 
for example :
/rhev/data-center/00a3fd67-d000-4de4-81f5-1b9fa125faf1/c330bbae-84b4-4733-8983-0f94c627a227/images/1e0c5df6-8ab9-4e87-9b4d-f4f4ab41a885/d41135c8-c3fa-480a-8728-2f97fa3083a0

3) To see all of the content of both json + OVF use hexdump -C :
hexdump -C /rhev/data-center/00a3fd67-d000-4de4-81f5-1b9fa125faf1/c330bbae-84b4-4733-8983-0f94c627a227/images/1e0c5df6-8ab9-4e87-9b4d-f4f4ab41a885/d41135c8-c3fa-480a-8728-2f97fa3083a0 | less

4)To extract json.info + ovf file copy them to local disk & extract via tar -xvf

> dd if=/rhev/data-center/00a3fd67-d000-4de4-81f5-1b9fa125faf1/c330bbae-84b4-4733-8983-0f94c627a227/images/1e0c5df6-8ab9-4e87-9b4d-f4f4ab41a885/d41135c8-c3fa-480a-8728-2f97fa3083a0 of=/tmp/ovf bs=4k

> tar -xvf /tmp/ovf
info.json
059cd771-ba0d-41c7-9bf5-c9473a9ce8ef.ovf


> Did you check it once the audit log indicated the operation was finished?
I checked several times both right after audit log was finished + several times minutes after the event finished & OVF_STORE images was created but they did not contain OVF files.

Comment 11 Allon Mureinik 2017-06-20 09:55:05 UTC
All these patches are included in the ovirt-engine-4.1.3.3 tag.

Comment 12 Avihai 2017-06-25 08:35:59 UTC
Unfortuntly testing the same scenario at build 4.1.3.4/4.19.19-1 the issue is still not fixed.

Please also check it out & advice, I am not reopening yet just to be on the safe side.

I attached logs & also the OVF store files of both OVF store disks.

I checked about 20+ minutes after OVF update was done & still NO OVF file was in the ovf_store.

Same scenario done :

1) restart engine ( or use clean engine) to simulate starting engine from scratch.
2) create SD ( I used iscsi SD named 'ovf_test_iscsi' )
3) create VM (test_VM ) & add disk (test_vm_Disk1)
4) update OVF by force via UI (Storage -> choose SD -> update OVFs) 

Update event:
Jun 25, 2017 10:44:15 AM OVF_STORE for domain ovf_test_iscsi was updated by admin@internal-authz.


VDSM warnings see OVF update  time :
2017-06-25 10:43:47,604+0300 WARN  (tasks/4) [storage.StorageDomainManifest] Could not find mapping for lv b0e4ddf6-9875-4789-a6c1-247a538371a1/29dd0343-0293-4d08-ae66-63423a6566ea (blockSD:888)
2017-06-25 10:43:47,442+0300 WARN  (tasks/4) [root] File: /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/4972648e-f3e8-4e4a-bebb-a7e2b2b1168d/29dd0343-0293-4d0
8-ae66-63423a6566ea already removed (utils:120)


* How to find & extract OVF files from OVF store :
For updating the refresh rate of the OVF_STORE disks:

1) Find the OVFStore id in the UI-> Lets say 'OVF test iscsi' SD has 2 OVF images:

a) 69bd3e24-d6b1-4d27-af0e-bbe6281ee24b 
b) 4972648e-f3e8-4e4a-bebb-a7e2b2b1168d


Finding the OVF on block domains:

0) USE the date to find the relevant VG & LV hierarchy in the SPM /rhev/data-center/....

ls -l /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/4972648e-f3e8-4e4a-bebb-a7e2b2b1168d/4972648e-f3e8-4e4a-bebb-a7e2b2b1168d/29dd0343-0293-4d08-ae66-63423a6566ea 
				 /< Storage-pool-ID>   				/<SD ID >						     /images/<image-id>/						 / <2nd image id>

ls -l /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/
total 0
drwxr-xr-x. 2 vdsm kvm 50 Jun 25 10:43 4972648e-f3e8-4e4a-bebb-a7e2b2b1168d
drwxr-xr-x. 2 vdsm kvm 50 Jun 25 10:43 69bd3e24-d6b1-4d27-af0e-bbe6281ee24b

Know we know that :
1) SD-id  =VG =  b0e4ddf6-9875-4789-a6c1-247a538371a1
2) matching images id-s & 2nd image id
3) the devices they match e.g /dev/....


[root@storage-ge1-vdsm3 ~]# ls -l /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/69bd3e24-d6b1-4d27-af0e-bbe6281ee24b/52941f27-1e28-4f53-9808-6e09b471600c 
lrwxrwxrwx. 1 vdsm kvm 78 Jun 25 10:43 /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/69bd3e24-d6b1-4d27-af0e-bbe6281ee24b/52941f27-1e28-4f53-9808-6e09b471600c -> /dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/52941f27-1e28-4f53-9808-6e09b471600c

[root@storage-ge1-vdsm3 ~]# ls -l /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/4972648e-f3e8-4e4a-bebb-a7e2b2b1168d/29dd0343-0293-4d08-ae66-63423a6566ea 
lrwxrwxrwx. 1 vdsm kvm 78 Jun 25 10:43 /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/4972648e-f3e8-4e4a-bebb-a7e2b2b1168d/29dd0343-0293-4d08-ae66-63423a6566ea -> /dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/29dd0343-0293-4d08-ae66-63423a6566ea


1. Run vgs to update the vgs
vgs
  VG                                   #PV #LV #SN Attr   VSize   VFree  
  b0e4ddf6-9875-4789-a6c1-247a538371a1   1   9   0 wz--n-  49.62g  44.50g


2. Run lvs |  <2nd image id>
Example:

[root@storage-ge1-vdsm3 ~]# lvs | grep '52941f27-1e28-4f53-9808-6e09b471600c'
  52941f27-1e28-4f53-9808-6e09b471600c b0e4ddf6-9875-4789-a6c1-247a538371a1 -wi------- 128.00m                                                    

[root@storage-ge1-vdsm3 ~]# lvs | grep '29dd0343-0293-4d08-ae66-63423a6566e'
  29dd0343-0293-4d08-ae66-63423a6566ea b0e4ddf6-9875-4789-a6c1-247a538371a1 -wi------- 128.00m                                       


3. Run lvscan and look for the lv path: e.g: 

[root@storage-ge1-vdsm3 ~]#  lvscan | grep '52941f27-1e28-4f53-9808-6e09b471600c'
  inactive          '/dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/52941f27-1e28-4f53-9808-6e09b471600c' [128.00 MiB] inherit

[root@storage-ge1-vdsm3 ~]#  lvscan | grep '29dd0343-0293-4d08-ae66-63423a6566e'
  inactive          '/dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/29dd0343-0293-4d08-ae66-63423a6566ea' [128.00 MiB] inherit



lvchange -ay /dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/52941f27-1e28-4f53-9808-6e09b471600c
lvchange -ay /dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/29dd0343-0293-4d08-ae66-63423a6566ea

 mkdir /mnt/test0c
 mkdir /mnt/test6e

dd if=/dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/52941f27-1e28-4f53-9808-6e09b471600c of=/mnt/test0c/ovf_store bs=4k
dd if=/dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/29dd0343-0293-4d08-ae66-63423a6566ea of=/mnt/test6e/ovf_store bs=4k

?
4) dd if=/dev/b9045ee8-ed92-466f-b787-19da6d7ddfda/899a9416-2b35-476c-8e6a-fe26d799a3f0 of=/tmp/ovf_store bs=4k
?

5) hexdump -C /mnt/test0c/ovf_store| less
5) hexdump -C /mnt/test6e/ovf_store| less

eg :
[root@storage-ge1-vdsm3 ~]# tar -xvf /mnt/test0c/ovf_store
info.json
[root@storage-ge1-vdsm3 ~]# ls -lah /mnt/test0c/ovf_store
-rw-r--r--. 1 root root 128M Jun 25 11:04 /mnt/test0c/ovf_store
[root@storage-ge1-vdsm3 ~]# tar -xvf /mnt/test6e/ovf_store
info.json

Comment 13 Maor 2017-06-25 09:47:08 UTC
Thanks for the update Avihai,
I haven't seen the attached logs, can you please attach them

Comment 14 Avihai 2017-06-25 09:51:04 UTC
Please disregard ( disk was not on correct SD),Anyway its verified on 4.1.3.4


Note You need to log in before you can comment on or make changes to this bug.