Created attachment 1230626 [details] engine and 2 hosts logs (vdsm_host.log and vdsm_host2.log) Description of problem: Issue occurs after starting the engine from scratch , no previous storage domains . Force Ovf Store (update OVFs) does not create ovf files until first scheduled OVF update occurs Version-Release number of selected component (if applicable): 4.1.0-0.2.master.20161210231201.git26a385e.el7.centos How reproducible: 100% Steps to Reproduce: 1.Start the engine from scratch , no previous storage domains or OVF_STORE disks. 2.create 3 storage domains (NFS,iscsi,gluster) 3.create VM 4.create 3 disks on that VM , each disk from a different storage domain(NFS,iscsi,gluster) 5.Force Ovf Store (update OVFs) on each of the storage domains(NFS,iscsi,gluster) Actual results: OVF_STORE images is created but they do not contain OVF files . Expected results: OVF_STORE images should contain OVF files Additional info: Only info.json files are in the images . Important work around : From the point Scheduled OVF update occurred (I forced Scheduled OVF update to occur by moving a storage domain to maintenance and back to activate ) Force Ovf Store worked .
relevant time frame in the logs are 2016-12-11 17:04 - 17:42 . From engine.log: 2016-12-11 17:04:14,941+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-13) [eb1a79d0-34dc-48f1-baf0-78ed2b790687] Correlation ID: eb1a79d0-34dc-48f1-baf0-78ed2b790687, Call Stack: null, Custom Event ID: -1, Message: Storage Domain nfs_domain was updated by admin@internal-authz 2016-12-11 17:20:52,972+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [4420becb] Correlation ID: 7651f3a6-a9a4-4015-952a-6000d3c70b23, Job ID: e78675c2-228e-4201-bee5-752e3a6d48bf, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain gluster_dom was updated by admin@internal-authz. 2016-12-11 17:26:57,769+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [bc4b74e] Correlation ID: 22fafc55-cee5-4bb7-a102-8bf346806efc, Job ID: 27d12ff2-5862-4722-87bf-8178b984ef2d, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain gluster_dom was updated by admin@internal-authz. 2016-12-11 17:34:50,860+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-13) [3a050cdb] Correlation ID: 1c374e0e-da16-485a-8c6a-fb5d12480b08, Job ID: ce9e8ad1-1002-4c9e-a452-28ed72b6aec3, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain gluster_dom was updated by admin@internal-authz. 2016-12-11 17:39:18,095+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [2af20877] Correlation ID: 13f11ea6-80e9-4c9f-9d07-869eaf32c8d1, Job ID: 5d509954-899f-4f60-a794-016b781c25ec, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain iscsi_domain was updated by admin@internal-authz. OVF data won't be updated meanwhile for that domain. OVF data won't be updated meanwhile for that domain. 2016-12-11 17:41:08,223+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-4) [7a4004c1] Correlation ID: 259c6c41-651c-4a18-b829-4497771d711e, Job ID: 5ccdfd19-a757-4f47-b6a1-682bca4933c7, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain nfs_domain was updated by admin@internal-authz. 2016-12-11 17:41:38,735+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-16) [b5198ab4-661c-4e9a-8e85-d3cbf399d443] Correlation ID: b5198ab4-661c-4e9a-8e85-d3cbf399d443, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi_domain was updated by admin@internal-authz 2016-12-11 17:41:46,035+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [66e3731a] Correlation ID: 0ad60619-ebb4-4548-9adc-92d36be262f5, Job ID: c70032fd-d041-4438-989a-a6fc7268ebe1, Call Stack: null, Custom Event ID: -1, Message: OVF_STORE for domain iscsi_domain was updated by admin@internal-authz.
from vdsm_host2.log (SPM host camel_vdsc) : 2016-12-11 17:20:49,379 INFO (jsonrpc/4) [dispatcher] Run and protect: createVolume(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49) 2016-12-11 17:20:51,694 INFO (jsonrpc/5) [dispatcher] Run and protect: createVolume(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='22e62245-35cc-4402-acec-769442eabfbb', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49) 2016-12-11 17:21:46,365 INFO (jsonrpc/3) [storage.VolumeManifest] 6fb7f1f1-fcbd-4404-8713-b97cbfc23700/8900bdb1-03c3-44ee-b48d-9badbd57df2d/d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 info is {'status': 'OK', 'domain': '6fb7f1f1-fcbd-4404-8713-b97cbfc23700', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '8900bdb1-03c3-44ee-b48d-9badbd57df2d', 'ctime': '1481469688', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': 'd07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249) 2016-12-11 17:21:46,365 INFO (jsonrpc/3) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '6fb7f1f1-fcbd-4404-8713-b97cbfc23700', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '8900bdb1-03c3-44ee-b48d-9badbd57df2d', 'ctime': '1481469688', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': 'd07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52) 2016-12-11 17:21:49,197 INFO (jsonrpc/4) [storage.VolumeManifest] 6fb7f1f1-fcbd-4404-8713-b97cbfc23700/be7e7bbe-ecb7-481f-b784-46bf859c134e/22e62245-35cc-4402-acec-769442eabfbb info is {'status': 'OK', 'domain': '6fb7f1f1-fcbd-4404-8713-b97cbfc23700', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'be7e7bbe-ecb7-481f-b784-46bf859c134e', 'ctime': '1481469694', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '22e62245-35cc-4402-acec-769442eabfbb', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249) 2016-12-11 17:21:49,197 INFO (jsonrpc/4) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '6fb7f1f1-fcbd-4404-8713-b97cbfc23700', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'be7e7bbe-ecb7-481f-b784-46bf859c134e', 'ctime': '1481469694', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '22e62245-35cc-4402-acec-769442eabfbb', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52) 2016-12-11 17:21:51,371 INFO (jsonrpc/5) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:21:51,421 INFO (jsonrpc/5) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:21:52,823 INFO (jsonrpc/6) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:21:52,857 INFO (jsonrpc/6) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:21:53,896 INFO (jsonrpc/7) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:21:53,942 INFO (jsonrpc/7) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:21:55,607 INFO (jsonrpc/3) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:21:55,645 INFO (jsonrpc/3) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:26:52,654 INFO (jsonrpc/5) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":false,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:26:52,697 INFO (jsonrpc/5) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":false,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:26:54,159 INFO (jsonrpc/4) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:26:54,197 INFO (jsonrpc/4) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:26:55,238 INFO (jsonrpc/6) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":false,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:26:55,283 INFO (jsonrpc/6) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":false,"Last Updated":"Sun Dec 11 17:21:51 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:26:56,690 INFO (jsonrpc/7) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:26:56,727 INFO (jsonrpc/7) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:34:44,064 INFO (jsonrpc/5) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":false,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:34:44,115 INFO (jsonrpc/5) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":false,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:34:45,587 INFO (jsonrpc/4) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='8900bdb1-03c3-44ee-b48d-9badbd57df2d', volUUID='d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:34:44 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:34:45,630 INFO (jsonrpc/4) [storage.VolumeManifest] volUUID = d07ad6c5-8e6e-41e0-81d3-7f198d43e2f9 descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:34:44 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:34:46,660 INFO (jsonrpc/6) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":false,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:34:46,706 INFO (jsonrpc/6) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":false,"Last Updated":"Sun Dec 11 17:26:52 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:34:49,845 INFO (jsonrpc/0) [dispatcher] Run and protect: setVolumeDescription(sdUUID='6fb7f1f1-fcbd-4404-8713-b97cbfc23700', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='be7e7bbe-ecb7-481f-b784-46bf859c134e', volUUID='22e62245-35cc-4402-acec-769442eabfbb', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:34:44 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:34:49,890 INFO (jsonrpc/0) [storage.VolumeManifest] volUUID = 22e62245-35cc-4402-acec-769442eabfbb descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:34:44 IST 2016","Storage Domains":[{"uuid":"6fb7f1f1-fcbd-4404-8713-b97cbfc23700"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:41:05,167 INFO (jsonrpc/1) [dispatcher] Run and protect: createVolume(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='5c1aeba9-89a9-4a00-8a09-97911489a2c8', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='95b0b215-dd6e-4f92-93fc-fd935be7a87d', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49) 2016-12-11 17:41:05,892 INFO (jsonrpc/4) [dispatcher] Run and protect: createVolume(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='c6bbae7f-b64e-4325-a17e-52c505098da5', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='4c34cc22-91f6-4753-a48f-1ede9d59ff3f', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49) 2016-12-11 17:41:21,674 INFO (jsonrpc/0) [storage.VolumeManifest] 81505d02-420e-4748-aabb-8daf39c037dc/c6bbae7f-b64e-4325-a17e-52c505098da5/4c34cc22-91f6-4753-a48f-1ede9d59ff3f info is {'status': 'OK', 'domain': '81505d02-420e-4748-aabb-8daf39c037dc', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'c6bbae7f-b64e-4325-a17e-52c505098da5', 'ctime': '1481470868', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '4c34cc22-91f6-4753-a48f-1ede9d59ff3f', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249) 2016-12-11 17:41:21,674 INFO (jsonrpc/0) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '81505d02-420e-4748-aabb-8daf39c037dc', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'c6bbae7f-b64e-4325-a17e-52c505098da5', 'ctime': '1481470868', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '4c34cc22-91f6-4753-a48f-1ede9d59ff3f', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52) 2016-12-11 17:41:25,011 INFO (jsonrpc/5) [storage.VolumeManifest] 81505d02-420e-4748-aabb-8daf39c037dc/5c1aeba9-89a9-4a00-8a09-97911489a2c8/95b0b215-dd6e-4f92-93fc-fd935be7a87d info is {'status': 'OK', 'domain': '81505d02-420e-4748-aabb-8daf39c037dc', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '5c1aeba9-89a9-4a00-8a09-97911489a2c8', 'ctime': '1481470867', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '95b0b215-dd6e-4f92-93fc-fd935be7a87d', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249) 2016-12-11 17:41:25,011 INFO (jsonrpc/5) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '81505d02-420e-4748-aabb-8daf39c037dc', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '5c1aeba9-89a9-4a00-8a09-97911489a2c8', 'ctime': '1481470867', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '95b0b215-dd6e-4f92-93fc-fd935be7a87d', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52) 2016-12-11 17:41:26,596 INFO (jsonrpc/4) [dispatcher] Run and protect: setVolumeDescription(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='c6bbae7f-b64e-4325-a17e-52c505098da5', volUUID='4c34cc22-91f6-4753-a48f-1ede9d59ff3f', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:41:26,620 INFO (jsonrpc/4) [storage.VolumeManifest] volUUID = 4c34cc22-91f6-4753-a48f-1ede9d59ff3f descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:41:27,154 INFO (jsonrpc/7) [dispatcher] Run and protect: setVolumeDescription(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='c6bbae7f-b64e-4325-a17e-52c505098da5', volUUID='4c34cc22-91f6-4753-a48f-1ede9d59ff3f', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:41:26 IST 2016","Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:41:27,192 INFO (jsonrpc/7) [storage.VolumeManifest] volUUID = 4c34cc22-91f6-4753-a48f-1ede9d59ff3f descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:41:26 IST 2016","Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:41:27,249 INFO (jsonrpc/3) [dispatcher] Run and protect: setVolumeDescription(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='5c1aeba9-89a9-4a00-8a09-97911489a2c8', volUUID='95b0b215-dd6e-4f92-93fc-fd935be7a87d', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:41:27,274 INFO (jsonrpc/3) [storage.VolumeManifest] volUUID = 95b0b215-dd6e-4f92-93fc-fd935be7a87d descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:41:28,161 INFO (jsonrpc/2) [dispatcher] Run and protect: setVolumeDescription(sdUUID='81505d02-420e-4748-aabb-8daf39c037dc', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='5c1aeba9-89a9-4a00-8a09-97911489a2c8', volUUID='95b0b215-dd6e-4f92-93fc-fd935be7a87d', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:41:26 IST 2016","Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:41:28,199 INFO (jsonrpc/2) [storage.VolumeManifest] volUUID = 95b0b215-dd6e-4f92-93fc-fd935be7a87d descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:41:26 IST 2016","Storage Domains":[{"uuid":"81505d02-420e-4748-aabb-8daf39c037dc"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:41:43,456 INFO (jsonrpc/1) [dispatcher] Run and protect: createVolume(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='b12d8d10-0fbf-45fd-918a-ebedabb25db9', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='1d4065b1-3c23-4c77-82d4-80c84ce1ccd3', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49) 2016-12-11 17:41:44,976 INFO (jsonrpc/4) [dispatcher] Run and protect: createVolume(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='6daf81e1-38af-4d2c-ae56-a4c34d07e768', size='134217728', volFormat=5, preallocate=1, diskType=2, volUUID='b7cc014f-8e4a-4641-b13d-cea64693760d', desc='{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:49) 2016-12-11 17:41:54,509 INFO (jsonrpc/6) [storage.VolumeManifest] 9f7b50fe-3dbe-43f8-932e-1814f4c2e007/6daf81e1-38af-4d2c-ae56-a4c34d07e768/b7cc014f-8e4a-4641-b13d-cea64693760d info is {'status': 'OK', 'domain': '9f7b50fe-3dbe-43f8-932e-1814f4c2e007', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '6daf81e1-38af-4d2c-ae56-a4c34d07e768', 'ctime': '1481470905', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': 'b7cc014f-8e4a-4641-b13d-cea64693760d', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249) 2016-12-11 17:41:54,509 INFO (jsonrpc/6) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9f7b50fe-3dbe-43f8-932e-1814f4c2e007', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': '6daf81e1-38af-4d2c-ae56-a4c34d07e768', 'ctime': '1481470905', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': 'b7cc014f-8e4a-4641-b13d-cea64693760d', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52) 2016-12-11 17:42:02,925 INFO (jsonrpc/2) [storage.VolumeManifest] 9f7b50fe-3dbe-43f8-932e-1814f4c2e007/b12d8d10-0fbf-45fd-918a-ebedabb25db9/1d4065b1-3c23-4c77-82d4-80c84ce1ccd3 info is {'status': 'OK', 'domain': '9f7b50fe-3dbe-43f8-932e-1814f4c2e007', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'b12d8d10-0fbf-45fd-918a-ebedabb25db9', 'ctime': '1481470904', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '1d4065b1-3c23-4c77-82d4-80c84ce1ccd3', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'} (volume:249) 2016-12-11 17:42:02,926 INFO (jsonrpc/2) [dispatcher] Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '9f7b50fe-3dbe-43f8-932e-1814f4c2e007', 'voltype': 'LEAF', 'description': '{"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'generation': 0, 'image': 'b12d8d10-0fbf-45fd-918a-ebedabb25db9', 'ctime': '1481470904', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': '1d4065b1-3c23-4c77-82d4-80c84ce1ccd3', 'truesize': '134217728', 'type': 'PREALLOCATED', 'lease': 'FREE'}} (logUtils:52) 2016-12-11 17:42:04,069 INFO (jsonrpc/0) [dispatcher] Run and protect: setVolumeDescription(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='b12d8d10-0fbf-45fd-918a-ebedabb25db9', volUUID='1d4065b1-3c23-4c77-82d4-80c84ce1ccd3', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:42:04,138 INFO (jsonrpc/0) [storage.VolumeManifest] volUUID = 1d4065b1-3c23-4c77-82d4-80c84ce1ccd3 descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:42:05,928 INFO (jsonrpc/1) [dispatcher] Run and protect: setVolumeDescription(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='b12d8d10-0fbf-45fd-918a-ebedabb25db9', volUUID='1d4065b1-3c23-4c77-82d4-80c84ce1ccd3', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:42:04 IST 2016","Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:42:06,000 INFO (jsonrpc/1) [storage.VolumeManifest] volUUID = 1d4065b1-3c23-4c77-82d4-80c84ce1ccd3 descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:42:04 IST 2016","Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:42:07,036 INFO (jsonrpc/6) [dispatcher] Run and protect: setVolumeDescription(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='6daf81e1-38af-4d2c-ae56-a4c34d07e768', volUUID='b7cc014f-8e4a-4641-b13d-cea64693760d', description='{"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:42:07,105 INFO (jsonrpc/6) [storage.VolumeManifest] volUUID = b7cc014f-8e4a-4641-b13d-cea64693760d descr = {"Updated":false,"Last Updated":null,"Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"} (volume:366) 2016-12-11 17:42:08,897 INFO (jsonrpc/3) [dispatcher] Run and protect: setVolumeDescription(sdUUID='9f7b50fe-3dbe-43f8-932e-1814f4c2e007', spUUID='957d533c-58e7-4d51-8ceb-730517947566', imgUUID='6daf81e1-38af-4d2c-ae56-a4c34d07e768', volUUID='b7cc014f-8e4a-4641-b13d-cea64693760d', description='{"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:42:04 IST 2016","Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"}', options=None) (logUtils:49) 2016-12-11 17:42:08,971 INFO (jsonrpc/3) [storage.VolumeManifest] volUUID = b7cc014f-8e4a-4641-b13d-cea64693760d descr = {"Updated":true,"Size":10240,"Last Updated":"Sun Dec 11 17:42:04 IST 2016","Storage Domains":[{"uuid":"9f7b50fe-3dbe-43f8-932e-1814f4c2e007"}],"Disk Description":"OVF_STORE"} (volume:366)
1. Does the reproduction needs all the storage domains? Aren't there simpler steps to reproduce? 2. No need for such long copy-paste of logs. It's impossible to work with and just clutters bugzilla. 3. Not sure why the severity is high? A simple workaround, not a P1 feature, etc...
Answering Yaniv Q's : "1. Does the reproduction needs all the storage domains? Aren't there simpler steps to reproduce? " No , we do not need all the storage domains , one is sufficient to reproduce this issue . The reason I tested added the multiple different input was to show this issue is not related to a storage domain specific type. "2. No need for such long copy-paste of logs. It's impossible to work with and just clutters bugzilla." Sorry about that, My intention was to give you all relevant data ( I grep only OFVupdate messages) in the relevant time frame so you can have all the data in-front of you. Next time I will put it in a file . "3. Not sure why the severity is high? A simple workaround, not a P1 feature, etc..." IMHO a customer not having OVF backup meaning no REAL VM backup/export + import storage domain not working for the first hour after a fresh install is a high severity issue. About the workaround although it is easy to perform it means that the costumer will have to put all its storage domain in maintenance & reactivate them which is very disruptive.
If the user will wait for the 1st scheduled OVF update (1h by default), then all is well, no? Sounds like a simple workaround to me and therefore not a high severity bug.
Moving out all non blocker\exceptions.
I tried it now myself and it seems to work. I suspect that there was a problem in the audit log which states that the operation succeeded although it was not finished yet. Avihai, how did you test it? How did you know what files was the OVF_STORE disk contain? Did you check it once the audit log indicated the operation was finished?
(In reply to Maor from comment #7) > I tried it now myself and it seems to work. Did you do it right after engine-cleanup ? ***Clean configuration is the key for reproduction here *** 1) first move all hosts to Maintenance 2) from engine CLI run -> engine-cleanup > I suspect that there was a problem in the audit log which states that the > operation succeeded although it was not finished yet. > > Avihai, how did you test it? Look at my first comment for exact scenario. > How did you know what files was the OVF_STORE disk contain? Explanation with an example to clarify: 1) Find the OVFStore id easiest way is in the UI -> disks For example in UI -> disks ->OVF_STORE ID = 1e0c5df6-8ab9-4e87-9b4d-f4f4ab41a885 2) Find relevant device in host for example : /rhev/data-center/00a3fd67-d000-4de4-81f5-1b9fa125faf1/c330bbae-84b4-4733-8983-0f94c627a227/images/1e0c5df6-8ab9-4e87-9b4d-f4f4ab41a885/d41135c8-c3fa-480a-8728-2f97fa3083a0 3) To see all of the content of both json + OVF use hexdump -C : hexdump -C /rhev/data-center/00a3fd67-d000-4de4-81f5-1b9fa125faf1/c330bbae-84b4-4733-8983-0f94c627a227/images/1e0c5df6-8ab9-4e87-9b4d-f4f4ab41a885/d41135c8-c3fa-480a-8728-2f97fa3083a0 | less 4)To extract json.info + ovf file copy them to local disk & extract via tar -xvf > dd if=/rhev/data-center/00a3fd67-d000-4de4-81f5-1b9fa125faf1/c330bbae-84b4-4733-8983-0f94c627a227/images/1e0c5df6-8ab9-4e87-9b4d-f4f4ab41a885/d41135c8-c3fa-480a-8728-2f97fa3083a0 of=/tmp/ovf bs=4k > tar -xvf /tmp/ovf info.json 059cd771-ba0d-41c7-9bf5-c9473a9ce8ef.ovf > Did you check it once the audit log indicated the operation was finished? I checked several times both right after audit log was finished + several times minutes after the event finished & OVF_STORE images was created but they did not contain OVF files.
All these patches are included in the ovirt-engine-4.1.3.3 tag.
Unfortuntly testing the same scenario at build 4.1.3.4/4.19.19-1 the issue is still not fixed. Please also check it out & advice, I am not reopening yet just to be on the safe side. I attached logs & also the OVF store files of both OVF store disks. I checked about 20+ minutes after OVF update was done & still NO OVF file was in the ovf_store. Same scenario done : 1) restart engine ( or use clean engine) to simulate starting engine from scratch. 2) create SD ( I used iscsi SD named 'ovf_test_iscsi' ) 3) create VM (test_VM ) & add disk (test_vm_Disk1) 4) update OVF by force via UI (Storage -> choose SD -> update OVFs) Update event: Jun 25, 2017 10:44:15 AM OVF_STORE for domain ovf_test_iscsi was updated by admin@internal-authz. VDSM warnings see OVF update time : 2017-06-25 10:43:47,604+0300 WARN (tasks/4) [storage.StorageDomainManifest] Could not find mapping for lv b0e4ddf6-9875-4789-a6c1-247a538371a1/29dd0343-0293-4d08-ae66-63423a6566ea (blockSD:888) 2017-06-25 10:43:47,442+0300 WARN (tasks/4) [root] File: /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/4972648e-f3e8-4e4a-bebb-a7e2b2b1168d/29dd0343-0293-4d0 8-ae66-63423a6566ea already removed (utils:120) * How to find & extract OVF files from OVF store : For updating the refresh rate of the OVF_STORE disks: 1) Find the OVFStore id in the UI-> Lets say 'OVF test iscsi' SD has 2 OVF images: a) 69bd3e24-d6b1-4d27-af0e-bbe6281ee24b b) 4972648e-f3e8-4e4a-bebb-a7e2b2b1168d Finding the OVF on block domains: 0) USE the date to find the relevant VG & LV hierarchy in the SPM /rhev/data-center/.... ls -l /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/4972648e-f3e8-4e4a-bebb-a7e2b2b1168d/4972648e-f3e8-4e4a-bebb-a7e2b2b1168d/29dd0343-0293-4d08-ae66-63423a6566ea /< Storage-pool-ID> /<SD ID > /images/<image-id>/ / <2nd image id> ls -l /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/ total 0 drwxr-xr-x. 2 vdsm kvm 50 Jun 25 10:43 4972648e-f3e8-4e4a-bebb-a7e2b2b1168d drwxr-xr-x. 2 vdsm kvm 50 Jun 25 10:43 69bd3e24-d6b1-4d27-af0e-bbe6281ee24b Know we know that : 1) SD-id =VG = b0e4ddf6-9875-4789-a6c1-247a538371a1 2) matching images id-s & 2nd image id 3) the devices they match e.g /dev/.... [root@storage-ge1-vdsm3 ~]# ls -l /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/69bd3e24-d6b1-4d27-af0e-bbe6281ee24b/52941f27-1e28-4f53-9808-6e09b471600c lrwxrwxrwx. 1 vdsm kvm 78 Jun 25 10:43 /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/69bd3e24-d6b1-4d27-af0e-bbe6281ee24b/52941f27-1e28-4f53-9808-6e09b471600c -> /dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/52941f27-1e28-4f53-9808-6e09b471600c [root@storage-ge1-vdsm3 ~]# ls -l /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/4972648e-f3e8-4e4a-bebb-a7e2b2b1168d/29dd0343-0293-4d08-ae66-63423a6566ea lrwxrwxrwx. 1 vdsm kvm 78 Jun 25 10:43 /rhev/data-center/d8f4d412-1df2-44c6-89fe-1747eb8aa133/b0e4ddf6-9875-4789-a6c1-247a538371a1/images/4972648e-f3e8-4e4a-bebb-a7e2b2b1168d/29dd0343-0293-4d08-ae66-63423a6566ea -> /dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/29dd0343-0293-4d08-ae66-63423a6566ea 1. Run vgs to update the vgs vgs VG #PV #LV #SN Attr VSize VFree b0e4ddf6-9875-4789-a6c1-247a538371a1 1 9 0 wz--n- 49.62g 44.50g 2. Run lvs | <2nd image id> Example: [root@storage-ge1-vdsm3 ~]# lvs | grep '52941f27-1e28-4f53-9808-6e09b471600c' 52941f27-1e28-4f53-9808-6e09b471600c b0e4ddf6-9875-4789-a6c1-247a538371a1 -wi------- 128.00m [root@storage-ge1-vdsm3 ~]# lvs | grep '29dd0343-0293-4d08-ae66-63423a6566e' 29dd0343-0293-4d08-ae66-63423a6566ea b0e4ddf6-9875-4789-a6c1-247a538371a1 -wi------- 128.00m 3. Run lvscan and look for the lv path: e.g: [root@storage-ge1-vdsm3 ~]# lvscan | grep '52941f27-1e28-4f53-9808-6e09b471600c' inactive '/dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/52941f27-1e28-4f53-9808-6e09b471600c' [128.00 MiB] inherit [root@storage-ge1-vdsm3 ~]# lvscan | grep '29dd0343-0293-4d08-ae66-63423a6566e' inactive '/dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/29dd0343-0293-4d08-ae66-63423a6566ea' [128.00 MiB] inherit lvchange -ay /dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/52941f27-1e28-4f53-9808-6e09b471600c lvchange -ay /dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/29dd0343-0293-4d08-ae66-63423a6566ea mkdir /mnt/test0c mkdir /mnt/test6e dd if=/dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/52941f27-1e28-4f53-9808-6e09b471600c of=/mnt/test0c/ovf_store bs=4k dd if=/dev/b0e4ddf6-9875-4789-a6c1-247a538371a1/29dd0343-0293-4d08-ae66-63423a6566ea of=/mnt/test6e/ovf_store bs=4k ? 4) dd if=/dev/b9045ee8-ed92-466f-b787-19da6d7ddfda/899a9416-2b35-476c-8e6a-fe26d799a3f0 of=/tmp/ovf_store bs=4k ? 5) hexdump -C /mnt/test0c/ovf_store| less 5) hexdump -C /mnt/test6e/ovf_store| less eg : [root@storage-ge1-vdsm3 ~]# tar -xvf /mnt/test0c/ovf_store info.json [root@storage-ge1-vdsm3 ~]# ls -lah /mnt/test0c/ovf_store -rw-r--r--. 1 root root 128M Jun 25 11:04 /mnt/test0c/ovf_store [root@storage-ge1-vdsm3 ~]# tar -xvf /mnt/test6e/ovf_store info.json
Thanks for the update Avihai, I haven't seen the attached logs, can you please attach them
Please disregard ( disk was not on correct SD),Anyway its verified on 4.1.3.4