Bug 1560610 - Storage Domain's size not being updated during deployment.
Summary: Storage Domain's size not being updated during deployment.
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: ovirt-hosted-engine-setup
Classification: oVirt
Component: General
Version: 2.2.14
Hardware: x86_64
OS: Linux
high
high
Target Milestone: ovirt-4.2.3
: ---
Assignee: Ido Rosenzwig
QA Contact: Nikolai Sednev
URL:
Whiteboard:
Depends On:
Blocks: 1458709
TreeView+ depends on / blocked
 
Reported: 2018-03-26 14:55 UTC by Nikolai Sednev
Modified: 2018-05-10 06:31 UTC (History)
4 users (show)

Fixed In Version: ovirt-hosted-engine-setup-2.2.19-1.el7ev
Doc Type: Bug Fix
Doc Text:
Cause: the user couldn't chose a suitable Storage Domain once he chose a small Storage Domain (under 60GB) Consequence: The user had to restart the deployment process in order to add the suitable storage domain instead of reenter another storage domain details Fix: The Storage Domain is added in an unattached state so it can be removed if its size is lower than then requirements. It is activated once its size is validated Result: The user can now choose a different Storage Domain or extend the one he chose previously without restarting the deployment process
Clone Of:
Environment:
Last Closed: 2018-05-10 06:31:49 UTC
oVirt Team: Integration
Embargoed:
rule-engine: ovirt-4.2+
ylavi: blocker+


Attachments (Terms of Use)
logs from alma04 (9.56 MB, application/x-xz)
2018-03-26 14:55 UTC, Nikolai Sednev
no flags Details
sosreport from alma04 (9.46 MB, application/x-xz)
2018-04-30 15:30 UTC, Nikolai Sednev
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 1560353 0 high CLOSED If iSCSI storage is selected and the LUN does not have enough space, deployment fails on other backends after changing 2021-02-22 00:41:40 UTC
oVirt gerrit 90326 0 master MERGED Ansible: Check available space on storage domain before adding it to the cluster 2021-01-19 00:15:18 UTC
oVirt gerrit 90509 0 ovirt-hosted-engine-setup-2.2 MERGED Ansible: Check available space on storage domain before adding it to the cluster 2021-01-19 00:15:19 UTC

Internal Links: 1560353

Description Nikolai Sednev 2018-03-26 14:55:54 UTC
Created attachment 1413201 [details]
logs from alma04

Description of problem:
If during deployment there is insufficient LUN size was provided and then it has been resized to sufficient size, then deployment can't continue, as current LUN's size not being updated in deployment.

[ INFO  ] ok: [localhost]
          The following luns have been found on the requested target:
                [1]     3514f0c5a516016d7       60GiB   XtremIO XtremApp
                        status: free, paths: 1 active
         
                [2]     3514f0c5a516016d8       54GiB   XtremIO XtremApp
                        status: free, paths: 1 active
         
          Please select the destination LUN (1, 2) [1]: 
[ INFO  ] iSCSI discard after delete is enabled
[ INFO  ] Creating Storage Domain
[ INFO  ] TASK [Gathering Facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Check local VM dir stat]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Enforce local VM dir existence]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [include_tasks]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Obtain SSO token using username/password credentials]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch host facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch cluster ID]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch cluster facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch Datacenter facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch Datacenter ID]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch Datacenter name]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Add NFS storage domain]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [Add glusterfs storage domain]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [Add iSCSI storage domain]
[ INFO  ] changed: [localhost]
[ INFO  ] TASK [Add Fibre Channel storage domain]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [Get storage domain details]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Find the appliance OVF]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Parse OVF]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Get required size]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Check storage domain free space]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Error: the target storage domain contains only 55296.0Mb of available space while a minimum of 56320.0Mb is required"}
          Please specify the storage you would like to use (glusterfs, iscsi, fc, nfs)[nfs]: iscsi
          Please specify the iSCSI portal IP address: 10.35.146.129
          Please specify the iSCSI portal port [3260]: 
          Please specify the iSCSI discover user: 
          Please specify the iSCSI discover password: 
          Please specify the iSCSI portal login user: 
          Please specify the iSCSI portal login password: 
[ INFO  ] Discovering iSCSI targets
[ INFO  ] TASK [Gathering Facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [include_tasks]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Obtain SSO token using username/password credentials]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Prepare iSCSI parameters]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch host facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [iSCSI discover with REST API]
[ INFO  ] ok: [localhost]
          The following targets have been found:
                [1]     iqn.2008-05.com.xtremio:xio00153500071-514f0c50023f6c05
                        TPGT: 1, portals:
                                10.35.146.225:3260
         
                [2]     iqn.2008-05.com.xtremio:xio00153500071-514f0c50023f6c04
                        TPGT: 1, portals:
                                10.35.146.193:3260
         
                [3]     iqn.2008-05.com.xtremio:xio00153500071-514f0c50023f6c01
                        TPGT: 1, portals:
                                10.35.146.161:3260
         
                [4]     iqn.2008-05.com.xtremio:xio00153500071-514f0c50023f6c00
                        TPGT: 1, portals:
                                10.35.146.129:3260
         
          Please select a target (1, 2, 3, 4) [1]: 4
[ INFO  ] Getting iSCSI LUNs list
[ INFO  ] TASK [Gathering Facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [include_tasks]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Obtain SSO token using username/password credentials]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [iSCSI login]
[ INFO  ] TASK [Get iSCSI LUNs]
[ INFO  ] ok: [localhost]
          The following luns have been found on the requested target:
                [1]     3514f0c5a516016d7       70GiB   XtremIO XtremApp
                        status: used, paths: 1 active
         
                [2]     3514f0c5a516016d8       54GiB   XtremIO XtremApp
                        status: free, paths: 1 active
         
          Please select the destination LUN (1, 2) [1]: 
[ INFO  ] iSCSI discard after delete is enabled
[ INFO  ] Creating Storage Domain
[ INFO  ] TASK [Gathering Facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Check local VM dir stat]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Enforce local VM dir existence]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [include_tasks]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Obtain SSO token using username/password credentials]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch host facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch cluster ID]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch cluster facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch Datacenter facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch Datacenter ID]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch Datacenter name]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Add NFS storage domain]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [Add glusterfs storage domain]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [Add iSCSI storage domain]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Add Fibre Channel storage domain]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [Get storage domain details]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Find the appliance OVF]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Parse OVF]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Get required size]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Check storage domain free space]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Error: the target storage domain contains only 55296.0Mb of available space while a minimum of 56320.0Mb is required"}
          Please specify the storage you would like to use (glusterfs, iscsi, fc, nfs)[nfs]:

Version-Release number of selected component (if applicable):
ovirt-hosted-engine-setup-2.2.14-1.el7ev.noarch
ovirt-hosted-engine-ha-2.2.7-1.el7ev.noarch
Linux 3.10.0-862.el7.x86_64 #1 SMP Wed Mar 21 18:14:51 EDT 2018 x86_64 x86_64 x86_64 GNU/Linux
Red Hat Enterprise Linux Server release 7.5 (Maipo)

How reproducible:
100%

Steps to Reproduce:
1.Create 60GB LUN on iSCSI and try deploying Node 0 over it.
2.Once error message "[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Error: the target storage domain contains only 55296.0Mb of available space while a minimum of 56320.0Mb is required"}" received, resize LUN to 70GB.
3.Continue with the deployment over resized LUN.

Actual results:
Deployment doesn't checks for up to date current LUN's size.

Expected results:
During deployment, if LUN's size was resized up to minimum required size, deployment should continue and succeed, it should not show outdated error.

Additional info:
Sosreport from host.

Comment 1 Nikolai Sednev 2018-03-26 15:00:42 UTC
Its not the LUN size, but the storage domain size that is not being updated after resizing the LUN.
See here from first LUN with 60GB size:
[ INFO  ] ok: [localhost]
          The following luns have been found on the requested target:
                [1]     3514f0c5a516016d7       60GiB   XtremIO XtremApp
                        status: free, paths: 1 active
And here from 60GB LUN that was already resized to 70GB:
[ INFO  ] ok: [localhost]
          The following luns have been found on the requested target:
                [1]     3514f0c5a516016d7       70GiB   XtremIO XtremApp
                        status: used, paths: 1 active

I would expect that storage domain should be automatically resized up to maximum of resized LUN's space.

Comment 5 Nikolai Sednev 2018-04-30 15:26:53 UTC
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Error: the target storage domain contains only 54.0GiB of available space while a minimum of 68.0GiB is required If you wish to use the current target storage domain by extending it, make sure it contains nothing before adding it."}
          Please specify the storage you would like to use (glusterfs, iscsi, fc, nfs)[nfs]: iscsi
          Please specify the iSCSI portal IP address: 10.35.146.129
          Please specify the iSCSI portal port [3260]: 
          Please specify the iSCSI discover user: 
          Please specify the iSCSI discover password: 
          Please specify the iSCSI portal login user: 
          Please specify the iSCSI portal login password: 
[ INFO  ] Discovering iSCSI targets
[ INFO  ] TASK [Gathering Facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [include_tasks]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Obtain SSO token using username/password credentials]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Prepare iSCSI parameters]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch host facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [iSCSI discover with REST API]
[ INFO  ] ok: [localhost]
          The following targets have been found:
                [1]     iqn.2008-05.com.xtremio:xio00153500071-514f0c50023f6c05
                        TPGT: 1, portals:
                                10.35.146.225:3260
         
                [2]     iqn.2008-05.com.xtremio:xio00153500071-514f0c50023f6c04
                        TPGT: 1, portals:
                                10.35.146.193:3260
         
                [3]     iqn.2008-05.com.xtremio:xio00153500071-514f0c50023f6c01
                        TPGT: 1, portals:
                                10.35.146.161:3260
         
                [4]     iqn.2008-05.com.xtremio:xio00153500071-514f0c50023f6c00
                        TPGT: 1, portals:
                                10.35.146.129:3260
         
          Please select a target (1, 2, 3, 4) [1]: 
[ INFO  ] Getting iSCSI LUNs list
[ INFO  ] TASK [Gathering Facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [include_tasks]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Obtain SSO token using username/password credentials]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [iSCSI login]
[ INFO  ] TASK [Get iSCSI LUNs]
[ INFO  ] ok: [localhost]
          The following luns have been found on the requested target:
                [1]     3514f0c5a5160175e       100GiB  XtremIO XtremApp
                        status: used, paths: 1 active
         
          Please select the destination LUN (1) [1]: 
[ INFO  ] iSCSI discard after delete is enabled
[ INFO  ] Creating Storage Domain
[ INFO  ] TASK [Gathering Facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Check local VM dir stat]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Enforce local VM dir existence]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [include_tasks]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Obtain SSO token using username/password credentials]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch host facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch cluster ID]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch cluster facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch Datacenter facts]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch Datacenter ID]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Fetch Datacenter name]
[ INFO  ] ok: [localhost]
[ INFO  ] TASK [Add NFS storage domain]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [Add glusterfs storage domain]
[ INFO  ] skipping: [localhost]
[ INFO  ] TASK [Add iSCSI storage domain]
[ ERROR ] Error: Fault reason is "Operation Failed". Fault detail is "[Physical device initialization failed. Please check that the device is empty and accessible by the host.]". HTTP response code is 400.
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[Physical device initialization failed. Please check that the device is empty and accessible by the host.]\". HTTP response code is 400."}
          Please specify the storage you would like to use (glusterfs, iscsi, fc, nfs)[nfs]:

Checked on these components:
ovirt-engine-4.2.3.3-0.1.el7.noarch
rhvm-appliance-4.2-20180427.0.el7.noarch
ovirt-hosted-engine-setup-2.2.19-1.el7ev.noarch
ovirt-hosted-engine-ha-2.2.11-1.el7ev.noarch
Linux 3.10.0-862.el7.x86_64 #1 SMP Wed Mar 21 18:14:51 EDT 2018 x86_64 x86_64 x86_64 GNU/Linux
Red Hat Enterprise Linux Server release 7.5 (Maipo)

In case of using clean LUN (not resized from 60GB to 100GB), deployment passes just fine on it.

Comment 6 Nikolai Sednev 2018-04-30 15:30:26 UTC
Created attachment 1428863 [details]
sosreport from alma04

Comment 7 Ido Rosenzwig 2018-05-01 07:25:11 UTC
Nikoali,

After you resize the Storage Domain did you clean it before choosing it again in the deployment?

Comment 8 Nikolai Sednev 2018-05-01 11:58:53 UTC
(In reply to Ido Rosenzwig from comment #7)
> Nikoali,
> 
> After you resize the Storage Domain did you clean it before choosing it
> again in the deployment?

It was clean before the deployment, why should I clean it?

Comment 9 Ido Rosenzwig 2018-05-01 12:35:00 UTC
(In reply to Nikolai Sednev from comment #8)

> (In reply to Ido Rosenzwig from comment #7)
> > Nikoali,
> > 
> > After you resize the Storage Domain did you clean it before choosing it
> > again in the deployment?
> 
> It was clean before the deployment, why should I clean it?

Because during the first deployment it got dirty.
so before attach it again in the second try, after you resize the SD, you should check the SD in clean.

We don't erase the content of the SD after a failed deployment, this is the user's responsibility. In addition, if the user wishes to reuse the same SD by extending it we instruct to clean it before adding it again. (see the first line on comment 5 as reference)

Comment 10 Nikolai Sednev 2018-05-01 12:42:45 UTC
Works for me on these components:
ovirt-engine-4.2.3.3-0.1.el7.noarch
rhvm-appliance-4.2-20180427.0.el7.noarch
ovirt-hosted-engine-setup-2.2.19-1.el7ev.noarch
ovirt-hosted-engine-ha-2.2.11-1.el7ev.noarch
Linux 3.10.0-862.el7.x86_64 #1 SMP Wed Mar 21 18:14:51 EDT 2018 x86_64 x86_64 x86_64 GNU/Linux
Red Hat Enterprise Linux Server release 7.5 (Maipo)

Comment 11 Sandro Bonazzola 2018-05-10 06:31:49 UTC
This bugzilla is included in oVirt 4.2.3 release, published on May 4th 2018.

Since the problem described in this bug report should be
resolved in oVirt 4.2.3 release, it has been closed with a resolution of CURRENT RELEASE.

If the solution does not work for you, please open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.