Bug 1746390 - Error while creating local storage: Internal Engine Error
Summary: Error while creating local storage: Internal Engine Error
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: ovirt-engine
Classification: oVirt
Component: BLL.Storage
Version: 4.3.6.3
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ovirt-4.4.0
: ---
Assignee: Ahmad Khiet
QA Contact: Shir Fishbain
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-08-28 10:43 UTC by Evelina Shames
Modified: 2020-05-20 19:57 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-05-20 19:57:42 UTC
oVirt Team: Storage
Embargoed:
pm-rhel: ovirt-4.4+


Attachments (Terms of Use)
engine log (1.03 MB, text/plain)
2019-08-28 10:43 UTC, Evelina Shames
no flags Details
vdsm+supervdsm logs (450.64 KB, application/zip)
2019-09-16 07:19 UTC, Evelina Shames
no flags Details
ovirt-engine-4.3.6.5-1.log (198.26 KB, text/plain)
2019-09-17 15:17 UTC, Dominik Holler
no flags Details


Links
System ID Private Priority Status Summary Last Updated
oVirt gerrit 103804 0 'None' MERGED engine: match storage format with local storage DC 2020-09-28 10:20:11 UTC

Description Evelina Shames 2019-08-28 10:43:08 UTC
Created attachment 1608972 [details]
engine log

Description of problem:
While verifying bug 1739134, I tried a different flow to create local storage and saw the same error in the UI:
"Error while executing New Local Storage Domain: Internal Engine Error"

Looks like the same issue.

Version-Release number of selected component (if applicable):
engine - 4.3.6.3

How reproducible:
100%

Steps to Reproduce:
Flow (UI):
- put host in maintenance
- create new directory on the host:
 mkdir -p /tst_dir
 chown 36:36 /tst_dir
 chmod 0755 /tst_dir
- Management > Configure Local Storage:
  Data Center - click edit and change Compatibility Version to 4.2
  path to local storage - /tst_dir
- click 'ok' -> "Error while executing New Local Storage Domain: Internal Engine Error"


Actual results:
Operation fails with "Error while executing New Local Storage Domain: Internal Engine Error"

Expected results:
Operation should succeed

Additional info:
logs are attached.

Comment 1 Tal Nisan 2019-09-09 14:45:40 UTC
Seems like a network issue, moving to them for inspection

Comment 2 Dominik Holler 2019-09-10 08:30:19 UTC
(In reply to Tal Nisan from comment #1)
> Seems like a network issue, moving to them for inspection

Thanks, looks there is an issue in the networking code.
I don't know yet if this is related to the problem, but nevertheless we have to dive in.

Evelina, can you please share the vdsm.log and supervdsm.log of the host?

Comment 3 Evelina Shames 2019-09-16 07:19:06 UTC
Created attachment 1615486 [details]
vdsm+supervdsm logs

Comment 4 Dominik Holler 2019-09-17 12:58:10 UTC
I am not able to reproduce this issue, because I am running into bug 1739134, even on ovirt-engine-4.3.6.5-1.el7.noarch.
Evelina, can you please check if bug 1739134 popped up again on ovirt-engine-4.3.6.5-1 ?

Comment 5 Dominik Holler 2019-09-17 15:17:39 UTC
Created attachment 1615883 [details]
ovirt-engine-4.3.6.5-1.log

engine log of ovirt-engine-4.3.6.5-1.el7.noarch,
containing
USER_ADD_STORAGE_POOL(950), Data Center ovirt-43-host11-Local, Compatibility Version 4.2 and Quota Type DISABLED was added by admin@internal-authz
WARN  [org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand] (default task-2) [31f1448c] Validation of action 'AttachStorageDomainToPool' failed for user SYSTEM. Reasons: VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__ATTACH,ACTION_TYPE_FAILED_STORAGE_DOMAIN_FORMAT_ILLEGAL,$storageFormat V5

Comment 6 Fred Rolland 2019-09-18 13:20:36 UTC
Avihai, can you assign someone to check if the other issue is still there?

Comment 7 Avihai 2019-09-19 04:03:45 UTC
(In reply to Fred Rolland from comment #6)
> Avihai, can you assign someone to check if the other issue is still there?

Shir, can you please check it out?

Comment 8 Shir Fishbain 2019-09-19 14:43:59 UTC
I checked this scenario again and found that this bug isn't related to network.
This ERROR message: "Error while executing action New Local Storage Domain: Error in creating a Storage Domain. The selected storage path is not empty (probably contains another Storage Domain). Either remove the existing Storage Domain from this path or change the Storage path)" appears because we try to create a storage domain in the second time on the same path(/tst_dir).
Needs to make the message more clear like in engine.log : 

2019-09-19 16:32:46,899+03 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-100) [2de8e429] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM host_mixed_3 command CreateStorageDomainVDS failed: Storage domain is not empty - requires cleaning: (u'/tst_dir',)

Comment 9 Shir Fishbain 2019-09-19 15:43:44 UTC
If the local storage connection already used by the storage domain, the message that should appear is 
"Create operation failed. Storage connection is already used by the following storage domain: nfs_0." The same as in nfs.

Comment 10 Shir Fishbain 2020-01-02 10:28:47 UTC
Verified 

The message that appears when trying to create a storage domain in the second time on the same path(/tst_dir) is: "Create operation failed. Storage connection is already used by the following storage domain: new_shir_sd "

vdsm-4.40.0-164.git38a19bb.el8ev.x86_64
ovirt-engine-4.4.0-0.13.master.el7.noarch

Comment 11 Sandro Bonazzola 2020-05-20 19:57:42 UTC
This bugzilla is included in oVirt 4.4.0 release, published on May 20th 2020.

Since the problem described in this bug report should be
resolved in oVirt 4.4.0 release, it has been closed with a resolution of CURRENT RELEASE.

If the solution does not work for you, please open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.