RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 912348 - Sanlock lockspace add failure while creating NFS storage pool on RHEV-H node.
Summary: Sanlock lockspace add failure while creating NFS storage pool on RHEV-H node.
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: ovirt-node
Version: 6.4
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: rc
: ---
Assignee: Mike Burns
QA Contact: Virtualization Bugs
URL:
Whiteboard: storage
Depends On:
Blocks: 913267 916183
TreeView+ depends on / blocked
 
Reported: 2013-02-18 13:43 UTC by Leonid Natapov
Modified: 2018-12-02 15:35 UTC (History)
18 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
The sanlock user was missing in some upgrade circumstances, so the "sanlock lockspace add" command could fail when creating new NFS storage pools on the hypervisor. Now, the sanlock user is checked on upgrade, and is created if it does not exist. The lockspace errors no longer occur.
Clone Of:
Environment:
Last Closed: 2013-06-10 23:03:28 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)
vdsm log (637.79 KB, application/octet-stream)
2013-02-18 13:44 UTC, Leonid Natapov 		no flags Details
View All

Description Leonid Natapov 2013-02-18 13:43:14 UTC 
Description of problem:

Getting Sanlock exception while creating NFS storage pool on RHEV-H node.
Happens with certain storage domains. Seems like a problem with sanlock and Root squash permission on storage domain.


Thread-1039::ERROR::2013-02-18 12:44:15,759::task::833::TaskManager.Task::(_setError) Task=`6c012945-be3f-4d12-834d-769e2d3185c3`::Unexpected error
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/task.py", line 840, in _run
  File "/usr/share/vdsm/logUtils.py", line 38, in wrapper
  File "/usr/share/vdsm/storage/hsm.py", line 893, in createStoragePool
  File "/usr/share/vdsm/storage/sp.py", line 568, in create
  File "/usr/share/vdsm/storage/sp.py", line 510, in _acquireTemporaryClusterLock
  File "/usr/share/vdsm/storage/sd.py", line 436, in acquireHostId
  File "/usr/share/vdsm/storage/clusterlock.py", line 187, in acquireHostId
AcquireHostIdFailure: Cannot acquire host id: ('c6c5d903-e05f-4b1d-89c5-2fdfd0b1b255', SanlockException(19, 'Sanlock lockspace add failure', 'No such device'))


Version-Release number of selected component (if applicable):


How reproducible:
Reproduces 100% with certain storage domain.

Steps to Reproduce:
1.Create Storage Pool on master domain.
2.
3.
  
Actual results:

Pool creation failed.

Expected results:
Pool creation succeed. 

[root@purple-vds1 vdsm]# rpm -q sanlock
sanlock-2.6-2.el6.x86_64
[root@purple-vds1 vdsm]# rpm -q vdsm
vdsm-4.10.2-1.4.el6.x86_64
[root@purple-vds1 vdsm]# rpm -q libvirt
libvirt-0.10.2-18.el6.x86_64


vdsm log attached
Comment 1 Leonid Natapov 2013-02-18 13:44:44 UTC 
Created attachment 698893 [details]
vdsm log
Comment 3 Yaniv Kaul 2013-02-18 14:07:00 UTC 
Leonid - isn't it a RHEVH issue?
Comment 5 Mike Burns 2013-02-18 15:05:56 UTC 
What version of rhev-h?  Can this be reproduced with RHEL+vdsm+sanlock?
Comment 6 Mike Burns 2013-02-18 15:13:27 UTC 
Dave/Dan,

Any hints on what the issue is here?
Comment 7 Leonid Natapov 2013-02-18 15:29:59 UTC 
1.RHEV-H release 6.4 (20130213.1.el6)
2.On RHEL works OK. We ran automation tests on RHEL 6.4 (the same setup) and it didn't happen.
Comment 8 Mike Burns 2013-02-18 20:14:48 UTC 
This is marked regression.  Can you tell me when it worked?  there is no logic in rhev-h or ovirt-node for using sanlock at all.  That logic is all held in vdsm.
Comment 9 Haim 2013-02-18 22:03:38 UTC 
(In reply to comment #8)
> This is marked regression.  Can you tell me when it worked?  there is no
> logic in rhev-h or ovirt-node for using sanlock at all.  That logic is all
> held in vdsm.

it worked with RHEV-H on 6.3 version.
from what I understand, sanlock user in rhev-h runs in root context instead of sanlock context, problem start with shares that configured with root_squash configuration, which prevent sanlock from acquiring the lockspace on the lease.

also, sanlock user is missing from /etc/passwd. 

please make proper changes in the rhev-h rpm.
Comment 10 Mike Burns 2013-02-18 22:44:45 UTC 
Was this on an upgrade?  A fresh install has sanlock user and group
Comment 11 Leonid Natapov 2013-02-19 06:19:01 UTC 
(In reply to comment #10)
> Was this on an upgrade?  A fresh install has sanlock user and group

This was an upgrade from 6.3.
Comment 12 Leonid Natapov 2013-02-19 06:21:32 UTC 
(In reply to comment #10)
> Was this on an upgrade?  A fresh install has sanlock user and group

This was an upgrade from 6.3.
Comment 29 Mike Burns 2013-06-10 23:03:28 UTC 
This is not valid for 6.5 anymore.  sanlock inclusion is now part of the RHEV plugin.
Note You need to log in before you can comment on or make changes to this bug.