Bug 2001024 - [RFE] RHEL9 support fence agent based on NVME reservation
Summary: [RFE] RHEL9 support fence agent based on NVME reservation
Keywords:
Status: ASSIGNED
Alias: None
Product: Red Hat Enterprise Linux 9
Classification: Red Hat
Component: fence-agents
Version: 9.0
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: rc
: 9.3
Assignee: Oyvind Albrigtsen
QA Contact: cluster-qe
URL:
Whiteboard:
Depends On:
Blocks: 2116239 2188515
TreeView+ depends on / blocked
 
Reported: 2021-09-03 14:58 UTC by vincent chen
Modified: 2023-08-10 15:41 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2023-03-03 07:27:53 UTC
Type: Bug
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHELPLAN-96163 0 None None None 2023-03-03 07:29:57 UTC

Description vincent chen 2021-09-03 14:58:40 UTC
Description of problem:
does RHCS in rhel9.0  support fence agent based on NVME reservation. I don't see any info about it?  
storage reservation is an important method to fence node from storage view. wish there could have nvme based PR fence agent in RHCS 


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 4 RHEL Program Management 2023-03-03 07:27:53 UTC
After evaluating this issue, there are no plans to address it further or fix it in an upcoming release.  Therefore, it is being closed.  If plans change such that this issue will be fixed in an upcoming release, then the bug can be reopened.

Comment 8 vincent chen 2023-04-12 02:52:04 UTC
Karl,  this is a public requirement. not dell specific.   thinking about RHCS support scsi_fence mechanism which depending on storage vender supporting scsi reservation standards. now nvme-F is more and more popular and dell storage already support nvme reservation standard too. so we ask if rhel has a plan support to support nvme_fence  agent.

Comment 9 John Meneghini 2023-05-04 03:11:33 UTC
The nvme replacement for sg3_utils with is the nvme-cli utility.  This utility is fully supported by RHEL.

 [root@rhel-storage-105 ~]# rpm -qi nvme-cli
 Name        : nvme-cli
 Version     : 2.4
 Release     : 1.el9
 Architecture: x86_64
 Install Date: Tue 18 Apr 2023 05:40:34 PM EDT
 Group       : Unspecified
 Size        : 4982802
 License     : GPLv2+
 Signature   : RSA/SHA256, Wed 12 Apr 2023 03:55:03 AM EDT, Key ID 199e2f91fd431d51
 Source RPM  : nvme-cli-2.4-1.el9.src.rpm
 Build Date  : Thu 06 Apr 2023 06:25:43 AM EDT
 Build Host  : x86-64-06.build.eng.rdu2.redhat.com
 Packager    : Red Hat, Inc. <http://bugzilla.redhat.com/bugzilla>
 Vendor      : Red Hat, Inc.
 URL         : https://github.com/linux-nvme/nvme-cli
 Summary     : NVMe management command line interface
 Description :
 nvme-cli provides NVM-Express user space tooling for Linux.

So, instead of using the `sg_persist` command you would use the `nvme` command to manage reservations on the nvme device.

  resv-acquire                 Submit a Reservation Acquire, return results
  resv-register                Submit a Reservation Register, return results
  resv-release                 Submit a Reservation Release, return results
  resv-report                  Submit a Reservation Report, return results

This means:

 sg_persist --out --register --param-rk=123456 /dev/sdb

becomes:

 nvme resv-register /dev/nvme1n1 --rrega=0 --nrkey=123456 --iekey

Example:

[root@rhel-storage-105 ~]# nvme resv-register /dev/nvme1n1 --rrega=0 --nrkey=123456 --iekey
NVME Reservation  success
[root@rhel-storage-105 ~]# nvme resv-report /dev/nvme1n1

NVME Reservation status:

gen       : 1
rtype     : 0
regctl    : 1
ptpls     : 1
regctl[0] :
  cntlid  : 1
  rcsts   : 0
  hostid  : 0
  rkey    : 1e240

Comment 10 vincent chen 2023-05-04 03:28:18 UTC
yes, the nvme-cli utility is supported by RHEL.  RHCS supply scsi_fence agent for cluster fencing. it only serve for scsi3 reservation.  there don't have a agent used for nvme reservation. there need a similar agent for nvme reservation


Note You need to log in before you can comment on or make changes to this bug.