Bug 2240588
| Summary: | NVMeoF GW deployment failed with rados.PermissionDeniedError error | ||
|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat Ceph Storage | Reporter: | Sunil Kumar Nagaraju <sunnagar> |
| Component: | Cephadm | Assignee: | Adam King <adking> |
| Status: | CLOSED ERRATA | QA Contact: | Sunil Kumar Nagaraju <sunnagar> |
| Severity: | urgent | Docs Contact: | Rivka Pollack <rpollack> |
| Priority: | unspecified | ||
| Version: | 7.0 | CC: | acaro, adking, akraj, cephqe-warriors, tserlin, vereddy |
| Target Milestone: | --- | Keywords: | Automation |
| Target Release: | 7.0 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | ceph-18.2.0-56.el9cp | Doc Type: | No Doc Update |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2023-12-13 15:24:03 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
|
Description
Sunil Kumar Nagaraju
2023-09-25 11:28:45 UTC
Sunil please provide the ceph-nvmeof.conf file. Hi Aviv,
PLease find the ceph-nvmeof-conf file contents.
# cat /var/lib/ceph/c6963904-5b8d-11ee-924e-fa163e19eae4/nvmeof.rbd.ceph-2sunilkumar-lxztyv-node2.cdtsax/ceph-nvmeof.conf
# This file is generated by cephadm.
[gateway]
name = client.nvmeof.rbd.ceph-2sunilkumar-lxztyv-node2.cdtsax
group = None
addr = 10.0.209.240
port = 5500
enable_auth = False
state_update_notify = True
state_update_interval_sec = 5
[ceph]
pool = rbd
config_file = /etc/ceph/ceph.conf
id = nvmeof.rbd.ceph-2sunilkumar-lxztyv-node2.cdtsax
[mtls]
server_key = ./server.key
client_key = ./client.key
server_cert = ./server.crt
client_cert = ./client.crt
[spdk]
tgt_path = /usr/local/bin/nvmf_tgt
rpc_socket = /var/tmp/spdk.sock
timeout = 60
log_level = WARN
conn_retries = 10
transports = tcp
transport_tcp_options = {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}
Hello Sunil, Could you also provide continent of the following files: - /etc/ceph/ceph.conf - /etc/ceph/keyring It is also interesting if you could access the ceph cluster using credentials provided by the above files. Additionally could you please check which nvmeof container image is used. Thank you! Hello Sunil, Thank you for all the info. I am able to connect to the bootrap node using ssh and credentials above. How do I access "10.0.209.240 ceph-2sunilkumar-lxztyv-node2"? According to https://bugzilla.redhat.com/show_bug.cgi?id=2240588#c2, the gateway group definition, it seems the ceph image lacks the following change https://github.com/ceph/ceph/pull/53408 Sunil, can you also include some rados logs - maybe we can see there why do we have this permission error? Deployment working fine with latest builds. ceph-version: 18.2.0-72 Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Red Hat Ceph Storage 7.0 Bug Fix update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2023:7780 |