Bug 2355056

Summary: [IBMSC][8.0z3][SMB] SMB Service Deployment Fails with Latest Builds
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Mohit Bisht <mobisht>
Component: CephadmAssignee: John Mulligan <jmulligan>
Status: CLOSED ERRATA QA Contact: Mohit Bisht <mobisht>
Severity: urgent Docs Contact:
Priority: unspecified    
Version: 8.0CC: adking, anoopcs, aramteke, cephqe-warriors, gdeschner, jmulligan, rpollack, tserlin, vdas
Target Milestone: ---Keywords: Automation, Regression, TestBlocker
Target Release: 8.0z3   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: ceph-19.2.0-122.el9cp Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2025-04-07 15:27:38 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Mohit Bisht 2025-03-26 14:45:35 UTC 
Description of problem:
=======================
[IBMSC][8.0z3][SMB] SMB Service Deployment Fails with Latest Builds
SMB service deployment is failing with the latest IBMSC 8.0z3 RC build and SMB images.
Version: 19.2.0-120
RPM: https://public.dhe.ibm.com/ibmdl/export/pub/storage/ceph/testing/IBM-CEPH-8.0-202503242111.ci.0/IBM-CEPH-8.0-202503242111.ci.0-rhel9.repo
Ceph Image: cp.stg.icr.io/cp/ibm-ceph/ceph-8-rhel9:8-101
Samba Server: cp.stg.icr.io/cp/ibm-ceph/samba-server-rhel9:v0.5-1389.20250325140735.412f1ad
samba metric: cp.stg.icr.io/cp/ibm-ceph/samba-metrics-rhel9:v0.5-1391.20250325144319.93f023c

# ceph config dump |grep samba
mgr                                                                advanced  mgr/cephadm/container_image_samba          cp.stg.icr.io/cp/ibm-ceph/samba-server-rhel9:v0.5-1389.20250325140735.412f1ad                                   * 
mgr                                                                advanced  mgr/cephadm/container_image_samba_metrics  cp.stg.icr.io/cp/ibm-ceph/samba-metrics-rhel9:v0.5-1391.20250325144319.93f023c 
  
  
# ceph orch ls | grep smb
smb.smb1                                    0/3  -          99s  label:smb 

2025-03-26T14:42:18.435029+0000 mgr.ceph-mobisht-ibm-8-0z3-fwlie2-node1-installer.vftpfd (mgr.14859) 174 : cephadm [WRN] ignoring unexpected uri scheme: 'rados:mon-config-key:smb/config/smb1/users-groups.0.json'
2025-03-26T14:42:18.441706+0000 mgr.ceph-mobisht-ibm-8-0z3-fwlie2-node1-installer.vftpfd (mgr.14859) 175 : cephadm [INF] configuring smb/ctdb cluster metadata
2025-03-26T14:42:18.470750+0000 mgr.ceph-mobisht-ibm-8-0z3-fwlie2-node1-installer.vftpfd (mgr.14859) 176 : cephadm [WRN] daemon not available: 'smb.smb1.0.2.ceph-mobisht-ibm-8-0z3-fwlie2-node1-installer.mikihe' not in {'smb.smb1.1.2.ceph-mobisht-ibm-8-0z3-fwlie2-node2.vrkcym': {'daemon_type': 'smb', 'daemon_id': 'smb1.1.2.ceph-mobisht-ibm-8-0z3-fwlie2-node2.vrkcym', 'hostname': 'ceph-mobisht-ibm-8-0z3-fwlie2-node2', 'host_ip': '10.0.65.181'}}
2025-03-26T14:42:18.470853+0000 mgr.ceph-mobisht-ibm-8-0z3-fwlie2-node1-installer.vftpfd (mgr.14859) 177 : cephadm [WRN] daemon not available: 'smb.smb1.2.2.ceph-mobisht-ibm-8-0z3-fwlie2-node3.bopcwk' not in {'smb.smb1.1.2.ceph-mobisht-ibm-8-0z3-fwlie2-node2.vrkcym': {'daemon_type': 'smb', 'daemon_id': 'smb1.1.2.ceph-mobisht-ibm-8-0z3-fwlie2-node2.vrkcym', 'hostname': 'ceph-mobisht-ibm-8-0z3-fwlie2-node2', 'host_ip': '10.0.65.181'}}
2025-03-26T14:42:18.525047+0000 mgr.ceph-mobisht-ibm-8-0z3-fwlie2-node1-installer.vftpfd (mgr.14859) 178 : cephadm [INF] Deploying daemon smb.smb1.1.2.ceph-mobisht-ibm-8-0z3-fwlie2-node2.vrkcym on ceph-mobisht-ibm-8-0z3-fwlie2-node2
2025-03-26T14:42:19.043373+0000 mgr.ceph-mobisht-ibm-8-0z3-fwlie2-node1-installer.vftpfd (mgr.14859) 179 : cephadm [INF] Removing key for client.smb.config.smb1.1.2.ceph-mobisht-ibm-8-0z3-fwlie2-node2.vrkcym
2025-03-26T14:42:19.050518+0000 mgr.ceph-mobisht-ibm-8-0z3-fwlie2-node1-installer.vftpfd (mgr.14859) 180 : cephadm [ERR] Failed while placing smb.smb1.1.2.ceph-mobisht-ibm-8-0z3-fwlie2-node2.vrkcym on ceph-mobisht-ibm-8-0z3-fwlie2-node2: cephadm exited with an error code: 1, stderr: Non-zero exit code 125 from /usr/bin/podman container inspect --format {{.State.Status}} ceph-b4c774d8-0a4e-11f0-b91e-fa163e852c92-smb-smb1-1-2-ceph-mobisht-ibm-8-0z3-fwlie2-node2-vrkcym
/usr/bin/podman: stderr Error: no such container ceph-b4c774d8-0a4e-11f0-b91e-fa163e852c92-smb-smb1-1-2-ceph-mobisht-ibm-8-0z3-fwlie2-node2-vrkcym
Non-zero exit code 125 from /usr/bin/podman container inspect --format {{.State.Status}} ceph-b4c774d8-0a4e-11f0-b91e-fa163e852c92-smb.smb1.1.2.ceph-mobisht-ibm-8-0z3-fwlie2-node2.vrkcym
/usr/bin/podman: stderr Error: no such container ceph-b4c774d8-0a4e-11f0-b91e-fa163e852c92-smb.smb1.1.2.ceph-mobisht-ibm-8-0z3-fwlie2-node2.vrkcym
Deploy daemon smb.smb1.1.2.ceph-mobisht-ibm-8-0z3-fwlie2-node2.vrkcym ...
Verifying port 0.0.0.0:445 ...
Verifying port 0.0.0.0:9922 ...
Cannot bind to IP 0.0.0.0 port 9922: [Errno 98] Address already in use
ERROR: TCP Port(s) '0.0.0.0:445,0.0.0.0:9922' required for smb already in use

Test Machine:
**************
10.0.67.229 root/passwd

Note:
******
SMB service deployment working as expected with last IBMSC 8.0z3 builds & Images Version: 19.2.0-114
RPM:https://public.dhe.ibm.com/ibmdl/export/pub/storage/ceph/testing/IBM-CEPH-8.0-202503181337.ci.0/IBM-CEPH-8.0-202503181337.ci.0-rhel9.repo
Ceph Image: cp.stg.icr.io/cp/ibm-ceph/ceph-8-rhel9:8-96
Samba Server: cp.stg.icr.io/cp/ibm-ceph/samba-server-rhel9:v0.5-1092.20250228144921.412f1ad
samba metric: cp.stg.icr.io/cp/ibm-ceph/samba-metrics-rhel9:v0.5-1093.20250228150555.693bfad

  
Version-Release number of selected component (if applicable):
==============================================================
19.2.0-120

How reproducible:
=================
Always


Steps to Reproduce:
====================
1. Bootstrap ceph cluster
2. Deploy SMB services 

Actual results:
===============
SMB Service Deployment Fails

Expected results:
=================
SMB Service should deployed successfully
Comment 14 errata-xmlrpc 2025-04-07 15:27:38 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: Red Hat Ceph Storage 8.0 security, bug fix, and enhancement updates), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2025:3635