Bug 2160301 - [GSS]During OCP upgrade, three OSD pod stuck in CLBO state
Summary: [GSS]During OCP upgrade, three OSD pod stuck in CLBO state
Keywords:
Status: CLOSED INSUFFICIENT_DATA
Alias: None
Product: Red Hat OpenShift Data Foundation
Classification: Red Hat Storage
Component: rook
Version: 4.9
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: ---
Assignee: Santosh Pillai
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2023-01-12 02:12 UTC by Soumi Mitra
Modified: 2023-08-09 17:03 UTC (History)
7 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2023-03-14 15:30:25 UTC
Embargoed:


Attachments (Terms of Use)

Comment 7 Colum Gaynor 2023-01-31 16:46:40 UTC
@Santosh Pillai <sapillai> ----> This issue was associated with one Nokia CloudRAN Support Case where the reported OCP version was ODF 4.10
OCP 4.10 is an important release for several Nokia CloudRAN programmes and they would expect this issue to fixed in ODF 4.10 but also ODF 4.11 and ODF 4.12
There is no Target release Specified for this Bugzilla ?

Nokia need this issue fixed in ODF 4.10 ODF 4.11 and ODF 4.12  
Can you clarify please ODF Engineering Fix Targets

Colum Gaynor - Senior Partner Success Manager, Global Nokia Account

Comment 18 Santosh Pillai 2023-02-08 09:39:22 UTC
I would go one step back to Local Storage Operator (that creates the PVs on these disks). 
When the system reboots, the multipath is not guaranteed to be same. Like, if it was /dev/dm-1 before reboot, it can be /dev/dm-2 after reboot. 
If the device have a stable /dev/disk/by-id/ then LSO should use them instead. Then even if the device name changes on reboot, symlink will keep pointing to the /dev/disk/by-id/. 

Currently I see that customer is using /dev/disk/by-path. 
```
  storageClassDevices:
  - devicePaths:
    - /dev/disk/by-path/pci-0000:81:00.0-sas-phy2-lun-0
    - /dev/disk/by-path/pci-0000:81:00.0-sas-phy3-lun-0
    storageClassName: localblock
    volumeMode: Block
```
So I would just to use the `/dev/disk/by-id` in the LocalVolume (or use LocalVolumeSet) and see if that fixes the upgrade issue.

Comment 19 Santosh Pillai 2023-02-14 15:16:12 UTC
any new update on this?

Comment 21 Santosh Pillai 2023-02-21 10:33:54 UTC
*** Bug 2167651 has been marked as a duplicate of this bug. ***

Comment 22 Travis Nielsen 2023-03-14 15:30:25 UTC
Please reopen when there is more info to investigate


Note You need to log in before you can comment on or make changes to this bug.