Bug 1659815

Summary: dynamically allocated volumes not deleted in OCS cluster.
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Elvir Kuric <ekuric>
Component: heketiAssignee: John Mulligan <jmulligan>
Status: CLOSED DEFERRED QA Contact: Prasanth <pprakash>
Severity: high Docs Contact:
Priority: unspecified    
Version: ocs-3.11CC: ekuric, hchiramm, hongkliu, kramdoss, madam, ndevos, pasik, prasanna.kalever, rhs-bugs, sankarshan, storage-qa-internal
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-04-22 07:16:56 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1573304    

Comment 2 Elvir Kuric 2018-12-17 14:00:05 UTC
# heketi -v
Heketi 7.0.0

Comment 3 Niels de Vos 2019-01-03 20:36:58 UTC
Heketi logs like this point to a brick process that keeps a file-descriptor open:

[heketi] ERROR 2018/12/16 17:39:25 /src/github.com/heketi/heketi/apps/glusterfs/brick_create.go:60: error destroying brick 3fea8885542f37b0f05ab821a8c86472: umount: /var/lib/heketi/mounts/vg_fbfb285c7d5981e5535816b415ed2c78/brick_3fea8885542f37b0f05ab821a8c86472: target is busy.
        (In some cases useful info about processes that use
         the device is found by lsof(8) or fuser(1))
[heketi] ERROR 2018/12/16 17:39:25 /src/github.com/heketi/heketi/apps/glusterfs/brick_create.go:77: umount: /var/lib/heketi/mounts/vg_fbfb285c7d5981e5535816b415ed2c78/brick_3fea8885542f37b0f05ab821a8c86472: target is busy.
        (In some cases useful info about processes that use
         the device is found by lsof(8) or fuser(1))
[heketi] ERROR 2018/12/16 17:39:25 /src/github.com/heketi/heketi/apps/glusterfs/volume_entry.go:696: Unable to delete bricks: umount: /var/lib/heketi/mounts/vg_fbfb285c7d5981e5535816b415ed2c78/brick_3fea8885542f37b0f05ab821a8c86472: target is busy.
        (In some cases useful info about processes that use
         the device is found by lsof(8) or fuser(1))
[heketi] ERROR 2018/12/16 17:39:25 /src/github.com/heketi/heketi/apps/glusterfs/operations.go:433: Error executing delete volume: umount: /var/lib/heketi/mounts/vg_fbfb285c7d5981e5535816b415ed2c78/brick_3fea8885542f37b0f05ab821a8c86472: target is busy.
        (In some cases useful info about processes that use
         the device is found by lsof(8) or fuser(1))


The output of 'lsof <brick-path>' would be very useful. Without that it is practically impossible to find what file (and by which xlator) a file-descriptor is kept open.

Comment 8 Red Hat Bugzilla 2023-09-14 04:43:52 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days