Bug 809368

Summary: [ovirt] [vdsm] deadlock on SPM stop command
Product: [Retired] oVirt Reporter: Haim <hateya>
Component: vdsmAssignee: Dan Kenigsberg <danken>
Status: CLOSED WONTFIX QA Contact:
Severity: high Docs Contact:
Priority: unspecified    
Version: unspecifiedCC: abaron, acathrow, amureini, bazulay, dyasny, fsimonce, hateya, iheim, mgoldboi, yeylon, ykaul
Target Milestone: ---   
Target Release: 3.3.4   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: storage
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-03-12 09:36:44 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Storage RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Attachments:
Description Flags
deadlock none

Description Haim 2012-04-03 08:19:48 UTC 
Description of problem:

I seem to hit a deadlock on vdsm after spmStop task fails on resource time-out.
I noticed that after this failure, host fails to handle connectStorageServer calls from backend, meaning, connectStorageServer is sent, iscsi login is performed,
but command seem to stuck on _invalidateAllPvs, and vdsm doesn't return valid response to backend. 

Thread-277736:EBUG::2012-04-01 05:16:07,103::lvm::457::OperationMutex:_invalidateAllPvs) Operation 'lvm reload operation' is holding the operation mutex, waiting...
Thread-277738:EBUG::2012-04-01 05:16:07,826::BindingXMLRPC::167::vds:wrapper) [10.35.97.3

all problems started after failure in 'Thread-277609'.

in gdb, there are lots of threads waiting in cond.wait().

attached full gdb trace of all running threads, and vdsm log.

please note that it happened while connection connection to NFS server hosting 2 mount points was blocked.
Comment 1 Haim 2012-04-03 08:22:13 UTC 
Created attachment 574784 [details]
deadlock
Comment 2 Itamar Heim 2013-03-12 09:36:44 UTC 
Closing old bugs. If this issue is still relevant/important in current version, please re-open the bug.