Created attachment 810000 [details]
log

Description of problem:

I installed gluster for cinder using packstack. 
my gluster servers went down and we have stale connection but no timeout (so they are not disconnecting) 

Version-Release number of selected component (if applicable):

openstack-packstack-2013.2.1-0.6.dev763.el6ost.noarch

How reproducible:

100%

Steps to Reproduce:
1. install openstack with packstack with cinder configured to work with gluster
2. run an instance from a volume 
3. shut down the gluster server

Actual results:

nfsmount has no time out

Expected results:

nfsmount should have time out configured by packstack 

Additional info:

Stderr: "mkdir: cannot create directory `/var/lib/cinder/mnt/4a31bc6e5fb9244971075aa23d364364': File exists\n"
2013-10-09 09:44:24.445 7297 WARNING cinder.volume.drivers.glusterfs [-] Exception during mounting Unexpected error while running command.
Command: mkdir -p /var/lib/cinder/mnt/4a31bc6e5fb9244971075aa23d364364
Exit code: 1
Stdout: ''

10.35.2.44:/Dafna_glance on /var/lib/glance/images type fuse.glusterfs (rw,default_permissions,default_permissions,allow_other,max_read=131072,allow_other,max_read=131072)
10.35.2.44:/Dafna_rhos on /var/lib/cinder/mnt/4a31bc6e5fb9244971075aa23d364364 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)
10.35.2.44:/Dafna_rhos on /var/lib/nova/mnt/4a31bc6e5fb9244971075aa23d364364 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)

ls: cannot access /var/lib/cinder/mnt/4a31bc6e5fb9244971075aa23d364364: Transport endpoint is not connected
total 0
d????????? ? ? ? ?            ? 4a31bc6e5fb9244971075aa23d364364

stale connection can cause issues in the future even if the storage is restored so we need to have a timeout.