Bug 1103152

Summary: glusterfsd crashed during quota testing
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Martin Kudlej <mkudlej>
Component: quotaAssignee: Raghavendra G <rgowdapp>
Status: CLOSED DUPLICATE QA Contact: Saurabh <saujain>
Severity: high Docs Contact:
Priority: unspecified    
Version: rhgs-3.0CC: mzywusko, nsathyan, rhs-bugs, ssamanta, storage-qa-internal
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-06-02 08:41:27 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
corefile without debuginfo
none
corefile with debuginfo none

Description Martin Kudlej 2014-05-30 11:37:39 UTC 
Description of problem:
I run automated tests for testing rhs-hadoop focusing on gluster quota. Tests are usually setting up gluster quota and try to work with files on gluster via "hadoop fs". The goal is to test rhs-hadoop plugin.
If glusterfsd crashes and I restart glusterfsd service, the test pass at least once until next crash.

During this testing I've got this coredump:
$ gdb /usr/sbin/glusterfsd ./core.29954.1401437186.dump
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /usr/sbin/glusterfsd...(no debugging symbols found)...done.
[New Thread 29954]
[New Thread 29955]
[New Thread 29956]
[New Thread 29957]
[New Thread 29958]
[New Thread 29968]
[New Thread 29969]
[New Thread 29971]
[New Thread 29972]
[New Thread 30100]
[New Thread 30358]
[New Thread 639]
[New Thread 640]
[New Thread 641]
[New Thread 642]
[New Thread 643]
[New Thread 645]
[New Thread 646]
[New Thread 647]
[New Thread 648]
[New Thread 649]
[New Thread 650]
[New Thread 651]
[New Thread 652]
[New Thread 6521]
Reading symbols from /usr/lib64/libglusterfs.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libglusterfs.so.0
Reading symbols from /usr/lib64/libgfrpc.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libgfrpc.so.0
Reading symbols from /usr/lib64/libgfxdr.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libgfxdr.so.0
Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/librt.so.1
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /usr/lib64/libcrypto.so.10...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libcrypto.so.10
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libz.so.1
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/rpc-transport/socket.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/rpc-transport/socket.so
Reading symbols from /usr/lib64/libssl.so.10...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libssl.so.10
Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgssapi_krb5.so.2
Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5.so.3
Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libcom_err.so.2
Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done.
Loaded symbols for /lib64/libk5crypto.so.3
Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5support.so.0
Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libkeyutils.so.1
Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libresolv.so.2
Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libselinux.so.1
Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_files.so.2
Reading symbols from /lib64/libnss_dns.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_dns.so.2
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/storage/posix.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/storage/posix.so
Reading symbols from /lib64/libaio.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libaio.so.1
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/features/changelog.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/features/changelog.so
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/features/access-control.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/features/access-control.so
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/features/locks.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/features/locks.so
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/features/barrier.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/features/barrier.so
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/features/index.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/features/index.so
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/features/marker.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/features/marker.so
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/features/quota.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/features/quota.so
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/debug/io-stats.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/debug/io-stats.so
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/xlator/protocol/server.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/xlator/protocol/server.so
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/auth/addr.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/auth/addr.so
Reading symbols from /usr/lib64/glusterfs/3.6.0.8/auth/login.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/glusterfs/3.6.0.8/auth/login.so
Core was generated by `/usr/sbin/glusterfsd -s dhcp-75-100.lab.eng.brq.redhat.com --volfile-id HadoopV'.
Program terminated with signal 11, Segmentation fault.
#0  0x00007f93f6228862 in quota_enforcer_blocking_connect () from /usr/lib64/glusterfs/3.6.0.8/xlator/features/quota.so
Missing separate debuginfos, use: debuginfo-install glusterfs-3.6.0.8-1.el6rhs.x86_64
(gdb)   25 Thread 0x7f93f5657700 (LWP 6521)  0x00000039748acced in nanosleep () from /lib64/libc.so.6
  24 Thread 0x7f93edb47700 (LWP 652)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  23 Thread 0x7f93edc48700 (LWP 651)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  22 Thread 0x7f93edd49700 (LWP 650)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  21 Thread 0x7f93ede4a700 (LWP 649)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  20 Thread 0x7f93edf4b700 (LWP 648)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  19 Thread 0x7f93ee04c700 (LWP 647)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  18 Thread 0x7f93ee14d700 (LWP 646)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  17 Thread 0x7f93ee24e700 (LWP 645)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  16 Thread 0x7f93ee34f700 (LWP 643)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  15 Thread 0x7f93ee450700 (LWP 642)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  14 Thread 0x7f93ee551700 (LWP 641)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  13 Thread 0x7f93ee652700 (LWP 640)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  12 Thread 0x7f93ee753700 (LWP 639)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  11 Thread 0x7f93ef255700 (LWP 30358)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  10 Thread 0x7f93ef356700 (LWP 30100)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  9 Thread 0x7f93effff700 (LWP 29972)  0x0000003974c0b5bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  8 Thread 0x7f93f4c56700 (LWP 29971)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  7 Thread 0x7f93f5758700 (LWP 29969)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  6 Thread 0x7f93f5859700 (LWP 29968)  0x0000003974c0b5bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  5 Thread 0x7f93f893f700 (LWP 29958)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  4 Thread 0x7f93f9340700 (LWP 29957)  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
  3 Thread 0x7f93f9d41700 (LWP 29956)  0x0000003974c0f4b5 in sigwait () from /lib64/libpthread.so.0
  2 Thread 0x7f93fa742700 (LWP 29955)  0x0000003974c0ef3d in nanosleep () from /lib64/libpthread.so.0
* 1 Thread 0x7f9401b2a700 (LWP 29954)  0x00007f93f6228862 in quota_enforcer_blocking_connect () from /usr/lib64/glusterfs/3.6.0.8/xlator/features/quota.so
(gdb)
Thread 25 (Thread 0x7f93f5657700 (LWP 6521)):
#0  0x00000039748acced in nanosleep () from /lib64/libc.so.6
#1  0x00000039748acb60 in sleep () from /lib64/libc.so.6
#2  0x00007f93f72c49a0 in ?? () from /usr/lib64/glusterfs/3.6.0.8/xlator/storage/posix.so
#3  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#4  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 24 (Thread 0x7f93edb47700 (LWP 652)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 23 (Thread 0x7f93edc48700 (LWP 651)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 22 (Thread 0x7f93edd49700 (LWP 650)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 21 (Thread 0x7f93ede4a700 (LWP 649)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 20 (Thread 0x7f93edf4b700 (LWP 648)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 19 (Thread 0x7f93ee04c700 (LWP 647)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 18 (Thread 0x7f93ee14d700 (LWP 646)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 17 (Thread 0x7f93ee24e700 (LWP 645)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 16 (Thread 0x7f93ee34f700 (LWP 643)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 15 (Thread 0x7f93ee450700 (LWP 642)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 14 (Thread 0x7f93ee551700 (LWP 641)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 13 (Thread 0x7f93ee652700 (LWP 640)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 12 (Thread 0x7f93ee753700 (LWP 639)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 11 (Thread 0x7f93ef255700 (LWP 30358)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 10 (Thread 0x7f93ef356700 (LWP 30100)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 9 (Thread 0x7f93effff700 (LWP 29972)):
#0  0x0000003974c0b5bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f72c468b in posix_fsyncer_pick () from /usr/lib64/glusterfs/3.6.0.8/xlator/storage/posix.so
#2  0x00007f93f72c4f25 in posix_fsyncer () from /usr/lib64/glusterfs/3.6.0.8/xlator/storage/posix.so
#3  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0

#4  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 8 (Thread 0x7f93f4c56700 (LWP 29971)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f72c5338 in ?? () from /usr/lib64/glusterfs/3.6.0.8/xlator/storage/posix.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 7 (Thread 0x7f93f5758700 (LWP 29969)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6a6a2c0 in iot_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/performance/io-threads.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 6 (Thread 0x7f93f5859700 (LWP 29968)):
#0  0x0000003974c0b5bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f93f6655ddb in index_worker () from /usr/lib64/glusterfs/3.6.0.8/xlator/features/index.so
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 5 (Thread 0x7f93f893f700 (LWP 29958)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x0000003975c5b7ef in syncenv_task () from /usr/lib64/libglusterfs.so.0
#2  0x0000003975c61720 in syncenv_processor () from /usr/lib64/libglusterfs.so.0
#3  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#4  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 4 (Thread 0x7f93f9340700 (LWP 29957)):
#0  0x0000003974c0b98e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x0000003975c5b7ef in syncenv_task () from /usr/lib64/libglusterfs.so.0
#2  0x0000003975c61720 in syncenv_processor () from /usr/lib64/libglusterfs.so.0
#3  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#4  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 3 (Thread 0x7f93f9d41700 (LWP 29956)):
#0  0x0000003974c0f4b5 in sigwait () from /lib64/libpthread.so.0
#1  0x000000000040566b in glusterfs_sigwaiter ()
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 2 (Thread 0x7f93fa742700 (LWP 29955)):
#0  0x0000003974c0ef3d in nanosleep () from /lib64/libpthread.so.0
#1  0x0000003975c3befc in gf_timer_proc () from /usr/lib64/libglusterfs.so.0
#2  0x0000003974c079d1 in start_thread () from /lib64/libpthread.so.0
#3  0x00000039748e8b5d in clone () from /lib64/libc.so.6

Thread 1 (Thread 0x7f9401b2a700 (LWP 29954)):
#0  0x00007f93f6228862 in quota_enforcer_blocking_connect () from /usr/lib64/glusterfs/3.6.0.8/xlator/features/quota.so
#1  0x00007f93f62288fa in quota_enforcer_init () from /usr/lib64/glusterfs/3.6.0.8/xlator/features/quota.so
#2  0x00007f93f62189f2 in reconfigure () from /usr/lib64/glusterfs/3.6.0.8/xlator/features/quota.so
#3  0x0000003975c6b94a in ?? () from /usr/lib64/libglusterfs.so.0
#4  0x0000003975c6b8dc in ?? () from /usr/lib64/libglusterfs.so.0
#5  0x0000003975c6b8dc in ?? () from /usr/lib64/libglusterfs.so.0
#6  0x0000003975c5a012 in glusterfs_volfile_reconfigure () from /usr/lib64/libglusterfs.so.0
#7  0x000000000040c863 in mgmt_getspec_cbk ()
#8  0x000000397640e9f5 in rpc_clnt_handle_reply () from /usr/lib64/libgfrpc.so.0
#9  0x000000397640fe7f in rpc_clnt_notify () from /usr/lib64/libgfrpc.so.0
#10 0x000000397640b638 in rpc_transport_notify () from /usr/lib64/libgfrpc.so.0
#11 0x00007f93f7d34fe5 in ?? () from /usr/lib64/glusterfs/3.6.0.8/rpc-transport/socket.so
#12 0x00007f93f7d369cd in ?? () from /usr/lib64/glusterfs/3.6.0.8/rpc-transport/socket.so
#13 0x0000003975c75817 in ?? () from /usr/lib64/libglusterfs.so.0
#14 0x0000000000407e93 in main ()
(gdb)

With debuginfo for gluster the output is almost the same.

Version-Release number of selected component (if applicable):
$ rpm -qa | egrep "gluster|rhs" | sort
ctdb2.5-2.5.3-2.el6rhs.x86_64
glusterfs-3.6.0.8-1.el6rhs.x86_64
glusterfs-api-3.6.0.8-1.el6rhs.x86_64
glusterfs-cli-3.6.0.8-1.el6rhs.x86_64
glusterfs-fuse-3.6.0.8-1.el6rhs.x86_64
glusterfs-geo-replication-3.6.0.8-1.el6rhs.x86_64
glusterfs-hadoop-distribution-glusterfs-hadoop-setup_common-0.2-32.noarch
glusterfs-hadoop-distribution-glusterfs-hadoop-setup_gluster-0.2-20.noarch
glusterfs-hadoop-distribution-glusterfs-hadoop-setup_hadoop-0.1-41.noarch
glusterfs-libs-3.6.0.8-1.el6rhs.x86_64
glusterfs-rdma-3.6.0.8-1.el6rhs.x86_64
glusterfs-server-3.6.0.8-1.el6rhs.x86_64
gluster-nagios-addons-0.1.0-72.gitb8b7222.el6rhs.x86_64
gluster-nagios-common-0.1.0-26.git2b35b66.el6rhs.x86_64
gluster-swift-1.10.0-2.el6rhs.noarch
gluster-swift-account-1.10.0-2.el6rhs.noarch
gluster-swift-container-1.10.0-2.el6rhs.noarch
gluster-swift-object-1.10.0-2.el6rhs.noarch
gluster-swift-plugin-1.10.0-5.el6rhs.noarch
gluster-swift-proxy-1.10.0-2.el6rhs.noarch
libsmbclient-3.6.9-168.1.el6rhs.x86_64
libsmbclient-devel-3.6.9-168.1.el6rhs.x86_64
nagios-plugins-1.4.16-7.el6rhs.x86_64
nagios-plugins-ide_smart-1.4.16-7.el6rhs.x86_64
nagios-plugins-procs-1.4.16-7.el6rhs.x86_64
nrpe-2.14-1.1.el6rhs.x86_64
nsca-client-2.7.2-8.el6rhs.x86_64
python-eventlet-0.9.16-5.el6_rhs2.0.noarch
python-greenlet-0.3.1-6.el6_rhs2.0.x86_64
python-rhsm-1.9.7-1.el6_5.x86_64
redhat-storage-logos-60.0.17-1.el6rhs.noarch
redhat-storage-server-3.0.0.0-2.el6rhs.noarch
rhs-hadoop-2.3.0-6.noarch
rhs-hadoop-install-1_11-1.el6rhs.noarch
samba-3.6.9-168.1.el6rhs.x86_64
samba-client-3.6.9-168.1.el6rhs.x86_64
samba-common-3.6.9-168.1.el6rhs.x86_64
samba-doc-3.6.9-168.1.el6rhs.x86_64
samba-domainjoin-gui-3.6.9-168.1.el6rhs.x86_64
samba-glusterfs-3.6.9-168.1.el6rhs.x86_64
samba-swat-3.6.9-168.1.el6rhs.x86_64
samba-winbind-3.6.9-168.1.el6rhs.x86_64
samba-winbind-clients-3.6.9-168.1.el6rhs.x86_64
samba-winbind-devel-3.6.9-168.1.el6rhs.x86_64
samba-winbind-krb5-locator-3.6.9-168.1.el6rhs.x86_64
vdsm-4.14.7.0-1.el6rhs.x86_64
vdsm-cli-4.14.7.0-1.el6rhs.noarch
vdsm-gluster-4.14.7.0-1.el6rhs.noarch
vdsm-python-4.14.7.0-1.el6rhs.x86_64
vdsm-python-zombiereaper-4.14.7.0-1.el6rhs.noarch
vdsm-reg-4.14.7.0-1.el6rhs.noarch
vdsm-xmlrpc-4.14.7.0-1.el6rhs.noarch

How reproducible:
50%

Steps to Reproduce:
1. work with gluster quota(enable, disable, limit-usage)

Actual results:
It crashes.

Expected results:
It will not crash.
Comment 1 Martin Kudlej 2014-05-30 11:39:24 UTC 
Now I see that this bug can be similar to bug 1095267
Comment 2 Martin Kudlej 2014-05-30 11:41:27 UTC 
Created attachment 900773 [details]
corefile without debuginfo
Comment 3 Martin Kudlej 2014-05-30 11:42:21 UTC 
Created attachment 900774 [details]
corefile with debuginfo
Comment 6 Raghavendra G 2014-06-02 08:41:27 UTC 

*** This bug has been marked as a duplicate of bug 1095267 ***