Bug 1214174

Summary:	SMB: smbd crashes and dumped core while running iozone from windows client with SMB3 protocol
Product:	[Red Hat Storage] Red Hat Gluster Storage	Reporter:	surabhi <sbhaloth>
Component:	samba	Assignee:	Poornima G <pgurusid>
Status:	CLOSED DUPLICATE	QA Contact:	storage-qa-internal <storage-qa-internal>
Severity:	urgent	Docs Contact:
Priority:	unspecified
Version:	rhgs-3.1	CC:	nlevinki, pgurusid, rjoseph
Target Milestone:	---	Keywords:	ZStream
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:	core
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2016-10-18 05:52:49 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1186580

Description surabhi 2015-04-22 07:30:31 UTC

Description of problem:
********************************
While running iozone on a gluster volume accessed via VIP from windows client ,smbd crashes which results in interrupting iozone.The max protocol is set to SMB3.

bt is as follows:

Apr 22 02:19:10 dhcp159-180 smbd[7252]:   BACKTRACE: 16 stack frames:
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #0 /usr/lib64/libsmbconf.so.0(log_stack_trace+0x1a) [0x7f0164ac607a]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #1 /usr/lib64/libsmbconf.so.0(smb_panic_s3+0x23) [0x7f0164ac6143]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #2 /usr/lib64/libsamba-util.so.0(smb_panic+0x1a1) [0x7f0166244ac1]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #3 /usr/lib64/libsamba-util.so.0(+0x3b74218b82) [0x7f0166244b82]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #4 /lib64/libpthread.so.0(+0x3b6de0f710) [0x7f0166471710]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #5 /lib64/libc.so.6(gsignal+0x35) [0x7f0163173625]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #6 /lib64/libc.so.6(abort+0x175) [0x7f0163174e05]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #7 /lib64/libc.so.6(+0x3b6da70537) [0x7f01631b1537]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #8 /lib64/libc.so.6(+0x3b6da75e66) [0x7f01631b6e66]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #9 /usr/lib64/libglusterfs.so.0(log_buf_destroy+0x16) [0x7f014c9cef56]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #10 /usr/lib64/libglusterfs.so.0(+0x30350253fd) [0x7f014c9d23fd]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #11 /usr/lib64/libglusterfs.so.0(gf_log_flush_msgs+0x8e) [0x7f014c9d24ae]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #12 /usr/lib64/libglusterfs.so.0(gf_log_flush_timeout_cbk+0x3a) [0x7f014c9d25fa]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #13 /usr/lib64/libglusterfs.so.0(gf_timer_proc+0x120) [0x7f014c9eca60]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #14 /lib64/libpthread.so.0(+0x3b6de079d1) [0x7f01664699d1]
Apr 22 02:19:10 dhcp159-180 smbd[7252]:    #15 /lib64/libc.so.6(clone+0x6d) [0x7f01632298fd]
Apr 22 02:19:10 dhcp159-180 smbd[7252]: [2015/04/22 02:19:10.713667,  0] ../source3/lib/dumpcore.c:317(dump_core)
Apr 22 02:19:10 dhcp159-180 smbd[7252]:   dumping core in /var/log/samba/cores/smbd


Version-Release number of selected component (if applicable):
samba-winbind-4.1.17-4.el6rhs.x86_64
samba-vfs-glusterfs-4.1.17-4.el6rhs.x86_64
samba-client-4.1.17-4.el6rhs.x86_64
samba-libs-4.1.17-4.el6rhs.x86_64
samba-4.1.17-4.el6rhs.x86_64
samba-winbind-clients-4.1.17-4.el6rhs.x86_64
samba-common-4.1.17-4.el6rhs.x86_64
samba-debuginfo-4.1.17-4.el6rhs.x86_64
samba-winbind-modules-4.1.17-4.el6rhs.x86_64

glusterfs-3.7dev-0.1009.git8b987be.el6.x86_64

How reproducible:
Tried once 


Steps to Reproduce:
1.Set max protocol=SMB3
2.Access the gluster volume as share mounted on windows client
3.Start iozone 


Actual results:
*******************
smbd crashes , interrupts iozone on windows client.


Expected results:
*********************
There should not be any crash and iozone should have finished successfully.

Additional info:

Comment 3 surabhi 2015-05-25 12:19:01 UTC

Version: 
**************
glusterfs-3.7.0-2.el6rhs.x86_64
samba-4.1.17-5.el6rhs.x86_64

Iozone fails on windows client with following error and smbd dumps core.
Error on windows client:
****************************
Error reading block 4
read: No such file or directory

bt:
****************************

#0 /usr/lib64/libsmbconf.so.0(log_stack_trace+0x1a) [0x7f8e60b2b07a]
#1 /usr/lib64/libsmbconf.so.0(smb_panic_s3+0x23) [0x7f8e60b2b143]
#2 /usr/lib64/libsamba-util.so.0(smb_panic+0x1a1) [0x7f8e622a9ac1]
#3 /usr/lib64/libsamba-util.so.0(+0x18b82) [0x7f8e622a9b82]
#4 /lib64/libpthread.so.0(+0x3199e0f710) [0x7f8e624d6710]
#5 /lib64/libc.so.6(gsignal+0x35) [0x7f8e5f1d5625]
#6 /lib64/libc.so.6(abort+0x175) [0x7f8e5f1d6e05]
#7 /lib64/libc.so.6(+0x3199a70537) [0x7f8e5f213537]
#8 /lib64/libc.so.6(+0x3199a75e66) [0x7f8e5f218e66]
#9 /usr/lib64/libglusterfs.so.0(log_buf_destroy+0x16) [0x7f8e49888d76]
#10 /usr/lib64/libglusterfs.so.0(+0x35a4c2821d) [0x7f8e4988c21d]
#11 /usr/lib64/libglusterfs.so.0(gf_log_set_log_buf_size+0x185) [0x7f8e4988c5b5]
#12 /usr/lib64/libglusterfs.so.0(gf_log_disable_suppression_before_exit+0x1f) [0x7f8e4988c60f]
#13 /usr/lib64/libglusterfs.so.0(gf_log_fini+0x27) [0x7f8e4988c677]
#14 /usr/lib64/libgfapi.so.0(glfs_fini+0x178) [0x7f8e49f59548]
#15 /usr/lib64/samba/vfs/glusterfs.so(+0x4ea2) [0x7f8e4a175ea2]
#16 /usr/lib64/samba/libsmbd_base.so(close_cnum+0x75) [0x7f8e61e9cc65]
#17 /usr/lib64/samba/libsmbd_base.so(smbXsrv_tcon_disconnect+0x14c) [0x7f8e61eca08c]
#18 /usr/lib64/samba/libsmbd_base.so(+0x150b7f) [0x7f8e61eb6b7f]
#19 /usr/lib64/libtevent.so.0(tevent_common_loop_immediate+0xe8) [0x7f8e5f53b558]
#20 /usr/lib64/libsmbconf.so.0(run_events_poll+0x3c) [0x7f8e60b49a9c]
#21 /usr/lib64/libsmbconf.so.0(+0x450b7) [0x7f8e60b4a0b7]
#22 /usr/lib64/libtevent.so.0(_tevent_loop_once+0x9d) [0x7f8e5f53a92d]
#23 /usr/lib64/samba/libsmbd_base.so(smbd_process+0xce2) [0x7f8e61e999a2]
#24 smbd(+0x88ac) [0x7f8e6290e8ac]
#25 /usr/lib64/libsmbconf.so.0(run_events_poll+0x2b7) [0x7f8e60b49d17]
#26 /usr/lib64/libsmbconf.so.0(+0x45166) [0x7f8e60b4a166]
#27 /usr/lib64/libtevent.so.0(_tevent_loop_once+0x9d) [0x7f8e5f53a92d]
#28 smbd(main+0x160b) [0x7f8e629104db]
#29 /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f8e5f1c1d5d]
#30 smbd(+0x5999) [0x7f8e6290b999]
May 25 05:09:41 dhcp159-154 smbd[15687]: [2015/05/25 05:09:41.927814,  0] ../source3/lib/dumpcore.c:317(dump_core)

Comment 6 rjoseph 2016-10-18 05:52:49 UTC


*** This bug has been marked as a duplicate of bug 1317940 ***