Hide Forgot
this bug is fixed in later code base (even in 2.0.x releases), unify_link_cbk used to memcpy stat buf without checking the 'op-ret' value.
[Migrated from savannah BTS] - bug 26035 [https://savannah.nongnu.org/bugs/?26035] Sat 28 Mar 2009 09:49:51 AM GMT, original submission: 2009-01-11 02:04:33 W [afr-self-heal-entry.c:1131:afr_sh_entry_impunge_mkdir] afr-st-1: creating directory /maildirs/p/r/pro/Maildir/cur mode=040700 on st-1a 2009-01-11 02:04:33 W [afr-self-heal-entry.c:1131:afr_sh_entry_impunge_mkdir] afr-st-1: creating directory /maildirs/p/r/pro/Maildir/new mode=040700 on st-1a 2009-01-11 02:04:50 E [client-protocol.c:263:call_bail] st-1a: activating bail-out. pending frames = 5. last sent = 2009-01-11 02:04:37. last received = 2009-01-11 02:04:37. transport-timeout = 10 2009-01-11 02:04:50 C [client-protocol.c:298:call_bail] st-1a: bailing transport 2009-01-11 02:04:50 E [saved-frames.c:148:saved_frames_unwind] st-1a: forced unwinding frame type(1) op(LOOKUP) 2009-01-11 02:04:50 E [saved-frames.c:148:saved_frames_unwind] st-1a: forced unwinding frame type(1) op(CREATE) 2009-01-11 02:04:50 E [socket.c:1187:socket_submit] st-1a: transport not connected to submit (priv->connected = 255) pending frames: frame : type(1) op(LOOKUP) frame : type(1) op(LOOKUP) frame : type(1) op(LINK) frame : type(1) op(LINK) frame : type(1) op(CREATE) frame : type(1) op(CREATE) frame : type(1) op(LOOKUP) frame : type(1) op(WRITE) frame : type(1) op(WRITE) frame : type(1) op(LINK) frame : type(1) op(LINK) frame : type(1) op(LOOKUP) frame : type(1) op(WRITE) frame : type(1) op(WRITE) frame : type(1) op(LOOKUP) frame : type(1) op(UNLINK) frame : type(1) op(UNLINK) frame : type(1) op(UNLINK) frame : type(1) op(UNLINK) frame : type(1) op(UNLINK) frame : type(1) op(UNLINK) frame : type(1) op(UNLINK) frame : type(1) op(UNLINK) frame : type(1) op(UNLINK) frame : type(1) op(UNLINK)Signal received: 11 configuration details:argp 1 backtrace 1 dlfcn 1 fdatasync 1 libpthread 1 llistxattr 1 setfsid 1 spinlock 1 epoll.h 1 xattr.h 1 tv_nsec 1 package-string: glusterfs 1.4.0rc7 /lib64/libc.so.6[0x30fa4301b0] --------- Version : glusterfs 1.4.0rc7 built on Dec 30 2008 15:27:46 TLA Revision : glusterfs--mainline--3.0--patch-814 Starting Time: 2009-01-11 02:10:23 Command line : /usr/sbin/glusterfs --log-level=WARNING --volfile=/etc/glusterfs/glusterfs-client.vol /4more given volfile +----- 1: volume mst-1a 2: type protocol/client 3: option transport-type tcp/client # for TCP/IP transport 4: option transport-timeout 10 5: option remote-host mst-1a # IP address of the remote brick 6: option remote-subvolume brick # name of the remote volume 7: end-volume 8: 9: volume mst-1b 10: type protocol/client 11: option transport-type tcp/client # for TCP/IP transport 12: option transport-timeout 10 13: option remote-host mst-1b # IP address of the remote brick 14: option remote-subvolume brick # name of the remote volume 15: end-volume 16: 17: volume mst-1a-ns 18: type protocol/client 19: option transport-type tcp/client 20: option transport-timeout 10 21: option remote-host mst-1a 22: option remote-subvolume brick-ns # Note the different remote volume name. 23: end-volume 24: 25: volume mst-1b-ns 26: type protocol/client 27: option transport-type tcp/client 28: option transport-timeout 10 29: option remote-host mst-1b 30: option remote-subvolume brick-ns # Note the different remote volume name. 31: end-volume 32: 33: ######################################################################### 34: volume st-1a 35: type protocol/client 36: option transport-type tcp/client # for TCP/IP transport 37: option transport-timeout 10 38: option remote-host st-1a # IP address of the remote brick 39: option remote-subvolume brick # name of the remote volume 40: end-volume 41: 42: volume st-1b 43: type protocol/client 44: option transport-type tcp/client # for TCP/IP transport 45: option transport-timeout 10 46: option remote-host st-1b # IP address of the remote brick 47: option remote-subvolume brick # name of the remote volume 48: end-volume 49: 50: ######################################################################### 51: volume afr-mst-1 52: type cluster/afr 53: subvolumes mst-1a mst-1b 54: end-volume 55: 56: volume mst-ns 57: type cluster/afr 58: subvolumes mst-1a-ns mst-1b-ns 59: end-volume 60: 61: volume afr-st-1 62: type cluster/afr 63: subvolumes st-1a st-1b 64: end-volume 65: 66: volume unify 67: type cluster/unify 68: option namespace mst-ns 69: option scheduler rr 70: subvolumes afr-mst-1 afr-st-1 71: end-volume 72: 73: ### Add IO-Cache feature 74: volume iocache 75: type performance/io-cache 76: option cache-size 128MB # default is 32MB 77: option page-size 4MB #128KB is default option 78: option force-revalidate-timeout 5 # default is 1 79: subvolumes unify 80: end-volume +----- Linux smtp-1 2.6.18-92.1.13.el5 #1 SMP Wed Sep 24 19:32:05 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux dkms-fuse-2.7.4-1.nodist.rf fuse-2.7.2glfs8-1 fuse-sshfs-2.2-1.el5.rf -------------------------------------------------------------------------------- Mon 30 Mar 2009 08:11:50 AM GMT, comment #1 by Pavel Veretennikov <vermut>: Backtrace Core was generated by `/usr/sbin/glusterfs --log-level=WARNING --volfile=/etc/glusterfs/glusterfs-clie'. Program terminated with signal 11, Segmentation fault. #0 0x0000000000000000 in ?? () (gdb) bt #0 0x0000000000000000 in ?? () #1 0x00002b9d2bf091cd in protocol_client_xfer () from /usr/lib64/glusterfs/1.4.0rc7/xlator/protocol/client.so #2 0x00002b9d2bf0f631 in client_xattrop () from /usr/lib64/glusterfs/1.4.0rc7/xlator/protocol/client.so #3 0x00002b9d2c134307 in afr_write_pending_post_op () from /usr/lib64/glusterfs/1.4.0rc7/xlator/cluster/afr.so #4 0x00002b9d2c13437e in afr_transaction_resume () from /usr/lib64/glusterfs/1.4.0rc7/xlator/cluster/afr.so #5 0x00002b9d2c127a7a in afr_create_wind_cbk () from /usr/lib64/glusterfs/1.4.0rc7/xlator/cluster/afr.so #6 0x00002b9d2bf08344 in client_create_cbk () from /usr/lib64/glusterfs/1.4.0rc7/xlator/protocol/client.so #7 0x00002b9d2bf136be in saved_frames_unwind () from /usr/lib64/glusterfs/1.4.0rc7/xlator/protocol/client.so #8 0x00002b9d2bf13794 in saved_frames_destroy () from /usr/lib64/glusterfs/1.4.0rc7/xlator/protocol/client.so #9 0x00002b9d2bf062a4 in protocol_client_cleanup () from /usr/lib64/glusterfs/1.4.0rc7/xlator/protocol/client.so #10 0x00002b9d2bf09689 in notify () from /usr/lib64/glusterfs/1.4.0rc7/xlator/protocol/client.so #11 0x00002aaaaaaada4b in fcntl@plt () from /usr/lib64/glusterfs/1.4.0rc7/transport/socket.so #12 0x0000003135c21ee5 in event_pool_new () from /usr/lib64/libglusterfs.so.0 #13 0x0000000000403408 in main () -------------------------------------------------------------------------------- Tue 14 Apr 2009 08:35:23 AM GMT, comment #2 by Pavel Veretennikov <vermut>: After update to latest git: Logs: ------------------------------------------ pending frames: frame : type(1) op(RENAME) frame : type(1) op(RENAME) frame : type(1) op(RENAME) frame : type(1) op(RENAME) patchset: git://git.sv.gnu.org/gluster.git signal received: 11 configuration details:argp 1 backtrace 1 dlfcn 1 fdatasync 1 libpthread 1 llistxattr 1 setfsid 1 spinlock 1 epoll.h 1 xattr.h 1 st_atim.tv_nsec 1 package-string: glusterfs 2.0.0git10Apr /lib64/libc.so.6[0x3ec50301b0] /lib64/libc.so.6(memcpy+0xe1)[0x3ec507a1b1] /usr/lib64/glusterfs/2.0.0git10Apr/xlator/cluster/unify.so(unify_link_cbk+0x4c)[0x2b793e4469fc] /usr/lib64/glusterfs/2.0.0git10Apr/xlator/cluster/afr.so(afr_link_unwind+0x9c)[0x2b793e21ba8c] /usr/lib64/glusterfs/2.0.0git10Apr/xlator/cluster/afr.so(afr_link_wind_cbk+0xae)[0x2b793e21c30e] /usr/lib64/glusterfs/2.0.0git10Apr/xlator/protocol/client.so(client_link_cbk+0x17e)[0x2b793e0061fe] /usr/lib64/glusterfs/2.0.0git10Apr/xlator/protocol/client.so(protocol_client_pollin+0xdf)[0x2b793dff487f] /usr/lib64/glusterfs/2.0.0git10Apr/xlator/protocol/client.so(notify+0x175)[0x2b793dffb715] /usr/lib64/glusterfs/2.0.0git10Apr/transport/socket.so(socket_event_handler+0xd3)[0x2aaaaaaaf7a3] /usr/lib64/libglusterfs.so.0[0x2b793dd69a05] /usr/sbin/glusterfs(main+0xaaa)[0x4037da] /lib64/libc.so.6(__libc_start_main+0xf4)[0x3ec501d8b4] /usr/sbin/glusterfs[0x402359] ------------------------------------ Backtrace Core was generated by `/usr/sbin/glusterfs --log-level=NORMAL --volfile=/etc/glusterfs/glusterfs-clien'. Program terminated with signal 11, Segmentation fault. #0 0x0000003ec507a1b1 in memcpy () from /lib64/libc.so.6 (gdb) bt #0 0x0000003ec507a1b1 in memcpy () from /lib64/libc.so.6 #1 0x00002b793e4469fc in unify_link_cbk () from /usr/lib64/glusterfs/2.0.0git10Apr/xlator/cluster/unify.so #2 0x00002b793e21ba8c in afr_link_unwind () from /usr/lib64/glusterfs/2.0.0git10Apr/xlator/cluster/afr.so #3 0x00002b793e21c30e in afr_link_wind_cbk () from /usr/lib64/glusterfs/2.0.0git10Apr/xlator/cluster/afr.so #4 0x00002b793e0061fe in client_link_cbk () from /usr/lib64/glusterfs/2.0.0git10Apr/xlator/protocol/client.so #5 0x00002b793dff487f in protocol_client_pollin () from /usr/lib64/glusterfs/2.0.0git10Apr/xlator/protocol/client.so #6 0x00002b793dffb715 in notify () from /usr/lib64/glusterfs/2.0.0git10Apr/xlator/protocol/client.so #7 0x00002aaaaaaaf7a3 in socket_event_handler () from /usr/lib64/glusterfs/2.0.0git10Apr/transport/socket.so #8 0x00002b793dd69a05 in ?? () #9 0x00002b793dd47080 in ?? () #10 0x000000000f2be060 in ?? () #11 0x000000000f2beea0 in ?? () #12 0x000000000f2be9b8 in ?? () #13 0x000000000f2d2290 in ?? () #14 0x000000000f2cbff0 in ?? () #15 0x00002aaaaaaaf6d0 in socket_event_poll_out () from /usr/lib64/glusterfs/2.0.0git10Apr/transport/socket.so #16 0x000000000f2be060 in ?? () #17 0x000000000f2beea0 in ?? () #18 0x0000000000000000 in ?? ()