Bug 1332077

Summary: We need more debug info from stack wind and unwind calls
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Raghavendra Talur <rtalur>
Component: coreAssignee: Raghavendra Talur <rtalur>
Status: CLOSED ERRATA QA Contact: krishnaram Karthick <kramdoss>
Severity: high Docs Contact:
Priority: high    
Version: rhgs-3.1CC: asrivast, bugs, mchangir, rcyriac, rgowdapp, rhinduja, rhs-bugs, sankarshan, storage-qa-internal
Target Milestone: ---Keywords: Triaged, ZStream
Target Release: RHGS 3.1.3   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: glusterfs-3.7.9-4 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: 1330739 Environment:
Last Closed: 2016-06-23 05:20:41 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1330052, 1330739    
Bug Blocks: 1311817    

Description Raghavendra Talur 2016-05-02 06:48:02 UTC
+++ This bug was initially created as a clone of Bug #1330739 +++

+++ This bug was initially created as a clone of Bug #1330052 +++

Description of problem:
It is possible that some xlators don't print debug/trace logs even when required.
In such cases debugging an existing setup without recompiling becomes very difficult. If libglusterfs/gluster wind/unwind had a debug log builtin then such dependency on every xlator would be reduced.


Version-Release number of selected component (if applicable):
mainline and all previous versions


How reproducible:
Always

--- Additional comment from Vijay Bellur on 2016-04-25 16:45:07 IST ---

REVIEW: http://review.gluster.org/13448 (libglusterfs: Add debug and trace logs for stack trace) posted (#3) for review on master by Raghavendra Talur (rtalur)

--- Additional comment from Vijay Bellur on 2016-04-28 13:39:31 IST ---

REVIEW: http://review.gluster.org/14099 (libglusterfs: Add debug and trace logs for stack trace) posted (#1) for review on release-3.7 by Raghavendra Talur (rtalur)

Comment 3 Raghavendra Talur 2016-05-02 11:00:14 UTC
Patch posted at https://code.engineering.redhat.com/gerrit/#/c/73399/1

Comment 6 krishnaram Karthick 2016-05-20 10:23:21 UTC
Verified the fix in build - glusterfs-3.7.9-5

with debug mode enabled, additional debug messages about the IO flow is logged.

[2016-05-20 09:54:39.130951] D [MSGID: 0] [io-cache.c:261:ioc_lookup_cbk] 0-stack-trace: stack-address: 0x7f02d163ab1c, test1-io-cache returned -1 error: No such file or directory [No such file or directory]
[2016-05-20 09:54:39.131044] D [MSGID: 0] [quick-read.c:447:qr_lookup_cbk] 0-stack-trace: stack-address: 0x7f02d163ab1c, test1-quick-read returned -1 error: No such file or directory [No such file or directory]
[2016-05-20 09:54:39.131075] D [MSGID: 0] [md-cache.c:868:mdc_lookup_cbk] 0-stack-trace: stack-address: 0x7f02d163ab1c, test1-md-cache returned -1 error: No such file or directory [No such file or directory]
[2016-05-20 09:54:39.131105] D [MSGID: 0] [io-stats.c:1513:io_stats_lookup_cbk] 0-stack-trace: stack-address: 0x7f02d163ab1c, test1 returned -1 error: No such file or directory [No such file or directory]
[2016-05-20 09:54:42.997872] D [MSGID: 0] [client-rpc-fops.c:2982:client3_3_lookup_cbk] 0-stack-trace: stack-address: 0x7f02d163a470, test1-client-0 returned -1 error: No such file or directory [No such file or

Comment 8 errata-xmlrpc 2016-06-23 05:20:41 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1240