Bug 787677

Summary: Iozone failed with EINVAL
Product: [Community] GlusterFS Reporter: Anush Shetty <ashetty>
Component: fuseAssignee: Amar Tumballi <amarts>
Status: CLOSED CURRENTRELEASE QA Contact:
Severity: medium Docs Contact:
Priority: medium    
Version: pre-releaseCC: amarts, gluster-bugs, vraman
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Linux   
Whiteboard:
Fixed In Version: glusterfs-3.4.0 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-07-24 17:30:07 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 817967    

Description Anush Shetty 2012-02-06 13:49:22 UTC
Description of problem: Was running iozone on a volume with single brick with all performance translators on the client side disabled except write-behind. The iozone process exited with an EINVAL It was a fuse client.


Version-Release number of selected component (if applicable): 3.3.0qa21

  
Actual results:
Can not fdopen temp file: iozone.tmp
fdopen: Invalid argument


Additional info:

Volume Name: perftest
Type: Distribute
Volume ID: 89b44cf3-0ee0-49f3-aa42-88b301f1e8ce
Status: Started
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: 10.10.12.104:/data/perf1
Options Reconfigured:
performance.read-ahead: off
performance.io-cache: off
performance.stat-prefetch: off
performance.quick-read: off
performance.write-behind: on


Client log-
[2012-02-06 13:32:20.447467] W [fuse-bridge.c:1003:fuse_err_cbk] 0-glusterfs-fuse: 125217136: FSYNC() ERR => -1 (File descriptor in bad state)
[2012-02-06 13:32:20.447568] W [client3_1-fops.c:3706:client3_1_flush] 8-perftest-client-0:  (98b22249-cea1-43c5-b748-974bd90a58a1) remote_fd is -1. EBADFD
[2012-02-06 13:32:20.447592] W [client3_1-fops.c:3734:client3_1_flush] 8-perftest-client-0: failed to send the fop: File descriptor in bad state
[2012-02-06 13:38:57.703714] I [client-handshake.c:1086:select_server_supported_programs] 8-perftest-client-0: Using Program GlusterFS 3git, Num (1298437), Version (330)
[2012-02-06 13:38:57.705564] E [client3_1-fops.c:2232:client3_1_lookup_cbk] 8-perftest-client-0: XDR decoding failed
[2012-02-06 13:38:57.705602] W [client3_1-fops.c:2287:client3_1_lookup_cbk] 8-perftest-client-0: remote operation failed: Invalid argument. Path: /iozone.tmp
[2012-02-06 13:38:57.705626] W [fuse-bridge.c:269:fuse_entry_cbk] 0-glusterfs-fuse: 125204563: LOOKUP() /iozone.tmp => -1 (Invalid argument)
[2012-02-06 13:38:57.705704] E [client3_1-fops.c:2232:client3_1_lookup_cbk] 8-perftest-client-0: XDR decoding failed
[2012-02-06 13:38:57.705730] W [client3_1-fops.c:2287:client3_1_lookup_cbk] 8-perftest-client-0: remote operation failed: Invalid argument. Path: /
[2012-02-06 13:38:57.705787] E [client3_1-fops.c:2232:client3_1_lookup_cbk] 8-perftest-client-0: XDR decoding failed
[2012-02-06 13:38:57.705812] W [client3_1-fops.c:2287:client3_1_lookup_cbk] 8-perftest-client-0: remote operation failed: Invalid argument. Path: /
[2012-02-06 13:38:57.705860] E [client3_1-fops.c:2232:client3_1_lookup_cbk] 8-perftest-client-0: XDR decoding failed
[2012-02-06 13:38:57.705898] W [client3_1-fops.c:2287:client3_1_lookup_cbk] 8-perftest-client-0: remote operation failed: Invalid argument. Path: /
[2012-02-06 13:38:57.705954] I [client-handshake.c:918:client_setvolume_cbk] 8-perftest-client-0: Connected to 10.10.12.104:24009, attached to remote volume '/data/perf1'.
[2012-02-06 13:38:57.705979] I [client-handshake.c:784:client_post_handshake] 8-perftest-client-0: 3 fds open - Delaying child_up until they are re-opened
[2012-02-06 13:38:57.706396] I [client3_1-fops.c:2422:client_fdctx_destroy] 8-perftest-client-0: sending release on fd
[2012-02-06 13:38:57.706476] I [client3_1-fops.c:2422:client_fdctx_destroy] 8-perftest-client-0: sending release on fd
[2012-02-06 13:38:57.706551] I [client-lk.c:610:decrement_reopen_fd_count] 8-perftest-client-0: last fd open'd/lock-self-heal'd - notifying CHILD-UP
[2012-02-06 13:38:57.706594] I [client3_1-fops.c:2422:client_fdctx_destroy] 8-perftest-client-0: sending release on fd

Comment 1 Amar Tumballi 2012-02-22 04:06:31 UTC
Anush can you check if this happens with 3.3.0qa23?

Comment 2 Amar Tumballi 2012-03-27 13:01:41 UTC
With the graph change related bugs fixed, this should not be happening on latest master branch (ie, >=qa31), Anush please re-open the bug if it happens for you. Couldn't reproduce it in my basic tests.

Comment 3 Anush Shetty 2012-04-03 06:20:42 UTC
Verified with 3.3.0qa33