Description of problem: Was running iozone on a volume with single brick with all performance translators on the client side disabled except write-behind. The iozone process exited with an EINVAL It was a fuse client. Version-Release number of selected component (if applicable): 3.3.0qa21 Actual results: Can not fdopen temp file: iozone.tmp fdopen: Invalid argument Additional info: Volume Name: perftest Type: Distribute Volume ID: 89b44cf3-0ee0-49f3-aa42-88b301f1e8ce Status: Started Number of Bricks: 1 Transport-type: tcp Bricks: Brick1: 10.10.12.104:/data/perf1 Options Reconfigured: performance.read-ahead: off performance.io-cache: off performance.stat-prefetch: off performance.quick-read: off performance.write-behind: on Client log- [2012-02-06 13:32:20.447467] W [fuse-bridge.c:1003:fuse_err_cbk] 0-glusterfs-fuse: 125217136: FSYNC() ERR => -1 (File descriptor in bad state) [2012-02-06 13:32:20.447568] W [client3_1-fops.c:3706:client3_1_flush] 8-perftest-client-0: (98b22249-cea1-43c5-b748-974bd90a58a1) remote_fd is -1. EBADFD [2012-02-06 13:32:20.447592] W [client3_1-fops.c:3734:client3_1_flush] 8-perftest-client-0: failed to send the fop: File descriptor in bad state [2012-02-06 13:38:57.703714] I [client-handshake.c:1086:select_server_supported_programs] 8-perftest-client-0: Using Program GlusterFS 3git, Num (1298437), Version (330) [2012-02-06 13:38:57.705564] E [client3_1-fops.c:2232:client3_1_lookup_cbk] 8-perftest-client-0: XDR decoding failed [2012-02-06 13:38:57.705602] W [client3_1-fops.c:2287:client3_1_lookup_cbk] 8-perftest-client-0: remote operation failed: Invalid argument. Path: /iozone.tmp [2012-02-06 13:38:57.705626] W [fuse-bridge.c:269:fuse_entry_cbk] 0-glusterfs-fuse: 125204563: LOOKUP() /iozone.tmp => -1 (Invalid argument) [2012-02-06 13:38:57.705704] E [client3_1-fops.c:2232:client3_1_lookup_cbk] 8-perftest-client-0: XDR decoding failed [2012-02-06 13:38:57.705730] W [client3_1-fops.c:2287:client3_1_lookup_cbk] 8-perftest-client-0: remote operation failed: Invalid argument. Path: / [2012-02-06 13:38:57.705787] E [client3_1-fops.c:2232:client3_1_lookup_cbk] 8-perftest-client-0: XDR decoding failed [2012-02-06 13:38:57.705812] W [client3_1-fops.c:2287:client3_1_lookup_cbk] 8-perftest-client-0: remote operation failed: Invalid argument. Path: / [2012-02-06 13:38:57.705860] E [client3_1-fops.c:2232:client3_1_lookup_cbk] 8-perftest-client-0: XDR decoding failed [2012-02-06 13:38:57.705898] W [client3_1-fops.c:2287:client3_1_lookup_cbk] 8-perftest-client-0: remote operation failed: Invalid argument. Path: / [2012-02-06 13:38:57.705954] I [client-handshake.c:918:client_setvolume_cbk] 8-perftest-client-0: Connected to 10.10.12.104:24009, attached to remote volume '/data/perf1'. [2012-02-06 13:38:57.705979] I [client-handshake.c:784:client_post_handshake] 8-perftest-client-0: 3 fds open - Delaying child_up until they are re-opened [2012-02-06 13:38:57.706396] I [client3_1-fops.c:2422:client_fdctx_destroy] 8-perftest-client-0: sending release on fd [2012-02-06 13:38:57.706476] I [client3_1-fops.c:2422:client_fdctx_destroy] 8-perftest-client-0: sending release on fd [2012-02-06 13:38:57.706551] I [client-lk.c:610:decrement_reopen_fd_count] 8-perftest-client-0: last fd open'd/lock-self-heal'd - notifying CHILD-UP [2012-02-06 13:38:57.706594] I [client3_1-fops.c:2422:client_fdctx_destroy] 8-perftest-client-0: sending release on fd
Anush can you check if this happens with 3.3.0qa23?
With the graph change related bugs fixed, this should not be happening on latest master branch (ie, >=qa31), Anush please re-open the bug if it happens for you. Couldn't reproduce it in my basic tests.
Verified with 3.3.0qa33