Bug 763124 (GLUSTER-1392)

Summary: inode path failure while running dbench
Product: [Community] GlusterFS Reporter: Anush Shetty <anush>
Component: replicateAssignee: Pavan Vilas Sondur <pavan>
Status: CLOSED CURRENTRELEASE QA Contact:
Severity: high Docs Contact:
Priority: low    
Version: mainlineCC: gluster-bugs, vijay
Target Milestone: ---   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Attachments:
Description Flags
Client log file none

Description Anush Shetty 2010-08-18 07:11:05 UTC
Dbench failed on a 3-replica setup. 

Command used - dbench -s 10

The checksum on the backend didn't match with the client. Logs attached

 10      9286     1.09 MB/sec  execute 354 sec  latency 224.231 ms
  10      9299     1.09 MB/sec  execute 355 sec  latency 218.443 ms
  10      9319     1.09 MB/sec  execute 356 sec  latency 221.074 ms
  10      9335     1.08 MB/sec  execute 357 sec  latency 236.595 ms
  10      9363     1.09 MB/sec  execute 358 sec  latency 404.228 ms
  10      9386     1.09 MB/sec  execute 359 sec  latency 180.511 ms
  10      9415     1.10 MB/sec  execute 360 sec  latency 178.718 ms
[9365] read failed on handle 11883 (No such file or directory)
[9366] read failed on handle 11883 (No such file or directory)
  10      9436     1.10 MB/sec  execute 361 sec  latency 256.613 ms
  10      9449     1.10 MB/sec  execute 362 sec  latency 302.603 ms
  10      9468     1.10 MB/sec  execute 363 sec  latency 261.415 ms
  10      9485     1.09 MB/sec  execute 364 sec  latency 298.930 ms
  10      9502     1.09 MB/sec  execute 365 sec  latency 309.578 ms
  10      9520     1.09 MB/sec  execute 366 sec  latency 234.266 ms
  10      9533     1.09 MB/sec  execute 367 sec  latency 297.033 ms
  10      9545     1.09 MB/sec  execute 368 sec  latency 445.955 ms
  10      9563     1.09 MB/sec  execute 369 sec  latency 295.128 ms
  10      9578     1.09 MB/sec  execute 370 sec  latency 285.056 ms
  10      9603     1.09 MB/sec  execute 371 sec  latency 317.624 ms
  10      9626     1.09 MB/sec  execute 372 sec  latency 330.949 ms
  10      9647     1.09 MB/sec  execute 373 sec  latency 275.185 ms
[9611] read failed on handle 11924 (No such file or directory)
[9612] read failed on handle 11924 (No such file or directory)
[9613] read failed on handle 11924 (No such file or directory)
[9614] read failed on handle 11924 (No such file or directory)
[9615] read failed on handle 11924 (No such file or directory)
[9616] read failed on handle 11924 (No such file or directory)
[9617] read failed on handle 11924 (No such file or directory)
[9618] read failed on handle 11924 (No such file or directory)
[9619] read failed on handle 11924 (No such file or directory)
[9620] read failed on handle 11924 (No such file or directory)
[9621] read failed on handle 11924 (No such file or directory)
[9622] read failed on handle 11924 (No such file or directory)
[9623] read failed on handle 11924 (No such file or directory)
[9624] read failed on handle 11924 (No such file or directory)
[9625] read failed on handle 11924 (No such file or directory)
[9626] read failed on handle 11924 (No such file or directory)
[9627] read failed on handle 11924 (No such file or directory)
[9628] read failed on handle 11924 (No such file or directory)
[9629] read failed on handle 11924 (No such file or directory)
[9630] read failed on handle 11924 (No such file or directory)
[9631] read failed on handle 11924 (No such file or directory)
[9632] read failed on handle 11924 (No such file or directory)
[9633] read failed on handle 11924 (No such file or directory)
[9634] read failed on handle 11924 (No such file or directory)
[9635] read failed on handle 11924 (No such file or directory)
[9636] read failed on handle 11924 (No such file or directory)
[9637] read failed on handle 11924 (No such file or directory)
[9638] read failed on handle 11924 (No such file or directory)
[9639] read failed on handle 11924 (No such file or directory)
[9640] read failed on handle 11924 (No such file or directory)
[9641] read failed on handle 11924 (No such file or directory)
[9642] read failed on handle 11924 (No such file or directory)
  10      9666     1.09 MB/sec  execute 374 sec  latency 305.221 ms
[9643] read failed on handle 11924 (No such file or directory)
[9644] read failed on handle 11924 (No such file or directory)
[9645] read failed on handle 11924 (No such file or directory)
[9646] read failed on handle 11924 (No such file or directory)
[9647] read failed on handle 11924 (No such file or directory)
[9648] read failed on handle 11924 (No such file or directory)
[9649] read failed on handle 11924 (No such file or directory)
[9650] read failed on handle 11924 (No such file or directory)
  10      9682     1.09 MB/sec  execute 375 sec  latency 391.654 ms
[9668] open ./clients/client7/~dmtmp/EXCEL/SALES.XLS failed for handle 11928 (No such file or directory)
(9669) ERROR: handle 11928 was not found
Child failed with status 1
root@pitta:/mnt/gluster# arequal-checksum /mnt/exportnew1/clients/ 

Entry counts
Regular files   : 693
Directories     : 111
Symbolic links  : 0
Other           : 0
Total           : 804

Metadata checksums
Regular files   : 485a69
Directories     : 24d74c
Symbolic links  : 3e9
Other           : 3e9

Checksums
Regular files   : c7b40ebae90fc77711bb75f15c5aa6ce
Directories     : 3031303044456b42
Symbolic links  : 0
Other           : 0
Total           : e63e4b7bf1100afb
root@pitta:/mnt/gluster# arequal-checksum clients/ 

Entry counts
Regular files   : 693
Directories     : 111
Symbolic links  : 0
Other           : 0
Total           : 804

Metadata checksums
Regular files   : 485a69
Directories     : 24d74c
Symbolic links  : 3e9
Other           : 3e9

Checksums
Regular files   : f3e3146222e77fddb32a741f07ba1060
Directories     : 3031303044456b42
Symbolic links  : 0
Other           : 0
Total           : 70f8504d611804ff
root@pitta:/mnt/gluster#