Login
Log in using an SSO provider:
Fedora Account System
Red Hat Associate
Red Hat Customer
Login using a Red Hat Bugzilla account
Forgot Password
Create an Account
Red Hat Bugzilla – Attachment 1148711 Details for
Bug 1328581
Continuous "remote operation failed" messages in ganesha-gfapi.log while removing files from ganesha mount.
Home
New
Search
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh92 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
[?]
This site requires JavaScript to be enabled to function correctly, please enable it.
ganesha-gfapi.log from mounted node
ganesha-gfapi.log (text/plain), 3.53 MB, created by
Shashank Raj
on 2016-04-19 18:28:22 UTC
(
hide
)
Description:
ganesha-gfapi.log from mounted node
Filename:
MIME Type:
Creator:
Shashank Raj
Created:
2016-04-19 18:28:22 UTC
Size:
3.53 MB
patch
obsolete
> >[2016-04-19 07:24:32.693958] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.695135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ddf0aab0-02fc-470c-af10-a2218e3947c8> (ddf0aab0-02fc-470c-af10-a2218e3947c8) [No such file or directory] >[2016-04-19 07:24:32.695137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ddf0aab0-02fc-470c-af10-a2218e3947c8> (ddf0aab0-02fc-470c-af10-a2218e3947c8) [No such file or directory] >[2016-04-19 07:24:32.696458] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ddf0aab0-02fc-470c-af10-a2218e3947c8. (Possible split-brain) >[2016-04-19 07:24:32.700228] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ddf0aab0-02fc-470c-af10-a2218e3947c8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ddf0aab0-02fc-470c-af10-a2218e3947c8> (ddf0aab0-02fc-470c-af10-a2218e3947c8) [No such file or directory]" repeated 4 times between [2016-04-19 07:24:32.695135] and [2016-04-19 07:24:32.705820] >[2016-04-19 07:24:32.705927] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ddf0aab0-02fc-470c-af10-a2218e3947c8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:32.715087] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.716060] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c> (cdec4516-2482-46fa-8534-2f0dec82b21c) [No such file or directory] >[2016-04-19 07:24:32.716137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c> (cdec4516-2482-46fa-8534-2f0dec82b21c) [No such file or directory] >[2016-04-19 07:24:32.718866] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cdec4516-2482-46fa-8534-2f0dec82b21c. (Possible split-brain) >[2016-04-19 07:24:32.720077] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c> (cdec4516-2482-46fa-8534-2f0dec82b21c) [No such file or directory] >[2016-04-19 07:24:32.720446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c> (cdec4516-2482-46fa-8534-2f0dec82b21c) [No such file or directory] >[2016-04-19 07:24:32.721398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c> (cdec4516-2482-46fa-8534-2f0dec82b21c) [No such file or directory] >[2016-04-19 07:24:32.721952] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c> (cdec4516-2482-46fa-8534-2f0dec82b21c) [No such file or directory] >[2016-04-19 07:24:32.722132] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:32.723069] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cdec4516-2482-46fa-8534-2f0dec82b21c. (Possible split-brain) >[2016-04-19 07:24:32.724022] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c> (cdec4516-2482-46fa-8534-2f0dec82b21c) [No such file or directory] >[2016-04-19 07:24:32.724125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c> (cdec4516-2482-46fa-8534-2f0dec82b21c) [No such file or directory] >[2016-04-19 07:24:32.726996] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c> (cdec4516-2482-46fa-8534-2f0dec82b21c) [No such file or directory] >[2016-04-19 07:24:32.727121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c> (cdec4516-2482-46fa-8534-2f0dec82b21c) [No such file or directory] >[2016-04-19 07:24:32.727380] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cdec4516-2482-46fa-8534-2f0dec82b21c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:32.737592] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.738529] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6bafac29-6941-414c-abdd-c3a87193e452> (6bafac29-6941-414c-abdd-c3a87193e452) [No such file or directory] >[2016-04-19 07:24:32.738916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6bafac29-6941-414c-abdd-c3a87193e452> (6bafac29-6941-414c-abdd-c3a87193e452) [No such file or directory] >[2016-04-19 07:24:32.740079] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6bafac29-6941-414c-abdd-c3a87193e452. (Possible split-brain) >[2016-04-19 07:24:32.741031] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6bafac29-6941-414c-abdd-c3a87193e452> (6bafac29-6941-414c-abdd-c3a87193e452) [No such file or directory] >[2016-04-19 07:24:32.741129] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6bafac29-6941-414c-abdd-c3a87193e452> (6bafac29-6941-414c-abdd-c3a87193e452) [No such file or directory] >[2016-04-19 07:24:32.742526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6bafac29-6941-414c-abdd-c3a87193e452> (6bafac29-6941-414c-abdd-c3a87193e452) [No such file or directory] >[2016-04-19 07:24:32.742644] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6bafac29-6941-414c-abdd-c3a87193e452> (6bafac29-6941-414c-abdd-c3a87193e452) [No such file or directory] >[2016-04-19 07:24:32.742882] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6bafac29-6941-414c-abdd-c3a87193e452>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:32.745370] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6bafac29-6941-414c-abdd-c3a87193e452. (Possible split-brain) >[2016-04-19 07:24:32.746370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6bafac29-6941-414c-abdd-c3a87193e452> (6bafac29-6941-414c-abdd-c3a87193e452) [No such file or directory] >[2016-04-19 07:24:32.746476] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6bafac29-6941-414c-abdd-c3a87193e452> (6bafac29-6941-414c-abdd-c3a87193e452) [No such file or directory] >[2016-04-19 07:24:32.749416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6bafac29-6941-414c-abdd-c3a87193e452> (6bafac29-6941-414c-abdd-c3a87193e452) [No such file or directory] >[2016-04-19 07:24:32.749547] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6bafac29-6941-414c-abdd-c3a87193e452> (6bafac29-6941-414c-abdd-c3a87193e452) [No such file or directory] >[2016-04-19 07:24:32.749772] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6bafac29-6941-414c-abdd-c3a87193e452>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:32.761901] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.763008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f483c101-99db-41fb-bee1-489ac489367e> (f483c101-99db-41fb-bee1-489ac489367e) [No such file or directory] >[2016-04-19 07:24:32.763424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f483c101-99db-41fb-bee1-489ac489367e> (f483c101-99db-41fb-bee1-489ac489367e) [No such file or directory] >[2016-04-19 07:24:32.766281] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f483c101-99db-41fb-bee1-489ac489367e. (Possible split-brain) >[2016-04-19 07:24:32.767757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f483c101-99db-41fb-bee1-489ac489367e> (f483c101-99db-41fb-bee1-489ac489367e) [No such file or directory] >[2016-04-19 07:24:32.767864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f483c101-99db-41fb-bee1-489ac489367e> (f483c101-99db-41fb-bee1-489ac489367e) [No such file or directory] >[2016-04-19 07:24:32.769468] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f483c101-99db-41fb-bee1-489ac489367e> (f483c101-99db-41fb-bee1-489ac489367e) [No such file or directory] >[2016-04-19 07:24:32.769564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f483c101-99db-41fb-bee1-489ac489367e> (f483c101-99db-41fb-bee1-489ac489367e) [No such file or directory] >[2016-04-19 07:24:32.769760] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f483c101-99db-41fb-bee1-489ac489367e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:32.772451] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f483c101-99db-41fb-bee1-489ac489367e. (Possible split-brain) >[2016-04-19 07:24:32.773655] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f483c101-99db-41fb-bee1-489ac489367e> (f483c101-99db-41fb-bee1-489ac489367e) [No such file or directory] >[2016-04-19 07:24:32.773765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f483c101-99db-41fb-bee1-489ac489367e> (f483c101-99db-41fb-bee1-489ac489367e) [No such file or directory] >[2016-04-19 07:24:32.776742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f483c101-99db-41fb-bee1-489ac489367e> (f483c101-99db-41fb-bee1-489ac489367e) [No such file or directory] >[2016-04-19 07:24:32.776866] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f483c101-99db-41fb-bee1-489ac489367e> (f483c101-99db-41fb-bee1-489ac489367e) [No such file or directory] >[2016-04-19 07:24:32.777034] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f483c101-99db-41fb-bee1-489ac489367e>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:32.786627] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.787633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e> (ec5b5d18-00ed-4c9d-a1fa-41319580dd5e) [No such file or directory] >[2016-04-19 07:24:32.787656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e> (ec5b5d18-00ed-4c9d-a1fa-41319580dd5e) [No such file or directory] >[2016-04-19 07:24:32.790503] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ec5b5d18-00ed-4c9d-a1fa-41319580dd5e. (Possible split-brain) >[2016-04-19 07:24:32.791567] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e> (ec5b5d18-00ed-4c9d-a1fa-41319580dd5e) [No such file or directory] >[2016-04-19 07:24:32.791578] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e> (ec5b5d18-00ed-4c9d-a1fa-41319580dd5e) [No such file or directory] >[2016-04-19 07:24:32.792891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e> (ec5b5d18-00ed-4c9d-a1fa-41319580dd5e) [No such file or directory] >[2016-04-19 07:24:32.793164] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e> (ec5b5d18-00ed-4c9d-a1fa-41319580dd5e) [No such file or directory] >[2016-04-19 07:24:32.793358] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:32.795907] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ec5b5d18-00ed-4c9d-a1fa-41319580dd5e. (Possible split-brain) >[2016-04-19 07:24:32.796694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e> (ec5b5d18-00ed-4c9d-a1fa-41319580dd5e) [No such file or directory] >[2016-04-19 07:24:32.796968] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e> (ec5b5d18-00ed-4c9d-a1fa-41319580dd5e) [No such file or directory] >[2016-04-19 07:24:32.799782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e> (ec5b5d18-00ed-4c9d-a1fa-41319580dd5e) [No such file or directory] >[2016-04-19 07:24:32.800295] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e> (ec5b5d18-00ed-4c9d-a1fa-41319580dd5e) [No such file or directory] >[2016-04-19 07:24:32.800513] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ec5b5d18-00ed-4c9d-a1fa-41319580dd5e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:32.810026] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.810991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b> (5503b041-0244-4bce-8248-7d13fc3f384b) [No such file or directory] >[2016-04-19 07:24:32.811269] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b> (5503b041-0244-4bce-8248-7d13fc3f384b) [No such file or directory] >[2016-04-19 07:24:32.812488] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5503b041-0244-4bce-8248-7d13fc3f384b. (Possible split-brain) >[2016-04-19 07:24:32.813533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b> (5503b041-0244-4bce-8248-7d13fc3f384b) [No such file or directory] >[2016-04-19 07:24:32.813860] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b> (5503b041-0244-4bce-8248-7d13fc3f384b) [No such file or directory] >[2016-04-19 07:24:32.815834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b> (5503b041-0244-4bce-8248-7d13fc3f384b) [No such file or directory] >[2016-04-19 07:24:32.815954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b> (5503b041-0244-4bce-8248-7d13fc3f384b) [No such file or directory] >[2016-04-19 07:24:32.816117] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:32.818898] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5503b041-0244-4bce-8248-7d13fc3f384b. (Possible split-brain) >[2016-04-19 07:24:32.820016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b> (5503b041-0244-4bce-8248-7d13fc3f384b) [No such file or directory] >[2016-04-19 07:24:32.820130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b> (5503b041-0244-4bce-8248-7d13fc3f384b) [No such file or directory] >[2016-04-19 07:24:32.823002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b> (5503b041-0244-4bce-8248-7d13fc3f384b) [No such file or directory] >[2016-04-19 07:24:32.823021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b> (5503b041-0244-4bce-8248-7d13fc3f384b) [No such file or directory] >[2016-04-19 07:24:32.823174] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5503b041-0244-4bce-8248-7d13fc3f384b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:32.833512] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.834770] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a> (4b39a334-ddd1-498f-b9a1-1f8df4c90e0a) [No such file or directory] >[2016-04-19 07:24:32.834906] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a> (4b39a334-ddd1-498f-b9a1-1f8df4c90e0a) [No such file or directory] >[2016-04-19 07:24:32.835996] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4b39a334-ddd1-498f-b9a1-1f8df4c90e0a. (Possible split-brain) >[2016-04-19 07:24:32.837000] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a> (4b39a334-ddd1-498f-b9a1-1f8df4c90e0a) [No such file or directory] >[2016-04-19 07:24:32.837248] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a> (4b39a334-ddd1-498f-b9a1-1f8df4c90e0a) [No such file or directory] >[2016-04-19 07:24:32.838411] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a> (4b39a334-ddd1-498f-b9a1-1f8df4c90e0a) [No such file or directory] >[2016-04-19 07:24:32.838746] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a> (4b39a334-ddd1-498f-b9a1-1f8df4c90e0a) [No such file or directory] >[2016-04-19 07:24:32.838895] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:32.841757] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4b39a334-ddd1-498f-b9a1-1f8df4c90e0a. (Possible split-brain) >[2016-04-19 07:24:32.843052] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a> (4b39a334-ddd1-498f-b9a1-1f8df4c90e0a) [No such file or directory] >[2016-04-19 07:24:32.843140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a> (4b39a334-ddd1-498f-b9a1-1f8df4c90e0a) [No such file or directory] >[2016-04-19 07:24:32.845613] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a> (4b39a334-ddd1-498f-b9a1-1f8df4c90e0a) [No such file or directory] >[2016-04-19 07:24:32.845709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a> (4b39a334-ddd1-498f-b9a1-1f8df4c90e0a) [No such file or directory] >[2016-04-19 07:24:32.846068] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4b39a334-ddd1-498f-b9a1-1f8df4c90e0a>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:32.855477] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.856721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf> (7f7ede89-37f2-4d6a-bdec-1f745a7d40bf) [No such file or directory] >[2016-04-19 07:24:32.856816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf> (7f7ede89-37f2-4d6a-bdec-1f745a7d40bf) [No such file or directory] >[2016-04-19 07:24:32.857950] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7f7ede89-37f2-4d6a-bdec-1f745a7d40bf. (Possible split-brain) >[2016-04-19 07:24:32.859220] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf> (7f7ede89-37f2-4d6a-bdec-1f745a7d40bf) [No such file or directory] >[2016-04-19 07:24:32.859358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf> (7f7ede89-37f2-4d6a-bdec-1f745a7d40bf) [No such file or directory] >[2016-04-19 07:24:32.860405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf> (7f7ede89-37f2-4d6a-bdec-1f745a7d40bf) [No such file or directory] >[2016-04-19 07:24:32.860774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf> (7f7ede89-37f2-4d6a-bdec-1f745a7d40bf) [No such file or directory] >[2016-04-19 07:24:32.860978] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:32.863584] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7f7ede89-37f2-4d6a-bdec-1f745a7d40bf. (Possible split-brain) >[2016-04-19 07:24:32.864560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf> (7f7ede89-37f2-4d6a-bdec-1f745a7d40bf) [No such file or directory] >[2016-04-19 07:24:32.864818] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf> (7f7ede89-37f2-4d6a-bdec-1f745a7d40bf) [No such file or directory] >[2016-04-19 07:24:32.868277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf> (7f7ede89-37f2-4d6a-bdec-1f745a7d40bf) [No such file or directory] >[2016-04-19 07:24:32.868591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf> (7f7ede89-37f2-4d6a-bdec-1f745a7d40bf) [No such file or directory] >[2016-04-19 07:24:32.868822] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7f7ede89-37f2-4d6a-bdec-1f745a7d40bf>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:32.880194] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.880891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3> (1377e20c-3bba-4d62-82e3-3f4176c2a6f3) [No such file or directory] >[2016-04-19 07:24:32.880953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3> (1377e20c-3bba-4d62-82e3-3f4176c2a6f3) [No such file or directory] >[2016-04-19 07:24:32.882937] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1377e20c-3bba-4d62-82e3-3f4176c2a6f3. (Possible split-brain) >[2016-04-19 07:24:32.883730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3> (1377e20c-3bba-4d62-82e3-3f4176c2a6f3) [No such file or directory] >[2016-04-19 07:24:32.883832] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3> (1377e20c-3bba-4d62-82e3-3f4176c2a6f3) [No such file or directory] >[2016-04-19 07:24:32.885187] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3> (1377e20c-3bba-4d62-82e3-3f4176c2a6f3) [No such file or directory] >[2016-04-19 07:24:32.885268] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3> (1377e20c-3bba-4d62-82e3-3f4176c2a6f3) [No such file or directory] >[2016-04-19 07:24:32.885429] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:32.887371] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1377e20c-3bba-4d62-82e3-3f4176c2a6f3. (Possible split-brain) >[2016-04-19 07:24:32.888402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3> (1377e20c-3bba-4d62-82e3-3f4176c2a6f3) [No such file or directory] >[2016-04-19 07:24:32.888402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3> (1377e20c-3bba-4d62-82e3-3f4176c2a6f3) [No such file or directory] >[2016-04-19 07:24:32.891096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3> (1377e20c-3bba-4d62-82e3-3f4176c2a6f3) [No such file or directory] >[2016-04-19 07:24:32.891184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3> (1377e20c-3bba-4d62-82e3-3f4176c2a6f3) [No such file or directory] >[2016-04-19 07:24:32.891553] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1377e20c-3bba-4d62-82e3-3f4176c2a6f3>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:32.900185] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.901181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b6cab888-628a-4109-801d-5c1452aff309> (b6cab888-628a-4109-801d-5c1452aff309) [No such file or directory] >[2016-04-19 07:24:32.901211] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b6cab888-628a-4109-801d-5c1452aff309> (b6cab888-628a-4109-801d-5c1452aff309) [No such file or directory] >[2016-04-19 07:24:32.903832] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b6cab888-628a-4109-801d-5c1452aff309. (Possible split-brain) >[2016-04-19 07:24:32.904631] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b6cab888-628a-4109-801d-5c1452aff309> (b6cab888-628a-4109-801d-5c1452aff309) [No such file or directory] >[2016-04-19 07:24:32.904642] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b6cab888-628a-4109-801d-5c1452aff309> (b6cab888-628a-4109-801d-5c1452aff309) [No such file or directory] >[2016-04-19 07:24:32.906052] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b6cab888-628a-4109-801d-5c1452aff309> (b6cab888-628a-4109-801d-5c1452aff309) [No such file or directory] >[2016-04-19 07:24:32.906184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b6cab888-628a-4109-801d-5c1452aff309> (b6cab888-628a-4109-801d-5c1452aff309) [No such file or directory] >[2016-04-19 07:24:32.906363] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b6cab888-628a-4109-801d-5c1452aff309>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:32.908908] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b6cab888-628a-4109-801d-5c1452aff309. (Possible split-brain) >[2016-04-19 07:24:32.909859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b6cab888-628a-4109-801d-5c1452aff309> (b6cab888-628a-4109-801d-5c1452aff309) [No such file or directory] >[2016-04-19 07:24:32.909941] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b6cab888-628a-4109-801d-5c1452aff309> (b6cab888-628a-4109-801d-5c1452aff309) [No such file or directory] >[2016-04-19 07:24:32.913264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b6cab888-628a-4109-801d-5c1452aff309> (b6cab888-628a-4109-801d-5c1452aff309) [No such file or directory] >[2016-04-19 07:24:32.913922] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b6cab888-628a-4109-801d-5c1452aff309> (b6cab888-628a-4109-801d-5c1452aff309) [No such file or directory] >[2016-04-19 07:24:32.914169] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b6cab888-628a-4109-801d-5c1452aff309>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:32.923003] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.923847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b> (e61a5911-8c03-45a6-9875-f5dbec03bd7b) [No such file or directory] >[2016-04-19 07:24:32.923961] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b> (e61a5911-8c03-45a6-9875-f5dbec03bd7b) [No such file or directory] >[2016-04-19 07:24:32.926475] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e61a5911-8c03-45a6-9875-f5dbec03bd7b. (Possible split-brain) >[2016-04-19 07:24:32.927350] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b> (e61a5911-8c03-45a6-9875-f5dbec03bd7b) [No such file or directory] >[2016-04-19 07:24:32.927685] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b> (e61a5911-8c03-45a6-9875-f5dbec03bd7b) [No such file or directory] >[2016-04-19 07:24:32.928988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b> (e61a5911-8c03-45a6-9875-f5dbec03bd7b) [No such file or directory] >[2016-04-19 07:24:32.929023] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b> (e61a5911-8c03-45a6-9875-f5dbec03bd7b) [No such file or directory] >[2016-04-19 07:24:32.929231] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:32.931795] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e61a5911-8c03-45a6-9875-f5dbec03bd7b. (Possible split-brain) >[2016-04-19 07:24:32.932598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b> (e61a5911-8c03-45a6-9875-f5dbec03bd7b) [No such file or directory] >[2016-04-19 07:24:32.932681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b> (e61a5911-8c03-45a6-9875-f5dbec03bd7b) [No such file or directory] >[2016-04-19 07:24:32.935290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b> (e61a5911-8c03-45a6-9875-f5dbec03bd7b) [No such file or directory] >[2016-04-19 07:24:32.935588] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b> (e61a5911-8c03-45a6-9875-f5dbec03bd7b) [No such file or directory] >[2016-04-19 07:24:32.935790] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e61a5911-8c03-45a6-9875-f5dbec03bd7b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:32.944954] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.945875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e> (35c58be8-7460-474c-b7a2-2726179fa59e) [No such file or directory] >[2016-04-19 07:24:32.946228] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e> (35c58be8-7460-474c-b7a2-2726179fa59e) [No such file or directory] >[2016-04-19 07:24:32.949128] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 35c58be8-7460-474c-b7a2-2726179fa59e. (Possible split-brain) >[2016-04-19 07:24:32.950194] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e> (35c58be8-7460-474c-b7a2-2726179fa59e) [No such file or directory] >[2016-04-19 07:24:32.950291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e> (35c58be8-7460-474c-b7a2-2726179fa59e) [No such file or directory] >[2016-04-19 07:24:32.951507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e> (35c58be8-7460-474c-b7a2-2726179fa59e) [No such file or directory] >[2016-04-19 07:24:32.951974] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e> (35c58be8-7460-474c-b7a2-2726179fa59e) [No such file or directory] >[2016-04-19 07:24:32.952154] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:32.954711] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 35c58be8-7460-474c-b7a2-2726179fa59e. (Possible split-brain) >[2016-04-19 07:24:32.955934] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e> (35c58be8-7460-474c-b7a2-2726179fa59e) [No such file or directory] >[2016-04-19 07:24:32.955968] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e> (35c58be8-7460-474c-b7a2-2726179fa59e) [No such file or directory] >[2016-04-19 07:24:32.958584] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e> (35c58be8-7460-474c-b7a2-2726179fa59e) [No such file or directory] >[2016-04-19 07:24:32.958717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e> (35c58be8-7460-474c-b7a2-2726179fa59e) [No such file or directory] >[2016-04-19 07:24:32.959038] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:35c58be8-7460-474c-b7a2-2726179fa59e>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:32.968130] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.968890] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1> (eb9db9ef-7c56-4aad-8cb2-7e30660f57d1) [No such file or directory] >[2016-04-19 07:24:32.968999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1> (eb9db9ef-7c56-4aad-8cb2-7e30660f57d1) [No such file or directory] >[2016-04-19 07:24:32.969869] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid eb9db9ef-7c56-4aad-8cb2-7e30660f57d1. (Possible split-brain) >[2016-04-19 07:24:32.970756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1> (eb9db9ef-7c56-4aad-8cb2-7e30660f57d1) [No such file or directory] >[2016-04-19 07:24:32.970912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1> (eb9db9ef-7c56-4aad-8cb2-7e30660f57d1) [No such file or directory] >[2016-04-19 07:24:32.972277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1> (eb9db9ef-7c56-4aad-8cb2-7e30660f57d1) [No such file or directory] >[2016-04-19 07:24:32.972531] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1> (eb9db9ef-7c56-4aad-8cb2-7e30660f57d1) [No such file or directory] >[2016-04-19 07:24:32.972673] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:32.975101] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid eb9db9ef-7c56-4aad-8cb2-7e30660f57d1. (Possible split-brain) >[2016-04-19 07:24:32.976158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1> (eb9db9ef-7c56-4aad-8cb2-7e30660f57d1) [No such file or directory] >[2016-04-19 07:24:32.976290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1> (eb9db9ef-7c56-4aad-8cb2-7e30660f57d1) [No such file or directory] >[2016-04-19 07:24:32.978922] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1> (eb9db9ef-7c56-4aad-8cb2-7e30660f57d1) [No such file or directory] >[2016-04-19 07:24:32.979223] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1> (eb9db9ef-7c56-4aad-8cb2-7e30660f57d1) [No such file or directory] >[2016-04-19 07:24:32.979426] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:eb9db9ef-7c56-4aad-8cb2-7e30660f57d1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:32.989463] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:32.990686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902> (c435e669-8f77-4e5b-aec4-339a461cc902) [No such file or directory] >[2016-04-19 07:24:32.990768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902> (c435e669-8f77-4e5b-aec4-339a461cc902) [No such file or directory] >[2016-04-19 07:24:32.993226] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c435e669-8f77-4e5b-aec4-339a461cc902. (Possible split-brain) >[2016-04-19 07:24:32.994389] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902> (c435e669-8f77-4e5b-aec4-339a461cc902) [No such file or directory] >[2016-04-19 07:24:32.994685] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902> (c435e669-8f77-4e5b-aec4-339a461cc902) [No such file or directory] >[2016-04-19 07:24:32.996112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902> (c435e669-8f77-4e5b-aec4-339a461cc902) [No such file or directory] >[2016-04-19 07:24:32.996386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902> (c435e669-8f77-4e5b-aec4-339a461cc902) [No such file or directory] >[2016-04-19 07:24:32.996538] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:32.999059] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c435e669-8f77-4e5b-aec4-339a461cc902. (Possible split-brain) >[2016-04-19 07:24:33.000245] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902> (c435e669-8f77-4e5b-aec4-339a461cc902) [No such file or directory] >[2016-04-19 07:24:33.000270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902> (c435e669-8f77-4e5b-aec4-339a461cc902) [No such file or directory] >[2016-04-19 07:24:33.002977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902> (c435e669-8f77-4e5b-aec4-339a461cc902) [No such file or directory] >[2016-04-19 07:24:33.003217] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902> (c435e669-8f77-4e5b-aec4-339a461cc902) [No such file or directory] >[2016-04-19 07:24:33.003487] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c435e669-8f77-4e5b-aec4-339a461cc902>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.012134] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.012963] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840> (603f2fd3-ca66-48c9-b3bb-048d8416a840) [No such file or directory] >[2016-04-19 07:24:33.013070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840> (603f2fd3-ca66-48c9-b3bb-048d8416a840) [No such file or directory] >[2016-04-19 07:24:33.013938] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 603f2fd3-ca66-48c9-b3bb-048d8416a840. (Possible split-brain) >[2016-04-19 07:24:33.014819] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840> (603f2fd3-ca66-48c9-b3bb-048d8416a840) [No such file or directory] >[2016-04-19 07:24:33.014894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840> (603f2fd3-ca66-48c9-b3bb-048d8416a840) [No such file or directory] >[2016-04-19 07:24:33.016179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840> (603f2fd3-ca66-48c9-b3bb-048d8416a840) [No such file or directory] >[2016-04-19 07:24:33.016585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840> (603f2fd3-ca66-48c9-b3bb-048d8416a840) [No such file or directory] >[2016-04-19 07:24:33.016717] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.019149] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 603f2fd3-ca66-48c9-b3bb-048d8416a840. (Possible split-brain) >[2016-04-19 07:24:33.019918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840> (603f2fd3-ca66-48c9-b3bb-048d8416a840) [No such file or directory] >[2016-04-19 07:24:33.020297] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840> (603f2fd3-ca66-48c9-b3bb-048d8416a840) [No such file or directory] >[2016-04-19 07:24:33.022908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840> (603f2fd3-ca66-48c9-b3bb-048d8416a840) [No such file or directory] >[2016-04-19 07:24:33.023039] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840> (603f2fd3-ca66-48c9-b3bb-048d8416a840) [No such file or directory] >[2016-04-19 07:24:33.023225] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:603f2fd3-ca66-48c9-b3bb-048d8416a840>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.030884] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.031755] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0> (ff25843b-c6dc-41df-b2cd-8844d05c7bf0) [No such file or directory] >[2016-04-19 07:24:33.031855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0> (ff25843b-c6dc-41df-b2cd-8844d05c7bf0) [No such file or directory] >[2016-04-19 07:24:33.032788] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ff25843b-c6dc-41df-b2cd-8844d05c7bf0. (Possible split-brain) >[2016-04-19 07:24:33.033556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0> (ff25843b-c6dc-41df-b2cd-8844d05c7bf0) [No such file or directory] >[2016-04-19 07:24:33.033670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0> (ff25843b-c6dc-41df-b2cd-8844d05c7bf0) [No such file or directory] >[2016-04-19 07:24:33.034949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0> (ff25843b-c6dc-41df-b2cd-8844d05c7bf0) [No such file or directory] >[2016-04-19 07:24:33.035347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0> (ff25843b-c6dc-41df-b2cd-8844d05c7bf0) [No such file or directory] >[2016-04-19 07:24:33.035645] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.038061] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ff25843b-c6dc-41df-b2cd-8844d05c7bf0. (Possible split-brain) >[2016-04-19 07:24:33.038920] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0> (ff25843b-c6dc-41df-b2cd-8844d05c7bf0) [No such file or directory] >[2016-04-19 07:24:33.039105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0> (ff25843b-c6dc-41df-b2cd-8844d05c7bf0) [No such file or directory] >[2016-04-19 07:24:33.041582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0> (ff25843b-c6dc-41df-b2cd-8844d05c7bf0) [No such file or directory] >[2016-04-19 07:24:33.041646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0> (ff25843b-c6dc-41df-b2cd-8844d05c7bf0) [No such file or directory] >[2016-04-19 07:24:33.041878] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ff25843b-c6dc-41df-b2cd-8844d05c7bf0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.050161] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.050935] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb> (861a3e8e-7acc-4393-9149-0afcc2dffefb) [No such file or directory] >[2016-04-19 07:24:33.051032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb> (861a3e8e-7acc-4393-9149-0afcc2dffefb) [No such file or directory] >[2016-04-19 07:24:33.053900] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 861a3e8e-7acc-4393-9149-0afcc2dffefb. (Possible split-brain) >[2016-04-19 07:24:33.054769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb> (861a3e8e-7acc-4393-9149-0afcc2dffefb) [No such file or directory] >[2016-04-19 07:24:33.055055] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb> (861a3e8e-7acc-4393-9149-0afcc2dffefb) [No such file or directory] >[2016-04-19 07:24:33.056405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb> (861a3e8e-7acc-4393-9149-0afcc2dffefb) [No such file or directory] >[2016-04-19 07:24:33.056442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb> (861a3e8e-7acc-4393-9149-0afcc2dffefb) [No such file or directory] >[2016-04-19 07:24:33.056630] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.059135] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 861a3e8e-7acc-4393-9149-0afcc2dffefb. (Possible split-brain) >[2016-04-19 07:24:33.059999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb> (861a3e8e-7acc-4393-9149-0afcc2dffefb) [No such file or directory] >[2016-04-19 07:24:33.060078] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb> (861a3e8e-7acc-4393-9149-0afcc2dffefb) [No such file or directory] >[2016-04-19 07:24:33.062452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb> (861a3e8e-7acc-4393-9149-0afcc2dffefb) [No such file or directory] >[2016-04-19 07:24:33.062577] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb> (861a3e8e-7acc-4393-9149-0afcc2dffefb) [No such file or directory] >[2016-04-19 07:24:33.062740] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:861a3e8e-7acc-4393-9149-0afcc2dffefb>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.071265] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.072438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7> (8cd0828b-4a20-4d2c-ab1c-050b77a05ca7) [No such file or directory] >[2016-04-19 07:24:33.072544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7> (8cd0828b-4a20-4d2c-ab1c-050b77a05ca7) [No such file or directory] >[2016-04-19 07:24:33.075082] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8cd0828b-4a20-4d2c-ab1c-050b77a05ca7. (Possible split-brain) >[2016-04-19 07:24:33.076267] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7> (8cd0828b-4a20-4d2c-ab1c-050b77a05ca7) [No such file or directory] >[2016-04-19 07:24:33.076366] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7> (8cd0828b-4a20-4d2c-ab1c-050b77a05ca7) [No such file or directory] >[2016-04-19 07:24:33.077633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7> (8cd0828b-4a20-4d2c-ab1c-050b77a05ca7) [No such file or directory] >[2016-04-19 07:24:33.077729] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7> (8cd0828b-4a20-4d2c-ab1c-050b77a05ca7) [No such file or directory] >[2016-04-19 07:24:33.077835] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.080380] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8cd0828b-4a20-4d2c-ab1c-050b77a05ca7. (Possible split-brain) >[2016-04-19 07:24:33.081686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7> (8cd0828b-4a20-4d2c-ab1c-050b77a05ca7) [No such file or directory] >[2016-04-19 07:24:33.081768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7> (8cd0828b-4a20-4d2c-ab1c-050b77a05ca7) [No such file or directory] >[2016-04-19 07:24:33.084282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7> (8cd0828b-4a20-4d2c-ab1c-050b77a05ca7) [No such file or directory] >[2016-04-19 07:24:33.084398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7> (8cd0828b-4a20-4d2c-ab1c-050b77a05ca7) [No such file or directory] >[2016-04-19 07:24:33.084555] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8cd0828b-4a20-4d2c-ab1c-050b77a05ca7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.093820] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.094897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952> (80de8db8-c88b-41fd-ae06-7cc062347952) [No such file or directory] >[2016-04-19 07:24:33.094911] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952> (80de8db8-c88b-41fd-ae06-7cc062347952) [No such file or directory] >[2016-04-19 07:24:33.095869] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 80de8db8-c88b-41fd-ae06-7cc062347952. (Possible split-brain) >[2016-04-19 07:24:33.096921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952> (80de8db8-c88b-41fd-ae06-7cc062347952) [No such file or directory] >[2016-04-19 07:24:33.097074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952> (80de8db8-c88b-41fd-ae06-7cc062347952) [No such file or directory] >[2016-04-19 07:24:33.098392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952> (80de8db8-c88b-41fd-ae06-7cc062347952) [No such file or directory] >[2016-04-19 07:24:33.098427] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952> (80de8db8-c88b-41fd-ae06-7cc062347952) [No such file or directory] >[2016-04-19 07:24:33.098605] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.101080] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 80de8db8-c88b-41fd-ae06-7cc062347952. (Possible split-brain) >[2016-04-19 07:24:33.102152] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952> (80de8db8-c88b-41fd-ae06-7cc062347952) [No such file or directory] >[2016-04-19 07:24:33.102279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952> (80de8db8-c88b-41fd-ae06-7cc062347952) [No such file or directory] >[2016-04-19 07:24:33.104969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952> (80de8db8-c88b-41fd-ae06-7cc062347952) [No such file or directory] >[2016-04-19 07:24:33.105190] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952> (80de8db8-c88b-41fd-ae06-7cc062347952) [No such file or directory] >[2016-04-19 07:24:33.105390] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:80de8db8-c88b-41fd-ae06-7cc062347952>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.114459] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.115620] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f> (05a560dd-7825-4f2e-b859-76ef0b623b0f) [No such file or directory] >[2016-04-19 07:24:33.115637] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f> (05a560dd-7825-4f2e-b859-76ef0b623b0f) [No such file or directory] >[2016-04-19 07:24:33.118179] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 05a560dd-7825-4f2e-b859-76ef0b623b0f. (Possible split-brain) >[2016-04-19 07:24:33.119184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f> (05a560dd-7825-4f2e-b859-76ef0b623b0f) [No such file or directory] >[2016-04-19 07:24:33.119376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f> (05a560dd-7825-4f2e-b859-76ef0b623b0f) [No such file or directory] >[2016-04-19 07:24:33.120563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f> (05a560dd-7825-4f2e-b859-76ef0b623b0f) [No such file or directory] >[2016-04-19 07:24:33.120627] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f> (05a560dd-7825-4f2e-b859-76ef0b623b0f) [No such file or directory] >[2016-04-19 07:24:33.120786] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.123233] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 05a560dd-7825-4f2e-b859-76ef0b623b0f. (Possible split-brain) >[2016-04-19 07:24:33.124356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f> (05a560dd-7825-4f2e-b859-76ef0b623b0f) [No such file or directory] >[2016-04-19 07:24:33.124447] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f> (05a560dd-7825-4f2e-b859-76ef0b623b0f) [No such file or directory] >[2016-04-19 07:24:33.127030] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f> (05a560dd-7825-4f2e-b859-76ef0b623b0f) [No such file or directory] >[2016-04-19 07:24:33.127141] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f> (05a560dd-7825-4f2e-b859-76ef0b623b0f) [No such file or directory] >[2016-04-19 07:24:33.127393] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:05a560dd-7825-4f2e-b859-76ef0b623b0f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.138127] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.139250] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2f80e243-346f-4352-ae09-e18745abbe10> (2f80e243-346f-4352-ae09-e18745abbe10) [No such file or directory] >[2016-04-19 07:24:33.139262] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2f80e243-346f-4352-ae09-e18745abbe10> (2f80e243-346f-4352-ae09-e18745abbe10) [No such file or directory] >[2016-04-19 07:24:33.140489] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2f80e243-346f-4352-ae09-e18745abbe10. (Possible split-brain) >[2016-04-19 07:24:33.141831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2f80e243-346f-4352-ae09-e18745abbe10> (2f80e243-346f-4352-ae09-e18745abbe10) [No such file or directory] >[2016-04-19 07:24:33.141929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2f80e243-346f-4352-ae09-e18745abbe10> (2f80e243-346f-4352-ae09-e18745abbe10) [No such file or directory] >[2016-04-19 07:24:33.143198] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2f80e243-346f-4352-ae09-e18745abbe10> (2f80e243-346f-4352-ae09-e18745abbe10) [No such file or directory] >[2016-04-19 07:24:33.143456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2f80e243-346f-4352-ae09-e18745abbe10> (2f80e243-346f-4352-ae09-e18745abbe10) [No such file or directory] >[2016-04-19 07:24:33.143583] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2f80e243-346f-4352-ae09-e18745abbe10>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.146000] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2f80e243-346f-4352-ae09-e18745abbe10. (Possible split-brain) >[2016-04-19 07:24:33.147147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2f80e243-346f-4352-ae09-e18745abbe10> (2f80e243-346f-4352-ae09-e18745abbe10) [No such file or directory] >[2016-04-19 07:24:33.147246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2f80e243-346f-4352-ae09-e18745abbe10> (2f80e243-346f-4352-ae09-e18745abbe10) [No such file or directory] >[2016-04-19 07:24:33.149651] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2f80e243-346f-4352-ae09-e18745abbe10> (2f80e243-346f-4352-ae09-e18745abbe10) [No such file or directory] >[2016-04-19 07:24:33.149693] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2f80e243-346f-4352-ae09-e18745abbe10> (2f80e243-346f-4352-ae09-e18745abbe10) [No such file or directory] >[2016-04-19 07:24:33.149892] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2f80e243-346f-4352-ae09-e18745abbe10>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.159573] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.160953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80a9041b-c800-4476-99ce-1510d02184b4> (80a9041b-c800-4476-99ce-1510d02184b4) [No such file or directory] >[2016-04-19 07:24:33.160954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80a9041b-c800-4476-99ce-1510d02184b4> (80a9041b-c800-4476-99ce-1510d02184b4) [No such file or directory] >[2016-04-19 07:24:33.163692] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 80a9041b-c800-4476-99ce-1510d02184b4. (Possible split-brain) >[2016-04-19 07:24:33.165061] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80a9041b-c800-4476-99ce-1510d02184b4> (80a9041b-c800-4476-99ce-1510d02184b4) [No such file or directory] >[2016-04-19 07:24:33.165053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80a9041b-c800-4476-99ce-1510d02184b4> (80a9041b-c800-4476-99ce-1510d02184b4) [No such file or directory] >[2016-04-19 07:24:33.166591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80a9041b-c800-4476-99ce-1510d02184b4> (80a9041b-c800-4476-99ce-1510d02184b4) [No such file or directory] >[2016-04-19 07:24:33.166712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80a9041b-c800-4476-99ce-1510d02184b4> (80a9041b-c800-4476-99ce-1510d02184b4) [No such file or directory] >[2016-04-19 07:24:33.166824] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:80a9041b-c800-4476-99ce-1510d02184b4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.169764] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 80a9041b-c800-4476-99ce-1510d02184b4. (Possible split-brain) >[2016-04-19 07:24:33.170917] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80a9041b-c800-4476-99ce-1510d02184b4> (80a9041b-c800-4476-99ce-1510d02184b4) [No such file or directory] >[2016-04-19 07:24:33.170955] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80a9041b-c800-4476-99ce-1510d02184b4> (80a9041b-c800-4476-99ce-1510d02184b4) [No such file or directory] >[2016-04-19 07:24:33.173773] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80a9041b-c800-4476-99ce-1510d02184b4> (80a9041b-c800-4476-99ce-1510d02184b4) [No such file or directory] >[2016-04-19 07:24:33.173865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80a9041b-c800-4476-99ce-1510d02184b4> (80a9041b-c800-4476-99ce-1510d02184b4) [No such file or directory] >[2016-04-19 07:24:33.174038] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:80a9041b-c800-4476-99ce-1510d02184b4>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.183399] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.184401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786> (a35196be-9ca3-46d3-a3ed-aab8acac3786) [No such file or directory] >[2016-04-19 07:24:33.184409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786> (a35196be-9ca3-46d3-a3ed-aab8acac3786) [No such file or directory] >[2016-04-19 07:24:33.187084] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a35196be-9ca3-46d3-a3ed-aab8acac3786. (Possible split-brain) >[2016-04-19 07:24:33.188204] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786> (a35196be-9ca3-46d3-a3ed-aab8acac3786) [No such file or directory] >[2016-04-19 07:24:33.188604] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786> (a35196be-9ca3-46d3-a3ed-aab8acac3786) [No such file or directory] >[2016-04-19 07:24:33.190371] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786> (a35196be-9ca3-46d3-a3ed-aab8acac3786) [No such file or directory] >[2016-04-19 07:24:33.190549] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786> (a35196be-9ca3-46d3-a3ed-aab8acac3786) [No such file or directory] >[2016-04-19 07:24:33.190693] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.193516] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a35196be-9ca3-46d3-a3ed-aab8acac3786. (Possible split-brain) >[2016-04-19 07:24:33.194640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786> (a35196be-9ca3-46d3-a3ed-aab8acac3786) [No such file or directory] >[2016-04-19 07:24:33.194873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786> (a35196be-9ca3-46d3-a3ed-aab8acac3786) [No such file or directory] >[2016-04-19 07:24:33.197680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786> (a35196be-9ca3-46d3-a3ed-aab8acac3786) [No such file or directory] >[2016-04-19 07:24:33.197914] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786> (a35196be-9ca3-46d3-a3ed-aab8acac3786) [No such file or directory] >[2016-04-19 07:24:33.198109] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a35196be-9ca3-46d3-a3ed-aab8acac3786>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.207259] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.208631] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4> (75b289a5-7497-4783-8cd4-8f052bd44ad4) [No such file or directory] >[2016-04-19 07:24:33.208729] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4> (75b289a5-7497-4783-8cd4-8f052bd44ad4) [No such file or directory] >[2016-04-19 07:24:33.209668] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 75b289a5-7497-4783-8cd4-8f052bd44ad4. (Possible split-brain) >[2016-04-19 07:24:33.210817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4> (75b289a5-7497-4783-8cd4-8f052bd44ad4) [No such file or directory] >[2016-04-19 07:24:33.210832] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4> (75b289a5-7497-4783-8cd4-8f052bd44ad4) [No such file or directory] >[2016-04-19 07:24:33.212351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4> (75b289a5-7497-4783-8cd4-8f052bd44ad4) [No such file or directory] >[2016-04-19 07:24:33.212412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4> (75b289a5-7497-4783-8cd4-8f052bd44ad4) [No such file or directory] >[2016-04-19 07:24:33.212590] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.215369] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 75b289a5-7497-4783-8cd4-8f052bd44ad4. (Possible split-brain) >[2016-04-19 07:24:33.216482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4> (75b289a5-7497-4783-8cd4-8f052bd44ad4) [No such file or directory] >[2016-04-19 07:24:33.216519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4> (75b289a5-7497-4783-8cd4-8f052bd44ad4) [No such file or directory] >[2016-04-19 07:24:33.219822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4> (75b289a5-7497-4783-8cd4-8f052bd44ad4) [No such file or directory] >[2016-04-19 07:24:33.219895] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4> (75b289a5-7497-4783-8cd4-8f052bd44ad4) [No such file or directory] >[2016-04-19 07:24:33.220162] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:75b289a5-7497-4783-8cd4-8f052bd44ad4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.229551] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.230591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff> (98392237-6aa9-4adc-b356-bf8e80bdffff) [No such file or directory] >[2016-04-19 07:24:33.230634] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff> (98392237-6aa9-4adc-b356-bf8e80bdffff) [No such file or directory] >[2016-04-19 07:24:33.231560] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 98392237-6aa9-4adc-b356-bf8e80bdffff. (Possible split-brain) >[2016-04-19 07:24:33.232542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff> (98392237-6aa9-4adc-b356-bf8e80bdffff) [No such file or directory] >[2016-04-19 07:24:33.232623] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff> (98392237-6aa9-4adc-b356-bf8e80bdffff) [No such file or directory] >[2016-04-19 07:24:33.233786] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff> (98392237-6aa9-4adc-b356-bf8e80bdffff) [No such file or directory] >[2016-04-19 07:24:33.233935] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff> (98392237-6aa9-4adc-b356-bf8e80bdffff) [No such file or directory] >[2016-04-19 07:24:33.234075] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.236572] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 98392237-6aa9-4adc-b356-bf8e80bdffff. (Possible split-brain) >[2016-04-19 07:24:33.237288] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff> (98392237-6aa9-4adc-b356-bf8e80bdffff) [No such file or directory] >[2016-04-19 07:24:33.237689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff> (98392237-6aa9-4adc-b356-bf8e80bdffff) [No such file or directory] >[2016-04-19 07:24:33.240557] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff> (98392237-6aa9-4adc-b356-bf8e80bdffff) [No such file or directory] >[2016-04-19 07:24:33.240802] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff> (98392237-6aa9-4adc-b356-bf8e80bdffff) [No such file or directory] >[2016-04-19 07:24:33.241010] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:98392237-6aa9-4adc-b356-bf8e80bdffff>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.249365] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.250199] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726> (461dc555-abac-4e0f-b0b8-1d3d83617726) [No such file or directory] >[2016-04-19 07:24:33.250226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726> (461dc555-abac-4e0f-b0b8-1d3d83617726) [No such file or directory] >[2016-04-19 07:24:33.251103] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 461dc555-abac-4e0f-b0b8-1d3d83617726. (Possible split-brain) >[2016-04-19 07:24:33.252122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726> (461dc555-abac-4e0f-b0b8-1d3d83617726) [No such file or directory] >[2016-04-19 07:24:33.252148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726> (461dc555-abac-4e0f-b0b8-1d3d83617726) [No such file or directory] >[2016-04-19 07:24:33.253500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726> (461dc555-abac-4e0f-b0b8-1d3d83617726) [No such file or directory] >[2016-04-19 07:24:33.253828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726> (461dc555-abac-4e0f-b0b8-1d3d83617726) [No such file or directory] >[2016-04-19 07:24:33.254058] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.256829] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 461dc555-abac-4e0f-b0b8-1d3d83617726. (Possible split-brain) >[2016-04-19 07:24:33.257879] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726> (461dc555-abac-4e0f-b0b8-1d3d83617726) [No such file or directory] >[2016-04-19 07:24:33.257900] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726> (461dc555-abac-4e0f-b0b8-1d3d83617726) [No such file or directory] >[2016-04-19 07:24:33.260868] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726> (461dc555-abac-4e0f-b0b8-1d3d83617726) [No such file or directory] >[2016-04-19 07:24:33.260986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726> (461dc555-abac-4e0f-b0b8-1d3d83617726) [No such file or directory] >[2016-04-19 07:24:33.261164] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:461dc555-abac-4e0f-b0b8-1d3d83617726>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.269943] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.270837] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92> (b13127e0-2882-40bd-bdc1-1e9061cc2a92) [No such file or directory] >[2016-04-19 07:24:33.270866] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92> (b13127e0-2882-40bd-bdc1-1e9061cc2a92) [No such file or directory] >[2016-04-19 07:24:33.273561] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b13127e0-2882-40bd-bdc1-1e9061cc2a92. (Possible split-brain) >[2016-04-19 07:24:33.274649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92> (b13127e0-2882-40bd-bdc1-1e9061cc2a92) [No such file or directory] >[2016-04-19 07:24:33.274788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92> (b13127e0-2882-40bd-bdc1-1e9061cc2a92) [No such file or directory] >[2016-04-19 07:24:33.276257] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92> (b13127e0-2882-40bd-bdc1-1e9061cc2a92) [No such file or directory] >[2016-04-19 07:24:33.276614] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92> (b13127e0-2882-40bd-bdc1-1e9061cc2a92) [No such file or directory] >[2016-04-19 07:24:33.276753] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.279377] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b13127e0-2882-40bd-bdc1-1e9061cc2a92. (Possible split-brain) >[2016-04-19 07:24:33.280493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92> (b13127e0-2882-40bd-bdc1-1e9061cc2a92) [No such file or directory] >[2016-04-19 07:24:33.280880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92> (b13127e0-2882-40bd-bdc1-1e9061cc2a92) [No such file or directory] >[2016-04-19 07:24:33.284241] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92> (b13127e0-2882-40bd-bdc1-1e9061cc2a92) [No such file or directory] >[2016-04-19 07:24:33.284265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92> (b13127e0-2882-40bd-bdc1-1e9061cc2a92) [No such file or directory] >[2016-04-19 07:24:33.284606] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b13127e0-2882-40bd-bdc1-1e9061cc2a92>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.294063] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.295147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef> (1655870f-a04d-4a44-90dc-334bb4d10cef) [No such file or directory] >[2016-04-19 07:24:33.295179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef> (1655870f-a04d-4a44-90dc-334bb4d10cef) [No such file or directory] >[2016-04-19 07:24:33.297953] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1655870f-a04d-4a44-90dc-334bb4d10cef. (Possible split-brain) >[2016-04-19 07:24:33.299229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef> (1655870f-a04d-4a44-90dc-334bb4d10cef) [No such file or directory] >[2016-04-19 07:24:33.299396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef> (1655870f-a04d-4a44-90dc-334bb4d10cef) [No such file or directory] >[2016-04-19 07:24:33.300796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef> (1655870f-a04d-4a44-90dc-334bb4d10cef) [No such file or directory] >[2016-04-19 07:24:33.300818] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef> (1655870f-a04d-4a44-90dc-334bb4d10cef) [No such file or directory] >[2016-04-19 07:24:33.301357] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:33.304153] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1655870f-a04d-4a44-90dc-334bb4d10cef. (Possible split-brain) >[2016-04-19 07:24:33.305271] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef> (1655870f-a04d-4a44-90dc-334bb4d10cef) [No such file or directory] >[2016-04-19 07:24:33.305301] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef> (1655870f-a04d-4a44-90dc-334bb4d10cef) [No such file or directory] >[2016-04-19 07:24:33.308749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef> (1655870f-a04d-4a44-90dc-334bb4d10cef) [No such file or directory] >[2016-04-19 07:24:33.308869] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef> (1655870f-a04d-4a44-90dc-334bb4d10cef) [No such file or directory] >[2016-04-19 07:24:33.309060] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1655870f-a04d-4a44-90dc-334bb4d10cef>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.318628] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.319702] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7> (a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7) [No such file or directory] >[2016-04-19 07:24:33.319715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7> (a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7) [No such file or directory] >[2016-04-19 07:24:33.320677] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7. (Possible split-brain) >[2016-04-19 07:24:33.321776] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7> (a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7) [No such file or directory] >[2016-04-19 07:24:33.321855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7> (a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7) [No such file or directory] >[2016-04-19 07:24:33.323236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7> (a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7) [No such file or directory] >[2016-04-19 07:24:33.323252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7> (a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7) [No such file or directory] >[2016-04-19 07:24:33.323569] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:33.326280] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7. (Possible split-brain) >[2016-04-19 07:24:33.327639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7> (a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7) [No such file or directory] >[2016-04-19 07:24:33.327653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7> (a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7) [No such file or directory] >[2016-04-19 07:24:33.330420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7> (a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7) [No such file or directory] >[2016-04-19 07:24:33.330451] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7> (a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7) [No such file or directory] >[2016-04-19 07:24:33.330629] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a169c1f0-9c1b-4cbf-97e1-b4755dcb6aa7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.339393] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.340053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6> (1a732646-9a89-49c9-b5ad-57c8d84e93a6) [No such file or directory] >[2016-04-19 07:24:33.340364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6> (1a732646-9a89-49c9-b5ad-57c8d84e93a6) [No such file or directory] >[2016-04-19 07:24:33.340935] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1a732646-9a89-49c9-b5ad-57c8d84e93a6. (Possible split-brain) >[2016-04-19 07:24:33.341518] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6> (1a732646-9a89-49c9-b5ad-57c8d84e93a6) [No such file or directory] >[2016-04-19 07:24:33.341656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6> (1a732646-9a89-49c9-b5ad-57c8d84e93a6) [No such file or directory] >[2016-04-19 07:24:33.342995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6> (1a732646-9a89-49c9-b5ad-57c8d84e93a6) [No such file or directory] >[2016-04-19 07:24:33.343585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6> (1a732646-9a89-49c9-b5ad-57c8d84e93a6) [No such file or directory] >[2016-04-19 07:24:33.343697] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.346285] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1a732646-9a89-49c9-b5ad-57c8d84e93a6. (Possible split-brain) >[2016-04-19 07:24:33.347192] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6> (1a732646-9a89-49c9-b5ad-57c8d84e93a6) [No such file or directory] >[2016-04-19 07:24:33.347381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6> (1a732646-9a89-49c9-b5ad-57c8d84e93a6) [No such file or directory] >[2016-04-19 07:24:33.350676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6> (1a732646-9a89-49c9-b5ad-57c8d84e93a6) [No such file or directory] >[2016-04-19 07:24:33.350746] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6> (1a732646-9a89-49c9-b5ad-57c8d84e93a6) [No such file or directory] >[2016-04-19 07:24:33.350898] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1a732646-9a89-49c9-b5ad-57c8d84e93a6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.360876] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.362115] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8eeee94-621a-4767-a375-512bea8a9056> (b8eeee94-621a-4767-a375-512bea8a9056) [No such file or directory] >[2016-04-19 07:24:33.362129] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8eeee94-621a-4767-a375-512bea8a9056> (b8eeee94-621a-4767-a375-512bea8a9056) [No such file or directory] >[2016-04-19 07:24:33.365002] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b8eeee94-621a-4767-a375-512bea8a9056. (Possible split-brain) >[2016-04-19 07:24:33.365933] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8eeee94-621a-4767-a375-512bea8a9056> (b8eeee94-621a-4767-a375-512bea8a9056) [No such file or directory] >[2016-04-19 07:24:33.365960] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8eeee94-621a-4767-a375-512bea8a9056> (b8eeee94-621a-4767-a375-512bea8a9056) [No such file or directory] >[2016-04-19 07:24:33.367077] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8eeee94-621a-4767-a375-512bea8a9056> (b8eeee94-621a-4767-a375-512bea8a9056) [No such file or directory] >[2016-04-19 07:24:33.367237] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8eeee94-621a-4767-a375-512bea8a9056> (b8eeee94-621a-4767-a375-512bea8a9056) [No such file or directory] >[2016-04-19 07:24:33.367716] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b8eeee94-621a-4767-a375-512bea8a9056>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:33.370509] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b8eeee94-621a-4767-a375-512bea8a9056. (Possible split-brain) >[2016-04-19 07:24:33.371692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8eeee94-621a-4767-a375-512bea8a9056> (b8eeee94-621a-4767-a375-512bea8a9056) [No such file or directory] >[2016-04-19 07:24:33.371699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8eeee94-621a-4767-a375-512bea8a9056> (b8eeee94-621a-4767-a375-512bea8a9056) [No such file or directory] >[2016-04-19 07:24:33.374782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8eeee94-621a-4767-a375-512bea8a9056> (b8eeee94-621a-4767-a375-512bea8a9056) [No such file or directory] >[2016-04-19 07:24:33.374816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8eeee94-621a-4767-a375-512bea8a9056> (b8eeee94-621a-4767-a375-512bea8a9056) [No such file or directory] >[2016-04-19 07:24:33.374988] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b8eeee94-621a-4767-a375-512bea8a9056>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.383648] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.384583] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6> (f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6) [No such file or directory] >[2016-04-19 07:24:33.384700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6> (f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6) [No such file or directory] >[2016-04-19 07:24:33.385835] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6. (Possible split-brain) >[2016-04-19 07:24:33.386921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6> (f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6) [No such file or directory] >[2016-04-19 07:24:33.386926] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6> (f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6) [No such file or directory] >[2016-04-19 07:24:33.388844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6> (f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6) [No such file or directory] >[2016-04-19 07:24:33.388954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6> (f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6) [No such file or directory] >[2016-04-19 07:24:33.389137] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.391941] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6. (Possible split-brain) >[2016-04-19 07:24:33.393021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6> (f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6) [No such file or directory] >[2016-04-19 07:24:33.393045] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6> (f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6) [No such file or directory] >[2016-04-19 07:24:33.395872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6> (f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6) [No such file or directory] >[2016-04-19 07:24:33.396037] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6> (f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6) [No such file or directory] >[2016-04-19 07:24:33.396345] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f9ba317c-e70a-47f0-a273-cf3d7a8ba0b6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.405621] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.406698] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9> (ecd9c97b-3950-4f73-be65-dadd21dd69e9) [No such file or directory] >[2016-04-19 07:24:33.406709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9> (ecd9c97b-3950-4f73-be65-dadd21dd69e9) [No such file or directory] >[2016-04-19 07:24:33.407936] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ecd9c97b-3950-4f73-be65-dadd21dd69e9. (Possible split-brain) >[2016-04-19 07:24:33.409032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9> (ecd9c97b-3950-4f73-be65-dadd21dd69e9) [No such file or directory] >[2016-04-19 07:24:33.409290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9> (ecd9c97b-3950-4f73-be65-dadd21dd69e9) [No such file or directory] >[2016-04-19 07:24:33.410573] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9> (ecd9c97b-3950-4f73-be65-dadd21dd69e9) [No such file or directory] >[2016-04-19 07:24:33.410859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9> (ecd9c97b-3950-4f73-be65-dadd21dd69e9) [No such file or directory] >[2016-04-19 07:24:33.411027] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.413585] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ecd9c97b-3950-4f73-be65-dadd21dd69e9. (Possible split-brain) >[2016-04-19 07:24:33.414625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9> (ecd9c97b-3950-4f73-be65-dadd21dd69e9) [No such file or directory] >[2016-04-19 07:24:33.414924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9> (ecd9c97b-3950-4f73-be65-dadd21dd69e9) [No such file or directory] >[2016-04-19 07:24:33.418279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9> (ecd9c97b-3950-4f73-be65-dadd21dd69e9) [No such file or directory] >[2016-04-19 07:24:33.418664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9> (ecd9c97b-3950-4f73-be65-dadd21dd69e9) [No such file or directory] >[2016-04-19 07:24:33.418856] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ecd9c97b-3950-4f73-be65-dadd21dd69e9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.427897] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.428975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28> (52dda49b-ae74-4075-ac7f-529d3c909e28) [No such file or directory] >[2016-04-19 07:24:33.429075] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28> (52dda49b-ae74-4075-ac7f-529d3c909e28) [No such file or directory] >[2016-04-19 07:24:33.430288] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 52dda49b-ae74-4075-ac7f-529d3c909e28. (Possible split-brain) >[2016-04-19 07:24:33.431526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28> (52dda49b-ae74-4075-ac7f-529d3c909e28) [No such file or directory] >[2016-04-19 07:24:33.431624] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28> (52dda49b-ae74-4075-ac7f-529d3c909e28) [No such file or directory] >[2016-04-19 07:24:33.432707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28> (52dda49b-ae74-4075-ac7f-529d3c909e28) [No such file or directory] >[2016-04-19 07:24:33.432982] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28> (52dda49b-ae74-4075-ac7f-529d3c909e28) [No such file or directory] >[2016-04-19 07:24:33.433164] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.435907] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 52dda49b-ae74-4075-ac7f-529d3c909e28. (Possible split-brain) >[2016-04-19 07:24:33.436985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28> (52dda49b-ae74-4075-ac7f-529d3c909e28) [No such file or directory] >[2016-04-19 07:24:33.437139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28> (52dda49b-ae74-4075-ac7f-529d3c909e28) [No such file or directory] >[2016-04-19 07:24:33.439605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28> (52dda49b-ae74-4075-ac7f-529d3c909e28) [No such file or directory] >[2016-04-19 07:24:33.439721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28> (52dda49b-ae74-4075-ac7f-529d3c909e28) [No such file or directory] >[2016-04-19 07:24:33.439849] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:52dda49b-ae74-4075-ac7f-529d3c909e28>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.448369] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.449254] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6> (08a90713-caa4-4d7a-bb12-c5b5412260f6) [No such file or directory] >[2016-04-19 07:24:33.449509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6> (08a90713-caa4-4d7a-bb12-c5b5412260f6) [No such file or directory] >[2016-04-19 07:24:33.450429] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 08a90713-caa4-4d7a-bb12-c5b5412260f6. (Possible split-brain) >[2016-04-19 07:24:33.451279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6> (08a90713-caa4-4d7a-bb12-c5b5412260f6) [No such file or directory] >[2016-04-19 07:24:33.451428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6> (08a90713-caa4-4d7a-bb12-c5b5412260f6) [No such file or directory] >[2016-04-19 07:24:33.453007] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6> (08a90713-caa4-4d7a-bb12-c5b5412260f6) [No such file or directory] >[2016-04-19 07:24:33.453378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6> (08a90713-caa4-4d7a-bb12-c5b5412260f6) [No such file or directory] >[2016-04-19 07:24:33.453634] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.456222] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 08a90713-caa4-4d7a-bb12-c5b5412260f6. (Possible split-brain) >[2016-04-19 07:24:33.457060] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6> (08a90713-caa4-4d7a-bb12-c5b5412260f6) [No such file or directory] >[2016-04-19 07:24:33.457363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6> (08a90713-caa4-4d7a-bb12-c5b5412260f6) [No such file or directory] >[2016-04-19 07:24:33.460624] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6> (08a90713-caa4-4d7a-bb12-c5b5412260f6) [No such file or directory] >[2016-04-19 07:24:33.460936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6> (08a90713-caa4-4d7a-bb12-c5b5412260f6) [No such file or directory] >[2016-04-19 07:24:33.461130] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:08a90713-caa4-4d7a-bb12-c5b5412260f6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.469084] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.470065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08> (6a9071bb-2f5f-4d33-b543-26923abd6b08) [No such file or directory] >[2016-04-19 07:24:33.470176] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08> (6a9071bb-2f5f-4d33-b543-26923abd6b08) [No such file or directory] >[2016-04-19 07:24:33.473084] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6a9071bb-2f5f-4d33-b543-26923abd6b08. (Possible split-brain) >[2016-04-19 07:24:33.474169] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08> (6a9071bb-2f5f-4d33-b543-26923abd6b08) [No such file or directory] >[2016-04-19 07:24:33.474715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08> (6a9071bb-2f5f-4d33-b543-26923abd6b08) [No such file or directory] >[2016-04-19 07:24:33.476123] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08> (6a9071bb-2f5f-4d33-b543-26923abd6b08) [No such file or directory] >[2016-04-19 07:24:33.476396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08> (6a9071bb-2f5f-4d33-b543-26923abd6b08) [No such file or directory] >[2016-04-19 07:24:33.476611] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.479398] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6a9071bb-2f5f-4d33-b543-26923abd6b08. (Possible split-brain) >[2016-04-19 07:24:33.480429] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08> (6a9071bb-2f5f-4d33-b543-26923abd6b08) [No such file or directory] >[2016-04-19 07:24:33.480451] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08> (6a9071bb-2f5f-4d33-b543-26923abd6b08) [No such file or directory] >[2016-04-19 07:24:33.483442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08> (6a9071bb-2f5f-4d33-b543-26923abd6b08) [No such file or directory] >[2016-04-19 07:24:33.483841] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08> (6a9071bb-2f5f-4d33-b543-26923abd6b08) [No such file or directory] >[2016-04-19 07:24:33.484055] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6a9071bb-2f5f-4d33-b543-26923abd6b08>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.493664] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.494738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9> (e0bda9ae-270d-4369-a850-04ee6f52c0f9) [No such file or directory] >[2016-04-19 07:24:33.494764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9> (e0bda9ae-270d-4369-a850-04ee6f52c0f9) [No such file or directory] >[2016-04-19 07:24:33.495870] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e0bda9ae-270d-4369-a850-04ee6f52c0f9. (Possible split-brain) >[2016-04-19 07:24:33.496926] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9> (e0bda9ae-270d-4369-a850-04ee6f52c0f9) [No such file or directory] >[2016-04-19 07:24:33.497344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9> (e0bda9ae-270d-4369-a850-04ee6f52c0f9) [No such file or directory] >[2016-04-19 07:24:33.498800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9> (e0bda9ae-270d-4369-a850-04ee6f52c0f9) [No such file or directory] >[2016-04-19 07:24:33.498899] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9> (e0bda9ae-270d-4369-a850-04ee6f52c0f9) [No such file or directory] >[2016-04-19 07:24:33.499022] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.501764] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e0bda9ae-270d-4369-a850-04ee6f52c0f9. (Possible split-brain) >[2016-04-19 07:24:33.502562] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9> (e0bda9ae-270d-4369-a850-04ee6f52c0f9) [No such file or directory] >[2016-04-19 07:24:33.502895] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9> (e0bda9ae-270d-4369-a850-04ee6f52c0f9) [No such file or directory] >[2016-04-19 07:24:33.505573] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9> (e0bda9ae-270d-4369-a850-04ee6f52c0f9) [No such file or directory] >[2016-04-19 07:24:33.505844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9> (e0bda9ae-270d-4369-a850-04ee6f52c0f9) [No such file or directory] >[2016-04-19 07:24:33.506019] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e0bda9ae-270d-4369-a850-04ee6f52c0f9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.514409] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.515178] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6d68669a-7a86-419f-8181-2014e12834b4> (6d68669a-7a86-419f-8181-2014e12834b4) [No such file or directory] >[2016-04-19 07:24:33.515521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6d68669a-7a86-419f-8181-2014e12834b4> (6d68669a-7a86-419f-8181-2014e12834b4) [No such file or directory] >[2016-04-19 07:24:33.516426] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6d68669a-7a86-419f-8181-2014e12834b4. (Possible split-brain) >[2016-04-19 07:24:33.517125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6d68669a-7a86-419f-8181-2014e12834b4> (6d68669a-7a86-419f-8181-2014e12834b4) [No such file or directory] >[2016-04-19 07:24:33.517391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6d68669a-7a86-419f-8181-2014e12834b4> (6d68669a-7a86-419f-8181-2014e12834b4) [No such file or directory] >[2016-04-19 07:24:33.518808] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6d68669a-7a86-419f-8181-2014e12834b4> (6d68669a-7a86-419f-8181-2014e12834b4) [No such file or directory] >[2016-04-19 07:24:33.519546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6d68669a-7a86-419f-8181-2014e12834b4> (6d68669a-7a86-419f-8181-2014e12834b4) [No such file or directory] >[2016-04-19 07:24:33.519696] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6d68669a-7a86-419f-8181-2014e12834b4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.522222] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6d68669a-7a86-419f-8181-2014e12834b4. (Possible split-brain) >[2016-04-19 07:24:33.522993] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6d68669a-7a86-419f-8181-2014e12834b4> (6d68669a-7a86-419f-8181-2014e12834b4) [No such file or directory] >[2016-04-19 07:24:33.523371] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6d68669a-7a86-419f-8181-2014e12834b4> (6d68669a-7a86-419f-8181-2014e12834b4) [No such file or directory] >[2016-04-19 07:24:33.526673] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6d68669a-7a86-419f-8181-2014e12834b4> (6d68669a-7a86-419f-8181-2014e12834b4) [No such file or directory] >[2016-04-19 07:24:33.526745] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6d68669a-7a86-419f-8181-2014e12834b4> (6d68669a-7a86-419f-8181-2014e12834b4) [No such file or directory] >[2016-04-19 07:24:33.526919] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6d68669a-7a86-419f-8181-2014e12834b4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.536154] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.537197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38> (ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38) [No such file or directory] >[2016-04-19 07:24:33.537218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38> (ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38) [No such file or directory] >[2016-04-19 07:24:33.538444] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38. (Possible split-brain) >[2016-04-19 07:24:33.539589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38> (ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38) [No such file or directory] >[2016-04-19 07:24:33.539918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38> (ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38) [No such file or directory] >[2016-04-19 07:24:33.541339] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38> (ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38) [No such file or directory] >[2016-04-19 07:24:33.541594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38> (ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38) [No such file or directory] >[2016-04-19 07:24:33.541777] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.544493] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38. (Possible split-brain) >[2016-04-19 07:24:33.545624] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38> (ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38) [No such file or directory] >[2016-04-19 07:24:33.546112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38> (ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38) [No such file or directory] >[2016-04-19 07:24:33.548925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38> (ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38) [No such file or directory] >[2016-04-19 07:24:33.549395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38> (ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38) [No such file or directory] >[2016-04-19 07:24:33.549586] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ed7c6e6a-2b9d-40f7-bf2e-90b283ab4c38>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.558008] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.559020] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1> (86c84301-290d-4718-a22d-a7a2950d97a1) [No such file or directory] >[2016-04-19 07:24:33.559036] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1> (86c84301-290d-4718-a22d-a7a2950d97a1) [No such file or directory] >[2016-04-19 07:24:33.560266] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 86c84301-290d-4718-a22d-a7a2950d97a1. (Possible split-brain) >[2016-04-19 07:24:33.561501] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1> (86c84301-290d-4718-a22d-a7a2950d97a1) [No such file or directory] >[2016-04-19 07:24:33.561516] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1> (86c84301-290d-4718-a22d-a7a2950d97a1) [No such file or directory] >[2016-04-19 07:24:33.563117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1> (86c84301-290d-4718-a22d-a7a2950d97a1) [No such file or directory] >[2016-04-19 07:24:33.563605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1> (86c84301-290d-4718-a22d-a7a2950d97a1) [No such file or directory] >[2016-04-19 07:24:33.563773] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.566303] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 86c84301-290d-4718-a22d-a7a2950d97a1. (Possible split-brain) >[2016-04-19 07:24:33.567255] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1> (86c84301-290d-4718-a22d-a7a2950d97a1) [No such file or directory] >[2016-04-19 07:24:33.567579] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1> (86c84301-290d-4718-a22d-a7a2950d97a1) [No such file or directory] >[2016-04-19 07:24:33.571007] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1> (86c84301-290d-4718-a22d-a7a2950d97a1) [No such file or directory] >[2016-04-19 07:24:33.571122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1> (86c84301-290d-4718-a22d-a7a2950d97a1) [No such file or directory] >[2016-04-19 07:24:33.571354] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:86c84301-290d-4718-a22d-a7a2950d97a1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.580355] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.581178] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f> (a2e0cf98-bfd9-43f1-a4dd-8e86732f512f) [No such file or directory] >[2016-04-19 07:24:33.581517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f> (a2e0cf98-bfd9-43f1-a4dd-8e86732f512f) [No such file or directory] >[2016-04-19 07:24:33.582644] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a2e0cf98-bfd9-43f1-a4dd-8e86732f512f. (Possible split-brain) >[2016-04-19 07:24:33.583848] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f> (a2e0cf98-bfd9-43f1-a4dd-8e86732f512f) [No such file or directory] >[2016-04-19 07:24:33.584306] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f> (a2e0cf98-bfd9-43f1-a4dd-8e86732f512f) [No such file or directory] >[2016-04-19 07:24:33.585751] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f> (a2e0cf98-bfd9-43f1-a4dd-8e86732f512f) [No such file or directory] >[2016-04-19 07:24:33.585816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f> (a2e0cf98-bfd9-43f1-a4dd-8e86732f512f) [No such file or directory] >[2016-04-19 07:24:33.585980] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.588750] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a2e0cf98-bfd9-43f1-a4dd-8e86732f512f. (Possible split-brain) >[2016-04-19 07:24:33.589822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f> (a2e0cf98-bfd9-43f1-a4dd-8e86732f512f) [No such file or directory] >[2016-04-19 07:24:33.589951] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f> (a2e0cf98-bfd9-43f1-a4dd-8e86732f512f) [No such file or directory] >[2016-04-19 07:24:33.592807] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f> (a2e0cf98-bfd9-43f1-a4dd-8e86732f512f) [No such file or directory] >[2016-04-19 07:24:33.592921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f> (a2e0cf98-bfd9-43f1-a4dd-8e86732f512f) [No such file or directory] >[2016-04-19 07:24:33.593049] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a2e0cf98-bfd9-43f1-a4dd-8e86732f512f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.601955] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.603077] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e> (7f42567d-4a5e-43a3-a43c-f5eb46503a5e) [No such file or directory] >[2016-04-19 07:24:33.603179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e> (7f42567d-4a5e-43a3-a43c-f5eb46503a5e) [No such file or directory] >[2016-04-19 07:24:33.604387] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7f42567d-4a5e-43a3-a43c-f5eb46503a5e. (Possible split-brain) >[2016-04-19 07:24:33.605509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e> (7f42567d-4a5e-43a3-a43c-f5eb46503a5e) [No such file or directory] >[2016-04-19 07:24:33.605615] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e> (7f42567d-4a5e-43a3-a43c-f5eb46503a5e) [No such file or directory] >[2016-04-19 07:24:33.606887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e> (7f42567d-4a5e-43a3-a43c-f5eb46503a5e) [No such file or directory] >[2016-04-19 07:24:33.606900] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e> (7f42567d-4a5e-43a3-a43c-f5eb46503a5e) [No such file or directory] >[2016-04-19 07:24:33.607150] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.609675] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7f42567d-4a5e-43a3-a43c-f5eb46503a5e. (Possible split-brain) >[2016-04-19 07:24:33.610719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e> (7f42567d-4a5e-43a3-a43c-f5eb46503a5e) [No such file or directory] >[2016-04-19 07:24:33.611000] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e> (7f42567d-4a5e-43a3-a43c-f5eb46503a5e) [No such file or directory] >[2016-04-19 07:24:33.614018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e> (7f42567d-4a5e-43a3-a43c-f5eb46503a5e) [No such file or directory] >[2016-04-19 07:24:33.614463] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e> (7f42567d-4a5e-43a3-a43c-f5eb46503a5e) [No such file or directory] >[2016-04-19 07:24:33.614676] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7f42567d-4a5e-43a3-a43c-f5eb46503a5e>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.624639] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.625747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475> (4fbd3a05-d8f7-4336-8147-aefc23675475) [No such file or directory] >[2016-04-19 07:24:33.625747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475> (4fbd3a05-d8f7-4336-8147-aefc23675475) [No such file or directory] >[2016-04-19 07:24:33.628691] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4fbd3a05-d8f7-4336-8147-aefc23675475. (Possible split-brain) >[2016-04-19 07:24:33.629806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475> (4fbd3a05-d8f7-4336-8147-aefc23675475) [No such file or directory] >[2016-04-19 07:24:33.629904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475> (4fbd3a05-d8f7-4336-8147-aefc23675475) [No such file or directory] >[2016-04-19 07:24:33.631133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475> (4fbd3a05-d8f7-4336-8147-aefc23675475) [No such file or directory] >[2016-04-19 07:24:33.631234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475> (4fbd3a05-d8f7-4336-8147-aefc23675475) [No such file or directory] >[2016-04-19 07:24:33.631387] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.634164] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4fbd3a05-d8f7-4336-8147-aefc23675475. (Possible split-brain) >[2016-04-19 07:24:33.635366] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475> (4fbd3a05-d8f7-4336-8147-aefc23675475) [No such file or directory] >[2016-04-19 07:24:33.635472] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475> (4fbd3a05-d8f7-4336-8147-aefc23675475) [No such file or directory] >[2016-04-19 07:24:33.638609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475> (4fbd3a05-d8f7-4336-8147-aefc23675475) [No such file or directory] >[2016-04-19 07:24:33.638708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475> (4fbd3a05-d8f7-4336-8147-aefc23675475) [No such file or directory] >[2016-04-19 07:24:33.638891] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4fbd3a05-d8f7-4336-8147-aefc23675475>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.647668] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.648785] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:80833a25-0387-479d-8b5e-6702edbce257> (80833a25-0387-479d-8b5e-6702edbce257) [No such file or directory] >[2016-04-19 07:24:33.648812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:80833a25-0387-479d-8b5e-6702edbce257> (80833a25-0387-479d-8b5e-6702edbce257) [No such file or directory] >[2016-04-19 07:24:33.651691] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 80833a25-0387-479d-8b5e-6702edbce257. (Possible split-brain) >[2016-04-19 07:24:33.652642] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:80833a25-0387-479d-8b5e-6702edbce257> (80833a25-0387-479d-8b5e-6702edbce257) [No such file or directory] >[2016-04-19 07:24:33.653089] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:80833a25-0387-479d-8b5e-6702edbce257> (80833a25-0387-479d-8b5e-6702edbce257) [No such file or directory] >[2016-04-19 07:24:33.654494] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:80833a25-0387-479d-8b5e-6702edbce257> (80833a25-0387-479d-8b5e-6702edbce257) [No such file or directory] >[2016-04-19 07:24:33.654760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:80833a25-0387-479d-8b5e-6702edbce257> (80833a25-0387-479d-8b5e-6702edbce257) [No such file or directory] >[2016-04-19 07:24:33.654932] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:80833a25-0387-479d-8b5e-6702edbce257>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.657740] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 80833a25-0387-479d-8b5e-6702edbce257. (Possible split-brain) >[2016-04-19 07:24:33.658773] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:80833a25-0387-479d-8b5e-6702edbce257> (80833a25-0387-479d-8b5e-6702edbce257) [No such file or directory] >[2016-04-19 07:24:33.658895] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:80833a25-0387-479d-8b5e-6702edbce257> (80833a25-0387-479d-8b5e-6702edbce257) [No such file or directory] >[2016-04-19 07:24:33.662301] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:80833a25-0387-479d-8b5e-6702edbce257> (80833a25-0387-479d-8b5e-6702edbce257) [No such file or directory] >[2016-04-19 07:24:33.662439] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:80833a25-0387-479d-8b5e-6702edbce257> (80833a25-0387-479d-8b5e-6702edbce257) [No such file or directory] >[2016-04-19 07:24:33.662584] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:80833a25-0387-479d-8b5e-6702edbce257>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.673259] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.674511] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b> (a42c5d3d-e87b-4eab-9947-ba37ee35034b) [No such file or directory] >[2016-04-19 07:24:33.674617] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b> (a42c5d3d-e87b-4eab-9947-ba37ee35034b) [No such file or directory] >[2016-04-19 07:24:33.675756] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a42c5d3d-e87b-4eab-9947-ba37ee35034b. (Possible split-brain) >[2016-04-19 07:24:33.676818] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b> (a42c5d3d-e87b-4eab-9947-ba37ee35034b) [No such file or directory] >[2016-04-19 07:24:33.676827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b> (a42c5d3d-e87b-4eab-9947-ba37ee35034b) [No such file or directory] >[2016-04-19 07:24:33.678172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b> (a42c5d3d-e87b-4eab-9947-ba37ee35034b) [No such file or directory] >[2016-04-19 07:24:33.678363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b> (a42c5d3d-e87b-4eab-9947-ba37ee35034b) [No such file or directory] >[2016-04-19 07:24:33.678542] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.681240] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a42c5d3d-e87b-4eab-9947-ba37ee35034b. (Possible split-brain) >[2016-04-19 07:24:33.682304] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b> (a42c5d3d-e87b-4eab-9947-ba37ee35034b) [No such file or directory] >[2016-04-19 07:24:33.682353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b> (a42c5d3d-e87b-4eab-9947-ba37ee35034b) [No such file or directory] >[2016-04-19 07:24:33.684924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b> (a42c5d3d-e87b-4eab-9947-ba37ee35034b) [No such file or directory] >[2016-04-19 07:24:33.685018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b> (a42c5d3d-e87b-4eab-9947-ba37ee35034b) [No such file or directory] >[2016-04-19 07:24:33.685400] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a42c5d3d-e87b-4eab-9947-ba37ee35034b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.692837] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.693681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:457b2599-fd13-489e-bd13-ac20a7168433> (457b2599-fd13-489e-bd13-ac20a7168433) [No such file or directory] >[2016-04-19 07:24:33.693969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:457b2599-fd13-489e-bd13-ac20a7168433> (457b2599-fd13-489e-bd13-ac20a7168433) [No such file or directory] >[2016-04-19 07:24:33.696793] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 457b2599-fd13-489e-bd13-ac20a7168433. (Possible split-brain) >[2016-04-19 07:24:33.697598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:457b2599-fd13-489e-bd13-ac20a7168433> (457b2599-fd13-489e-bd13-ac20a7168433) [No such file or directory] >[2016-04-19 07:24:33.697891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:457b2599-fd13-489e-bd13-ac20a7168433> (457b2599-fd13-489e-bd13-ac20a7168433) [No such file or directory] >[2016-04-19 07:24:33.699079] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:457b2599-fd13-489e-bd13-ac20a7168433> (457b2599-fd13-489e-bd13-ac20a7168433) [No such file or directory] >[2016-04-19 07:24:33.699528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:457b2599-fd13-489e-bd13-ac20a7168433> (457b2599-fd13-489e-bd13-ac20a7168433) [No such file or directory] >[2016-04-19 07:24:33.699669] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:457b2599-fd13-489e-bd13-ac20a7168433>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.702231] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 457b2599-fd13-489e-bd13-ac20a7168433. (Possible split-brain) >[2016-04-19 07:24:33.703046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:457b2599-fd13-489e-bd13-ac20a7168433> (457b2599-fd13-489e-bd13-ac20a7168433) [No such file or directory] >[2016-04-19 07:24:33.703393] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:457b2599-fd13-489e-bd13-ac20a7168433> (457b2599-fd13-489e-bd13-ac20a7168433) [No such file or directory] >[2016-04-19 07:24:33.706503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:457b2599-fd13-489e-bd13-ac20a7168433> (457b2599-fd13-489e-bd13-ac20a7168433) [No such file or directory] >[2016-04-19 07:24:33.706548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:457b2599-fd13-489e-bd13-ac20a7168433> (457b2599-fd13-489e-bd13-ac20a7168433) [No such file or directory] >[2016-04-19 07:24:33.706768] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:457b2599-fd13-489e-bd13-ac20a7168433>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.716035] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.716941] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5> (07b9a973-f069-4cbe-bc47-adc6c5b38bc5) [No such file or directory] >[2016-04-19 07:24:33.717017] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5> (07b9a973-f069-4cbe-bc47-adc6c5b38bc5) [No such file or directory] >[2016-04-19 07:24:33.718134] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 07b9a973-f069-4cbe-bc47-adc6c5b38bc5. (Possible split-brain) >[2016-04-19 07:24:33.719234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5> (07b9a973-f069-4cbe-bc47-adc6c5b38bc5) [No such file or directory] >[2016-04-19 07:24:33.719351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5> (07b9a973-f069-4cbe-bc47-adc6c5b38bc5) [No such file or directory] >[2016-04-19 07:24:33.720700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5> (07b9a973-f069-4cbe-bc47-adc6c5b38bc5) [No such file or directory] >[2016-04-19 07:24:33.720728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5> (07b9a973-f069-4cbe-bc47-adc6c5b38bc5) [No such file or directory] >[2016-04-19 07:24:33.720883] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:33.723452] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 07b9a973-f069-4cbe-bc47-adc6c5b38bc5. (Possible split-brain) >[2016-04-19 07:24:33.724548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5> (07b9a973-f069-4cbe-bc47-adc6c5b38bc5) [No such file or directory] >[2016-04-19 07:24:33.724657] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5> (07b9a973-f069-4cbe-bc47-adc6c5b38bc5) [No such file or directory] >[2016-04-19 07:24:33.727742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5> (07b9a973-f069-4cbe-bc47-adc6c5b38bc5) [No such file or directory] >[2016-04-19 07:24:33.727752] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5> (07b9a973-f069-4cbe-bc47-adc6c5b38bc5) [No such file or directory] >[2016-04-19 07:24:33.728237] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:07b9a973-f069-4cbe-bc47-adc6c5b38bc5>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.735671] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.736454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e> (7b5ef759-b4db-468f-9a08-69cd756c567e) [No such file or directory] >[2016-04-19 07:24:33.736721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e> (7b5ef759-b4db-468f-9a08-69cd756c567e) [No such file or directory] >[2016-04-19 07:24:33.739362] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7b5ef759-b4db-468f-9a08-69cd756c567e. (Possible split-brain) >[2016-04-19 07:24:33.740175] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e> (7b5ef759-b4db-468f-9a08-69cd756c567e) [No such file or directory] >[2016-04-19 07:24:33.740508] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e> (7b5ef759-b4db-468f-9a08-69cd756c567e) [No such file or directory] >[2016-04-19 07:24:33.741857] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e> (7b5ef759-b4db-468f-9a08-69cd756c567e) [No such file or directory] >[2016-04-19 07:24:33.742179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e> (7b5ef759-b4db-468f-9a08-69cd756c567e) [No such file or directory] >[2016-04-19 07:24:33.742381] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.745090] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7b5ef759-b4db-468f-9a08-69cd756c567e. (Possible split-brain) >[2016-04-19 07:24:33.745841] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e> (7b5ef759-b4db-468f-9a08-69cd756c567e) [No such file or directory] >[2016-04-19 07:24:33.746156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e> (7b5ef759-b4db-468f-9a08-69cd756c567e) [No such file or directory] >[2016-04-19 07:24:33.749223] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e> (7b5ef759-b4db-468f-9a08-69cd756c567e) [No such file or directory] >[2016-04-19 07:24:33.749476] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e> (7b5ef759-b4db-468f-9a08-69cd756c567e) [No such file or directory] >[2016-04-19 07:24:33.749643] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7b5ef759-b4db-468f-9a08-69cd756c567e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.758722] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.759728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f> (869a10cd-1e8d-4f7e-9bfd-b2098f66a54f) [No such file or directory] >[2016-04-19 07:24:33.760118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f> (869a10cd-1e8d-4f7e-9bfd-b2098f66a54f) [No such file or directory] >[2016-04-19 07:24:33.762963] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 869a10cd-1e8d-4f7e-9bfd-b2098f66a54f. (Possible split-brain) >[2016-04-19 07:24:33.763892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f> (869a10cd-1e8d-4f7e-9bfd-b2098f66a54f) [No such file or directory] >[2016-04-19 07:24:33.764289] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f> (869a10cd-1e8d-4f7e-9bfd-b2098f66a54f) [No such file or directory] >[2016-04-19 07:24:33.765542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f> (869a10cd-1e8d-4f7e-9bfd-b2098f66a54f) [No such file or directory] >[2016-04-19 07:24:33.765673] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f> (869a10cd-1e8d-4f7e-9bfd-b2098f66a54f) [No such file or directory] >[2016-04-19 07:24:33.765787] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.768532] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 869a10cd-1e8d-4f7e-9bfd-b2098f66a54f. (Possible split-brain) >[2016-04-19 07:24:33.769719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f> (869a10cd-1e8d-4f7e-9bfd-b2098f66a54f) [No such file or directory] >[2016-04-19 07:24:33.769819] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f> (869a10cd-1e8d-4f7e-9bfd-b2098f66a54f) [No such file or directory] >[2016-04-19 07:24:33.772790] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f> (869a10cd-1e8d-4f7e-9bfd-b2098f66a54f) [No such file or directory] >[2016-04-19 07:24:33.772895] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f> (869a10cd-1e8d-4f7e-9bfd-b2098f66a54f) [No such file or directory] >[2016-04-19 07:24:33.773109] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:869a10cd-1e8d-4f7e-9bfd-b2098f66a54f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.782403] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.783446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f> (ca4a30a0-0c88-40e8-9b27-5b80277d997f) [No such file or directory] >[2016-04-19 07:24:33.783653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f> (ca4a30a0-0c88-40e8-9b27-5b80277d997f) [No such file or directory] >[2016-04-19 07:24:33.784794] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ca4a30a0-0c88-40e8-9b27-5b80277d997f. (Possible split-brain) >[2016-04-19 07:24:33.785905] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f> (ca4a30a0-0c88-40e8-9b27-5b80277d997f) [No such file or directory] >[2016-04-19 07:24:33.786005] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f> (ca4a30a0-0c88-40e8-9b27-5b80277d997f) [No such file or directory] >[2016-04-19 07:24:33.787182] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f> (ca4a30a0-0c88-40e8-9b27-5b80277d997f) [No such file or directory] >[2016-04-19 07:24:33.787413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f> (ca4a30a0-0c88-40e8-9b27-5b80277d997f) [No such file or directory] >[2016-04-19 07:24:33.787697] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:33.790200] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ca4a30a0-0c88-40e8-9b27-5b80277d997f. (Possible split-brain) >[2016-04-19 07:24:33.791225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f> (ca4a30a0-0c88-40e8-9b27-5b80277d997f) [No such file or directory] >[2016-04-19 07:24:33.791243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f> (ca4a30a0-0c88-40e8-9b27-5b80277d997f) [No such file or directory] >[2016-04-19 07:24:33.793725] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f> (ca4a30a0-0c88-40e8-9b27-5b80277d997f) [No such file or directory] >[2016-04-19 07:24:33.793740] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f> (ca4a30a0-0c88-40e8-9b27-5b80277d997f) [No such file or directory] >[2016-04-19 07:24:33.794008] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ca4a30a0-0c88-40e8-9b27-5b80277d997f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.801769] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.802578] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498> (06e30362-ca69-45a1-b9b5-5d180b792498) [No such file or directory] >[2016-04-19 07:24:33.802783] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498> (06e30362-ca69-45a1-b9b5-5d180b792498) [No such file or directory] >[2016-04-19 07:24:33.803902] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 06e30362-ca69-45a1-b9b5-5d180b792498. (Possible split-brain) >[2016-04-19 07:24:33.804647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498> (06e30362-ca69-45a1-b9b5-5d180b792498) [No such file or directory] >[2016-04-19 07:24:33.804871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498> (06e30362-ca69-45a1-b9b5-5d180b792498) [No such file or directory] >[2016-04-19 07:24:33.806381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498> (06e30362-ca69-45a1-b9b5-5d180b792498) [No such file or directory] >[2016-04-19 07:24:33.806755] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498> (06e30362-ca69-45a1-b9b5-5d180b792498) [No such file or directory] >[2016-04-19 07:24:33.806992] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.809598] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 06e30362-ca69-45a1-b9b5-5d180b792498. (Possible split-brain) >[2016-04-19 07:24:33.810604] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498> (06e30362-ca69-45a1-b9b5-5d180b792498) [No such file or directory] >[2016-04-19 07:24:33.810709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498> (06e30362-ca69-45a1-b9b5-5d180b792498) [No such file or directory] >[2016-04-19 07:24:33.813532] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498> (06e30362-ca69-45a1-b9b5-5d180b792498) [No such file or directory] >[2016-04-19 07:24:33.813628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498> (06e30362-ca69-45a1-b9b5-5d180b792498) [No such file or directory] >[2016-04-19 07:24:33.813857] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:06e30362-ca69-45a1-b9b5-5d180b792498>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.821194] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.822110] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7911e069-2754-43b9-814b-f85a75572a5c> (7911e069-2754-43b9-814b-f85a75572a5c) [No such file or directory] >[2016-04-19 07:24:33.822189] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7911e069-2754-43b9-814b-f85a75572a5c> (7911e069-2754-43b9-814b-f85a75572a5c) [No such file or directory] >[2016-04-19 07:24:33.823078] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7911e069-2754-43b9-814b-f85a75572a5c. (Possible split-brain) >[2016-04-19 07:24:33.823959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7911e069-2754-43b9-814b-f85a75572a5c> (7911e069-2754-43b9-814b-f85a75572a5c) [No such file or directory] >[2016-04-19 07:24:33.824553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7911e069-2754-43b9-814b-f85a75572a5c> (7911e069-2754-43b9-814b-f85a75572a5c) [No such file or directory] >[2016-04-19 07:24:33.826008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7911e069-2754-43b9-814b-f85a75572a5c> (7911e069-2754-43b9-814b-f85a75572a5c) [No such file or directory] >[2016-04-19 07:24:33.826029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7911e069-2754-43b9-814b-f85a75572a5c> (7911e069-2754-43b9-814b-f85a75572a5c) [No such file or directory] >[2016-04-19 07:24:33.826248] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7911e069-2754-43b9-814b-f85a75572a5c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.828692] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7911e069-2754-43b9-814b-f85a75572a5c. (Possible split-brain) >[2016-04-19 07:24:33.829558] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7911e069-2754-43b9-814b-f85a75572a5c> (7911e069-2754-43b9-814b-f85a75572a5c) [No such file or directory] >[2016-04-19 07:24:33.829666] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7911e069-2754-43b9-814b-f85a75572a5c> (7911e069-2754-43b9-814b-f85a75572a5c) [No such file or directory] >[2016-04-19 07:24:33.833244] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7911e069-2754-43b9-814b-f85a75572a5c> (7911e069-2754-43b9-814b-f85a75572a5c) [No such file or directory] >[2016-04-19 07:24:33.833278] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7911e069-2754-43b9-814b-f85a75572a5c> (7911e069-2754-43b9-814b-f85a75572a5c) [No such file or directory] >[2016-04-19 07:24:33.833551] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7911e069-2754-43b9-814b-f85a75572a5c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.847099] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.847936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4> (ae2b6972-cfd7-49a3-9bb2-df54497f3bd4) [No such file or directory] >[2016-04-19 07:24:33.848218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4> (ae2b6972-cfd7-49a3-9bb2-df54497f3bd4) [No such file or directory] >[2016-04-19 07:24:33.851048] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ae2b6972-cfd7-49a3-9bb2-df54497f3bd4. (Possible split-brain) >[2016-04-19 07:24:33.852110] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4> (ae2b6972-cfd7-49a3-9bb2-df54497f3bd4) [No such file or directory] >[2016-04-19 07:24:33.852117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4> (ae2b6972-cfd7-49a3-9bb2-df54497f3bd4) [No such file or directory] >[2016-04-19 07:24:33.853485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4> (ae2b6972-cfd7-49a3-9bb2-df54497f3bd4) [No such file or directory] >[2016-04-19 07:24:33.853957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4> (ae2b6972-cfd7-49a3-9bb2-df54497f3bd4) [No such file or directory] >[2016-04-19 07:24:33.854151] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.856916] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ae2b6972-cfd7-49a3-9bb2-df54497f3bd4. (Possible split-brain) >[2016-04-19 07:24:33.857957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4> (ae2b6972-cfd7-49a3-9bb2-df54497f3bd4) [No such file or directory] >[2016-04-19 07:24:33.858047] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4> (ae2b6972-cfd7-49a3-9bb2-df54497f3bd4) [No such file or directory] >[2016-04-19 07:24:33.861206] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4> (ae2b6972-cfd7-49a3-9bb2-df54497f3bd4) [No such file or directory] >[2016-04-19 07:24:33.861670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4> (ae2b6972-cfd7-49a3-9bb2-df54497f3bd4) [No such file or directory] >[2016-04-19 07:24:33.865436] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ae2b6972-cfd7-49a3-9bb2-df54497f3bd4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.874394] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.875625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37> (17797e53-1cab-4086-a258-5f529f4c2e37) [No such file or directory] >[2016-04-19 07:24:33.875738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37> (17797e53-1cab-4086-a258-5f529f4c2e37) [No such file or directory] >[2016-04-19 07:24:33.879161] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 17797e53-1cab-4086-a258-5f529f4c2e37. (Possible split-brain) >[2016-04-19 07:24:33.880268] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37> (17797e53-1cab-4086-a258-5f529f4c2e37) [No such file or directory] >[2016-04-19 07:24:33.880395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37> (17797e53-1cab-4086-a258-5f529f4c2e37) [No such file or directory] >[2016-04-19 07:24:33.882070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37> (17797e53-1cab-4086-a258-5f529f4c2e37) [No such file or directory] >[2016-04-19 07:24:33.882341] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37> (17797e53-1cab-4086-a258-5f529f4c2e37) [No such file or directory] >[2016-04-19 07:24:33.883473] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:33.886404] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 17797e53-1cab-4086-a258-5f529f4c2e37. (Possible split-brain) >[2016-04-19 07:24:33.887414] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37> (17797e53-1cab-4086-a258-5f529f4c2e37) [No such file or directory] >[2016-04-19 07:24:33.887557] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37> (17797e53-1cab-4086-a258-5f529f4c2e37) [No such file or directory] >[2016-04-19 07:24:33.890283] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37> (17797e53-1cab-4086-a258-5f529f4c2e37) [No such file or directory] >[2016-04-19 07:24:33.890343] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37> (17797e53-1cab-4086-a258-5f529f4c2e37) [No such file or directory] >[2016-04-19 07:24:33.890579] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:17797e53-1cab-4086-a258-5f529f4c2e37>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.898860] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.899754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a> (445fae4f-7d9c-4e06-add3-ed7816d06f0a) [No such file or directory] >[2016-04-19 07:24:33.899991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a> (445fae4f-7d9c-4e06-add3-ed7816d06f0a) [No such file or directory] >[2016-04-19 07:24:33.900895] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 445fae4f-7d9c-4e06-add3-ed7816d06f0a. (Possible split-brain) >[2016-04-19 07:24:33.901755] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a> (445fae4f-7d9c-4e06-add3-ed7816d06f0a) [No such file or directory] >[2016-04-19 07:24:33.901956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a> (445fae4f-7d9c-4e06-add3-ed7816d06f0a) [No such file or directory] >[2016-04-19 07:24:33.902964] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a> (445fae4f-7d9c-4e06-add3-ed7816d06f0a) [No such file or directory] >[2016-04-19 07:24:33.903065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a> (445fae4f-7d9c-4e06-add3-ed7816d06f0a) [No such file or directory] >[2016-04-19 07:24:33.903756] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:33.906473] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 445fae4f-7d9c-4e06-add3-ed7816d06f0a. (Possible split-brain) >[2016-04-19 07:24:33.907382] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a> (445fae4f-7d9c-4e06-add3-ed7816d06f0a) [No such file or directory] >[2016-04-19 07:24:33.907841] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a> (445fae4f-7d9c-4e06-add3-ed7816d06f0a) [No such file or directory] >[2016-04-19 07:24:33.910536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a> (445fae4f-7d9c-4e06-add3-ed7816d06f0a) [No such file or directory] >[2016-04-19 07:24:33.910903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a> (445fae4f-7d9c-4e06-add3-ed7816d06f0a) [No such file or directory] >[2016-04-19 07:24:33.911027] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:445fae4f-7d9c-4e06-add3-ed7816d06f0a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.919001] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.919729] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:08424d12-f57f-4629-a646-9db22af2412d> (08424d12-f57f-4629-a646-9db22af2412d) [No such file or directory] >[2016-04-19 07:24:33.919954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:08424d12-f57f-4629-a646-9db22af2412d> (08424d12-f57f-4629-a646-9db22af2412d) [No such file or directory] >[2016-04-19 07:24:33.922599] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 08424d12-f57f-4629-a646-9db22af2412d. (Possible split-brain) >[2016-04-19 07:24:33.923452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:08424d12-f57f-4629-a646-9db22af2412d> (08424d12-f57f-4629-a646-9db22af2412d) [No such file or directory] >[2016-04-19 07:24:33.923639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:08424d12-f57f-4629-a646-9db22af2412d> (08424d12-f57f-4629-a646-9db22af2412d) [No such file or directory] >[2016-04-19 07:24:33.924751] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:08424d12-f57f-4629-a646-9db22af2412d> (08424d12-f57f-4629-a646-9db22af2412d) [No such file or directory] >[2016-04-19 07:24:33.924989] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:08424d12-f57f-4629-a646-9db22af2412d> (08424d12-f57f-4629-a646-9db22af2412d) [No such file or directory] >[2016-04-19 07:24:33.925118] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:08424d12-f57f-4629-a646-9db22af2412d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.927929] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 08424d12-f57f-4629-a646-9db22af2412d. (Possible split-brain) >[2016-04-19 07:24:33.928730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:08424d12-f57f-4629-a646-9db22af2412d> (08424d12-f57f-4629-a646-9db22af2412d) [No such file or directory] >[2016-04-19 07:24:33.929006] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:08424d12-f57f-4629-a646-9db22af2412d> (08424d12-f57f-4629-a646-9db22af2412d) [No such file or directory] >[2016-04-19 07:24:33.933514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:08424d12-f57f-4629-a646-9db22af2412d> (08424d12-f57f-4629-a646-9db22af2412d) [No such file or directory] >[2016-04-19 07:24:33.933599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:08424d12-f57f-4629-a646-9db22af2412d> (08424d12-f57f-4629-a646-9db22af2412d) [No such file or directory] >[2016-04-19 07:24:33.933909] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:08424d12-f57f-4629-a646-9db22af2412d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.942664] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.943574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44f4205d-f9c9-429f-a868-385913f5978f> (44f4205d-f9c9-429f-a868-385913f5978f) [No such file or directory] >[2016-04-19 07:24:33.943652] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44f4205d-f9c9-429f-a868-385913f5978f> (44f4205d-f9c9-429f-a868-385913f5978f) [No such file or directory] >[2016-04-19 07:24:33.944604] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 44f4205d-f9c9-429f-a868-385913f5978f. (Possible split-brain) >[2016-04-19 07:24:33.945539] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44f4205d-f9c9-429f-a868-385913f5978f> (44f4205d-f9c9-429f-a868-385913f5978f) [No such file or directory] >[2016-04-19 07:24:33.945761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44f4205d-f9c9-429f-a868-385913f5978f> (44f4205d-f9c9-429f-a868-385913f5978f) [No such file or directory] >[2016-04-19 07:24:33.947091] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44f4205d-f9c9-429f-a868-385913f5978f> (44f4205d-f9c9-429f-a868-385913f5978f) [No such file or directory] >[2016-04-19 07:24:33.947270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44f4205d-f9c9-429f-a868-385913f5978f> (44f4205d-f9c9-429f-a868-385913f5978f) [No such file or directory] >[2016-04-19 07:24:33.947547] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:44f4205d-f9c9-429f-a868-385913f5978f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.950488] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 44f4205d-f9c9-429f-a868-385913f5978f. (Possible split-brain) >[2016-04-19 07:24:33.951531] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44f4205d-f9c9-429f-a868-385913f5978f> (44f4205d-f9c9-429f-a868-385913f5978f) [No such file or directory] >[2016-04-19 07:24:33.951559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44f4205d-f9c9-429f-a868-385913f5978f> (44f4205d-f9c9-429f-a868-385913f5978f) [No such file or directory] >[2016-04-19 07:24:33.955278] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44f4205d-f9c9-429f-a868-385913f5978f> (44f4205d-f9c9-429f-a868-385913f5978f) [No such file or directory] >[2016-04-19 07:24:33.955698] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44f4205d-f9c9-429f-a868-385913f5978f> (44f4205d-f9c9-429f-a868-385913f5978f) [No such file or directory] >[2016-04-19 07:24:33.956150] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:44f4205d-f9c9-429f-a868-385913f5978f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:33.964127] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.964927] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96664575-1324-4fc6-8593-3aa38b89a502> (96664575-1324-4fc6-8593-3aa38b89a502) [No such file or directory] >[2016-04-19 07:24:33.965118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96664575-1324-4fc6-8593-3aa38b89a502> (96664575-1324-4fc6-8593-3aa38b89a502) [No such file or directory] >[2016-04-19 07:24:33.966002] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 96664575-1324-4fc6-8593-3aa38b89a502. (Possible split-brain) >[2016-04-19 07:24:33.966936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96664575-1324-4fc6-8593-3aa38b89a502> (96664575-1324-4fc6-8593-3aa38b89a502) [No such file or directory] >[2016-04-19 07:24:33.967064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96664575-1324-4fc6-8593-3aa38b89a502> (96664575-1324-4fc6-8593-3aa38b89a502) [No such file or directory] >[2016-04-19 07:24:33.968415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96664575-1324-4fc6-8593-3aa38b89a502> (96664575-1324-4fc6-8593-3aa38b89a502) [No such file or directory] >[2016-04-19 07:24:33.968600] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96664575-1324-4fc6-8593-3aa38b89a502> (96664575-1324-4fc6-8593-3aa38b89a502) [No such file or directory] >[2016-04-19 07:24:33.968867] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:96664575-1324-4fc6-8593-3aa38b89a502>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:33.971545] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 96664575-1324-4fc6-8593-3aa38b89a502. (Possible split-brain) >[2016-04-19 07:24:33.972292] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96664575-1324-4fc6-8593-3aa38b89a502> (96664575-1324-4fc6-8593-3aa38b89a502) [No such file or directory] >[2016-04-19 07:24:33.972694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96664575-1324-4fc6-8593-3aa38b89a502> (96664575-1324-4fc6-8593-3aa38b89a502) [No such file or directory] >[2016-04-19 07:24:33.975641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96664575-1324-4fc6-8593-3aa38b89a502> (96664575-1324-4fc6-8593-3aa38b89a502) [No such file or directory] >[2016-04-19 07:24:33.975739] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96664575-1324-4fc6-8593-3aa38b89a502> (96664575-1324-4fc6-8593-3aa38b89a502) [No such file or directory] >[2016-04-19 07:24:33.975855] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:96664575-1324-4fc6-8593-3aa38b89a502>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:33.984395] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:33.985387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd> (d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd) [No such file or directory] >[2016-04-19 07:24:33.985388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd> (d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd) [No such file or directory] >[2016-04-19 07:24:33.988115] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd. (Possible split-brain) >[2016-04-19 07:24:33.989238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd> (d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd) [No such file or directory] >[2016-04-19 07:24:33.989253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd> (d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd) [No such file or directory] >[2016-04-19 07:24:33.990413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd> (d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd) [No such file or directory] >[2016-04-19 07:24:33.990521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd> (d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd) [No such file or directory] >[2016-04-19 07:24:33.991001] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:33.993777] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd. (Possible split-brain) >[2016-04-19 07:24:33.994771] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd> (d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd) [No such file or directory] >[2016-04-19 07:24:33.994935] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd> (d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd) [No such file or directory] >[2016-04-19 07:24:33.998821] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd> (d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd) [No such file or directory] >[2016-04-19 07:24:33.998953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd> (d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd) [No such file or directory] >[2016-04-19 07:24:33.999746] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d2ce979c-b3c3-46b7-ae0b-b5fec891ddfd>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.007147] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.007929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe> (138045f0-2e9d-447d-9d82-7d2a29286dbe) [No such file or directory] >[2016-04-19 07:24:34.008285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe> (138045f0-2e9d-447d-9d82-7d2a29286dbe) [No such file or directory] >[2016-04-19 07:24:34.010980] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 138045f0-2e9d-447d-9d82-7d2a29286dbe. (Possible split-brain) >[2016-04-19 07:24:34.011967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe> (138045f0-2e9d-447d-9d82-7d2a29286dbe) [No such file or directory] >[2016-04-19 07:24:34.012041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe> (138045f0-2e9d-447d-9d82-7d2a29286dbe) [No such file or directory] >[2016-04-19 07:24:34.013419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe> (138045f0-2e9d-447d-9d82-7d2a29286dbe) [No such file or directory] >[2016-04-19 07:24:34.013563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe> (138045f0-2e9d-447d-9d82-7d2a29286dbe) [No such file or directory] >[2016-04-19 07:24:34.013949] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.016639] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 138045f0-2e9d-447d-9d82-7d2a29286dbe. (Possible split-brain) >[2016-04-19 07:24:34.017470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe> (138045f0-2e9d-447d-9d82-7d2a29286dbe) [No such file or directory] >[2016-04-19 07:24:34.017582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe> (138045f0-2e9d-447d-9d82-7d2a29286dbe) [No such file or directory] >[2016-04-19 07:24:34.022099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe> (138045f0-2e9d-447d-9d82-7d2a29286dbe) [No such file or directory] >[2016-04-19 07:24:34.022131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe> (138045f0-2e9d-447d-9d82-7d2a29286dbe) [No such file or directory] >[2016-04-19 07:24:34.022417] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:138045f0-2e9d-447d-9d82-7d2a29286dbe>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.031338] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.032071] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066> (f257f961-5422-4c71-a1e2-50e8402fe066) [No such file or directory] >[2016-04-19 07:24:34.032419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066> (f257f961-5422-4c71-a1e2-50e8402fe066) [No such file or directory] >[2016-04-19 07:24:34.033526] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f257f961-5422-4c71-a1e2-50e8402fe066. (Possible split-brain) >[2016-04-19 07:24:34.034253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066> (f257f961-5422-4c71-a1e2-50e8402fe066) [No such file or directory] >[2016-04-19 07:24:34.034601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066> (f257f961-5422-4c71-a1e2-50e8402fe066) [No such file or directory] >[2016-04-19 07:24:34.035861] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066> (f257f961-5422-4c71-a1e2-50e8402fe066) [No such file or directory] >[2016-04-19 07:24:34.036051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066> (f257f961-5422-4c71-a1e2-50e8402fe066) [No such file or directory] >[2016-04-19 07:24:34.036350] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.039212] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f257f961-5422-4c71-a1e2-50e8402fe066. (Possible split-brain) >[2016-04-19 07:24:34.040101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066> (f257f961-5422-4c71-a1e2-50e8402fe066) [No such file or directory] >[2016-04-19 07:24:34.040368] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066> (f257f961-5422-4c71-a1e2-50e8402fe066) [No such file or directory] >[2016-04-19 07:24:34.043657] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066> (f257f961-5422-4c71-a1e2-50e8402fe066) [No such file or directory] >[2016-04-19 07:24:34.044012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066> (f257f961-5422-4c71-a1e2-50e8402fe066) [No such file or directory] >[2016-04-19 07:24:34.044140] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f257f961-5422-4c71-a1e2-50e8402fe066>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.052669] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.053780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846> (e3f9dbae-f5f9-4213-ac8a-a9051749b846) [No such file or directory] >[2016-04-19 07:24:34.053782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846> (e3f9dbae-f5f9-4213-ac8a-a9051749b846) [No such file or directory] >[2016-04-19 07:24:34.056706] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e3f9dbae-f5f9-4213-ac8a-a9051749b846. (Possible split-brain) >[2016-04-19 07:24:34.057708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846> (e3f9dbae-f5f9-4213-ac8a-a9051749b846) [No such file or directory] >[2016-04-19 07:24:34.057894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846> (e3f9dbae-f5f9-4213-ac8a-a9051749b846) [No such file or directory] >[2016-04-19 07:24:34.059172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846> (e3f9dbae-f5f9-4213-ac8a-a9051749b846) [No such file or directory] >[2016-04-19 07:24:34.059189] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846> (e3f9dbae-f5f9-4213-ac8a-a9051749b846) [No such file or directory] >[2016-04-19 07:24:34.059506] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.062186] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e3f9dbae-f5f9-4213-ac8a-a9051749b846. (Possible split-brain) >[2016-04-19 07:24:34.063310] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846> (e3f9dbae-f5f9-4213-ac8a-a9051749b846) [No such file or directory] >[2016-04-19 07:24:34.063429] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846> (e3f9dbae-f5f9-4213-ac8a-a9051749b846) [No such file or directory] >[2016-04-19 07:24:34.067519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846> (e3f9dbae-f5f9-4213-ac8a-a9051749b846) [No such file or directory] >[2016-04-19 07:24:34.067549] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846> (e3f9dbae-f5f9-4213-ac8a-a9051749b846) [No such file or directory] >[2016-04-19 07:24:34.067957] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e3f9dbae-f5f9-4213-ac8a-a9051749b846>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.076568] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.077418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6> (27e3f906-f29b-44f7-9b66-83f99ed284c6) [No such file or directory] >[2016-04-19 07:24:34.077535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6> (27e3f906-f29b-44f7-9b66-83f99ed284c6) [No such file or directory] >[2016-04-19 07:24:34.078393] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 27e3f906-f29b-44f7-9b66-83f99ed284c6. (Possible split-brain) >[2016-04-19 07:24:34.079122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6> (27e3f906-f29b-44f7-9b66-83f99ed284c6) [No such file or directory] >[2016-04-19 07:24:34.079454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6> (27e3f906-f29b-44f7-9b66-83f99ed284c6) [No such file or directory] >[2016-04-19 07:24:34.080724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6> (27e3f906-f29b-44f7-9b66-83f99ed284c6) [No such file or directory] >[2016-04-19 07:24:34.080843] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6> (27e3f906-f29b-44f7-9b66-83f99ed284c6) [No such file or directory] >[2016-04-19 07:24:34.081295] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.083956] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 27e3f906-f29b-44f7-9b66-83f99ed284c6. (Possible split-brain) >[2016-04-19 07:24:34.084837] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6> (27e3f906-f29b-44f7-9b66-83f99ed284c6) [No such file or directory] >[2016-04-19 07:24:34.084948] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6> (27e3f906-f29b-44f7-9b66-83f99ed284c6) [No such file or directory] >[2016-04-19 07:24:34.089728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6> (27e3f906-f29b-44f7-9b66-83f99ed284c6) [No such file or directory] >[2016-04-19 07:24:34.089817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6> (27e3f906-f29b-44f7-9b66-83f99ed284c6) [No such file or directory] >[2016-04-19 07:24:34.089944] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:27e3f906-f29b-44f7-9b66-83f99ed284c6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.097469] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.098302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49> (3c834c76-a288-4b7d-b129-205b1fc1af49) [No such file or directory] >[2016-04-19 07:24:34.098534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49> (3c834c76-a288-4b7d-b129-205b1fc1af49) [No such file or directory] >[2016-04-19 07:24:34.101169] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3c834c76-a288-4b7d-b129-205b1fc1af49. (Possible split-brain) >[2016-04-19 07:24:34.102164] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49> (3c834c76-a288-4b7d-b129-205b1fc1af49) [No such file or directory] >[2016-04-19 07:24:34.102192] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49> (3c834c76-a288-4b7d-b129-205b1fc1af49) [No such file or directory] >[2016-04-19 07:24:34.103521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49> (3c834c76-a288-4b7d-b129-205b1fc1af49) [No such file or directory] >[2016-04-19 07:24:34.103555] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49> (3c834c76-a288-4b7d-b129-205b1fc1af49) [No such file or directory] >[2016-04-19 07:24:34.103775] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.107052] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3c834c76-a288-4b7d-b129-205b1fc1af49. (Possible split-brain) >[2016-04-19 07:24:34.108186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49> (3c834c76-a288-4b7d-b129-205b1fc1af49) [No such file or directory] >[2016-04-19 07:24:34.108308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49> (3c834c76-a288-4b7d-b129-205b1fc1af49) [No such file or directory] >[2016-04-19 07:24:34.112466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49> (3c834c76-a288-4b7d-b129-205b1fc1af49) [No such file or directory] >[2016-04-19 07:24:34.112471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49> (3c834c76-a288-4b7d-b129-205b1fc1af49) [No such file or directory] >[2016-04-19 07:24:34.112873] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3c834c76-a288-4b7d-b129-205b1fc1af49>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.122285] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.123303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a> (b8957458-e393-4e51-9ea4-0370b3c3687a) [No such file or directory] >[2016-04-19 07:24:34.123360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a> (b8957458-e393-4e51-9ea4-0370b3c3687a) [No such file or directory] >[2016-04-19 07:24:34.126093] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b8957458-e393-4e51-9ea4-0370b3c3687a. (Possible split-brain) >[2016-04-19 07:24:34.127398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a> (b8957458-e393-4e51-9ea4-0370b3c3687a) [No such file or directory] >[2016-04-19 07:24:34.127420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a> (b8957458-e393-4e51-9ea4-0370b3c3687a) [No such file or directory] >[2016-04-19 07:24:34.128704] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a> (b8957458-e393-4e51-9ea4-0370b3c3687a) [No such file or directory] >[2016-04-19 07:24:34.128733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a> (b8957458-e393-4e51-9ea4-0370b3c3687a) [No such file or directory] >[2016-04-19 07:24:34.129158] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.131923] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b8957458-e393-4e51-9ea4-0370b3c3687a. (Possible split-brain) >[2016-04-19 07:24:34.133158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a> (b8957458-e393-4e51-9ea4-0370b3c3687a) [No such file or directory] >[2016-04-19 07:24:34.133252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a> (b8957458-e393-4e51-9ea4-0370b3c3687a) [No such file or directory] >[2016-04-19 07:24:34.137267] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a> (b8957458-e393-4e51-9ea4-0370b3c3687a) [No such file or directory] >[2016-04-19 07:24:34.137423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a> (b8957458-e393-4e51-9ea4-0370b3c3687a) [No such file or directory] >[2016-04-19 07:24:34.138200] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b8957458-e393-4e51-9ea4-0370b3c3687a>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.146573] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.147603] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7> (6b88bca4-6fb1-48d9-a45c-d84d33710bf7) [No such file or directory] >[2016-04-19 07:24:34.147618] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7> (6b88bca4-6fb1-48d9-a45c-d84d33710bf7) [No such file or directory] >[2016-04-19 07:24:34.148868] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6b88bca4-6fb1-48d9-a45c-d84d33710bf7. (Possible split-brain) >[2016-04-19 07:24:34.150080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7> (6b88bca4-6fb1-48d9-a45c-d84d33710bf7) [No such file or directory] >[2016-04-19 07:24:34.150221] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7> (6b88bca4-6fb1-48d9-a45c-d84d33710bf7) [No such file or directory] >[2016-04-19 07:24:34.151525] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7> (6b88bca4-6fb1-48d9-a45c-d84d33710bf7) [No such file or directory] >[2016-04-19 07:24:34.151729] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7> (6b88bca4-6fb1-48d9-a45c-d84d33710bf7) [No such file or directory] >[2016-04-19 07:24:34.152001] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.154544] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6b88bca4-6fb1-48d9-a45c-d84d33710bf7. (Possible split-brain) >[2016-04-19 07:24:34.155668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7> (6b88bca4-6fb1-48d9-a45c-d84d33710bf7) [No such file or directory] >[2016-04-19 07:24:34.155781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7> (6b88bca4-6fb1-48d9-a45c-d84d33710bf7) [No such file or directory] >[2016-04-19 07:24:34.158168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7> (6b88bca4-6fb1-48d9-a45c-d84d33710bf7) [No such file or directory] >[2016-04-19 07:24:34.158394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7> (6b88bca4-6fb1-48d9-a45c-d84d33710bf7) [No such file or directory] >[2016-04-19 07:24:34.158839] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6b88bca4-6fb1-48d9-a45c-d84d33710bf7>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.168881] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.170028] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4> (3f9de52d-7f67-4206-883b-fcc02d4a6fb4) [No such file or directory] >[2016-04-19 07:24:34.170234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4> (3f9de52d-7f67-4206-883b-fcc02d4a6fb4) [No such file or directory] >[2016-04-19 07:24:34.171461] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3f9de52d-7f67-4206-883b-fcc02d4a6fb4. (Possible split-brain) >[2016-04-19 07:24:34.172734] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4> (3f9de52d-7f67-4206-883b-fcc02d4a6fb4) [No such file or directory] >[2016-04-19 07:24:34.172736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4> (3f9de52d-7f67-4206-883b-fcc02d4a6fb4) [No such file or directory] >[2016-04-19 07:24:34.174197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4> (3f9de52d-7f67-4206-883b-fcc02d4a6fb4) [No such file or directory] >[2016-04-19 07:24:34.174581] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4> (3f9de52d-7f67-4206-883b-fcc02d4a6fb4) [No such file or directory] >[2016-04-19 07:24:34.174874] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.177371] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3f9de52d-7f67-4206-883b-fcc02d4a6fb4. (Possible split-brain) >[2016-04-19 07:24:34.178468] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4> (3f9de52d-7f67-4206-883b-fcc02d4a6fb4) [No such file or directory] >[2016-04-19 07:24:34.178590] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4> (3f9de52d-7f67-4206-883b-fcc02d4a6fb4) [No such file or directory] >[2016-04-19 07:24:34.181937] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4> (3f9de52d-7f67-4206-883b-fcc02d4a6fb4) [No such file or directory] >[2016-04-19 07:24:34.181981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4> (3f9de52d-7f67-4206-883b-fcc02d4a6fb4) [No such file or directory] >[2016-04-19 07:24:34.182694] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3f9de52d-7f67-4206-883b-fcc02d4a6fb4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.190831] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.191869] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7> (e22126a7-1773-488a-a89c-9c3e4dc487c7) [No such file or directory] >[2016-04-19 07:24:34.191995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7> (e22126a7-1773-488a-a89c-9c3e4dc487c7) [No such file or directory] >[2016-04-19 07:24:34.194933] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e22126a7-1773-488a-a89c-9c3e4dc487c7. (Possible split-brain) >[2016-04-19 07:24:34.196045] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7> (e22126a7-1773-488a-a89c-9c3e4dc487c7) [No such file or directory] >[2016-04-19 07:24:34.196163] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7> (e22126a7-1773-488a-a89c-9c3e4dc487c7) [No such file or directory] >[2016-04-19 07:24:34.197879] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7> (e22126a7-1773-488a-a89c-9c3e4dc487c7) [No such file or directory] >[2016-04-19 07:24:34.197913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7> (e22126a7-1773-488a-a89c-9c3e4dc487c7) [No such file or directory] >[2016-04-19 07:24:34.198120] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.200993] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e22126a7-1773-488a-a89c-9c3e4dc487c7. (Possible split-brain) >[2016-04-19 07:24:34.202022] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7> (e22126a7-1773-488a-a89c-9c3e4dc487c7) [No such file or directory] >[2016-04-19 07:24:34.202026] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7> (e22126a7-1773-488a-a89c-9c3e4dc487c7) [No such file or directory] >[2016-04-19 07:24:34.205163] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7> (e22126a7-1773-488a-a89c-9c3e4dc487c7) [No such file or directory] >[2016-04-19 07:24:34.205290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7> (e22126a7-1773-488a-a89c-9c3e4dc487c7) [No such file or directory] >[2016-04-19 07:24:34.205472] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e22126a7-1773-488a-a89c-9c3e4dc487c7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.214952] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.215870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f> (4014fe30-8e07-4ffd-ac77-9575c1f5d08f) [No such file or directory] >[2016-04-19 07:24:34.216312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f> (4014fe30-8e07-4ffd-ac77-9575c1f5d08f) [No such file or directory] >[2016-04-19 07:24:34.217476] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4014fe30-8e07-4ffd-ac77-9575c1f5d08f. (Possible split-brain) >[2016-04-19 07:24:34.218487] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f> (4014fe30-8e07-4ffd-ac77-9575c1f5d08f) [No such file or directory] >[2016-04-19 07:24:34.218640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f> (4014fe30-8e07-4ffd-ac77-9575c1f5d08f) [No such file or directory] >[2016-04-19 07:24:34.220040] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f> (4014fe30-8e07-4ffd-ac77-9575c1f5d08f) [No such file or directory] >[2016-04-19 07:24:34.220065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f> (4014fe30-8e07-4ffd-ac77-9575c1f5d08f) [No such file or directory] >[2016-04-19 07:24:34.220220] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.222684] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4014fe30-8e07-4ffd-ac77-9575c1f5d08f. (Possible split-brain) >[2016-04-19 07:24:34.223725] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f> (4014fe30-8e07-4ffd-ac77-9575c1f5d08f) [No such file or directory] >[2016-04-19 07:24:34.223859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f> (4014fe30-8e07-4ffd-ac77-9575c1f5d08f) [No such file or directory] >[2016-04-19 07:24:34.227043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f> (4014fe30-8e07-4ffd-ac77-9575c1f5d08f) [No such file or directory] >[2016-04-19 07:24:34.227138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f> (4014fe30-8e07-4ffd-ac77-9575c1f5d08f) [No such file or directory] >[2016-04-19 07:24:34.227305] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4014fe30-8e07-4ffd-ac77-9575c1f5d08f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.237166] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.238605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577> (f0e8a7aa-4cb1-4f48-b91a-5ce052192577) [No such file or directory] >[2016-04-19 07:24:34.239489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577> (f0e8a7aa-4cb1-4f48-b91a-5ce052192577) [No such file or directory] >[2016-04-19 07:24:34.240744] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f0e8a7aa-4cb1-4f48-b91a-5ce052192577. (Possible split-brain) >[2016-04-19 07:24:34.241872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577> (f0e8a7aa-4cb1-4f48-b91a-5ce052192577) [No such file or directory] >[2016-04-19 07:24:34.241896] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577> (f0e8a7aa-4cb1-4f48-b91a-5ce052192577) [No such file or directory] >[2016-04-19 07:24:34.243376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577> (f0e8a7aa-4cb1-4f48-b91a-5ce052192577) [No such file or directory] >[2016-04-19 07:24:34.243568] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577> (f0e8a7aa-4cb1-4f48-b91a-5ce052192577) [No such file or directory] >[2016-04-19 07:24:34.243795] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.246497] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f0e8a7aa-4cb1-4f48-b91a-5ce052192577. (Possible split-brain) >[2016-04-19 07:24:34.247508] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577> (f0e8a7aa-4cb1-4f48-b91a-5ce052192577) [No such file or directory] >[2016-04-19 07:24:34.247880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577> (f0e8a7aa-4cb1-4f48-b91a-5ce052192577) [No such file or directory] >[2016-04-19 07:24:34.250873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577> (f0e8a7aa-4cb1-4f48-b91a-5ce052192577) [No such file or directory] >[2016-04-19 07:24:34.251044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577> (f0e8a7aa-4cb1-4f48-b91a-5ce052192577) [No such file or directory] >[2016-04-19 07:24:34.251295] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f0e8a7aa-4cb1-4f48-b91a-5ce052192577>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.261296] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.262571] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f> (611a4250-cb97-492d-8d68-2c0b1114ba3f) [No such file or directory] >[2016-04-19 07:24:34.262721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f> (611a4250-cb97-492d-8d68-2c0b1114ba3f) [No such file or directory] >[2016-04-19 07:24:34.263932] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 611a4250-cb97-492d-8d68-2c0b1114ba3f. (Possible split-brain) >[2016-04-19 07:24:34.265220] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f> (611a4250-cb97-492d-8d68-2c0b1114ba3f) [No such file or directory] >[2016-04-19 07:24:34.265355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f> (611a4250-cb97-492d-8d68-2c0b1114ba3f) [No such file or directory] >[2016-04-19 07:24:34.266641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f> (611a4250-cb97-492d-8d68-2c0b1114ba3f) [No such file or directory] >[2016-04-19 07:24:34.267097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f> (611a4250-cb97-492d-8d68-2c0b1114ba3f) [No such file or directory] >[2016-04-19 07:24:34.267311] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.269897] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 611a4250-cb97-492d-8d68-2c0b1114ba3f. (Possible split-brain) >[2016-04-19 07:24:34.271101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f> (611a4250-cb97-492d-8d68-2c0b1114ba3f) [No such file or directory] >[2016-04-19 07:24:34.271230] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f> (611a4250-cb97-492d-8d68-2c0b1114ba3f) [No such file or directory] >[2016-04-19 07:24:34.274641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f> (611a4250-cb97-492d-8d68-2c0b1114ba3f) [No such file or directory] >[2016-04-19 07:24:34.274670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f> (611a4250-cb97-492d-8d68-2c0b1114ba3f) [No such file or directory] >[2016-04-19 07:24:34.274913] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:611a4250-cb97-492d-8d68-2c0b1114ba3f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.283562] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.284576] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df> (9bcddb63-5624-4bd9-842c-a1a7cb84d6df) [No such file or directory] >[2016-04-19 07:24:34.284992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df> (9bcddb63-5624-4bd9-842c-a1a7cb84d6df) [No such file or directory] >[2016-04-19 07:24:34.287916] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9bcddb63-5624-4bd9-842c-a1a7cb84d6df. (Possible split-brain) >[2016-04-19 07:24:34.288963] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df> (9bcddb63-5624-4bd9-842c-a1a7cb84d6df) [No such file or directory] >[2016-04-19 07:24:34.288972] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df> (9bcddb63-5624-4bd9-842c-a1a7cb84d6df) [No such file or directory] >[2016-04-19 07:24:34.290515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df> (9bcddb63-5624-4bd9-842c-a1a7cb84d6df) [No such file or directory] >[2016-04-19 07:24:34.290543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df> (9bcddb63-5624-4bd9-842c-a1a7cb84d6df) [No such file or directory] >[2016-04-19 07:24:34.290836] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.293367] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9bcddb63-5624-4bd9-842c-a1a7cb84d6df. (Possible split-brain) >[2016-04-19 07:24:34.294553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df> (9bcddb63-5624-4bd9-842c-a1a7cb84d6df) [No such file or directory] >[2016-04-19 07:24:34.294656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df> (9bcddb63-5624-4bd9-842c-a1a7cb84d6df) [No such file or directory] >[2016-04-19 07:24:34.297525] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df> (9bcddb63-5624-4bd9-842c-a1a7cb84d6df) [No such file or directory] >[2016-04-19 07:24:34.297813] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df> (9bcddb63-5624-4bd9-842c-a1a7cb84d6df) [No such file or directory] >[2016-04-19 07:24:34.298002] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9bcddb63-5624-4bd9-842c-a1a7cb84d6df>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.306790] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.307907] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625> (c309e7c4-9bd9-4c28-ab73-002520c44625) [No such file or directory] >[2016-04-19 07:24:34.307991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625> (c309e7c4-9bd9-4c28-ab73-002520c44625) [No such file or directory] >[2016-04-19 07:24:34.308979] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c309e7c4-9bd9-4c28-ab73-002520c44625. (Possible split-brain) >[2016-04-19 07:24:34.309855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625> (c309e7c4-9bd9-4c28-ab73-002520c44625) [No such file or directory] >[2016-04-19 07:24:34.310143] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625> (c309e7c4-9bd9-4c28-ab73-002520c44625) [No such file or directory] >[2016-04-19 07:24:34.311509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625> (c309e7c4-9bd9-4c28-ab73-002520c44625) [No such file or directory] >[2016-04-19 07:24:34.311607] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625> (c309e7c4-9bd9-4c28-ab73-002520c44625) [No such file or directory] >[2016-04-19 07:24:34.311749] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.314260] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c309e7c4-9bd9-4c28-ab73-002520c44625. (Possible split-brain) >[2016-04-19 07:24:34.315086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625> (c309e7c4-9bd9-4c28-ab73-002520c44625) [No such file or directory] >[2016-04-19 07:24:34.315463] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625> (c309e7c4-9bd9-4c28-ab73-002520c44625) [No such file or directory] >[2016-04-19 07:24:34.318606] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625> (c309e7c4-9bd9-4c28-ab73-002520c44625) [No such file or directory] >[2016-04-19 07:24:34.318710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625> (c309e7c4-9bd9-4c28-ab73-002520c44625) [No such file or directory] >[2016-04-19 07:24:34.318814] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c309e7c4-9bd9-4c28-ab73-002520c44625>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.328504] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.329602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:10092cde-97ff-407a-9583-b17288075b71> (10092cde-97ff-407a-9583-b17288075b71) [No such file or directory] >[2016-04-19 07:24:34.329770] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:10092cde-97ff-407a-9583-b17288075b71> (10092cde-97ff-407a-9583-b17288075b71) [No such file or directory] >[2016-04-19 07:24:34.330988] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 10092cde-97ff-407a-9583-b17288075b71. (Possible split-brain) >[2016-04-19 07:24:34.332100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:10092cde-97ff-407a-9583-b17288075b71> (10092cde-97ff-407a-9583-b17288075b71) [No such file or directory] >[2016-04-19 07:24:34.332460] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:10092cde-97ff-407a-9583-b17288075b71> (10092cde-97ff-407a-9583-b17288075b71) [No such file or directory] >[2016-04-19 07:24:34.333796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:10092cde-97ff-407a-9583-b17288075b71> (10092cde-97ff-407a-9583-b17288075b71) [No such file or directory] >[2016-04-19 07:24:34.333990] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:10092cde-97ff-407a-9583-b17288075b71> (10092cde-97ff-407a-9583-b17288075b71) [No such file or directory] >[2016-04-19 07:24:34.334136] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:10092cde-97ff-407a-9583-b17288075b71>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.336621] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 10092cde-97ff-407a-9583-b17288075b71. (Possible split-brain) >[2016-04-19 07:24:34.337723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:10092cde-97ff-407a-9583-b17288075b71> (10092cde-97ff-407a-9583-b17288075b71) [No such file or directory] >[2016-04-19 07:24:34.337750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:10092cde-97ff-407a-9583-b17288075b71> (10092cde-97ff-407a-9583-b17288075b71) [No such file or directory] >[2016-04-19 07:24:34.340649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:10092cde-97ff-407a-9583-b17288075b71> (10092cde-97ff-407a-9583-b17288075b71) [No such file or directory] >[2016-04-19 07:24:34.340659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:10092cde-97ff-407a-9583-b17288075b71> (10092cde-97ff-407a-9583-b17288075b71) [No such file or directory] >[2016-04-19 07:24:34.340935] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:10092cde-97ff-407a-9583-b17288075b71>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.349357] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.350425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1> (4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1) [No such file or directory] >[2016-04-19 07:24:34.350623] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1> (4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1) [No such file or directory] >[2016-04-19 07:24:34.351479] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1. (Possible split-brain) >[2016-04-19 07:24:34.352442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1> (4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1) [No such file or directory] >[2016-04-19 07:24:34.352560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1> (4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1) [No such file or directory] >[2016-04-19 07:24:34.353786] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1> (4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1) [No such file or directory] >[2016-04-19 07:24:34.353814] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1> (4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1) [No such file or directory] >[2016-04-19 07:24:34.353990] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.356416] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1. (Possible split-brain) >[2016-04-19 07:24:34.357397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1> (4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1) [No such file or directory] >[2016-04-19 07:24:34.357519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1> (4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1) [No such file or directory] >[2016-04-19 07:24:34.360651] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1> (4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1) [No such file or directory] >[2016-04-19 07:24:34.360763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1> (4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1) [No such file or directory] >[2016-04-19 07:24:34.360989] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4ac84b5a-7cf1-4b21-a6cd-66fd354cf8a1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.369832] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.370962] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede> (bb483603-ee5d-4800-820a-e2c726f82ede) [No such file or directory] >[2016-04-19 07:24:34.370968] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede> (bb483603-ee5d-4800-820a-e2c726f82ede) [No such file or directory] >[2016-04-19 07:24:34.371916] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bb483603-ee5d-4800-820a-e2c726f82ede. (Possible split-brain) >[2016-04-19 07:24:34.372870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede> (bb483603-ee5d-4800-820a-e2c726f82ede) [No such file or directory] >[2016-04-19 07:24:34.372998] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede> (bb483603-ee5d-4800-820a-e2c726f82ede) [No such file or directory] >[2016-04-19 07:24:34.374352] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede> (bb483603-ee5d-4800-820a-e2c726f82ede) [No such file or directory] >[2016-04-19 07:24:34.374588] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede> (bb483603-ee5d-4800-820a-e2c726f82ede) [No such file or directory] >[2016-04-19 07:24:34.374720] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.377086] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bb483603-ee5d-4800-820a-e2c726f82ede. (Possible split-brain) >[2016-04-19 07:24:34.378001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede> (bb483603-ee5d-4800-820a-e2c726f82ede) [No such file or directory] >[2016-04-19 07:24:34.378124] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede> (bb483603-ee5d-4800-820a-e2c726f82ede) [No such file or directory] >[2016-04-19 07:24:34.380843] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede> (bb483603-ee5d-4800-820a-e2c726f82ede) [No such file or directory] >[2016-04-19 07:24:34.381035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede> (bb483603-ee5d-4800-820a-e2c726f82ede) [No such file or directory] >[2016-04-19 07:24:34.381165] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bb483603-ee5d-4800-820a-e2c726f82ede>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.389639] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.390842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda> (c892bed3-6eeb-4fae-a2f9-f605b3286eda) [No such file or directory] >[2016-04-19 07:24:34.390862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda> (c892bed3-6eeb-4fae-a2f9-f605b3286eda) [No such file or directory] >[2016-04-19 07:24:34.392095] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c892bed3-6eeb-4fae-a2f9-f605b3286eda. (Possible split-brain) >[2016-04-19 07:24:34.392972] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda> (c892bed3-6eeb-4fae-a2f9-f605b3286eda) [No such file or directory] >[2016-04-19 07:24:34.393097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda> (c892bed3-6eeb-4fae-a2f9-f605b3286eda) [No such file or directory] >[2016-04-19 07:24:34.394653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda> (c892bed3-6eeb-4fae-a2f9-f605b3286eda) [No such file or directory] >[2016-04-19 07:24:34.394683] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda> (c892bed3-6eeb-4fae-a2f9-f605b3286eda) [No such file or directory] >[2016-04-19 07:24:34.394877] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.397344] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c892bed3-6eeb-4fae-a2f9-f605b3286eda. (Possible split-brain) >[2016-04-19 07:24:34.398546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda> (c892bed3-6eeb-4fae-a2f9-f605b3286eda) [No such file or directory] >[2016-04-19 07:24:34.398839] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda> (c892bed3-6eeb-4fae-a2f9-f605b3286eda) [No such file or directory] >[2016-04-19 07:24:34.401534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda> (c892bed3-6eeb-4fae-a2f9-f605b3286eda) [No such file or directory] >[2016-04-19 07:24:34.401810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda> (c892bed3-6eeb-4fae-a2f9-f605b3286eda) [No such file or directory] >[2016-04-19 07:24:34.402037] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c892bed3-6eeb-4fae-a2f9-f605b3286eda>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.411785] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.412904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a4112900-67bd-426e-89da-8ed853013c28> (a4112900-67bd-426e-89da-8ed853013c28) [No such file or directory] >[2016-04-19 07:24:34.412929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a4112900-67bd-426e-89da-8ed853013c28> (a4112900-67bd-426e-89da-8ed853013c28) [No such file or directory] >[2016-04-19 07:24:34.415888] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a4112900-67bd-426e-89da-8ed853013c28. (Possible split-brain) >[2016-04-19 07:24:34.416883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a4112900-67bd-426e-89da-8ed853013c28> (a4112900-67bd-426e-89da-8ed853013c28) [No such file or directory] >[2016-04-19 07:24:34.416903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a4112900-67bd-426e-89da-8ed853013c28> (a4112900-67bd-426e-89da-8ed853013c28) [No such file or directory] >[2016-04-19 07:24:34.418194] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a4112900-67bd-426e-89da-8ed853013c28> (a4112900-67bd-426e-89da-8ed853013c28) [No such file or directory] >[2016-04-19 07:24:34.418536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a4112900-67bd-426e-89da-8ed853013c28> (a4112900-67bd-426e-89da-8ed853013c28) [No such file or directory] >[2016-04-19 07:24:34.418770] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a4112900-67bd-426e-89da-8ed853013c28>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.421254] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a4112900-67bd-426e-89da-8ed853013c28. (Possible split-brain) >[2016-04-19 07:24:34.422552] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a4112900-67bd-426e-89da-8ed853013c28> (a4112900-67bd-426e-89da-8ed853013c28) [No such file or directory] >[2016-04-19 07:24:34.422682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a4112900-67bd-426e-89da-8ed853013c28> (a4112900-67bd-426e-89da-8ed853013c28) [No such file or directory] >[2016-04-19 07:24:34.425443] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a4112900-67bd-426e-89da-8ed853013c28> (a4112900-67bd-426e-89da-8ed853013c28) [No such file or directory] >[2016-04-19 07:24:34.425596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a4112900-67bd-426e-89da-8ed853013c28> (a4112900-67bd-426e-89da-8ed853013c28) [No such file or directory] >[2016-04-19 07:24:34.426037] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a4112900-67bd-426e-89da-8ed853013c28>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.434633] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.435492] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb> (3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb) [No such file or directory] >[2016-04-19 07:24:34.435812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb> (3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb) [No such file or directory] >[2016-04-19 07:24:34.438792] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb. (Possible split-brain) >[2016-04-19 07:24:34.439932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb> (3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb) [No such file or directory] >[2016-04-19 07:24:34.440057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb> (3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb) [No such file or directory] >[2016-04-19 07:24:34.441558] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb> (3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb) [No such file or directory] >[2016-04-19 07:24:34.441758] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb> (3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb) [No such file or directory] >[2016-04-19 07:24:34.441993] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.444522] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb. (Possible split-brain) >[2016-04-19 07:24:34.445687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb> (3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb) [No such file or directory] >[2016-04-19 07:24:34.446057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb> (3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb) [No such file or directory] >[2016-04-19 07:24:34.450029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb> (3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb) [No such file or directory] >[2016-04-19 07:24:34.450055] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb> (3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb) [No such file or directory] >[2016-04-19 07:24:34.450358] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3d74d15d-1a83-4fef-9131-1f7c7fb2b0eb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.460466] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.461795] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a> (802a3d7e-3239-4b07-a140-e20cce3d202a) [No such file or directory] >[2016-04-19 07:24:34.461935] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a> (802a3d7e-3239-4b07-a140-e20cce3d202a) [No such file or directory] >[2016-04-19 07:24:34.463096] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 802a3d7e-3239-4b07-a140-e20cce3d202a. (Possible split-brain) >[2016-04-19 07:24:34.464273] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a> (802a3d7e-3239-4b07-a140-e20cce3d202a) [No such file or directory] >[2016-04-19 07:24:34.464301] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a> (802a3d7e-3239-4b07-a140-e20cce3d202a) [No such file or directory] >[2016-04-19 07:24:34.465764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a> (802a3d7e-3239-4b07-a140-e20cce3d202a) [No such file or directory] >[2016-04-19 07:24:34.465894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a> (802a3d7e-3239-4b07-a140-e20cce3d202a) [No such file or directory] >[2016-04-19 07:24:34.466119] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.468556] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 802a3d7e-3239-4b07-a140-e20cce3d202a. (Possible split-brain) >[2016-04-19 07:24:34.469731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a> (802a3d7e-3239-4b07-a140-e20cce3d202a) [No such file or directory] >[2016-04-19 07:24:34.469859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a> (802a3d7e-3239-4b07-a140-e20cce3d202a) [No such file or directory] >[2016-04-19 07:24:34.472446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a> (802a3d7e-3239-4b07-a140-e20cce3d202a) [No such file or directory] >[2016-04-19 07:24:34.472781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a> (802a3d7e-3239-4b07-a140-e20cce3d202a) [No such file or directory] >[2016-04-19 07:24:34.472919] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:802a3d7e-3239-4b07-a140-e20cce3d202a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.482726] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.483915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c> (6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c) [No such file or directory] >[2016-04-19 07:24:34.483915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c> (6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c) [No such file or directory] >[2016-04-19 07:24:34.485168] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c. (Possible split-brain) >[2016-04-19 07:24:34.486416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c> (6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c) [No such file or directory] >[2016-04-19 07:24:34.486415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c> (6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c) [No such file or directory] >[2016-04-19 07:24:34.487982] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c> (6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c) [No such file or directory] >[2016-04-19 07:24:34.488036] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c> (6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c) [No such file or directory] >[2016-04-19 07:24:34.488408] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.490884] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c. (Possible split-brain) >[2016-04-19 07:24:34.492148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c> (6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c) [No such file or directory] >[2016-04-19 07:24:34.492177] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c> (6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c) [No such file or directory] >[2016-04-19 07:24:34.494893] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c> (6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c) [No such file or directory] >[2016-04-19 07:24:34.494974] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c> (6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c) [No such file or directory] >[2016-04-19 07:24:34.495252] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6d7aaaf6-3e3e-4547-bdc7-a4c570ea274c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.503859] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.504987] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14> (9351dae8-21f8-46ff-8f3d-521c95f52a14) [No such file or directory] >[2016-04-19 07:24:34.505013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14> (9351dae8-21f8-46ff-8f3d-521c95f52a14) [No such file or directory] >[2016-04-19 07:24:34.507958] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9351dae8-21f8-46ff-8f3d-521c95f52a14. (Possible split-brain) >[2016-04-19 07:24:34.508918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14> (9351dae8-21f8-46ff-8f3d-521c95f52a14) [No such file or directory] >[2016-04-19 07:24:34.509407] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14> (9351dae8-21f8-46ff-8f3d-521c95f52a14) [No such file or directory] >[2016-04-19 07:24:34.511038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14> (9351dae8-21f8-46ff-8f3d-521c95f52a14) [No such file or directory] >[2016-04-19 07:24:34.511071] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14> (9351dae8-21f8-46ff-8f3d-521c95f52a14) [No such file or directory] >[2016-04-19 07:24:34.511245] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.513800] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9351dae8-21f8-46ff-8f3d-521c95f52a14. (Possible split-brain) >[2016-04-19 07:24:34.514719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14> (9351dae8-21f8-46ff-8f3d-521c95f52a14) [No such file or directory] >[2016-04-19 07:24:34.514808] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14> (9351dae8-21f8-46ff-8f3d-521c95f52a14) [No such file or directory] >[2016-04-19 07:24:34.517926] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14> (9351dae8-21f8-46ff-8f3d-521c95f52a14) [No such file or directory] >[2016-04-19 07:24:34.517975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14> (9351dae8-21f8-46ff-8f3d-521c95f52a14) [No such file or directory] >[2016-04-19 07:24:34.518179] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9351dae8-21f8-46ff-8f3d-521c95f52a14>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.527995] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.529084] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae> (920aefe5-2847-4aff-8f26-0ad1189debae) [No such file or directory] >[2016-04-19 07:24:34.529101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae> (920aefe5-2847-4aff-8f26-0ad1189debae) [No such file or directory] >[2016-04-19 07:24:34.530370] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 920aefe5-2847-4aff-8f26-0ad1189debae. (Possible split-brain) >[2016-04-19 07:24:34.531259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae> (920aefe5-2847-4aff-8f26-0ad1189debae) [No such file or directory] >[2016-04-19 07:24:34.531528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae> (920aefe5-2847-4aff-8f26-0ad1189debae) [No such file or directory] >[2016-04-19 07:24:34.532854] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae> (920aefe5-2847-4aff-8f26-0ad1189debae) [No such file or directory] >[2016-04-19 07:24:34.532855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae> (920aefe5-2847-4aff-8f26-0ad1189debae) [No such file or directory] >[2016-04-19 07:24:34.533167] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.535965] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 920aefe5-2847-4aff-8f26-0ad1189debae. (Possible split-brain) >[2016-04-19 07:24:34.537355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae> (920aefe5-2847-4aff-8f26-0ad1189debae) [No such file or directory] >[2016-04-19 07:24:34.537434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae> (920aefe5-2847-4aff-8f26-0ad1189debae) [No such file or directory] >[2016-04-19 07:24:34.540131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae> (920aefe5-2847-4aff-8f26-0ad1189debae) [No such file or directory] >[2016-04-19 07:24:34.540478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae> (920aefe5-2847-4aff-8f26-0ad1189debae) [No such file or directory] >[2016-04-19 07:24:34.540796] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:920aefe5-2847-4aff-8f26-0ad1189debae>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.549778] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.550624] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9> (9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9) [No such file or directory] >[2016-04-19 07:24:34.550997] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9> (9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9) [No such file or directory] >[2016-04-19 07:24:34.553844] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9. (Possible split-brain) >[2016-04-19 07:24:34.554847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9> (9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9) [No such file or directory] >[2016-04-19 07:24:34.554877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9> (9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9) [No such file or directory] >[2016-04-19 07:24:34.556272] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9> (9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9) [No such file or directory] >[2016-04-19 07:24:34.556343] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9> (9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9) [No such file or directory] >[2016-04-19 07:24:34.556999] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.559543] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9. (Possible split-brain) >[2016-04-19 07:24:34.560829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9> (9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9) [No such file or directory] >[2016-04-19 07:24:34.560934] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9> (9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9) [No such file or directory] >[2016-04-19 07:24:34.563759] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9> (9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9) [No such file or directory] >[2016-04-19 07:24:34.563788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9> (9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9) [No such file or directory] >[2016-04-19 07:24:34.564073] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9d2c70f6-df24-4d8e-bb76-ab5e8c1b50c9>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.573241] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.574365] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23> (26e2ea3b-d19c-4d4d-9401-f840e71b2c23) [No such file or directory] >[2016-04-19 07:24:34.574649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23> (26e2ea3b-d19c-4d4d-9401-f840e71b2c23) [No such file or directory] >[2016-04-19 07:24:34.575548] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 26e2ea3b-d19c-4d4d-9401-f840e71b2c23. (Possible split-brain) >[2016-04-19 07:24:34.576445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23> (26e2ea3b-d19c-4d4d-9401-f840e71b2c23) [No such file or directory] >[2016-04-19 07:24:34.576838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23> (26e2ea3b-d19c-4d4d-9401-f840e71b2c23) [No such file or directory] >[2016-04-19 07:24:34.577967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23> (26e2ea3b-d19c-4d4d-9401-f840e71b2c23) [No such file or directory] >[2016-04-19 07:24:34.578399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23> (26e2ea3b-d19c-4d4d-9401-f840e71b2c23) [No such file or directory] >[2016-04-19 07:24:34.578888] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.581398] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 26e2ea3b-d19c-4d4d-9401-f840e71b2c23. (Possible split-brain) >[2016-04-19 07:24:34.582466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23> (26e2ea3b-d19c-4d4d-9401-f840e71b2c23) [No such file or directory] >[2016-04-19 07:24:34.582486] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23> (26e2ea3b-d19c-4d4d-9401-f840e71b2c23) [No such file or directory] >[2016-04-19 07:24:34.585807] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23> (26e2ea3b-d19c-4d4d-9401-f840e71b2c23) [No such file or directory] >[2016-04-19 07:24:34.585877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23> (26e2ea3b-d19c-4d4d-9401-f840e71b2c23) [No such file or directory] >[2016-04-19 07:24:34.586013] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:26e2ea3b-d19c-4d4d-9401-f840e71b2c23>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.594865] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.596094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed> (32649e9a-cec7-4ef6-8b95-24c6e069eeed) [No such file or directory] >[2016-04-19 07:24:34.596222] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed> (32649e9a-cec7-4ef6-8b95-24c6e069eeed) [No such file or directory] >[2016-04-19 07:24:34.597387] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 32649e9a-cec7-4ef6-8b95-24c6e069eeed. (Possible split-brain) >[2016-04-19 07:24:34.598545] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed> (32649e9a-cec7-4ef6-8b95-24c6e069eeed) [No such file or directory] >[2016-04-19 07:24:34.598578] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed> (32649e9a-cec7-4ef6-8b95-24c6e069eeed) [No such file or directory] >[2016-04-19 07:24:34.600054] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed> (32649e9a-cec7-4ef6-8b95-24c6e069eeed) [No such file or directory] >[2016-04-19 07:24:34.600085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed> (32649e9a-cec7-4ef6-8b95-24c6e069eeed) [No such file or directory] >[2016-04-19 07:24:34.600255] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.603016] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 32649e9a-cec7-4ef6-8b95-24c6e069eeed. (Possible split-brain) >[2016-04-19 07:24:34.604075] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed> (32649e9a-cec7-4ef6-8b95-24c6e069eeed) [No such file or directory] >[2016-04-19 07:24:34.604533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed> (32649e9a-cec7-4ef6-8b95-24c6e069eeed) [No such file or directory] >[2016-04-19 07:24:34.607283] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed> (32649e9a-cec7-4ef6-8b95-24c6e069eeed) [No such file or directory] >[2016-04-19 07:24:34.607582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed> (32649e9a-cec7-4ef6-8b95-24c6e069eeed) [No such file or directory] >[2016-04-19 07:24:34.607772] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:32649e9a-cec7-4ef6-8b95-24c6e069eeed>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.616425] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.617473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea> (761edd6d-3a2b-4e09-8470-7da07a2fa1ea) [No such file or directory] >[2016-04-19 07:24:34.617505] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea> (761edd6d-3a2b-4e09-8470-7da07a2fa1ea) [No such file or directory] >[2016-04-19 07:24:34.620304] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 761edd6d-3a2b-4e09-8470-7da07a2fa1ea. (Possible split-brain) >[2016-04-19 07:24:34.621357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea> (761edd6d-3a2b-4e09-8470-7da07a2fa1ea) [No such file or directory] >[2016-04-19 07:24:34.621451] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea> (761edd6d-3a2b-4e09-8470-7da07a2fa1ea) [No such file or directory] >[2016-04-19 07:24:34.623131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea> (761edd6d-3a2b-4e09-8470-7da07a2fa1ea) [No such file or directory] >[2016-04-19 07:24:34.623623] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea> (761edd6d-3a2b-4e09-8470-7da07a2fa1ea) [No such file or directory] >[2016-04-19 07:24:34.623831] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.626435] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 761edd6d-3a2b-4e09-8470-7da07a2fa1ea. (Possible split-brain) >[2016-04-19 07:24:34.627264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea> (761edd6d-3a2b-4e09-8470-7da07a2fa1ea) [No such file or directory] >[2016-04-19 07:24:34.627743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea> (761edd6d-3a2b-4e09-8470-7da07a2fa1ea) [No such file or directory] >[2016-04-19 07:24:34.630466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea> (761edd6d-3a2b-4e09-8470-7da07a2fa1ea) [No such file or directory] >[2016-04-19 07:24:34.630612] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea> (761edd6d-3a2b-4e09-8470-7da07a2fa1ea) [No such file or directory] >[2016-04-19 07:24:34.630753] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:761edd6d-3a2b-4e09-8470-7da07a2fa1ea>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.639736] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.640601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:62a73466-2b7c-4161-8211-990cda16dde8> (62a73466-2b7c-4161-8211-990cda16dde8) [No such file or directory] >[2016-04-19 07:24:34.641041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:62a73466-2b7c-4161-8211-990cda16dde8> (62a73466-2b7c-4161-8211-990cda16dde8) [No such file or directory] >[2016-04-19 07:24:34.642199] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 62a73466-2b7c-4161-8211-990cda16dde8. (Possible split-brain) >[2016-04-19 07:24:34.643107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:62a73466-2b7c-4161-8211-990cda16dde8> (62a73466-2b7c-4161-8211-990cda16dde8) [No such file or directory] >[2016-04-19 07:24:34.643529] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:62a73466-2b7c-4161-8211-990cda16dde8> (62a73466-2b7c-4161-8211-990cda16dde8) [No such file or directory] >[2016-04-19 07:24:34.644869] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:62a73466-2b7c-4161-8211-990cda16dde8> (62a73466-2b7c-4161-8211-990cda16dde8) [No such file or directory] >[2016-04-19 07:24:34.644987] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:62a73466-2b7c-4161-8211-990cda16dde8> (62a73466-2b7c-4161-8211-990cda16dde8) [No such file or directory] >[2016-04-19 07:24:34.645188] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:62a73466-2b7c-4161-8211-990cda16dde8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.647685] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 62a73466-2b7c-4161-8211-990cda16dde8. (Possible split-brain) >[2016-04-19 07:24:34.648884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:62a73466-2b7c-4161-8211-990cda16dde8> (62a73466-2b7c-4161-8211-990cda16dde8) [No such file or directory] >[2016-04-19 07:24:34.649012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:62a73466-2b7c-4161-8211-990cda16dde8> (62a73466-2b7c-4161-8211-990cda16dde8) [No such file or directory] >[2016-04-19 07:24:34.652252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:62a73466-2b7c-4161-8211-990cda16dde8> (62a73466-2b7c-4161-8211-990cda16dde8) [No such file or directory] >[2016-04-19 07:24:34.652380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:62a73466-2b7c-4161-8211-990cda16dde8> (62a73466-2b7c-4161-8211-990cda16dde8) [No such file or directory] >[2016-04-19 07:24:34.652651] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:62a73466-2b7c-4161-8211-990cda16dde8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.662078] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.663149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80> (aa5df773-7211-42f0-8b56-19ce7258cc80) [No such file or directory] >[2016-04-19 07:24:34.663414] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80> (aa5df773-7211-42f0-8b56-19ce7258cc80) [No such file or directory] >[2016-04-19 07:24:34.666266] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid aa5df773-7211-42f0-8b56-19ce7258cc80. (Possible split-brain) >[2016-04-19 07:24:34.667398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80> (aa5df773-7211-42f0-8b56-19ce7258cc80) [No such file or directory] >[2016-04-19 07:24:34.667574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80> (aa5df773-7211-42f0-8b56-19ce7258cc80) [No such file or directory] >[2016-04-19 07:24:34.669051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80> (aa5df773-7211-42f0-8b56-19ce7258cc80) [No such file or directory] >[2016-04-19 07:24:34.669086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80> (aa5df773-7211-42f0-8b56-19ce7258cc80) [No such file or directory] >[2016-04-19 07:24:34.669253] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.671852] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid aa5df773-7211-42f0-8b56-19ce7258cc80. (Possible split-brain) >[2016-04-19 07:24:34.672713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80> (aa5df773-7211-42f0-8b56-19ce7258cc80) [No such file or directory] >[2016-04-19 07:24:34.672824] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80> (aa5df773-7211-42f0-8b56-19ce7258cc80) [No such file or directory] >[2016-04-19 07:24:34.676207] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80> (aa5df773-7211-42f0-8b56-19ce7258cc80) [No such file or directory] >[2016-04-19 07:24:34.676231] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80> (aa5df773-7211-42f0-8b56-19ce7258cc80) [No such file or directory] >[2016-04-19 07:24:34.676709] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:aa5df773-7211-42f0-8b56-19ce7258cc80>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.686185] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.687532] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c> (6efa7e78-e459-4aa3-8c47-e615b6d00d2c) [No such file or directory] >[2016-04-19 07:24:34.687624] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c> (6efa7e78-e459-4aa3-8c47-e615b6d00d2c) [No such file or directory] >[2016-04-19 07:24:34.688597] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6efa7e78-e459-4aa3-8c47-e615b6d00d2c. (Possible split-brain) >[2016-04-19 07:24:34.689901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c> (6efa7e78-e459-4aa3-8c47-e615b6d00d2c) [No such file or directory] >[2016-04-19 07:24:34.690036] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c> (6efa7e78-e459-4aa3-8c47-e615b6d00d2c) [No such file or directory] >[2016-04-19 07:24:34.691277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c> (6efa7e78-e459-4aa3-8c47-e615b6d00d2c) [No such file or directory] >[2016-04-19 07:24:34.691425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c> (6efa7e78-e459-4aa3-8c47-e615b6d00d2c) [No such file or directory] >[2016-04-19 07:24:34.691614] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.694108] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6efa7e78-e459-4aa3-8c47-e615b6d00d2c. (Possible split-brain) >[2016-04-19 07:24:34.694961] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c> (6efa7e78-e459-4aa3-8c47-e615b6d00d2c) [No such file or directory] >[2016-04-19 07:24:34.695369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c> (6efa7e78-e459-4aa3-8c47-e615b6d00d2c) [No such file or directory] >[2016-04-19 07:24:34.697957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c> (6efa7e78-e459-4aa3-8c47-e615b6d00d2c) [No such file or directory] >[2016-04-19 07:24:34.698089] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c> (6efa7e78-e459-4aa3-8c47-e615b6d00d2c) [No such file or directory] >[2016-04-19 07:24:34.698270] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6efa7e78-e459-4aa3-8c47-e615b6d00d2c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.708196] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.709475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1254a705-b568-4738-9cce-27b0664b7445> (1254a705-b568-4738-9cce-27b0664b7445) [No such file or directory] >[2016-04-19 07:24:34.709496] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1254a705-b568-4738-9cce-27b0664b7445> (1254a705-b568-4738-9cce-27b0664b7445) [No such file or directory] >[2016-04-19 07:24:34.712174] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1254a705-b568-4738-9cce-27b0664b7445. (Possible split-brain) >[2016-04-19 07:24:34.713133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1254a705-b568-4738-9cce-27b0664b7445> (1254a705-b568-4738-9cce-27b0664b7445) [No such file or directory] >[2016-04-19 07:24:34.713542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1254a705-b568-4738-9cce-27b0664b7445> (1254a705-b568-4738-9cce-27b0664b7445) [No such file or directory] >[2016-04-19 07:24:34.714822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1254a705-b568-4738-9cce-27b0664b7445> (1254a705-b568-4738-9cce-27b0664b7445) [No such file or directory] >[2016-04-19 07:24:34.714931] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1254a705-b568-4738-9cce-27b0664b7445> (1254a705-b568-4738-9cce-27b0664b7445) [No such file or directory] >[2016-04-19 07:24:34.715116] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1254a705-b568-4738-9cce-27b0664b7445>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.717669] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1254a705-b568-4738-9cce-27b0664b7445. (Possible split-brain) >[2016-04-19 07:24:34.718628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1254a705-b568-4738-9cce-27b0664b7445> (1254a705-b568-4738-9cce-27b0664b7445) [No such file or directory] >[2016-04-19 07:24:34.719002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1254a705-b568-4738-9cce-27b0664b7445> (1254a705-b568-4738-9cce-27b0664b7445) [No such file or directory] >[2016-04-19 07:24:34.721682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1254a705-b568-4738-9cce-27b0664b7445> (1254a705-b568-4738-9cce-27b0664b7445) [No such file or directory] >[2016-04-19 07:24:34.721794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1254a705-b568-4738-9cce-27b0664b7445> (1254a705-b568-4738-9cce-27b0664b7445) [No such file or directory] >[2016-04-19 07:24:34.721995] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1254a705-b568-4738-9cce-27b0664b7445>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.729533] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.730794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8> (1795adec-3933-4e29-80af-0cd2d23d4fe8) [No such file or directory] >[2016-04-19 07:24:34.730827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8> (1795adec-3933-4e29-80af-0cd2d23d4fe8) [No such file or directory] >[2016-04-19 07:24:34.732013] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1795adec-3933-4e29-80af-0cd2d23d4fe8. (Possible split-brain) >[2016-04-19 07:24:34.733172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8> (1795adec-3933-4e29-80af-0cd2d23d4fe8) [No such file or directory] >[2016-04-19 07:24:34.733207] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8> (1795adec-3933-4e29-80af-0cd2d23d4fe8) [No such file or directory] >[2016-04-19 07:24:34.734819] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8> (1795adec-3933-4e29-80af-0cd2d23d4fe8) [No such file or directory] >[2016-04-19 07:24:34.734842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8> (1795adec-3933-4e29-80af-0cd2d23d4fe8) [No such file or directory] >[2016-04-19 07:24:34.735017] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.737492] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1795adec-3933-4e29-80af-0cd2d23d4fe8. (Possible split-brain) >[2016-04-19 07:24:34.738290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8> (1795adec-3933-4e29-80af-0cd2d23d4fe8) [No such file or directory] >[2016-04-19 07:24:34.738716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8> (1795adec-3933-4e29-80af-0cd2d23d4fe8) [No such file or directory] >[2016-04-19 07:24:34.741774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8> (1795adec-3933-4e29-80af-0cd2d23d4fe8) [No such file or directory] >[2016-04-19 07:24:34.741859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8> (1795adec-3933-4e29-80af-0cd2d23d4fe8) [No such file or directory] >[2016-04-19 07:24:34.742004] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1795adec-3933-4e29-80af-0cd2d23d4fe8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.751158] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.752222] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680> (7eedb2fc-caef-4000-8c70-77072b3f3680) [No such file or directory] >[2016-04-19 07:24:34.752346] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680> (7eedb2fc-caef-4000-8c70-77072b3f3680) [No such file or directory] >[2016-04-19 07:24:34.753543] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7eedb2fc-caef-4000-8c70-77072b3f3680. (Possible split-brain) >[2016-04-19 07:24:34.754852] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680> (7eedb2fc-caef-4000-8c70-77072b3f3680) [No such file or directory] >[2016-04-19 07:24:34.754937] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680> (7eedb2fc-caef-4000-8c70-77072b3f3680) [No such file or directory] >[2016-04-19 07:24:34.756223] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680> (7eedb2fc-caef-4000-8c70-77072b3f3680) [No such file or directory] >[2016-04-19 07:24:34.756412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680> (7eedb2fc-caef-4000-8c70-77072b3f3680) [No such file or directory] >[2016-04-19 07:24:34.756663] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.759130] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7eedb2fc-caef-4000-8c70-77072b3f3680. (Possible split-brain) >[2016-04-19 07:24:34.760294] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680> (7eedb2fc-caef-4000-8c70-77072b3f3680) [No such file or directory] >[2016-04-19 07:24:34.760520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680> (7eedb2fc-caef-4000-8c70-77072b3f3680) [No such file or directory] >[2016-04-19 07:24:34.763054] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680> (7eedb2fc-caef-4000-8c70-77072b3f3680) [No such file or directory] >[2016-04-19 07:24:34.763082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680> (7eedb2fc-caef-4000-8c70-77072b3f3680) [No such file or directory] >[2016-04-19 07:24:34.763486] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7eedb2fc-caef-4000-8c70-77072b3f3680>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.772176] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.773160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264> (6d5dc6ff-49c5-4f26-b4ed-f55d29397264) [No such file or directory] >[2016-04-19 07:24:34.773263] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264> (6d5dc6ff-49c5-4f26-b4ed-f55d29397264) [No such file or directory] >[2016-04-19 07:24:34.774205] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6d5dc6ff-49c5-4f26-b4ed-f55d29397264. (Possible split-brain) >[2016-04-19 07:24:34.775239] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264> (6d5dc6ff-49c5-4f26-b4ed-f55d29397264) [No such file or directory] >[2016-04-19 07:24:34.775465] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264> (6d5dc6ff-49c5-4f26-b4ed-f55d29397264) [No such file or directory] >[2016-04-19 07:24:34.776514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264> (6d5dc6ff-49c5-4f26-b4ed-f55d29397264) [No such file or directory] >[2016-04-19 07:24:34.776664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264> (6d5dc6ff-49c5-4f26-b4ed-f55d29397264) [No such file or directory] >[2016-04-19 07:24:34.776839] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.779287] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6d5dc6ff-49c5-4f26-b4ed-f55d29397264. (Possible split-brain) >[2016-04-19 07:24:34.780497] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264> (6d5dc6ff-49c5-4f26-b4ed-f55d29397264) [No such file or directory] >[2016-04-19 07:24:34.780500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264> (6d5dc6ff-49c5-4f26-b4ed-f55d29397264) [No such file or directory] >[2016-04-19 07:24:34.783047] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264> (6d5dc6ff-49c5-4f26-b4ed-f55d29397264) [No such file or directory] >[2016-04-19 07:24:34.783150] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264> (6d5dc6ff-49c5-4f26-b4ed-f55d29397264) [No such file or directory] >[2016-04-19 07:24:34.783648] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6d5dc6ff-49c5-4f26-b4ed-f55d29397264>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.792063] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.792835] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7050a968-91b9-42d0-845c-8b6b68166844> (7050a968-91b9-42d0-845c-8b6b68166844) [No such file or directory] >[2016-04-19 07:24:34.793092] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7050a968-91b9-42d0-845c-8b6b68166844> (7050a968-91b9-42d0-845c-8b6b68166844) [No such file or directory] >[2016-04-19 07:24:34.795932] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7050a968-91b9-42d0-845c-8b6b68166844. (Possible split-brain) >[2016-04-19 07:24:34.797539] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7050a968-91b9-42d0-845c-8b6b68166844> (7050a968-91b9-42d0-845c-8b6b68166844) [No such file or directory] >[2016-04-19 07:24:34.797639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7050a968-91b9-42d0-845c-8b6b68166844> (7050a968-91b9-42d0-845c-8b6b68166844) [No such file or directory] >[2016-04-19 07:24:34.798972] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7050a968-91b9-42d0-845c-8b6b68166844> (7050a968-91b9-42d0-845c-8b6b68166844) [No such file or directory] >[2016-04-19 07:24:34.799010] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7050a968-91b9-42d0-845c-8b6b68166844> (7050a968-91b9-42d0-845c-8b6b68166844) [No such file or directory] >[2016-04-19 07:24:34.799207] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7050a968-91b9-42d0-845c-8b6b68166844>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.801736] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7050a968-91b9-42d0-845c-8b6b68166844. (Possible split-brain) >[2016-04-19 07:24:34.802722] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7050a968-91b9-42d0-845c-8b6b68166844> (7050a968-91b9-42d0-845c-8b6b68166844) [No such file or directory] >[2016-04-19 07:24:34.802732] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7050a968-91b9-42d0-845c-8b6b68166844> (7050a968-91b9-42d0-845c-8b6b68166844) [No such file or directory] >[2016-04-19 07:24:34.805547] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7050a968-91b9-42d0-845c-8b6b68166844> (7050a968-91b9-42d0-845c-8b6b68166844) [No such file or directory] >[2016-04-19 07:24:34.805780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7050a968-91b9-42d0-845c-8b6b68166844> (7050a968-91b9-42d0-845c-8b6b68166844) [No such file or directory] >[2016-04-19 07:24:34.806104] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7050a968-91b9-42d0-845c-8b6b68166844>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.813925] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.814705] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9> (16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9) [No such file or directory] >[2016-04-19 07:24:34.814978] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9> (16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9) [No such file or directory] >[2016-04-19 07:24:34.815851] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9. (Possible split-brain) >[2016-04-19 07:24:34.816698] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9> (16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9) [No such file or directory] >[2016-04-19 07:24:34.816792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9> (16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9) [No such file or directory] >[2016-04-19 07:24:34.817961] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9> (16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9) [No such file or directory] >[2016-04-19 07:24:34.818058] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9> (16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9) [No such file or directory] >[2016-04-19 07:24:34.818212] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.820996] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9. (Possible split-brain) >[2016-04-19 07:24:34.821874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9> (16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9) [No such file or directory] >[2016-04-19 07:24:34.822183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9> (16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9) [No such file or directory] >[2016-04-19 07:24:34.824815] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9> (16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9) [No such file or directory] >[2016-04-19 07:24:34.825207] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9> (16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9) [No such file or directory] >[2016-04-19 07:24:34.825456] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:16b2e5a7-788e-4ead-afde-cf6dd2d3c9b9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.834754] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.835744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3> (73107c72-4ecf-458c-bc13-e0de2bfe66d3) [No such file or directory] >[2016-04-19 07:24:34.835749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3> (73107c72-4ecf-458c-bc13-e0de2bfe66d3) [No such file or directory] >[2016-04-19 07:24:34.836692] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 73107c72-4ecf-458c-bc13-e0de2bfe66d3. (Possible split-brain) >[2016-04-19 07:24:34.837693] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3> (73107c72-4ecf-458c-bc13-e0de2bfe66d3) [No such file or directory] >[2016-04-19 07:24:34.837788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3> (73107c72-4ecf-458c-bc13-e0de2bfe66d3) [No such file or directory] >[2016-04-19 07:24:34.839116] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3> (73107c72-4ecf-458c-bc13-e0de2bfe66d3) [No such file or directory] >[2016-04-19 07:24:34.839144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3> (73107c72-4ecf-458c-bc13-e0de2bfe66d3) [No such file or directory] >[2016-04-19 07:24:34.839307] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.841897] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 73107c72-4ecf-458c-bc13-e0de2bfe66d3. (Possible split-brain) >[2016-04-19 07:24:34.843016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3> (73107c72-4ecf-458c-bc13-e0de2bfe66d3) [No such file or directory] >[2016-04-19 07:24:34.843038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3> (73107c72-4ecf-458c-bc13-e0de2bfe66d3) [No such file or directory] >[2016-04-19 07:24:34.845707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3> (73107c72-4ecf-458c-bc13-e0de2bfe66d3) [No such file or directory] >[2016-04-19 07:24:34.845936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3> (73107c72-4ecf-458c-bc13-e0de2bfe66d3) [No such file or directory] >[2016-04-19 07:24:34.846388] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:73107c72-4ecf-458c-bc13-e0de2bfe66d3>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.855390] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.856553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:db0c6652-3f06-4d32-8533-9466924f3839> (db0c6652-3f06-4d32-8533-9466924f3839) [No such file or directory] >[2016-04-19 07:24:34.856584] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:db0c6652-3f06-4d32-8533-9466924f3839> (db0c6652-3f06-4d32-8533-9466924f3839) [No such file or directory] >[2016-04-19 07:24:34.859440] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid db0c6652-3f06-4d32-8533-9466924f3839. (Possible split-brain) >[2016-04-19 07:24:34.860700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:db0c6652-3f06-4d32-8533-9466924f3839> (db0c6652-3f06-4d32-8533-9466924f3839) [No such file or directory] >[2016-04-19 07:24:34.860891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:db0c6652-3f06-4d32-8533-9466924f3839> (db0c6652-3f06-4d32-8533-9466924f3839) [No such file or directory] >[2016-04-19 07:24:34.862145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:db0c6652-3f06-4d32-8533-9466924f3839> (db0c6652-3f06-4d32-8533-9466924f3839) [No such file or directory] >[2016-04-19 07:24:34.862172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:db0c6652-3f06-4d32-8533-9466924f3839> (db0c6652-3f06-4d32-8533-9466924f3839) [No such file or directory] >[2016-04-19 07:24:34.862502] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:db0c6652-3f06-4d32-8533-9466924f3839>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.865384] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid db0c6652-3f06-4d32-8533-9466924f3839. (Possible split-brain) >[2016-04-19 07:24:34.866586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:db0c6652-3f06-4d32-8533-9466924f3839> (db0c6652-3f06-4d32-8533-9466924f3839) [No such file or directory] >[2016-04-19 07:24:34.866594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:db0c6652-3f06-4d32-8533-9466924f3839> (db0c6652-3f06-4d32-8533-9466924f3839) [No such file or directory] >[2016-04-19 07:24:34.869477] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:db0c6652-3f06-4d32-8533-9466924f3839> (db0c6652-3f06-4d32-8533-9466924f3839) [No such file or directory] >[2016-04-19 07:24:34.870027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:db0c6652-3f06-4d32-8533-9466924f3839> (db0c6652-3f06-4d32-8533-9466924f3839) [No such file or directory] >[2016-04-19 07:24:34.870198] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:db0c6652-3f06-4d32-8533-9466924f3839>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.878376] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.879289] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13> (0cb847de-b0ec-4998-80fe-caa8c0bfaf13) [No such file or directory] >[2016-04-19 07:24:34.879642] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13> (0cb847de-b0ec-4998-80fe-caa8c0bfaf13) [No such file or directory] >[2016-04-19 07:24:34.882454] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0cb847de-b0ec-4998-80fe-caa8c0bfaf13. (Possible split-brain) >[2016-04-19 07:24:34.883400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13> (0cb847de-b0ec-4998-80fe-caa8c0bfaf13) [No such file or directory] >[2016-04-19 07:24:34.883777] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13> (0cb847de-b0ec-4998-80fe-caa8c0bfaf13) [No such file or directory] >[2016-04-19 07:24:34.884977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13> (0cb847de-b0ec-4998-80fe-caa8c0bfaf13) [No such file or directory] >[2016-04-19 07:24:34.885386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13> (0cb847de-b0ec-4998-80fe-caa8c0bfaf13) [No such file or directory] >[2016-04-19 07:24:34.885569] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.887995] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0cb847de-b0ec-4998-80fe-caa8c0bfaf13. (Possible split-brain) >[2016-04-19 07:24:34.888874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13> (0cb847de-b0ec-4998-80fe-caa8c0bfaf13) [No such file or directory] >[2016-04-19 07:24:34.889085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13> (0cb847de-b0ec-4998-80fe-caa8c0bfaf13) [No such file or directory] >[2016-04-19 07:24:34.891764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13> (0cb847de-b0ec-4998-80fe-caa8c0bfaf13) [No such file or directory] >[2016-04-19 07:24:34.891979] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13> (0cb847de-b0ec-4998-80fe-caa8c0bfaf13) [No such file or directory] >[2016-04-19 07:24:34.892177] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0cb847de-b0ec-4998-80fe-caa8c0bfaf13>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.900729] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.901728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5> (9922664e-7888-4fbc-9bba-1e1e8a700ca5) [No such file or directory] >[2016-04-19 07:24:34.901833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5> (9922664e-7888-4fbc-9bba-1e1e8a700ca5) [No such file or directory] >[2016-04-19 07:24:34.903108] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9922664e-7888-4fbc-9bba-1e1e8a700ca5. (Possible split-brain) >[2016-04-19 07:24:34.904145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5> (9922664e-7888-4fbc-9bba-1e1e8a700ca5) [No such file or directory] >[2016-04-19 07:24:34.904172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5> (9922664e-7888-4fbc-9bba-1e1e8a700ca5) [No such file or directory] >[2016-04-19 07:24:34.905616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5> (9922664e-7888-4fbc-9bba-1e1e8a700ca5) [No such file or directory] >[2016-04-19 07:24:34.905638] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5> (9922664e-7888-4fbc-9bba-1e1e8a700ca5) [No such file or directory] >[2016-04-19 07:24:34.906095] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.908604] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9922664e-7888-4fbc-9bba-1e1e8a700ca5. (Possible split-brain) >[2016-04-19 07:24:34.909761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5> (9922664e-7888-4fbc-9bba-1e1e8a700ca5) [No such file or directory] >[2016-04-19 07:24:34.909867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5> (9922664e-7888-4fbc-9bba-1e1e8a700ca5) [No such file or directory] >[2016-04-19 07:24:34.912534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5> (9922664e-7888-4fbc-9bba-1e1e8a700ca5) [No such file or directory] >[2016-04-19 07:24:34.912692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5> (9922664e-7888-4fbc-9bba-1e1e8a700ca5) [No such file or directory] >[2016-04-19 07:24:34.912885] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9922664e-7888-4fbc-9bba-1e1e8a700ca5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.922351] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.923145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041> (d6fb3190-32ad-4e5e-a5e6-22a6487b7041) [No such file or directory] >[2016-04-19 07:24:34.923553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041> (d6fb3190-32ad-4e5e-a5e6-22a6487b7041) [No such file or directory] >[2016-04-19 07:24:34.926123] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d6fb3190-32ad-4e5e-a5e6-22a6487b7041. (Possible split-brain) >[2016-04-19 07:24:34.927097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041> (d6fb3190-32ad-4e5e-a5e6-22a6487b7041) [No such file or directory] >[2016-04-19 07:24:34.927353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041> (d6fb3190-32ad-4e5e-a5e6-22a6487b7041) [No such file or directory] >[2016-04-19 07:24:34.929009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041> (d6fb3190-32ad-4e5e-a5e6-22a6487b7041) [No such file or directory] >[2016-04-19 07:24:34.929046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041> (d6fb3190-32ad-4e5e-a5e6-22a6487b7041) [No such file or directory] >[2016-04-19 07:24:34.929311] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.932107] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d6fb3190-32ad-4e5e-a5e6-22a6487b7041. (Possible split-brain) >[2016-04-19 07:24:34.933000] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041> (d6fb3190-32ad-4e5e-a5e6-22a6487b7041) [No such file or directory] >[2016-04-19 07:24:34.933267] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041> (d6fb3190-32ad-4e5e-a5e6-22a6487b7041) [No such file or directory] >[2016-04-19 07:24:34.936113] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041> (d6fb3190-32ad-4e5e-a5e6-22a6487b7041) [No such file or directory] >[2016-04-19 07:24:34.936454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041> (d6fb3190-32ad-4e5e-a5e6-22a6487b7041) [No such file or directory] >[2016-04-19 07:24:34.936660] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d6fb3190-32ad-4e5e-a5e6-22a6487b7041>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:34.945471] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.946588] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae> (f2561fde-faa2-45cc-8d33-32785ccf43ae) [No such file or directory] >[2016-04-19 07:24:34.946598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae> (f2561fde-faa2-45cc-8d33-32785ccf43ae) [No such file or directory] >[2016-04-19 07:24:34.949234] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f2561fde-faa2-45cc-8d33-32785ccf43ae. (Possible split-brain) >[2016-04-19 07:24:34.950274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae> (f2561fde-faa2-45cc-8d33-32785ccf43ae) [No such file or directory] >[2016-04-19 07:24:34.950430] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae> (f2561fde-faa2-45cc-8d33-32785ccf43ae) [No such file or directory] >[2016-04-19 07:24:34.951518] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae> (f2561fde-faa2-45cc-8d33-32785ccf43ae) [No such file or directory] >[2016-04-19 07:24:34.951630] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae> (f2561fde-faa2-45cc-8d33-32785ccf43ae) [No such file or directory] >[2016-04-19 07:24:34.951934] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.954719] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f2561fde-faa2-45cc-8d33-32785ccf43ae. (Possible split-brain) >[2016-04-19 07:24:34.955713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae> (f2561fde-faa2-45cc-8d33-32785ccf43ae) [No such file or directory] >[2016-04-19 07:24:34.955811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae> (f2561fde-faa2-45cc-8d33-32785ccf43ae) [No such file or directory] >[2016-04-19 07:24:34.958523] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae> (f2561fde-faa2-45cc-8d33-32785ccf43ae) [No such file or directory] >[2016-04-19 07:24:34.958670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae> (f2561fde-faa2-45cc-8d33-32785ccf43ae) [No such file or directory] >[2016-04-19 07:24:34.958856] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f2561fde-faa2-45cc-8d33-32785ccf43ae>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.968070] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.969276] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:276454e4-118c-42a3-8aa6-a855198866dc> (276454e4-118c-42a3-8aa6-a855198866dc) [No such file or directory] >[2016-04-19 07:24:34.969422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:276454e4-118c-42a3-8aa6-a855198866dc> (276454e4-118c-42a3-8aa6-a855198866dc) [No such file or directory] >[2016-04-19 07:24:34.970570] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 276454e4-118c-42a3-8aa6-a855198866dc. (Possible split-brain) >[2016-04-19 07:24:34.971753] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:276454e4-118c-42a3-8aa6-a855198866dc> (276454e4-118c-42a3-8aa6-a855198866dc) [No such file or directory] >[2016-04-19 07:24:34.971856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:276454e4-118c-42a3-8aa6-a855198866dc> (276454e4-118c-42a3-8aa6-a855198866dc) [No such file or directory] >[2016-04-19 07:24:34.972901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:276454e4-118c-42a3-8aa6-a855198866dc> (276454e4-118c-42a3-8aa6-a855198866dc) [No such file or directory] >[2016-04-19 07:24:34.972990] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:276454e4-118c-42a3-8aa6-a855198866dc> (276454e4-118c-42a3-8aa6-a855198866dc) [No such file or directory] >[2016-04-19 07:24:34.973444] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:276454e4-118c-42a3-8aa6-a855198866dc>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:34.975969] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 276454e4-118c-42a3-8aa6-a855198866dc. (Possible split-brain) >[2016-04-19 07:24:34.977186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:276454e4-118c-42a3-8aa6-a855198866dc> (276454e4-118c-42a3-8aa6-a855198866dc) [No such file or directory] >[2016-04-19 07:24:34.977285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:276454e4-118c-42a3-8aa6-a855198866dc> (276454e4-118c-42a3-8aa6-a855198866dc) [No such file or directory] >[2016-04-19 07:24:34.980176] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:276454e4-118c-42a3-8aa6-a855198866dc> (276454e4-118c-42a3-8aa6-a855198866dc) [No such file or directory] >[2016-04-19 07:24:34.980290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:276454e4-118c-42a3-8aa6-a855198866dc> (276454e4-118c-42a3-8aa6-a855198866dc) [No such file or directory] >[2016-04-19 07:24:34.980961] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:276454e4-118c-42a3-8aa6-a855198866dc>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:34.989303] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:34.990171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d> (ec0b5574-2029-4797-8c5c-b8c929a8fa7d) [No such file or directory] >[2016-04-19 07:24:34.990426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d> (ec0b5574-2029-4797-8c5c-b8c929a8fa7d) [No such file or directory] >[2016-04-19 07:24:34.991617] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ec0b5574-2029-4797-8c5c-b8c929a8fa7d. (Possible split-brain) >[2016-04-19 07:24:34.992500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d> (ec0b5574-2029-4797-8c5c-b8c929a8fa7d) [No such file or directory] >[2016-04-19 07:24:34.992927] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d> (ec0b5574-2029-4797-8c5c-b8c929a8fa7d) [No such file or directory] >[2016-04-19 07:24:34.994296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d> (ec0b5574-2029-4797-8c5c-b8c929a8fa7d) [No such file or directory] >[2016-04-19 07:24:34.994563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d> (ec0b5574-2029-4797-8c5c-b8c929a8fa7d) [No such file or directory] >[2016-04-19 07:24:34.994738] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:34.997156] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ec0b5574-2029-4797-8c5c-b8c929a8fa7d. (Possible split-brain) >[2016-04-19 07:24:34.998080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d> (ec0b5574-2029-4797-8c5c-b8c929a8fa7d) [No such file or directory] >[2016-04-19 07:24:34.998379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d> (ec0b5574-2029-4797-8c5c-b8c929a8fa7d) [No such file or directory] >[2016-04-19 07:24:35.001723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d> (ec0b5574-2029-4797-8c5c-b8c929a8fa7d) [No such file or directory] >[2016-04-19 07:24:35.001812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d> (ec0b5574-2029-4797-8c5c-b8c929a8fa7d) [No such file or directory] >[2016-04-19 07:24:35.002010] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ec0b5574-2029-4797-8c5c-b8c929a8fa7d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.010781] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.011607] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af> (d9e694ab-e0f1-4b03-a6be-161bf2a566af) [No such file or directory] >[2016-04-19 07:24:35.011795] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af> (d9e694ab-e0f1-4b03-a6be-161bf2a566af) [No such file or directory] >[2016-04-19 07:24:35.012907] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d9e694ab-e0f1-4b03-a6be-161bf2a566af. (Possible split-brain) >[2016-04-19 07:24:35.013694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af> (d9e694ab-e0f1-4b03-a6be-161bf2a566af) [No such file or directory] >[2016-04-19 07:24:35.013995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af> (d9e694ab-e0f1-4b03-a6be-161bf2a566af) [No such file or directory] >[2016-04-19 07:24:35.015493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af> (d9e694ab-e0f1-4b03-a6be-161bf2a566af) [No such file or directory] >[2016-04-19 07:24:35.015643] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af> (d9e694ab-e0f1-4b03-a6be-161bf2a566af) [No such file or directory] >[2016-04-19 07:24:35.015830] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.018286] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d9e694ab-e0f1-4b03-a6be-161bf2a566af. (Possible split-brain) >[2016-04-19 07:24:35.019190] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af> (d9e694ab-e0f1-4b03-a6be-161bf2a566af) [No such file or directory] >[2016-04-19 07:24:35.019399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af> (d9e694ab-e0f1-4b03-a6be-161bf2a566af) [No such file or directory] >[2016-04-19 07:24:35.022209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af> (d9e694ab-e0f1-4b03-a6be-161bf2a566af) [No such file or directory] >[2016-04-19 07:24:35.022351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af> (d9e694ab-e0f1-4b03-a6be-161bf2a566af) [No such file or directory] >[2016-04-19 07:24:35.022633] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d9e694ab-e0f1-4b03-a6be-161bf2a566af>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.031190] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.032182] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3> (54426517-b05e-4522-8ae4-46050ebe76b3) [No such file or directory] >[2016-04-19 07:24:35.032196] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3> (54426517-b05e-4522-8ae4-46050ebe76b3) [No such file or directory] >[2016-04-19 07:24:35.033190] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 54426517-b05e-4522-8ae4-46050ebe76b3. (Possible split-brain) >[2016-04-19 07:24:35.034295] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3> (54426517-b05e-4522-8ae4-46050ebe76b3) [No such file or directory] >[2016-04-19 07:24:35.034441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3> (54426517-b05e-4522-8ae4-46050ebe76b3) [No such file or directory] >[2016-04-19 07:24:35.035597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3> (54426517-b05e-4522-8ae4-46050ebe76b3) [No such file or directory] >[2016-04-19 07:24:35.035898] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3> (54426517-b05e-4522-8ae4-46050ebe76b3) [No such file or directory] >[2016-04-19 07:24:35.036100] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.038850] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 54426517-b05e-4522-8ae4-46050ebe76b3. (Possible split-brain) >[2016-04-19 07:24:35.039756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3> (54426517-b05e-4522-8ae4-46050ebe76b3) [No such file or directory] >[2016-04-19 07:24:35.039831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3> (54426517-b05e-4522-8ae4-46050ebe76b3) [No such file or directory] >[2016-04-19 07:24:35.042342] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3> (54426517-b05e-4522-8ae4-46050ebe76b3) [No such file or directory] >[2016-04-19 07:24:35.042430] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3> (54426517-b05e-4522-8ae4-46050ebe76b3) [No such file or directory] >[2016-04-19 07:24:35.042939] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:54426517-b05e-4522-8ae4-46050ebe76b3>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.050691] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.051683] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0> (cec97097-7ad8-4e06-a651-3d31c266e6d0) [No such file or directory] >[2016-04-19 07:24:35.051696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0> (cec97097-7ad8-4e06-a651-3d31c266e6d0) [No such file or directory] >[2016-04-19 07:24:35.054687] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cec97097-7ad8-4e06-a651-3d31c266e6d0. (Possible split-brain) >[2016-04-19 07:24:35.055644] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0> (cec97097-7ad8-4e06-a651-3d31c266e6d0) [No such file or directory] >[2016-04-19 07:24:35.055656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0> (cec97097-7ad8-4e06-a651-3d31c266e6d0) [No such file or directory] >[2016-04-19 07:24:35.057148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0> (cec97097-7ad8-4e06-a651-3d31c266e6d0) [No such file or directory] >[2016-04-19 07:24:35.057183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0> (cec97097-7ad8-4e06-a651-3d31c266e6d0) [No such file or directory] >[2016-04-19 07:24:35.057417] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.059991] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cec97097-7ad8-4e06-a651-3d31c266e6d0. (Possible split-brain) >[2016-04-19 07:24:35.060975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0> (cec97097-7ad8-4e06-a651-3d31c266e6d0) [No such file or directory] >[2016-04-19 07:24:35.060989] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0> (cec97097-7ad8-4e06-a651-3d31c266e6d0) [No such file or directory] >[2016-04-19 07:24:35.063965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0> (cec97097-7ad8-4e06-a651-3d31c266e6d0) [No such file or directory] >[2016-04-19 07:24:35.063996] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0> (cec97097-7ad8-4e06-a651-3d31c266e6d0) [No such file or directory] >[2016-04-19 07:24:35.064178] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cec97097-7ad8-4e06-a651-3d31c266e6d0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.071280] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.072014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6> (e8ba304f-e99b-41e1-86aa-b522ccd2f3f6) [No such file or directory] >[2016-04-19 07:24:35.072253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6> (e8ba304f-e99b-41e1-86aa-b522ccd2f3f6) [No such file or directory] >[2016-04-19 07:24:35.073381] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e8ba304f-e99b-41e1-86aa-b522ccd2f3f6. (Possible split-brain) >[2016-04-19 07:24:35.074197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6> (e8ba304f-e99b-41e1-86aa-b522ccd2f3f6) [No such file or directory] >[2016-04-19 07:24:35.074296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6> (e8ba304f-e99b-41e1-86aa-b522ccd2f3f6) [No such file or directory] >[2016-04-19 07:24:35.075531] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6> (e8ba304f-e99b-41e1-86aa-b522ccd2f3f6) [No such file or directory] >[2016-04-19 07:24:35.075643] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6> (e8ba304f-e99b-41e1-86aa-b522ccd2f3f6) [No such file or directory] >[2016-04-19 07:24:35.075767] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.078354] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e8ba304f-e99b-41e1-86aa-b522ccd2f3f6. (Possible split-brain) >[2016-04-19 07:24:35.079095] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6> (e8ba304f-e99b-41e1-86aa-b522ccd2f3f6) [No such file or directory] >[2016-04-19 07:24:35.079349] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6> (e8ba304f-e99b-41e1-86aa-b522ccd2f3f6) [No such file or directory] >[2016-04-19 07:24:35.081747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6> (e8ba304f-e99b-41e1-86aa-b522ccd2f3f6) [No such file or directory] >[2016-04-19 07:24:35.082054] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6> (e8ba304f-e99b-41e1-86aa-b522ccd2f3f6) [No such file or directory] >[2016-04-19 07:24:35.082200] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e8ba304f-e99b-41e1-86aa-b522ccd2f3f6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.090504] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.091434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32> (0063d3ba-55bc-44c1-ad99-7979b43f9c32) [No such file or directory] >[2016-04-19 07:24:35.091507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32> (0063d3ba-55bc-44c1-ad99-7979b43f9c32) [No such file or directory] >[2016-04-19 07:24:35.094407] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0063d3ba-55bc-44c1-ad99-7979b43f9c32. (Possible split-brain) >[2016-04-19 07:24:35.095433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32> (0063d3ba-55bc-44c1-ad99-7979b43f9c32) [No such file or directory] >[2016-04-19 07:24:35.095501] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32> (0063d3ba-55bc-44c1-ad99-7979b43f9c32) [No such file or directory] >[2016-04-19 07:24:35.096665] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32> (0063d3ba-55bc-44c1-ad99-7979b43f9c32) [No such file or directory] >[2016-04-19 07:24:35.096780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32> (0063d3ba-55bc-44c1-ad99-7979b43f9c32) [No such file or directory] >[2016-04-19 07:24:35.096886] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.099615] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0063d3ba-55bc-44c1-ad99-7979b43f9c32. (Possible split-brain) >[2016-04-19 07:24:35.100780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32> (0063d3ba-55bc-44c1-ad99-7979b43f9c32) [No such file or directory] >[2016-04-19 07:24:35.100797] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32> (0063d3ba-55bc-44c1-ad99-7979b43f9c32) [No such file or directory] >[2016-04-19 07:24:35.103313] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32> (0063d3ba-55bc-44c1-ad99-7979b43f9c32) [No such file or directory] >[2016-04-19 07:24:35.103633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32> (0063d3ba-55bc-44c1-ad99-7979b43f9c32) [No such file or directory] >[2016-04-19 07:24:35.103796] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0063d3ba-55bc-44c1-ad99-7979b43f9c32>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.112264] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.113188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987> (e92863fe-8e92-4fd1-bb47-666ca3ba7987) [No such file or directory] >[2016-04-19 07:24:35.113291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987> (e92863fe-8e92-4fd1-bb47-666ca3ba7987) [No such file or directory] >[2016-04-19 07:24:35.116192] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e92863fe-8e92-4fd1-bb47-666ca3ba7987. (Possible split-brain) >[2016-04-19 07:24:35.117234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987> (e92863fe-8e92-4fd1-bb47-666ca3ba7987) [No such file or directory] >[2016-04-19 07:24:35.117259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987> (e92863fe-8e92-4fd1-bb47-666ca3ba7987) [No such file or directory] >[2016-04-19 07:24:35.118616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987> (e92863fe-8e92-4fd1-bb47-666ca3ba7987) [No such file or directory] >[2016-04-19 07:24:35.118646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987> (e92863fe-8e92-4fd1-bb47-666ca3ba7987) [No such file or directory] >[2016-04-19 07:24:35.118830] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.121621] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e92863fe-8e92-4fd1-bb47-666ca3ba7987. (Possible split-brain) >[2016-04-19 07:24:35.122788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987> (e92863fe-8e92-4fd1-bb47-666ca3ba7987) [No such file or directory] >[2016-04-19 07:24:35.122972] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987> (e92863fe-8e92-4fd1-bb47-666ca3ba7987) [No such file or directory] >[2016-04-19 07:24:35.125694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987> (e92863fe-8e92-4fd1-bb47-666ca3ba7987) [No such file or directory] >[2016-04-19 07:24:35.125846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987> (e92863fe-8e92-4fd1-bb47-666ca3ba7987) [No such file or directory] >[2016-04-19 07:24:35.126036] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e92863fe-8e92-4fd1-bb47-666ca3ba7987>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.134982] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.135845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:22d830a0-5173-4732-940f-b2f54a71e649> (22d830a0-5173-4732-940f-b2f54a71e649) [No such file or directory] >[2016-04-19 07:24:35.136027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:22d830a0-5173-4732-940f-b2f54a71e649> (22d830a0-5173-4732-940f-b2f54a71e649) [No such file or directory] >[2016-04-19 07:24:35.138538] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 22d830a0-5173-4732-940f-b2f54a71e649. (Possible split-brain) >[2016-04-19 07:24:35.139265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:22d830a0-5173-4732-940f-b2f54a71e649> (22d830a0-5173-4732-940f-b2f54a71e649) [No such file or directory] >[2016-04-19 07:24:35.139522] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:22d830a0-5173-4732-940f-b2f54a71e649> (22d830a0-5173-4732-940f-b2f54a71e649) [No such file or directory] >[2016-04-19 07:24:35.140693] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:22d830a0-5173-4732-940f-b2f54a71e649> (22d830a0-5173-4732-940f-b2f54a71e649) [No such file or directory] >[2016-04-19 07:24:35.141038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:22d830a0-5173-4732-940f-b2f54a71e649> (22d830a0-5173-4732-940f-b2f54a71e649) [No such file or directory] >[2016-04-19 07:24:35.141243] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:22d830a0-5173-4732-940f-b2f54a71e649>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.143947] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 22d830a0-5173-4732-940f-b2f54a71e649. (Possible split-brain) >[2016-04-19 07:24:35.144676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:22d830a0-5173-4732-940f-b2f54a71e649> (22d830a0-5173-4732-940f-b2f54a71e649) [No such file or directory] >[2016-04-19 07:24:35.144937] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:22d830a0-5173-4732-940f-b2f54a71e649> (22d830a0-5173-4732-940f-b2f54a71e649) [No such file or directory] >[2016-04-19 07:24:35.147828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:22d830a0-5173-4732-940f-b2f54a71e649> (22d830a0-5173-4732-940f-b2f54a71e649) [No such file or directory] >[2016-04-19 07:24:35.148107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:22d830a0-5173-4732-940f-b2f54a71e649> (22d830a0-5173-4732-940f-b2f54a71e649) [No such file or directory] >[2016-04-19 07:24:35.148310] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:22d830a0-5173-4732-940f-b2f54a71e649>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.155838] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.156926] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8> (24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8) [No such file or directory] >[2016-04-19 07:24:35.156932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8> (24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8) [No such file or directory] >[2016-04-19 07:24:35.157929] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8. (Possible split-brain) >[2016-04-19 07:24:35.158872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8> (24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8) [No such file or directory] >[2016-04-19 07:24:35.159059] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8> (24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8) [No such file or directory] >[2016-04-19 07:24:35.160235] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8> (24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8) [No such file or directory] >[2016-04-19 07:24:35.160374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8> (24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8) [No such file or directory] >[2016-04-19 07:24:35.160583] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.163202] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8. (Possible split-brain) >[2016-04-19 07:24:35.164362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8> (24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8) [No such file or directory] >[2016-04-19 07:24:35.164476] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8> (24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8) [No such file or directory] >[2016-04-19 07:24:35.166788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8> (24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8) [No such file or directory] >[2016-04-19 07:24:35.167176] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8> (24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8) [No such file or directory] >[2016-04-19 07:24:35.167311] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:24db1e4f-ab0e-4474-8f8e-c46ce7df3ee8>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.177498] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.178654] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef> (68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef) [No such file or directory] >[2016-04-19 07:24:35.178763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef> (68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef) [No such file or directory] >[2016-04-19 07:24:35.179739] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef. (Possible split-brain) >[2016-04-19 07:24:35.180847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef> (68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef) [No such file or directory] >[2016-04-19 07:24:35.180943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef> (68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef) [No such file or directory] >[2016-04-19 07:24:35.182310] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef> (68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef) [No such file or directory] >[2016-04-19 07:24:35.182367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef> (68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef) [No such file or directory] >[2016-04-19 07:24:35.182668] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.185193] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef. (Possible split-brain) >[2016-04-19 07:24:35.186220] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef> (68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef) [No such file or directory] >[2016-04-19 07:24:35.186441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef> (68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef) [No such file or directory] >[2016-04-19 07:24:35.189087] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef> (68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef) [No such file or directory] >[2016-04-19 07:24:35.189178] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef> (68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef) [No such file or directory] >[2016-04-19 07:24:35.189713] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:68e7a8c1-ed5c-4ef4-b624-65fc6b7f18ef>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.198070] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.199058] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b> (97de8a3c-beda-4e05-b93e-d937cc871b5b) [No such file or directory] >[2016-04-19 07:24:35.199082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b> (97de8a3c-beda-4e05-b93e-d937cc871b5b) [No such file or directory] >[2016-04-19 07:24:35.201980] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 97de8a3c-beda-4e05-b93e-d937cc871b5b. (Possible split-brain) >[2016-04-19 07:24:35.203001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b> (97de8a3c-beda-4e05-b93e-d937cc871b5b) [No such file or directory] >[2016-04-19 07:24:35.203420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b> (97de8a3c-beda-4e05-b93e-d937cc871b5b) [No such file or directory] >[2016-04-19 07:24:35.204944] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b> (97de8a3c-beda-4e05-b93e-d937cc871b5b) [No such file or directory] >[2016-04-19 07:24:35.204980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b> (97de8a3c-beda-4e05-b93e-d937cc871b5b) [No such file or directory] >[2016-04-19 07:24:35.205145] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.207974] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 97de8a3c-beda-4e05-b93e-d937cc871b5b. (Possible split-brain) >[2016-04-19 07:24:35.208838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b> (97de8a3c-beda-4e05-b93e-d937cc871b5b) [No such file or directory] >[2016-04-19 07:24:35.209145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b> (97de8a3c-beda-4e05-b93e-d937cc871b5b) [No such file or directory] >[2016-04-19 07:24:35.212288] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b> (97de8a3c-beda-4e05-b93e-d937cc871b5b) [No such file or directory] >[2016-04-19 07:24:35.212546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b> (97de8a3c-beda-4e05-b93e-d937cc871b5b) [No such file or directory] >[2016-04-19 07:24:35.212725] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:97de8a3c-beda-4e05-b93e-d937cc871b5b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.222825] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.224041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8> (80245288-d187-485e-9eb7-2ffa44dcd9b8) [No such file or directory] >[2016-04-19 07:24:35.224062] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8> (80245288-d187-485e-9eb7-2ffa44dcd9b8) [No such file or directory] >[2016-04-19 07:24:35.225212] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 80245288-d187-485e-9eb7-2ffa44dcd9b8. (Possible split-brain) >[2016-04-19 07:24:35.226380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8> (80245288-d187-485e-9eb7-2ffa44dcd9b8) [No such file or directory] >[2016-04-19 07:24:35.226399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8> (80245288-d187-485e-9eb7-2ffa44dcd9b8) [No such file or directory] >[2016-04-19 07:24:35.227783] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8> (80245288-d187-485e-9eb7-2ffa44dcd9b8) [No such file or directory] >[2016-04-19 07:24:35.227811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8> (80245288-d187-485e-9eb7-2ffa44dcd9b8) [No such file or directory] >[2016-04-19 07:24:35.228040] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.230781] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 80245288-d187-485e-9eb7-2ffa44dcd9b8. (Possible split-brain) >[2016-04-19 07:24:35.231891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8> (80245288-d187-485e-9eb7-2ffa44dcd9b8) [No such file or directory] >[2016-04-19 07:24:35.231988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8> (80245288-d187-485e-9eb7-2ffa44dcd9b8) [No such file or directory] >[2016-04-19 07:24:35.234676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8> (80245288-d187-485e-9eb7-2ffa44dcd9b8) [No such file or directory] >[2016-04-19 07:24:35.234703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8> (80245288-d187-485e-9eb7-2ffa44dcd9b8) [No such file or directory] >[2016-04-19 07:24:35.234885] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:80245288-d187-485e-9eb7-2ffa44dcd9b8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.243805] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.244738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8> (a7e15b74-af12-4023-baa0-43c66b5247c8) [No such file or directory] >[2016-04-19 07:24:35.245079] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8> (a7e15b74-af12-4023-baa0-43c66b5247c8) [No such file or directory] >[2016-04-19 07:24:35.248000] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a7e15b74-af12-4023-baa0-43c66b5247c8. (Possible split-brain) >[2016-04-19 07:24:35.248771] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8> (a7e15b74-af12-4023-baa0-43c66b5247c8) [No such file or directory] >[2016-04-19 07:24:35.249097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8> (a7e15b74-af12-4023-baa0-43c66b5247c8) [No such file or directory] >[2016-04-19 07:24:35.250716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8> (a7e15b74-af12-4023-baa0-43c66b5247c8) [No such file or directory] >[2016-04-19 07:24:35.250975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8> (a7e15b74-af12-4023-baa0-43c66b5247c8) [No such file or directory] >[2016-04-19 07:24:35.251135] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.253770] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a7e15b74-af12-4023-baa0-43c66b5247c8. (Possible split-brain) >[2016-04-19 07:24:35.254623] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8> (a7e15b74-af12-4023-baa0-43c66b5247c8) [No such file or directory] >[2016-04-19 07:24:35.254717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8> (a7e15b74-af12-4023-baa0-43c66b5247c8) [No such file or directory] >[2016-04-19 07:24:35.257798] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8> (a7e15b74-af12-4023-baa0-43c66b5247c8) [No such file or directory] >[2016-04-19 07:24:35.257804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8> (a7e15b74-af12-4023-baa0-43c66b5247c8) [No such file or directory] >[2016-04-19 07:24:35.258124] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a7e15b74-af12-4023-baa0-43c66b5247c8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.268118] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.269158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646> (b64d8cb5-20b1-4674-a10f-6db1d4ee6646) [No such file or directory] >[2016-04-19 07:24:35.269268] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646> (b64d8cb5-20b1-4674-a10f-6db1d4ee6646) [No such file or directory] >[2016-04-19 07:24:35.270402] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b64d8cb5-20b1-4674-a10f-6db1d4ee6646. (Possible split-brain) >[2016-04-19 07:24:35.271609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646> (b64d8cb5-20b1-4674-a10f-6db1d4ee6646) [No such file or directory] >[2016-04-19 07:24:35.271638] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646> (b64d8cb5-20b1-4674-a10f-6db1d4ee6646) [No such file or directory] >[2016-04-19 07:24:35.272885] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646> (b64d8cb5-20b1-4674-a10f-6db1d4ee6646) [No such file or directory] >[2016-04-19 07:24:35.273365] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646> (b64d8cb5-20b1-4674-a10f-6db1d4ee6646) [No such file or directory] >[2016-04-19 07:24:35.273569] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.276272] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b64d8cb5-20b1-4674-a10f-6db1d4ee6646. (Possible split-brain) >[2016-04-19 07:24:35.277300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646> (b64d8cb5-20b1-4674-a10f-6db1d4ee6646) [No such file or directory] >[2016-04-19 07:24:35.277443] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646> (b64d8cb5-20b1-4674-a10f-6db1d4ee6646) [No such file or directory] >[2016-04-19 07:24:35.279865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646> (b64d8cb5-20b1-4674-a10f-6db1d4ee6646) [No such file or directory] >[2016-04-19 07:24:35.280255] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646> (b64d8cb5-20b1-4674-a10f-6db1d4ee6646) [No such file or directory] >[2016-04-19 07:24:35.280552] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b64d8cb5-20b1-4674-a10f-6db1d4ee6646>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.289339] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.290153] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc> (63aa40e5-1d70-4247-87c6-0aaae66dccdc) [No such file or directory] >[2016-04-19 07:24:35.290475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc> (63aa40e5-1d70-4247-87c6-0aaae66dccdc) [No such file or directory] >[2016-04-19 07:24:35.293359] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 63aa40e5-1d70-4247-87c6-0aaae66dccdc. (Possible split-brain) >[2016-04-19 07:24:35.294113] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc> (63aa40e5-1d70-4247-87c6-0aaae66dccdc) [No such file or directory] >[2016-04-19 07:24:35.294397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc> (63aa40e5-1d70-4247-87c6-0aaae66dccdc) [No such file or directory] >[2016-04-19 07:24:35.295716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc> (63aa40e5-1d70-4247-87c6-0aaae66dccdc) [No such file or directory] >[2016-04-19 07:24:35.296017] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc> (63aa40e5-1d70-4247-87c6-0aaae66dccdc) [No such file or directory] >[2016-04-19 07:24:35.296224] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.298716] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 63aa40e5-1d70-4247-87c6-0aaae66dccdc. (Possible split-brain) >[2016-04-19 07:24:35.299469] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc> (63aa40e5-1d70-4247-87c6-0aaae66dccdc) [No such file or directory] >[2016-04-19 07:24:35.299769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc> (63aa40e5-1d70-4247-87c6-0aaae66dccdc) [No such file or directory] >[2016-04-19 07:24:35.302793] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc> (63aa40e5-1d70-4247-87c6-0aaae66dccdc) [No such file or directory] >[2016-04-19 07:24:35.302984] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc> (63aa40e5-1d70-4247-87c6-0aaae66dccdc) [No such file or directory] >[2016-04-19 07:24:35.303155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:63aa40e5-1d70-4247-87c6-0aaae66dccdc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.312038] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.313046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96> (3b81035a-9f10-402c-b9f7-5e9ba31bdd96) [No such file or directory] >[2016-04-19 07:24:35.313137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96> (3b81035a-9f10-402c-b9f7-5e9ba31bdd96) [No such file or directory] >[2016-04-19 07:24:35.314413] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3b81035a-9f10-402c-b9f7-5e9ba31bdd96. (Possible split-brain) >[2016-04-19 07:24:35.315195] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96> (3b81035a-9f10-402c-b9f7-5e9ba31bdd96) [No such file or directory] >[2016-04-19 07:24:35.315526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96> (3b81035a-9f10-402c-b9f7-5e9ba31bdd96) [No such file or directory] >[2016-04-19 07:24:35.316835] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96> (3b81035a-9f10-402c-b9f7-5e9ba31bdd96) [No such file or directory] >[2016-04-19 07:24:35.316915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96> (3b81035a-9f10-402c-b9f7-5e9ba31bdd96) [No such file or directory] >[2016-04-19 07:24:35.317091] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.319697] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3b81035a-9f10-402c-b9f7-5e9ba31bdd96. (Possible split-brain) >[2016-04-19 07:24:35.320518] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96> (3b81035a-9f10-402c-b9f7-5e9ba31bdd96) [No such file or directory] >[2016-04-19 07:24:35.320715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96> (3b81035a-9f10-402c-b9f7-5e9ba31bdd96) [No such file or directory] >[2016-04-19 07:24:35.323449] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96> (3b81035a-9f10-402c-b9f7-5e9ba31bdd96) [No such file or directory] >[2016-04-19 07:24:35.323576] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96> (3b81035a-9f10-402c-b9f7-5e9ba31bdd96) [No such file or directory] >[2016-04-19 07:24:35.323694] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3b81035a-9f10-402c-b9f7-5e9ba31bdd96>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.331898] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.332682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3> (19c0a6e5-0edf-42f3-bd56-ff9833b179f3) [No such file or directory] >[2016-04-19 07:24:35.333016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3> (19c0a6e5-0edf-42f3-bd56-ff9833b179f3) [No such file or directory] >[2016-04-19 07:24:35.335862] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 19c0a6e5-0edf-42f3-bd56-ff9833b179f3. (Possible split-brain) >[2016-04-19 07:24:35.336881] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3> (19c0a6e5-0edf-42f3-bd56-ff9833b179f3) [No such file or directory] >[2016-04-19 07:24:35.336987] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3> (19c0a6e5-0edf-42f3-bd56-ff9833b179f3) [No such file or directory] >[2016-04-19 07:24:35.338400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3> (19c0a6e5-0edf-42f3-bd56-ff9833b179f3) [No such file or directory] >[2016-04-19 07:24:35.338556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3> (19c0a6e5-0edf-42f3-bd56-ff9833b179f3) [No such file or directory] >[2016-04-19 07:24:35.338679] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.341466] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 19c0a6e5-0edf-42f3-bd56-ff9833b179f3. (Possible split-brain) >[2016-04-19 07:24:35.342436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3> (19c0a6e5-0edf-42f3-bd56-ff9833b179f3) [No such file or directory] >[2016-04-19 07:24:35.342438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3> (19c0a6e5-0edf-42f3-bd56-ff9833b179f3) [No such file or directory] >[2016-04-19 07:24:35.344846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3> (19c0a6e5-0edf-42f3-bd56-ff9833b179f3) [No such file or directory] >[2016-04-19 07:24:35.345112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3> (19c0a6e5-0edf-42f3-bd56-ff9833b179f3) [No such file or directory] >[2016-04-19 07:24:35.345429] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:19c0a6e5-0edf-42f3-bd56-ff9833b179f3>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:32.701446] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ddf0aab0-02fc-470c-af10-a2218e3947c8. (Possible split-brain) >The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ddf0aab0-02fc-470c-af10-a2218e3947c8> (ddf0aab0-02fc-470c-af10-a2218e3947c8) [No such file or directory]" repeated 4 times between [2016-04-19 07:24:32.695137] and [2016-04-19 07:24:32.705792] >[2016-04-19 07:24:35.354949] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.356087] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0915d529-b94c-4a0a-af1c-d56dfac38a5d> (0915d529-b94c-4a0a-af1c-d56dfac38a5d) [No such file or directory] >[2016-04-19 07:24:35.356093] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0915d529-b94c-4a0a-af1c-d56dfac38a5d> (0915d529-b94c-4a0a-af1c-d56dfac38a5d) [No such file or directory] >[2016-04-19 07:24:35.359786] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0915d529-b94c-4a0a-af1c-d56dfac38a5d. (Possible split-brain) >[2016-04-19 07:24:35.362619] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0915d529-b94c-4a0a-af1c-d56dfac38a5d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0915d529-b94c-4a0a-af1c-d56dfac38a5d> (0915d529-b94c-4a0a-af1c-d56dfac38a5d) [No such file or directory]" repeated 4 times between [2016-04-19 07:24:35.356093] and [2016-04-19 07:24:35.369084] >[2016-04-19 07:24:35.369256] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0915d529-b94c-4a0a-af1c-d56dfac38a5d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.377634] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.378502] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d> (217b3426-13d3-4127-9dc6-aee9a7ec020d) [No such file or directory] >[2016-04-19 07:24:35.378637] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d> (217b3426-13d3-4127-9dc6-aee9a7ec020d) [No such file or directory] >[2016-04-19 07:24:35.381588] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 217b3426-13d3-4127-9dc6-aee9a7ec020d. (Possible split-brain) >[2016-04-19 07:24:35.382457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d> (217b3426-13d3-4127-9dc6-aee9a7ec020d) [No such file or directory] >[2016-04-19 07:24:35.382781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d> (217b3426-13d3-4127-9dc6-aee9a7ec020d) [No such file or directory] >[2016-04-19 07:24:35.383847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d> (217b3426-13d3-4127-9dc6-aee9a7ec020d) [No such file or directory] >[2016-04-19 07:24:35.384283] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d> (217b3426-13d3-4127-9dc6-aee9a7ec020d) [No such file or directory] >[2016-04-19 07:24:35.384559] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.387359] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 217b3426-13d3-4127-9dc6-aee9a7ec020d. (Possible split-brain) >[2016-04-19 07:24:35.388248] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d> (217b3426-13d3-4127-9dc6-aee9a7ec020d) [No such file or directory] >[2016-04-19 07:24:35.388646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d> (217b3426-13d3-4127-9dc6-aee9a7ec020d) [No such file or directory] >[2016-04-19 07:24:35.391240] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d> (217b3426-13d3-4127-9dc6-aee9a7ec020d) [No such file or directory] >[2016-04-19 07:24:35.391423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d> (217b3426-13d3-4127-9dc6-aee9a7ec020d) [No such file or directory] >[2016-04-19 07:24:35.391612] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:217b3426-13d3-4127-9dc6-aee9a7ec020d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.400605] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.401403] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906> (36858a01-a67c-42d9-b72c-7bd1d5b87906) [No such file or directory] >[2016-04-19 07:24:35.401689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906> (36858a01-a67c-42d9-b72c-7bd1d5b87906) [No such file or directory] >[2016-04-19 07:24:35.402863] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 36858a01-a67c-42d9-b72c-7bd1d5b87906. (Possible split-brain) >[2016-04-19 07:24:35.403629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906> (36858a01-a67c-42d9-b72c-7bd1d5b87906) [No such file or directory] >[2016-04-19 07:24:35.403992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906> (36858a01-a67c-42d9-b72c-7bd1d5b87906) [No such file or directory] >[2016-04-19 07:24:35.405427] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906> (36858a01-a67c-42d9-b72c-7bd1d5b87906) [No such file or directory] >[2016-04-19 07:24:35.405708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906> (36858a01-a67c-42d9-b72c-7bd1d5b87906) [No such file or directory] >[2016-04-19 07:24:35.405887] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.408649] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 36858a01-a67c-42d9-b72c-7bd1d5b87906. (Possible split-brain) >[2016-04-19 07:24:35.409511] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906> (36858a01-a67c-42d9-b72c-7bd1d5b87906) [No such file or directory] >[2016-04-19 07:24:35.409781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906> (36858a01-a67c-42d9-b72c-7bd1d5b87906) [No such file or directory] >[2016-04-19 07:24:35.412719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906> (36858a01-a67c-42d9-b72c-7bd1d5b87906) [No such file or directory] >[2016-04-19 07:24:35.412823] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906> (36858a01-a67c-42d9-b72c-7bd1d5b87906) [No such file or directory] >[2016-04-19 07:24:35.413020] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:36858a01-a67c-42d9-b72c-7bd1d5b87906>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.421057] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.421995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e> (6ae21aba-0d6f-47d9-97ea-6f3874a54b7e) [No such file or directory] >[2016-04-19 07:24:35.422229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e> (6ae21aba-0d6f-47d9-97ea-6f3874a54b7e) [No such file or directory] >[2016-04-19 07:24:35.423203] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6ae21aba-0d6f-47d9-97ea-6f3874a54b7e. (Possible split-brain) >[2016-04-19 07:24:35.424143] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e> (6ae21aba-0d6f-47d9-97ea-6f3874a54b7e) [No such file or directory] >[2016-04-19 07:24:35.424247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e> (6ae21aba-0d6f-47d9-97ea-6f3874a54b7e) [No such file or directory] >[2016-04-19 07:24:35.425629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e> (6ae21aba-0d6f-47d9-97ea-6f3874a54b7e) [No such file or directory] >[2016-04-19 07:24:35.425741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e> (6ae21aba-0d6f-47d9-97ea-6f3874a54b7e) [No such file or directory] >[2016-04-19 07:24:35.425898] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.428561] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6ae21aba-0d6f-47d9-97ea-6f3874a54b7e. (Possible split-brain) >[2016-04-19 07:24:35.429766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e> (6ae21aba-0d6f-47d9-97ea-6f3874a54b7e) [No such file or directory] >[2016-04-19 07:24:35.429883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e> (6ae21aba-0d6f-47d9-97ea-6f3874a54b7e) [No such file or directory] >[2016-04-19 07:24:35.432740] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e> (6ae21aba-0d6f-47d9-97ea-6f3874a54b7e) [No such file or directory] >[2016-04-19 07:24:35.432834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e> (6ae21aba-0d6f-47d9-97ea-6f3874a54b7e) [No such file or directory] >[2016-04-19 07:24:35.433420] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6ae21aba-0d6f-47d9-97ea-6f3874a54b7e>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.443241] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.444088] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e> (16b713f4-f880-4465-b7ca-5fd62bf28a0e) [No such file or directory] >[2016-04-19 07:24:35.444412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e> (16b713f4-f880-4465-b7ca-5fd62bf28a0e) [No such file or directory] >[2016-04-19 07:24:35.445519] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 16b713f4-f880-4465-b7ca-5fd62bf28a0e. (Possible split-brain) >[2016-04-19 07:24:35.446548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e> (16b713f4-f880-4465-b7ca-5fd62bf28a0e) [No such file or directory] >[2016-04-19 07:24:35.446738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e> (16b713f4-f880-4465-b7ca-5fd62bf28a0e) [No such file or directory] >[2016-04-19 07:24:35.448140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e> (16b713f4-f880-4465-b7ca-5fd62bf28a0e) [No such file or directory] >[2016-04-19 07:24:35.448174] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e> (16b713f4-f880-4465-b7ca-5fd62bf28a0e) [No such file or directory] >[2016-04-19 07:24:35.448381] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.450978] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 16b713f4-f880-4465-b7ca-5fd62bf28a0e. (Possible split-brain) >[2016-04-19 07:24:35.451794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e> (16b713f4-f880-4465-b7ca-5fd62bf28a0e) [No such file or directory] >[2016-04-19 07:24:35.452038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e> (16b713f4-f880-4465-b7ca-5fd62bf28a0e) [No such file or directory] >[2016-04-19 07:24:35.454882] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e> (16b713f4-f880-4465-b7ca-5fd62bf28a0e) [No such file or directory] >[2016-04-19 07:24:35.454889] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e> (16b713f4-f880-4465-b7ca-5fd62bf28a0e) [No such file or directory] >[2016-04-19 07:24:35.455566] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:16b713f4-f880-4465-b7ca-5fd62bf28a0e>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.464494] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.465412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d> (bc159f46-a88c-4339-b770-0b808ecf206d) [No such file or directory] >[2016-04-19 07:24:35.465884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d> (bc159f46-a88c-4339-b770-0b808ecf206d) [No such file or directory] >[2016-04-19 07:24:35.466989] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bc159f46-a88c-4339-b770-0b808ecf206d. (Possible split-brain) >[2016-04-19 07:24:35.467965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d> (bc159f46-a88c-4339-b770-0b808ecf206d) [No such file or directory] >[2016-04-19 07:24:35.470065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d> (bc159f46-a88c-4339-b770-0b808ecf206d) [No such file or directory] >[2016-04-19 07:24:35.471680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d> (bc159f46-a88c-4339-b770-0b808ecf206d) [No such file or directory] >[2016-04-19 07:24:35.471687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d> (bc159f46-a88c-4339-b770-0b808ecf206d) [No such file or directory] >[2016-04-19 07:24:35.471852] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.474295] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bc159f46-a88c-4339-b770-0b808ecf206d. (Possible split-brain) >[2016-04-19 07:24:35.475456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d> (bc159f46-a88c-4339-b770-0b808ecf206d) [No such file or directory] >[2016-04-19 07:24:35.475570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d> (bc159f46-a88c-4339-b770-0b808ecf206d) [No such file or directory] >[2016-04-19 07:24:35.478620] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d> (bc159f46-a88c-4339-b770-0b808ecf206d) [No such file or directory] >[2016-04-19 07:24:35.478717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d> (bc159f46-a88c-4339-b770-0b808ecf206d) [No such file or directory] >[2016-04-19 07:24:35.478918] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bc159f46-a88c-4339-b770-0b808ecf206d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.488496] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.489708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da> (10425f51-d7be-4136-92ac-fe4b8f8940da) [No such file or directory] >[2016-04-19 07:24:35.489797] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da> (10425f51-d7be-4136-92ac-fe4b8f8940da) [No such file or directory] >[2016-04-19 07:24:35.491753] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 10425f51-d7be-4136-92ac-fe4b8f8940da. (Possible split-brain) >[2016-04-19 07:24:35.492457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da> (10425f51-d7be-4136-92ac-fe4b8f8940da) [No such file or directory] >[2016-04-19 07:24:35.492564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da> (10425f51-d7be-4136-92ac-fe4b8f8940da) [No such file or directory] >[2016-04-19 07:24:35.493355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da> (10425f51-d7be-4136-92ac-fe4b8f8940da) [No such file or directory] >[2016-04-19 07:24:35.493407] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da> (10425f51-d7be-4136-92ac-fe4b8f8940da) [No such file or directory] >[2016-04-19 07:24:35.493875] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.496356] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 10425f51-d7be-4136-92ac-fe4b8f8940da. (Possible split-brain) >[2016-04-19 07:24:35.497141] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da> (10425f51-d7be-4136-92ac-fe4b8f8940da) [No such file or directory] >[2016-04-19 07:24:35.497201] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da> (10425f51-d7be-4136-92ac-fe4b8f8940da) [No such file or directory] >[2016-04-19 07:24:35.499288] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da> (10425f51-d7be-4136-92ac-fe4b8f8940da) [No such file or directory] >[2016-04-19 07:24:35.499360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da> (10425f51-d7be-4136-92ac-fe4b8f8940da) [No such file or directory] >[2016-04-19 07:24:35.499715] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:10425f51-d7be-4136-92ac-fe4b8f8940da>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.506554] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.507401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0> (18dee1d6-8b9d-44f8-8510-ebaf346ca7a0) [No such file or directory] >[2016-04-19 07:24:35.507408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0> (18dee1d6-8b9d-44f8-8510-ebaf346ca7a0) [No such file or directory] >[2016-04-19 07:24:35.508360] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 18dee1d6-8b9d-44f8-8510-ebaf346ca7a0. (Possible split-brain) >[2016-04-19 07:24:35.509172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0> (18dee1d6-8b9d-44f8-8510-ebaf346ca7a0) [No such file or directory] >[2016-04-19 07:24:35.509237] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0> (18dee1d6-8b9d-44f8-8510-ebaf346ca7a0) [No such file or directory] >[2016-04-19 07:24:35.510154] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0> (18dee1d6-8b9d-44f8-8510-ebaf346ca7a0) [No such file or directory] >[2016-04-19 07:24:35.510184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0> (18dee1d6-8b9d-44f8-8510-ebaf346ca7a0) [No such file or directory] >[2016-04-19 07:24:35.510728] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.513205] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 18dee1d6-8b9d-44f8-8510-ebaf346ca7a0. (Possible split-brain) >[2016-04-19 07:24:35.514260] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0> (18dee1d6-8b9d-44f8-8510-ebaf346ca7a0) [No such file or directory] >[2016-04-19 07:24:35.514392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0> (18dee1d6-8b9d-44f8-8510-ebaf346ca7a0) [No such file or directory] >[2016-04-19 07:24:35.516817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0> (18dee1d6-8b9d-44f8-8510-ebaf346ca7a0) [No such file or directory] >[2016-04-19 07:24:35.516864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0> (18dee1d6-8b9d-44f8-8510-ebaf346ca7a0) [No such file or directory] >[2016-04-19 07:24:35.517237] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:18dee1d6-8b9d-44f8-8510-ebaf346ca7a0>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.525906] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.526921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5> (f04fd901-5a6a-49d3-90c7-c785e4e5b7c5) [No such file or directory] >[2016-04-19 07:24:35.527008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5> (f04fd901-5a6a-49d3-90c7-c785e4e5b7c5) [No such file or directory] >[2016-04-19 07:24:35.529565] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f04fd901-5a6a-49d3-90c7-c785e4e5b7c5. (Possible split-brain) >[2016-04-19 07:24:35.530581] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5> (f04fd901-5a6a-49d3-90c7-c785e4e5b7c5) [No such file or directory] >[2016-04-19 07:24:35.530682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5> (f04fd901-5a6a-49d3-90c7-c785e4e5b7c5) [No such file or directory] >[2016-04-19 07:24:35.531765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5> (f04fd901-5a6a-49d3-90c7-c785e4e5b7c5) [No such file or directory] >[2016-04-19 07:24:35.532221] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5> (f04fd901-5a6a-49d3-90c7-c785e4e5b7c5) [No such file or directory] >[2016-04-19 07:24:35.532432] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.534991] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f04fd901-5a6a-49d3-90c7-c785e4e5b7c5. (Possible split-brain) >[2016-04-19 07:24:35.536094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5> (f04fd901-5a6a-49d3-90c7-c785e4e5b7c5) [No such file or directory] >[2016-04-19 07:24:35.536193] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5> (f04fd901-5a6a-49d3-90c7-c785e4e5b7c5) [No such file or directory] >[2016-04-19 07:24:35.538545] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5> (f04fd901-5a6a-49d3-90c7-c785e4e5b7c5) [No such file or directory] >[2016-04-19 07:24:35.538574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5> (f04fd901-5a6a-49d3-90c7-c785e4e5b7c5) [No such file or directory] >[2016-04-19 07:24:35.539023] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f04fd901-5a6a-49d3-90c7-c785e4e5b7c5>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.546825] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.547789] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0062be2f-557b-4a80-a552-5efaf636993d> (0062be2f-557b-4a80-a552-5efaf636993d) [No such file or directory] >[2016-04-19 07:24:35.547955] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0062be2f-557b-4a80-a552-5efaf636993d> (0062be2f-557b-4a80-a552-5efaf636993d) [No such file or directory] >[2016-04-19 07:24:35.550797] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0062be2f-557b-4a80-a552-5efaf636993d. (Possible split-brain) >[2016-04-19 07:24:35.551683] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0062be2f-557b-4a80-a552-5efaf636993d> (0062be2f-557b-4a80-a552-5efaf636993d) [No such file or directory] >[2016-04-19 07:24:35.551806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0062be2f-557b-4a80-a552-5efaf636993d> (0062be2f-557b-4a80-a552-5efaf636993d) [No such file or directory] >[2016-04-19 07:24:35.552980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0062be2f-557b-4a80-a552-5efaf636993d> (0062be2f-557b-4a80-a552-5efaf636993d) [No such file or directory] >[2016-04-19 07:24:35.553285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0062be2f-557b-4a80-a552-5efaf636993d> (0062be2f-557b-4a80-a552-5efaf636993d) [No such file or directory] >[2016-04-19 07:24:35.553445] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0062be2f-557b-4a80-a552-5efaf636993d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.555957] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0062be2f-557b-4a80-a552-5efaf636993d. (Possible split-brain) >[2016-04-19 07:24:35.557004] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0062be2f-557b-4a80-a552-5efaf636993d> (0062be2f-557b-4a80-a552-5efaf636993d) [No such file or directory] >[2016-04-19 07:24:35.557125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0062be2f-557b-4a80-a552-5efaf636993d> (0062be2f-557b-4a80-a552-5efaf636993d) [No such file or directory] >[2016-04-19 07:24:35.559690] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0062be2f-557b-4a80-a552-5efaf636993d> (0062be2f-557b-4a80-a552-5efaf636993d) [No such file or directory] >[2016-04-19 07:24:35.559759] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0062be2f-557b-4a80-a552-5efaf636993d> (0062be2f-557b-4a80-a552-5efaf636993d) [No such file or directory] >[2016-04-19 07:24:35.559938] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0062be2f-557b-4a80-a552-5efaf636993d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.569093] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.570258] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d> (e69bf66b-0775-432d-bc22-8a7a135fef5d) [No such file or directory] >[2016-04-19 07:24:35.570381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d> (e69bf66b-0775-432d-bc22-8a7a135fef5d) [No such file or directory] >[2016-04-19 07:24:35.573205] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e69bf66b-0775-432d-bc22-8a7a135fef5d. (Possible split-brain) >[2016-04-19 07:24:35.574404] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d> (e69bf66b-0775-432d-bc22-8a7a135fef5d) [No such file or directory] >[2016-04-19 07:24:35.574418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d> (e69bf66b-0775-432d-bc22-8a7a135fef5d) [No such file or directory] >[2016-04-19 07:24:35.575677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d> (e69bf66b-0775-432d-bc22-8a7a135fef5d) [No such file or directory] >[2016-04-19 07:24:35.575727] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d> (e69bf66b-0775-432d-bc22-8a7a135fef5d) [No such file or directory] >[2016-04-19 07:24:35.575989] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.578405] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e69bf66b-0775-432d-bc22-8a7a135fef5d. (Possible split-brain) >[2016-04-19 07:24:35.579512] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d> (e69bf66b-0775-432d-bc22-8a7a135fef5d) [No such file or directory] >[2016-04-19 07:24:35.579619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d> (e69bf66b-0775-432d-bc22-8a7a135fef5d) [No such file or directory] >[2016-04-19 07:24:35.582473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d> (e69bf66b-0775-432d-bc22-8a7a135fef5d) [No such file or directory] >[2016-04-19 07:24:35.582857] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d> (e69bf66b-0775-432d-bc22-8a7a135fef5d) [No such file or directory] >[2016-04-19 07:24:35.583055] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e69bf66b-0775-432d-bc22-8a7a135fef5d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.592139] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.593120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5651091a-1e90-465c-9287-2159d7512318> (5651091a-1e90-465c-9287-2159d7512318) [No such file or directory] >[2016-04-19 07:24:35.593436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5651091a-1e90-465c-9287-2159d7512318> (5651091a-1e90-465c-9287-2159d7512318) [No such file or directory] >[2016-04-19 07:24:35.594549] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5651091a-1e90-465c-9287-2159d7512318. (Possible split-brain) >[2016-04-19 07:24:35.595441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5651091a-1e90-465c-9287-2159d7512318> (5651091a-1e90-465c-9287-2159d7512318) [No such file or directory] >[2016-04-19 07:24:35.595684] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5651091a-1e90-465c-9287-2159d7512318> (5651091a-1e90-465c-9287-2159d7512318) [No such file or directory] >[2016-04-19 07:24:35.597085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5651091a-1e90-465c-9287-2159d7512318> (5651091a-1e90-465c-9287-2159d7512318) [No such file or directory] >[2016-04-19 07:24:35.597128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5651091a-1e90-465c-9287-2159d7512318> (5651091a-1e90-465c-9287-2159d7512318) [No such file or directory] >[2016-04-19 07:24:35.597683] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5651091a-1e90-465c-9287-2159d7512318>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.600155] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5651091a-1e90-465c-9287-2159d7512318. (Possible split-brain) >[2016-04-19 07:24:35.601380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5651091a-1e90-465c-9287-2159d7512318> (5651091a-1e90-465c-9287-2159d7512318) [No such file or directory] >[2016-04-19 07:24:35.601493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5651091a-1e90-465c-9287-2159d7512318> (5651091a-1e90-465c-9287-2159d7512318) [No such file or directory] >[2016-04-19 07:24:35.603970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5651091a-1e90-465c-9287-2159d7512318> (5651091a-1e90-465c-9287-2159d7512318) [No such file or directory] >[2016-04-19 07:24:35.604247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5651091a-1e90-465c-9287-2159d7512318> (5651091a-1e90-465c-9287-2159d7512318) [No such file or directory] >[2016-04-19 07:24:35.604652] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5651091a-1e90-465c-9287-2159d7512318>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.613702] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.614584] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6eef5808-5b48-4ac9-9322-940656779103> (6eef5808-5b48-4ac9-9322-940656779103) [No such file or directory] >[2016-04-19 07:24:35.614864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6eef5808-5b48-4ac9-9322-940656779103> (6eef5808-5b48-4ac9-9322-940656779103) [No such file or directory] >[2016-04-19 07:24:35.615832] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6eef5808-5b48-4ac9-9322-940656779103. (Possible split-brain) >[2016-04-19 07:24:35.616909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6eef5808-5b48-4ac9-9322-940656779103> (6eef5808-5b48-4ac9-9322-940656779103) [No such file or directory] >[2016-04-19 07:24:35.617014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6eef5808-5b48-4ac9-9322-940656779103> (6eef5808-5b48-4ac9-9322-940656779103) [No such file or directory] >[2016-04-19 07:24:35.618146] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6eef5808-5b48-4ac9-9322-940656779103> (6eef5808-5b48-4ac9-9322-940656779103) [No such file or directory] >[2016-04-19 07:24:35.618507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6eef5808-5b48-4ac9-9322-940656779103> (6eef5808-5b48-4ac9-9322-940656779103) [No such file or directory] >[2016-04-19 07:24:35.618683] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6eef5808-5b48-4ac9-9322-940656779103>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.621486] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6eef5808-5b48-4ac9-9322-940656779103. (Possible split-brain) >[2016-04-19 07:24:35.622442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6eef5808-5b48-4ac9-9322-940656779103> (6eef5808-5b48-4ac9-9322-940656779103) [No such file or directory] >[2016-04-19 07:24:35.622444] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6eef5808-5b48-4ac9-9322-940656779103> (6eef5808-5b48-4ac9-9322-940656779103) [No such file or directory] >[2016-04-19 07:24:35.625435] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6eef5808-5b48-4ac9-9322-940656779103> (6eef5808-5b48-4ac9-9322-940656779103) [No such file or directory] >[2016-04-19 07:24:35.625462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6eef5808-5b48-4ac9-9322-940656779103> (6eef5808-5b48-4ac9-9322-940656779103) [No such file or directory] >[2016-04-19 07:24:35.625687] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6eef5808-5b48-4ac9-9322-940656779103>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.634226] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.635101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6> (3b36182a-e244-4fa0-a673-bb939f1f07d6) [No such file or directory] >[2016-04-19 07:24:35.635401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6> (3b36182a-e244-4fa0-a673-bb939f1f07d6) [No such file or directory] >[2016-04-19 07:24:35.636506] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3b36182a-e244-4fa0-a673-bb939f1f07d6. (Possible split-brain) >[2016-04-19 07:24:35.637568] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6> (3b36182a-e244-4fa0-a673-bb939f1f07d6) [No such file or directory] >[2016-04-19 07:24:35.637580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6> (3b36182a-e244-4fa0-a673-bb939f1f07d6) [No such file or directory] >[2016-04-19 07:24:35.638595] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6> (3b36182a-e244-4fa0-a673-bb939f1f07d6) [No such file or directory] >[2016-04-19 07:24:35.639093] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6> (3b36182a-e244-4fa0-a673-bb939f1f07d6) [No such file or directory] >[2016-04-19 07:24:35.639224] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.641759] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3b36182a-e244-4fa0-a673-bb939f1f07d6. (Possible split-brain) >[2016-04-19 07:24:35.642628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6> (3b36182a-e244-4fa0-a673-bb939f1f07d6) [No such file or directory] >[2016-04-19 07:24:35.642925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6> (3b36182a-e244-4fa0-a673-bb939f1f07d6) [No such file or directory] >[2016-04-19 07:24:35.645395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6> (3b36182a-e244-4fa0-a673-bb939f1f07d6) [No such file or directory] >[2016-04-19 07:24:35.645415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6> (3b36182a-e244-4fa0-a673-bb939f1f07d6) [No such file or directory] >[2016-04-19 07:24:35.645738] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3b36182a-e244-4fa0-a673-bb939f1f07d6>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.654759] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.655809] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01> (bdbaf3bd-387f-4998-9e43-b1891813cc01) [No such file or directory] >[2016-04-19 07:24:35.655833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01> (bdbaf3bd-387f-4998-9e43-b1891813cc01) [No such file or directory] >[2016-04-19 07:24:35.656972] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bdbaf3bd-387f-4998-9e43-b1891813cc01. (Possible split-brain) >[2016-04-19 07:24:35.657827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01> (bdbaf3bd-387f-4998-9e43-b1891813cc01) [No such file or directory] >[2016-04-19 07:24:35.658160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01> (bdbaf3bd-387f-4998-9e43-b1891813cc01) [No such file or directory] >[2016-04-19 07:24:35.659181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01> (bdbaf3bd-387f-4998-9e43-b1891813cc01) [No such file or directory] >[2016-04-19 07:24:35.659520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01> (bdbaf3bd-387f-4998-9e43-b1891813cc01) [No such file or directory] >[2016-04-19 07:24:35.659657] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.662407] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bdbaf3bd-387f-4998-9e43-b1891813cc01. (Possible split-brain) >[2016-04-19 07:24:35.663355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01> (bdbaf3bd-387f-4998-9e43-b1891813cc01) [No such file or directory] >[2016-04-19 07:24:35.663385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01> (bdbaf3bd-387f-4998-9e43-b1891813cc01) [No such file or directory] >[2016-04-19 07:24:35.666042] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01> (bdbaf3bd-387f-4998-9e43-b1891813cc01) [No such file or directory] >[2016-04-19 07:24:35.666140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01> (bdbaf3bd-387f-4998-9e43-b1891813cc01) [No such file or directory] >[2016-04-19 07:24:35.666297] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bdbaf3bd-387f-4998-9e43-b1891813cc01>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.675180] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.676068] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a> (e5356c9c-e920-43dc-9b41-ee8b16f9c78a) [No such file or directory] >[2016-04-19 07:24:35.676357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a> (e5356c9c-e920-43dc-9b41-ee8b16f9c78a) [No such file or directory] >[2016-04-19 07:24:35.677298] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e5356c9c-e920-43dc-9b41-ee8b16f9c78a. (Possible split-brain) >[2016-04-19 07:24:35.678421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a> (e5356c9c-e920-43dc-9b41-ee8b16f9c78a) [No such file or directory] >[2016-04-19 07:24:35.678638] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a> (e5356c9c-e920-43dc-9b41-ee8b16f9c78a) [No such file or directory] >[2016-04-19 07:24:35.679877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a> (e5356c9c-e920-43dc-9b41-ee8b16f9c78a) [No such file or directory] >[2016-04-19 07:24:35.679935] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a> (e5356c9c-e920-43dc-9b41-ee8b16f9c78a) [No such file or directory] >[2016-04-19 07:24:35.680098] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.682946] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e5356c9c-e920-43dc-9b41-ee8b16f9c78a. (Possible split-brain) >[2016-04-19 07:24:35.683854] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a> (e5356c9c-e920-43dc-9b41-ee8b16f9c78a) [No such file or directory] >[2016-04-19 07:24:35.683954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a> (e5356c9c-e920-43dc-9b41-ee8b16f9c78a) [No such file or directory] >[2016-04-19 07:24:35.686709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a> (e5356c9c-e920-43dc-9b41-ee8b16f9c78a) [No such file or directory] >[2016-04-19 07:24:35.686787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a> (e5356c9c-e920-43dc-9b41-ee8b16f9c78a) [No such file or directory] >[2016-04-19 07:24:35.687022] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e5356c9c-e920-43dc-9b41-ee8b16f9c78a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.695782] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.696567] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0d890613-c67c-4334-bb3b-b46959484875> (0d890613-c67c-4334-bb3b-b46959484875) [No such file or directory] >[2016-04-19 07:24:35.696827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0d890613-c67c-4334-bb3b-b46959484875> (0d890613-c67c-4334-bb3b-b46959484875) [No such file or directory] >[2016-04-19 07:24:35.697700] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0d890613-c67c-4334-bb3b-b46959484875. (Possible split-brain) >[2016-04-19 07:24:35.698541] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0d890613-c67c-4334-bb3b-b46959484875> (0d890613-c67c-4334-bb3b-b46959484875) [No such file or directory] >[2016-04-19 07:24:35.699001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0d890613-c67c-4334-bb3b-b46959484875> (0d890613-c67c-4334-bb3b-b46959484875) [No such file or directory] >[2016-04-19 07:24:35.700162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0d890613-c67c-4334-bb3b-b46959484875> (0d890613-c67c-4334-bb3b-b46959484875) [No such file or directory] >[2016-04-19 07:24:35.700547] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0d890613-c67c-4334-bb3b-b46959484875> (0d890613-c67c-4334-bb3b-b46959484875) [No such file or directory] >[2016-04-19 07:24:35.700710] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0d890613-c67c-4334-bb3b-b46959484875>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.703207] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0d890613-c67c-4334-bb3b-b46959484875. (Possible split-brain) >[2016-04-19 07:24:35.704012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0d890613-c67c-4334-bb3b-b46959484875> (0d890613-c67c-4334-bb3b-b46959484875) [No such file or directory] >[2016-04-19 07:24:35.704408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0d890613-c67c-4334-bb3b-b46959484875> (0d890613-c67c-4334-bb3b-b46959484875) [No such file or directory] >[2016-04-19 07:24:35.707088] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0d890613-c67c-4334-bb3b-b46959484875> (0d890613-c67c-4334-bb3b-b46959484875) [No such file or directory] >[2016-04-19 07:24:35.707111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0d890613-c67c-4334-bb3b-b46959484875> (0d890613-c67c-4334-bb3b-b46959484875) [No such file or directory] >[2016-04-19 07:24:35.707287] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0d890613-c67c-4334-bb3b-b46959484875>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.715540] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.716384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951> (b939c440-aa2f-41a4-883b-de794ddb1951) [No such file or directory] >[2016-04-19 07:24:35.716671] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951> (b939c440-aa2f-41a4-883b-de794ddb1951) [No such file or directory] >[2016-04-19 07:24:35.717763] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b939c440-aa2f-41a4-883b-de794ddb1951. (Possible split-brain) >[2016-04-19 07:24:35.718831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951> (b939c440-aa2f-41a4-883b-de794ddb1951) [No such file or directory] >[2016-04-19 07:24:35.718856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951> (b939c440-aa2f-41a4-883b-de794ddb1951) [No such file or directory] >[2016-04-19 07:24:35.720093] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951> (b939c440-aa2f-41a4-883b-de794ddb1951) [No such file or directory] >[2016-04-19 07:24:35.720374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951> (b939c440-aa2f-41a4-883b-de794ddb1951) [No such file or directory] >[2016-04-19 07:24:35.720506] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.723242] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b939c440-aa2f-41a4-883b-de794ddb1951. (Possible split-brain) >[2016-04-19 07:24:35.724263] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951> (b939c440-aa2f-41a4-883b-de794ddb1951) [No such file or directory] >[2016-04-19 07:24:35.724288] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951> (b939c440-aa2f-41a4-883b-de794ddb1951) [No such file or directory] >[2016-04-19 07:24:35.726965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951> (b939c440-aa2f-41a4-883b-de794ddb1951) [No such file or directory] >[2016-04-19 07:24:35.726992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951> (b939c440-aa2f-41a4-883b-de794ddb1951) [No such file or directory] >[2016-04-19 07:24:35.727203] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b939c440-aa2f-41a4-883b-de794ddb1951>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.735974] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.736824] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3> (ab75916f-b07a-4669-a71b-e07004cabfa3) [No such file or directory] >[2016-04-19 07:24:35.737121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3> (ab75916f-b07a-4669-a71b-e07004cabfa3) [No such file or directory] >[2016-04-19 07:24:35.738238] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ab75916f-b07a-4669-a71b-e07004cabfa3. (Possible split-brain) >[2016-04-19 07:24:35.739185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3> (ab75916f-b07a-4669-a71b-e07004cabfa3) [No such file or directory] >[2016-04-19 07:24:35.739391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3> (ab75916f-b07a-4669-a71b-e07004cabfa3) [No such file or directory] >[2016-04-19 07:24:35.740828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3> (ab75916f-b07a-4669-a71b-e07004cabfa3) [No such file or directory] >[2016-04-19 07:24:35.741214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3> (ab75916f-b07a-4669-a71b-e07004cabfa3) [No such file or directory] >[2016-04-19 07:24:35.741410] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.743921] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ab75916f-b07a-4669-a71b-e07004cabfa3. (Possible split-brain) >[2016-04-19 07:24:35.744733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3> (ab75916f-b07a-4669-a71b-e07004cabfa3) [No such file or directory] >[2016-04-19 07:24:35.745095] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3> (ab75916f-b07a-4669-a71b-e07004cabfa3) [No such file or directory] >[2016-04-19 07:24:35.748057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3> (ab75916f-b07a-4669-a71b-e07004cabfa3) [No such file or directory] >[2016-04-19 07:24:35.748241] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3> (ab75916f-b07a-4669-a71b-e07004cabfa3) [No such file or directory] >[2016-04-19 07:24:35.748457] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ab75916f-b07a-4669-a71b-e07004cabfa3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.756164] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.757251] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf> (9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf) [No such file or directory] >[2016-04-19 07:24:35.757280] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf> (9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf) [No such file or directory] >[2016-04-19 07:24:35.760191] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf. (Possible split-brain) >[2016-04-19 07:24:35.761270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf> (9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf) [No such file or directory] >[2016-04-19 07:24:35.761294] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf> (9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf) [No such file or directory] >[2016-04-19 07:24:35.762511] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf> (9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf) [No such file or directory] >[2016-04-19 07:24:35.762785] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf> (9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf) [No such file or directory] >[2016-04-19 07:24:35.762933] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.765713] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf. (Possible split-brain) >[2016-04-19 07:24:35.766752] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf> (9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf) [No such file or directory] >[2016-04-19 07:24:35.766838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf> (9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf) [No such file or directory] >[2016-04-19 07:24:35.769515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf> (9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf) [No such file or directory] >[2016-04-19 07:24:35.769626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf> (9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf) [No such file or directory] >[2016-04-19 07:24:35.769819] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9455f4d4-4cc5-4357-8827-9d2ef0f7d7cf>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.778223] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.779100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1> (d5325d2b-34f0-4f74-9947-2c1dcfc75eb1) [No such file or directory] >[2016-04-19 07:24:35.779541] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1> (d5325d2b-34f0-4f74-9947-2c1dcfc75eb1) [No such file or directory] >[2016-04-19 07:24:35.782379] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d5325d2b-34f0-4f74-9947-2c1dcfc75eb1. (Possible split-brain) >[2016-04-19 07:24:35.783181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1> (d5325d2b-34f0-4f74-9947-2c1dcfc75eb1) [No such file or directory] >[2016-04-19 07:24:35.783460] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1> (d5325d2b-34f0-4f74-9947-2c1dcfc75eb1) [No such file or directory] >[2016-04-19 07:24:35.784992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1> (d5325d2b-34f0-4f74-9947-2c1dcfc75eb1) [No such file or directory] >[2016-04-19 07:24:35.785027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1> (d5325d2b-34f0-4f74-9947-2c1dcfc75eb1) [No such file or directory] >[2016-04-19 07:24:35.785177] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.787964] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d5325d2b-34f0-4f74-9947-2c1dcfc75eb1. (Possible split-brain) >[2016-04-19 07:24:35.789016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1> (d5325d2b-34f0-4f74-9947-2c1dcfc75eb1) [No such file or directory] >[2016-04-19 07:24:35.789119] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1> (d5325d2b-34f0-4f74-9947-2c1dcfc75eb1) [No such file or directory] >[2016-04-19 07:24:35.791957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1> (d5325d2b-34f0-4f74-9947-2c1dcfc75eb1) [No such file or directory] >[2016-04-19 07:24:35.792059] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1> (d5325d2b-34f0-4f74-9947-2c1dcfc75eb1) [No such file or directory] >[2016-04-19 07:24:35.792175] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d5325d2b-34f0-4f74-9947-2c1dcfc75eb1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.800133] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.800962] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d> (74e7bd61-ef87-4890-92bb-1bf63141610d) [No such file or directory] >[2016-04-19 07:24:35.801267] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d> (74e7bd61-ef87-4890-92bb-1bf63141610d) [No such file or directory] >[2016-04-19 07:24:35.804165] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 74e7bd61-ef87-4890-92bb-1bf63141610d. (Possible split-brain) >[2016-04-19 07:24:35.804939] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d> (74e7bd61-ef87-4890-92bb-1bf63141610d) [No such file or directory] >[2016-04-19 07:24:35.805413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d> (74e7bd61-ef87-4890-92bb-1bf63141610d) [No such file or directory] >[2016-04-19 07:24:35.806921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d> (74e7bd61-ef87-4890-92bb-1bf63141610d) [No such file or directory] >[2016-04-19 07:24:35.806985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d> (74e7bd61-ef87-4890-92bb-1bf63141610d) [No such file or directory] >[2016-04-19 07:24:35.807187] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.809950] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 74e7bd61-ef87-4890-92bb-1bf63141610d. (Possible split-brain) >[2016-04-19 07:24:35.810789] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d> (74e7bd61-ef87-4890-92bb-1bf63141610d) [No such file or directory] >[2016-04-19 07:24:35.810985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d> (74e7bd61-ef87-4890-92bb-1bf63141610d) [No such file or directory] >[2016-04-19 07:24:35.813454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d> (74e7bd61-ef87-4890-92bb-1bf63141610d) [No such file or directory] >[2016-04-19 07:24:35.813729] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d> (74e7bd61-ef87-4890-92bb-1bf63141610d) [No such file or directory] >[2016-04-19 07:24:35.813876] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:74e7bd61-ef87-4890-92bb-1bf63141610d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.822777] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.823692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69> (6a6fa3ce-f314-4a28-a79b-61df09d5fb69) [No such file or directory] >[2016-04-19 07:24:35.823798] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69> (6a6fa3ce-f314-4a28-a79b-61df09d5fb69) [No such file or directory] >[2016-04-19 07:24:35.826631] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6a6fa3ce-f314-4a28-a79b-61df09d5fb69. (Possible split-brain) >[2016-04-19 07:24:35.827580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69> (6a6fa3ce-f314-4a28-a79b-61df09d5fb69) [No such file or directory] >[2016-04-19 07:24:35.827695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69> (6a6fa3ce-f314-4a28-a79b-61df09d5fb69) [No such file or directory] >[2016-04-19 07:24:35.828968] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69> (6a6fa3ce-f314-4a28-a79b-61df09d5fb69) [No such file or directory] >[2016-04-19 07:24:35.829020] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69> (6a6fa3ce-f314-4a28-a79b-61df09d5fb69) [No such file or directory] >[2016-04-19 07:24:35.829515] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.832305] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6a6fa3ce-f314-4a28-a79b-61df09d5fb69. (Possible split-brain) >[2016-04-19 07:24:35.833358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69> (6a6fa3ce-f314-4a28-a79b-61df09d5fb69) [No such file or directory] >[2016-04-19 07:24:35.833385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69> (6a6fa3ce-f314-4a28-a79b-61df09d5fb69) [No such file or directory] >[2016-04-19 07:24:35.836122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69> (6a6fa3ce-f314-4a28-a79b-61df09d5fb69) [No such file or directory] >[2016-04-19 07:24:35.836220] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69> (6a6fa3ce-f314-4a28-a79b-61df09d5fb69) [No such file or directory] >[2016-04-19 07:24:35.836827] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6a6fa3ce-f314-4a28-a79b-61df09d5fb69>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.845343] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.846048] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45> (980c7981-7ef3-4b89-860e-3b307bb0dc45) [No such file or directory] >[2016-04-19 07:24:35.846376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45> (980c7981-7ef3-4b89-860e-3b307bb0dc45) [No such file or directory] >[2016-04-19 07:24:35.847240] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 980c7981-7ef3-4b89-860e-3b307bb0dc45. (Possible split-brain) >[2016-04-19 07:24:35.848025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45> (980c7981-7ef3-4b89-860e-3b307bb0dc45) [No such file or directory] >[2016-04-19 07:24:35.848299] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45> (980c7981-7ef3-4b89-860e-3b307bb0dc45) [No such file or directory] >[2016-04-19 07:24:35.849753] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45> (980c7981-7ef3-4b89-860e-3b307bb0dc45) [No such file or directory] >[2016-04-19 07:24:35.849811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45> (980c7981-7ef3-4b89-860e-3b307bb0dc45) [No such file or directory] >[2016-04-19 07:24:35.850016] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.852755] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 980c7981-7ef3-4b89-860e-3b307bb0dc45. (Possible split-brain) >[2016-04-19 07:24:35.853744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45> (980c7981-7ef3-4b89-860e-3b307bb0dc45) [No such file or directory] >[2016-04-19 07:24:35.853772] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45> (980c7981-7ef3-4b89-860e-3b307bb0dc45) [No such file or directory] >[2016-04-19 07:24:35.856281] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45> (980c7981-7ef3-4b89-860e-3b307bb0dc45) [No such file or directory] >[2016-04-19 07:24:35.856674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45> (980c7981-7ef3-4b89-860e-3b307bb0dc45) [No such file or directory] >[2016-04-19 07:24:35.856830] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:980c7981-7ef3-4b89-860e-3b307bb0dc45>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.864476] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.865253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de> (7bf376a3-e4fb-4573-8c0f-fdeff7c332de) [No such file or directory] >[2016-04-19 07:24:35.865532] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de> (7bf376a3-e4fb-4573-8c0f-fdeff7c332de) [No such file or directory] >[2016-04-19 07:24:35.866684] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7bf376a3-e4fb-4573-8c0f-fdeff7c332de. (Possible split-brain) >[2016-04-19 07:24:35.867524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de> (7bf376a3-e4fb-4573-8c0f-fdeff7c332de) [No such file or directory] >[2016-04-19 07:24:35.867636] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de> (7bf376a3-e4fb-4573-8c0f-fdeff7c332de) [No such file or directory] >[2016-04-19 07:24:35.868743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de> (7bf376a3-e4fb-4573-8c0f-fdeff7c332de) [No such file or directory] >[2016-04-19 07:24:35.869007] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de> (7bf376a3-e4fb-4573-8c0f-fdeff7c332de) [No such file or directory] >[2016-04-19 07:24:35.869133] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.871618] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7bf376a3-e4fb-4573-8c0f-fdeff7c332de. (Possible split-brain) >[2016-04-19 07:24:35.872339] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de> (7bf376a3-e4fb-4573-8c0f-fdeff7c332de) [No such file or directory] >[2016-04-19 07:24:35.872643] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de> (7bf376a3-e4fb-4573-8c0f-fdeff7c332de) [No such file or directory] >[2016-04-19 07:24:35.875350] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de> (7bf376a3-e4fb-4573-8c0f-fdeff7c332de) [No such file or directory] >[2016-04-19 07:24:35.876065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de> (7bf376a3-e4fb-4573-8c0f-fdeff7c332de) [No such file or directory] >[2016-04-19 07:24:35.876203] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7bf376a3-e4fb-4573-8c0f-fdeff7c332de>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.884116] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.884934] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd> (1dc179f5-8d9d-40c4-9010-cf3ca2c891bd) [No such file or directory] >[2016-04-19 07:24:35.885211] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd> (1dc179f5-8d9d-40c4-9010-cf3ca2c891bd) [No such file or directory] >[2016-04-19 07:24:35.886339] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1dc179f5-8d9d-40c4-9010-cf3ca2c891bd. (Possible split-brain) >[2016-04-19 07:24:35.887311] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd> (1dc179f5-8d9d-40c4-9010-cf3ca2c891bd) [No such file or directory] >[2016-04-19 07:24:35.887450] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd> (1dc179f5-8d9d-40c4-9010-cf3ca2c891bd) [No such file or directory] >[2016-04-19 07:24:35.888605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd> (1dc179f5-8d9d-40c4-9010-cf3ca2c891bd) [No such file or directory] >[2016-04-19 07:24:35.888708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd> (1dc179f5-8d9d-40c4-9010-cf3ca2c891bd) [No such file or directory] >[2016-04-19 07:24:35.888878] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.891545] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1dc179f5-8d9d-40c4-9010-cf3ca2c891bd. (Possible split-brain) >[2016-04-19 07:24:35.892424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd> (1dc179f5-8d9d-40c4-9010-cf3ca2c891bd) [No such file or directory] >[2016-04-19 07:24:35.892427] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd> (1dc179f5-8d9d-40c4-9010-cf3ca2c891bd) [No such file or directory] >[2016-04-19 07:24:35.894788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd> (1dc179f5-8d9d-40c4-9010-cf3ca2c891bd) [No such file or directory] >[2016-04-19 07:24:35.895160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd> (1dc179f5-8d9d-40c4-9010-cf3ca2c891bd) [No such file or directory] >[2016-04-19 07:24:35.895498] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1dc179f5-8d9d-40c4-9010-cf3ca2c891bd>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.902995] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.903743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19> (b16b2742-c43f-4dcc-8abd-e09c40e41f19) [No such file or directory] >[2016-04-19 07:24:35.903957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19> (b16b2742-c43f-4dcc-8abd-e09c40e41f19) [No such file or directory] >[2016-04-19 07:24:35.905055] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b16b2742-c43f-4dcc-8abd-e09c40e41f19. (Possible split-brain) >[2016-04-19 07:24:35.905774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19> (b16b2742-c43f-4dcc-8abd-e09c40e41f19) [No such file or directory] >[2016-04-19 07:24:35.906116] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19> (b16b2742-c43f-4dcc-8abd-e09c40e41f19) [No such file or directory] >[2016-04-19 07:24:35.907312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19> (b16b2742-c43f-4dcc-8abd-e09c40e41f19) [No such file or directory] >[2016-04-19 07:24:35.907453] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19> (b16b2742-c43f-4dcc-8abd-e09c40e41f19) [No such file or directory] >[2016-04-19 07:24:35.907578] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.910045] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b16b2742-c43f-4dcc-8abd-e09c40e41f19. (Possible split-brain) >[2016-04-19 07:24:35.910801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19> (b16b2742-c43f-4dcc-8abd-e09c40e41f19) [No such file or directory] >[2016-04-19 07:24:35.910867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19> (b16b2742-c43f-4dcc-8abd-e09c40e41f19) [No such file or directory] >[2016-04-19 07:24:35.912523] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19> (b16b2742-c43f-4dcc-8abd-e09c40e41f19) [No such file or directory] >[2016-04-19 07:24:35.912591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19> (b16b2742-c43f-4dcc-8abd-e09c40e41f19) [No such file or directory] >[2016-04-19 07:24:35.912801] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b16b2742-c43f-4dcc-8abd-e09c40e41f19>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.918303] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.918903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8> (ff034334-58fe-4713-9aa6-bcbf2fcff4f8) [No such file or directory] >[2016-04-19 07:24:35.919424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8> (ff034334-58fe-4713-9aa6-bcbf2fcff4f8) [No such file or directory] >[2016-04-19 07:24:35.921330] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ff034334-58fe-4713-9aa6-bcbf2fcff4f8. (Possible split-brain) >[2016-04-19 07:24:35.922078] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8> (ff034334-58fe-4713-9aa6-bcbf2fcff4f8) [No such file or directory] >[2016-04-19 07:24:35.922096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8> (ff034334-58fe-4713-9aa6-bcbf2fcff4f8) [No such file or directory] >[2016-04-19 07:24:35.923287] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8> (ff034334-58fe-4713-9aa6-bcbf2fcff4f8) [No such file or directory] >[2016-04-19 07:24:35.923308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8> (ff034334-58fe-4713-9aa6-bcbf2fcff4f8) [No such file or directory] >[2016-04-19 07:24:35.923418] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.925309] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ff034334-58fe-4713-9aa6-bcbf2fcff4f8. (Possible split-brain) >[2016-04-19 07:24:35.926104] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8> (ff034334-58fe-4713-9aa6-bcbf2fcff4f8) [No such file or directory] >[2016-04-19 07:24:35.926187] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8> (ff034334-58fe-4713-9aa6-bcbf2fcff4f8) [No such file or directory] >[2016-04-19 07:24:35.928132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8> (ff034334-58fe-4713-9aa6-bcbf2fcff4f8) [No such file or directory] >[2016-04-19 07:24:35.928143] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8> (ff034334-58fe-4713-9aa6-bcbf2fcff4f8) [No such file or directory] >[2016-04-19 07:24:35.928362] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ff034334-58fe-4713-9aa6-bcbf2fcff4f8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.936183] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.937103] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b> (35c1cc52-dcb7-4866-878e-18bbe987a21b) [No such file or directory] >[2016-04-19 07:24:35.937132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b> (35c1cc52-dcb7-4866-878e-18bbe987a21b) [No such file or directory] >[2016-04-19 07:24:35.938044] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 35c1cc52-dcb7-4866-878e-18bbe987a21b. (Possible split-brain) >[2016-04-19 07:24:35.938941] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b> (35c1cc52-dcb7-4866-878e-18bbe987a21b) [No such file or directory] >[2016-04-19 07:24:35.939035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b> (35c1cc52-dcb7-4866-878e-18bbe987a21b) [No such file or directory] >[2016-04-19 07:24:35.940284] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b> (35c1cc52-dcb7-4866-878e-18bbe987a21b) [No such file or directory] >[2016-04-19 07:24:35.940543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b> (35c1cc52-dcb7-4866-878e-18bbe987a21b) [No such file or directory] >[2016-04-19 07:24:35.940703] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.943625] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 35c1cc52-dcb7-4866-878e-18bbe987a21b. (Possible split-brain) >[2016-04-19 07:24:35.944524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b> (35c1cc52-dcb7-4866-878e-18bbe987a21b) [No such file or directory] >[2016-04-19 07:24:35.944980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b> (35c1cc52-dcb7-4866-878e-18bbe987a21b) [No such file or directory] >[2016-04-19 07:24:35.947653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b> (35c1cc52-dcb7-4866-878e-18bbe987a21b) [No such file or directory] >[2016-04-19 07:24:35.947749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b> (35c1cc52-dcb7-4866-878e-18bbe987a21b) [No such file or directory] >[2016-04-19 07:24:35.947999] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:35c1cc52-dcb7-4866-878e-18bbe987a21b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.956101] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.957064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:59112b13-1acc-43d7-9914-e49f327c4140> (59112b13-1acc-43d7-9914-e49f327c4140) [No such file or directory] >[2016-04-19 07:24:35.957199] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:59112b13-1acc-43d7-9914-e49f327c4140> (59112b13-1acc-43d7-9914-e49f327c4140) [No such file or directory] >[2016-04-19 07:24:35.958070] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 59112b13-1acc-43d7-9914-e49f327c4140. (Possible split-brain) >[2016-04-19 07:24:35.959055] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:59112b13-1acc-43d7-9914-e49f327c4140> (59112b13-1acc-43d7-9914-e49f327c4140) [No such file or directory] >[2016-04-19 07:24:35.959231] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:59112b13-1acc-43d7-9914-e49f327c4140> (59112b13-1acc-43d7-9914-e49f327c4140) [No such file or directory] >[2016-04-19 07:24:35.960408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:59112b13-1acc-43d7-9914-e49f327c4140> (59112b13-1acc-43d7-9914-e49f327c4140) [No such file or directory] >[2016-04-19 07:24:35.960429] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:59112b13-1acc-43d7-9914-e49f327c4140> (59112b13-1acc-43d7-9914-e49f327c4140) [No such file or directory] >[2016-04-19 07:24:35.960790] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:59112b13-1acc-43d7-9914-e49f327c4140>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:35.963298] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 59112b13-1acc-43d7-9914-e49f327c4140. (Possible split-brain) >[2016-04-19 07:24:35.964254] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:59112b13-1acc-43d7-9914-e49f327c4140> (59112b13-1acc-43d7-9914-e49f327c4140) [No such file or directory] >[2016-04-19 07:24:35.964490] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:59112b13-1acc-43d7-9914-e49f327c4140> (59112b13-1acc-43d7-9914-e49f327c4140) [No such file or directory] >[2016-04-19 07:24:35.967216] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:59112b13-1acc-43d7-9914-e49f327c4140> (59112b13-1acc-43d7-9914-e49f327c4140) [No such file or directory] >[2016-04-19 07:24:35.967415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:59112b13-1acc-43d7-9914-e49f327c4140> (59112b13-1acc-43d7-9914-e49f327c4140) [No such file or directory] >[2016-04-19 07:24:35.968025] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:59112b13-1acc-43d7-9914-e49f327c4140>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.977021] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.977918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96> (bb0fd3a4-746d-4de9-8edb-8efe3af57f96) [No such file or directory] >[2016-04-19 07:24:35.977993] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96> (bb0fd3a4-746d-4de9-8edb-8efe3af57f96) [No such file or directory] >[2016-04-19 07:24:35.980889] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bb0fd3a4-746d-4de9-8edb-8efe3af57f96. (Possible split-brain) >[2016-04-19 07:24:35.981723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96> (bb0fd3a4-746d-4de9-8edb-8efe3af57f96) [No such file or directory] >[2016-04-19 07:24:35.981997] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96> (bb0fd3a4-746d-4de9-8edb-8efe3af57f96) [No such file or directory] >[2016-04-19 07:24:35.983141] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96> (bb0fd3a4-746d-4de9-8edb-8efe3af57f96) [No such file or directory] >[2016-04-19 07:24:35.983104] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96> (bb0fd3a4-746d-4de9-8edb-8efe3af57f96) [No such file or directory] >[2016-04-19 07:24:35.983446] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:35.986180] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bb0fd3a4-746d-4de9-8edb-8efe3af57f96. (Possible split-brain) >[2016-04-19 07:24:35.987179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96> (bb0fd3a4-746d-4de9-8edb-8efe3af57f96) [No such file or directory] >[2016-04-19 07:24:35.987276] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96> (bb0fd3a4-746d-4de9-8edb-8efe3af57f96) [No such file or directory] >[2016-04-19 07:24:35.989654] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96> (bb0fd3a4-746d-4de9-8edb-8efe3af57f96) [No such file or directory] >[2016-04-19 07:24:35.989756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96> (bb0fd3a4-746d-4de9-8edb-8efe3af57f96) [No such file or directory] >[2016-04-19 07:24:35.990168] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bb0fd3a4-746d-4de9-8edb-8efe3af57f96>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:35.997726] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:35.998456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b> (9dbe8488-5cc2-4c2c-9314-f231efcaab4b) [No such file or directory] >[2016-04-19 07:24:35.998728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b> (9dbe8488-5cc2-4c2c-9314-f231efcaab4b) [No such file or directory] >[2016-04-19 07:24:36.001391] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9dbe8488-5cc2-4c2c-9314-f231efcaab4b. (Possible split-brain) >[2016-04-19 07:24:36.002475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b> (9dbe8488-5cc2-4c2c-9314-f231efcaab4b) [No such file or directory] >[2016-04-19 07:24:36.002744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b> (9dbe8488-5cc2-4c2c-9314-f231efcaab4b) [No such file or directory] >[2016-04-19 07:24:36.004118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b> (9dbe8488-5cc2-4c2c-9314-f231efcaab4b) [No such file or directory] >[2016-04-19 07:24:36.004469] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b> (9dbe8488-5cc2-4c2c-9314-f231efcaab4b) [No such file or directory] >[2016-04-19 07:24:36.004690] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.007454] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9dbe8488-5cc2-4c2c-9314-f231efcaab4b. (Possible split-brain) >[2016-04-19 07:24:36.008207] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b> (9dbe8488-5cc2-4c2c-9314-f231efcaab4b) [No such file or directory] >[2016-04-19 07:24:36.008549] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b> (9dbe8488-5cc2-4c2c-9314-f231efcaab4b) [No such file or directory] >[2016-04-19 07:24:36.011195] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b> (9dbe8488-5cc2-4c2c-9314-f231efcaab4b) [No such file or directory] >[2016-04-19 07:24:36.011299] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b> (9dbe8488-5cc2-4c2c-9314-f231efcaab4b) [No such file or directory] >[2016-04-19 07:24:36.011543] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9dbe8488-5cc2-4c2c-9314-f231efcaab4b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.020261] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.021184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f> (d241bc4d-6b47-483c-837a-9e558c65276f) [No such file or directory] >[2016-04-19 07:24:36.021205] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f> (d241bc4d-6b47-483c-837a-9e558c65276f) [No such file or directory] >[2016-04-19 07:24:36.022194] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d241bc4d-6b47-483c-837a-9e558c65276f. (Possible split-brain) >[2016-04-19 07:24:36.023113] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f> (d241bc4d-6b47-483c-837a-9e558c65276f) [No such file or directory] >[2016-04-19 07:24:36.023416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f> (d241bc4d-6b47-483c-837a-9e558c65276f) [No such file or directory] >[2016-04-19 07:24:36.024739] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f> (d241bc4d-6b47-483c-837a-9e558c65276f) [No such file or directory] >[2016-04-19 07:24:36.024876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f> (d241bc4d-6b47-483c-837a-9e558c65276f) [No such file or directory] >[2016-04-19 07:24:36.025022] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.027847] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d241bc4d-6b47-483c-837a-9e558c65276f. (Possible split-brain) >[2016-04-19 07:24:36.028849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f> (d241bc4d-6b47-483c-837a-9e558c65276f) [No such file or directory] >[2016-04-19 07:24:36.028870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f> (d241bc4d-6b47-483c-837a-9e558c65276f) [No such file or directory] >[2016-04-19 07:24:36.031252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f> (d241bc4d-6b47-483c-837a-9e558c65276f) [No such file or directory] >[2016-04-19 07:24:36.031513] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f> (d241bc4d-6b47-483c-837a-9e558c65276f) [No such file or directory] >[2016-04-19 07:24:36.031759] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d241bc4d-6b47-483c-837a-9e558c65276f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.039446] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.040386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:41859311-7df4-440e-8641-2160cbbef52a> (41859311-7df4-440e-8641-2160cbbef52a) [No such file or directory] >[2016-04-19 07:24:36.040700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:41859311-7df4-440e-8641-2160cbbef52a> (41859311-7df4-440e-8641-2160cbbef52a) [No such file or directory] >[2016-04-19 07:24:36.041815] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 41859311-7df4-440e-8641-2160cbbef52a. (Possible split-brain) >[2016-04-19 07:24:36.042813] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:41859311-7df4-440e-8641-2160cbbef52a> (41859311-7df4-440e-8641-2160cbbef52a) [No such file or directory] >[2016-04-19 07:24:36.042834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:41859311-7df4-440e-8641-2160cbbef52a> (41859311-7df4-440e-8641-2160cbbef52a) [No such file or directory] >[2016-04-19 07:24:36.044096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:41859311-7df4-440e-8641-2160cbbef52a> (41859311-7df4-440e-8641-2160cbbef52a) [No such file or directory] >[2016-04-19 07:24:36.044129] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:41859311-7df4-440e-8641-2160cbbef52a> (41859311-7df4-440e-8641-2160cbbef52a) [No such file or directory] >[2016-04-19 07:24:36.044498] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:41859311-7df4-440e-8641-2160cbbef52a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.047007] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 41859311-7df4-440e-8641-2160cbbef52a. (Possible split-brain) >[2016-04-19 07:24:36.048164] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:41859311-7df4-440e-8641-2160cbbef52a> (41859311-7df4-440e-8641-2160cbbef52a) [No such file or directory] >[2016-04-19 07:24:36.048275] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:41859311-7df4-440e-8641-2160cbbef52a> (41859311-7df4-440e-8641-2160cbbef52a) [No such file or directory] >[2016-04-19 07:24:36.050844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:41859311-7df4-440e-8641-2160cbbef52a> (41859311-7df4-440e-8641-2160cbbef52a) [No such file or directory] >[2016-04-19 07:24:36.050912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:41859311-7df4-440e-8641-2160cbbef52a> (41859311-7df4-440e-8641-2160cbbef52a) [No such file or directory] >[2016-04-19 07:24:36.051076] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:41859311-7df4-440e-8641-2160cbbef52a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.059991] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.060883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4> (b7f52472-4afd-415d-9750-6c81a76aa4b4) [No such file or directory] >[2016-04-19 07:24:36.060983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4> (b7f52472-4afd-415d-9750-6c81a76aa4b4) [No such file or directory] >[2016-04-19 07:24:36.063566] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b7f52472-4afd-415d-9750-6c81a76aa4b4. (Possible split-brain) >[2016-04-19 07:24:36.064399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4> (b7f52472-4afd-415d-9750-6c81a76aa4b4) [No such file or directory] >[2016-04-19 07:24:36.064647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4> (b7f52472-4afd-415d-9750-6c81a76aa4b4) [No such file or directory] >[2016-04-19 07:24:36.065755] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4> (b7f52472-4afd-415d-9750-6c81a76aa4b4) [No such file or directory] >[2016-04-19 07:24:36.066282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4> (b7f52472-4afd-415d-9750-6c81a76aa4b4) [No such file or directory] >[2016-04-19 07:24:36.066546] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.069299] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b7f52472-4afd-415d-9750-6c81a76aa4b4. (Possible split-brain) >[2016-04-19 07:24:36.070073] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4> (b7f52472-4afd-415d-9750-6c81a76aa4b4) [No such file or directory] >[2016-04-19 07:24:36.070960] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4> (b7f52472-4afd-415d-9750-6c81a76aa4b4) [No such file or directory] >[2016-04-19 07:24:36.073462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4> (b7f52472-4afd-415d-9750-6c81a76aa4b4) [No such file or directory] >[2016-04-19 07:24:36.073840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4> (b7f52472-4afd-415d-9750-6c81a76aa4b4) [No such file or directory] >[2016-04-19 07:24:36.074021] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b7f52472-4afd-415d-9750-6c81a76aa4b4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.082311] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.083391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9> (46cfecff-b879-4989-bf05-6eb65f2f83a9) [No such file or directory] >[2016-04-19 07:24:36.083392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9> (46cfecff-b879-4989-bf05-6eb65f2f83a9) [No such file or directory] >[2016-04-19 07:24:36.084927] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 46cfecff-b879-4989-bf05-6eb65f2f83a9. (Possible split-brain) >[2016-04-19 07:24:36.086065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9> (46cfecff-b879-4989-bf05-6eb65f2f83a9) [No such file or directory] >[2016-04-19 07:24:36.086096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9> (46cfecff-b879-4989-bf05-6eb65f2f83a9) [No such file or directory] >[2016-04-19 07:24:36.087227] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9> (46cfecff-b879-4989-bf05-6eb65f2f83a9) [No such file or directory] >[2016-04-19 07:24:36.087250] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9> (46cfecff-b879-4989-bf05-6eb65f2f83a9) [No such file or directory] >[2016-04-19 07:24:36.087680] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.090487] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 46cfecff-b879-4989-bf05-6eb65f2f83a9. (Possible split-brain) >[2016-04-19 07:24:36.091650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9> (46cfecff-b879-4989-bf05-6eb65f2f83a9) [No such file or directory] >[2016-04-19 07:24:36.091656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9> (46cfecff-b879-4989-bf05-6eb65f2f83a9) [No such file or directory] >[2016-04-19 07:24:36.094279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9> (46cfecff-b879-4989-bf05-6eb65f2f83a9) [No such file or directory] >[2016-04-19 07:24:36.094378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9> (46cfecff-b879-4989-bf05-6eb65f2f83a9) [No such file or directory] >[2016-04-19 07:24:36.094889] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:46cfecff-b879-4989-bf05-6eb65f2f83a9>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:36.103122] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.104043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8> (2bebaf35-3296-451f-8075-db70ab9feac8) [No such file or directory] >[2016-04-19 07:24:36.104529] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8> (2bebaf35-3296-451f-8075-db70ab9feac8) [No such file or directory] >[2016-04-19 07:24:36.107145] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2bebaf35-3296-451f-8075-db70ab9feac8. (Possible split-brain) >[2016-04-19 07:24:36.108271] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8> (2bebaf35-3296-451f-8075-db70ab9feac8) [No such file or directory] >[2016-04-19 07:24:36.108556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8> (2bebaf35-3296-451f-8075-db70ab9feac8) [No such file or directory] >[2016-04-19 07:24:36.109959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8> (2bebaf35-3296-451f-8075-db70ab9feac8) [No such file or directory] >[2016-04-19 07:24:36.110209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8> (2bebaf35-3296-451f-8075-db70ab9feac8) [No such file or directory] >[2016-04-19 07:24:36.110487] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.112936] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2bebaf35-3296-451f-8075-db70ab9feac8. (Possible split-brain) >[2016-04-19 07:24:36.113755] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8> (2bebaf35-3296-451f-8075-db70ab9feac8) [No such file or directory] >[2016-04-19 07:24:36.114069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8> (2bebaf35-3296-451f-8075-db70ab9feac8) [No such file or directory] >[2016-04-19 07:24:36.116981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8> (2bebaf35-3296-451f-8075-db70ab9feac8) [No such file or directory] >[2016-04-19 07:24:36.117034] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8> (2bebaf35-3296-451f-8075-db70ab9feac8) [No such file or directory] >[2016-04-19 07:24:36.117237] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2bebaf35-3296-451f-8075-db70ab9feac8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.125818] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.127486] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1> (961cda37-3b35-4efe-ab85-a074f0b43df1) [No such file or directory] >[2016-04-19 07:24:36.127503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1> (961cda37-3b35-4efe-ab85-a074f0b43df1) [No such file or directory] >[2016-04-19 07:24:36.130469] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 961cda37-3b35-4efe-ab85-a074f0b43df1. (Possible split-brain) >[2016-04-19 07:24:36.131544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1> (961cda37-3b35-4efe-ab85-a074f0b43df1) [No such file or directory] >[2016-04-19 07:24:36.131540] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1> (961cda37-3b35-4efe-ab85-a074f0b43df1) [No such file or directory] >[2016-04-19 07:24:36.133016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1> (961cda37-3b35-4efe-ab85-a074f0b43df1) [No such file or directory] >[2016-04-19 07:24:36.133061] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1> (961cda37-3b35-4efe-ab85-a074f0b43df1) [No such file or directory] >[2016-04-19 07:24:36.133700] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:36.136223] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 961cda37-3b35-4efe-ab85-a074f0b43df1. (Possible split-brain) >[2016-04-19 07:24:36.137504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1> (961cda37-3b35-4efe-ab85-a074f0b43df1) [No such file or directory] >[2016-04-19 07:24:36.137648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1> (961cda37-3b35-4efe-ab85-a074f0b43df1) [No such file or directory] >[2016-04-19 07:24:36.140370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1> (961cda37-3b35-4efe-ab85-a074f0b43df1) [No such file or directory] >[2016-04-19 07:24:36.140483] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1> (961cda37-3b35-4efe-ab85-a074f0b43df1) [No such file or directory] >[2016-04-19 07:24:36.140704] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:961cda37-3b35-4efe-ab85-a074f0b43df1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:36.150372] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.151393] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60> (582586cf-706c-4d2d-8b37-3de61b7bab60) [No such file or directory] >[2016-04-19 07:24:36.151393] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60> (582586cf-706c-4d2d-8b37-3de61b7bab60) [No such file or directory] >[2016-04-19 07:24:36.152645] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 582586cf-706c-4d2d-8b37-3de61b7bab60. (Possible split-brain) >[2016-04-19 07:24:36.153801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60> (582586cf-706c-4d2d-8b37-3de61b7bab60) [No such file or directory] >[2016-04-19 07:24:36.153844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60> (582586cf-706c-4d2d-8b37-3de61b7bab60) [No such file or directory] >[2016-04-19 07:24:36.155238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60> (582586cf-706c-4d2d-8b37-3de61b7bab60) [No such file or directory] >[2016-04-19 07:24:36.155307] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60> (582586cf-706c-4d2d-8b37-3de61b7bab60) [No such file or directory] >[2016-04-19 07:24:36.155588] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:36.158231] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 582586cf-706c-4d2d-8b37-3de61b7bab60. (Possible split-brain) >[2016-04-19 07:24:36.159493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60> (582586cf-706c-4d2d-8b37-3de61b7bab60) [No such file or directory] >[2016-04-19 07:24:36.159515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60> (582586cf-706c-4d2d-8b37-3de61b7bab60) [No such file or directory] >[2016-04-19 07:24:36.162189] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60> (582586cf-706c-4d2d-8b37-3de61b7bab60) [No such file or directory] >[2016-04-19 07:24:36.162278] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60> (582586cf-706c-4d2d-8b37-3de61b7bab60) [No such file or directory] >[2016-04-19 07:24:36.162621] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:582586cf-706c-4d2d-8b37-3de61b7bab60>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:36.170542] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.171536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c> (a2301b97-b634-47a3-88cb-aae1d6a11a2c) [No such file or directory] >[2016-04-19 07:24:36.171829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c> (a2301b97-b634-47a3-88cb-aae1d6a11a2c) [No such file or directory] >[2016-04-19 07:24:36.174492] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a2301b97-b634-47a3-88cb-aae1d6a11a2c. (Possible split-brain) >[2016-04-19 07:24:36.175535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c> (a2301b97-b634-47a3-88cb-aae1d6a11a2c) [No such file or directory] >[2016-04-19 07:24:36.175633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c> (a2301b97-b634-47a3-88cb-aae1d6a11a2c) [No such file or directory] >[2016-04-19 07:24:36.177006] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c> (a2301b97-b634-47a3-88cb-aae1d6a11a2c) [No such file or directory] >[2016-04-19 07:24:36.177383] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c> (a2301b97-b634-47a3-88cb-aae1d6a11a2c) [No such file or directory] >[2016-04-19 07:24:36.177520] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.180061] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a2301b97-b634-47a3-88cb-aae1d6a11a2c. (Possible split-brain) >[2016-04-19 07:24:36.180885] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c> (a2301b97-b634-47a3-88cb-aae1d6a11a2c) [No such file or directory] >[2016-04-19 07:24:36.181270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c> (a2301b97-b634-47a3-88cb-aae1d6a11a2c) [No such file or directory] >[2016-04-19 07:24:36.183822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c> (a2301b97-b634-47a3-88cb-aae1d6a11a2c) [No such file or directory] >[2016-04-19 07:24:36.184253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c> (a2301b97-b634-47a3-88cb-aae1d6a11a2c) [No such file or directory] >[2016-04-19 07:24:36.184479] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a2301b97-b634-47a3-88cb-aae1d6a11a2c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.192882] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.193692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd> (7cbca55a-9dec-452f-bd15-ad86b1664abd) [No such file or directory] >[2016-04-19 07:24:36.194050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd> (7cbca55a-9dec-452f-bd15-ad86b1664abd) [No such file or directory] >[2016-04-19 07:24:36.195144] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7cbca55a-9dec-452f-bd15-ad86b1664abd. (Possible split-brain) >[2016-04-19 07:24:36.196027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd> (7cbca55a-9dec-452f-bd15-ad86b1664abd) [No such file or directory] >[2016-04-19 07:24:36.196414] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd> (7cbca55a-9dec-452f-bd15-ad86b1664abd) [No such file or directory] >[2016-04-19 07:24:36.197599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd> (7cbca55a-9dec-452f-bd15-ad86b1664abd) [No such file or directory] >[2016-04-19 07:24:36.197950] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd> (7cbca55a-9dec-452f-bd15-ad86b1664abd) [No such file or directory] >[2016-04-19 07:24:36.198074] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.200650] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7cbca55a-9dec-452f-bd15-ad86b1664abd. (Possible split-brain) >[2016-04-19 07:24:36.201684] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd> (7cbca55a-9dec-452f-bd15-ad86b1664abd) [No such file or directory] >[2016-04-19 07:24:36.201685] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd> (7cbca55a-9dec-452f-bd15-ad86b1664abd) [No such file or directory] >[2016-04-19 07:24:36.204257] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd> (7cbca55a-9dec-452f-bd15-ad86b1664abd) [No such file or directory] >[2016-04-19 07:24:36.204560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd> (7cbca55a-9dec-452f-bd15-ad86b1664abd) [No such file or directory] >[2016-04-19 07:24:36.204796] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7cbca55a-9dec-452f-bd15-ad86b1664abd>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.213375] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.214496] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55e8909e-2279-41ab-887e-f0eda085707b> (55e8909e-2279-41ab-887e-f0eda085707b) [No such file or directory] >[2016-04-19 07:24:36.214599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55e8909e-2279-41ab-887e-f0eda085707b> (55e8909e-2279-41ab-887e-f0eda085707b) [No such file or directory] >[2016-04-19 07:24:36.217417] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 55e8909e-2279-41ab-887e-f0eda085707b. (Possible split-brain) >[2016-04-19 07:24:36.218529] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55e8909e-2279-41ab-887e-f0eda085707b> (55e8909e-2279-41ab-887e-f0eda085707b) [No such file or directory] >[2016-04-19 07:24:36.218559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55e8909e-2279-41ab-887e-f0eda085707b> (55e8909e-2279-41ab-887e-f0eda085707b) [No such file or directory] >[2016-04-19 07:24:36.219766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55e8909e-2279-41ab-887e-f0eda085707b> (55e8909e-2279-41ab-887e-f0eda085707b) [No such file or directory] >[2016-04-19 07:24:36.219814] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55e8909e-2279-41ab-887e-f0eda085707b> (55e8909e-2279-41ab-887e-f0eda085707b) [No such file or directory] >[2016-04-19 07:24:36.220144] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:55e8909e-2279-41ab-887e-f0eda085707b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.223189] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 55e8909e-2279-41ab-887e-f0eda085707b. (Possible split-brain) >[2016-04-19 07:24:36.224282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55e8909e-2279-41ab-887e-f0eda085707b> (55e8909e-2279-41ab-887e-f0eda085707b) [No such file or directory] >[2016-04-19 07:24:36.224308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55e8909e-2279-41ab-887e-f0eda085707b> (55e8909e-2279-41ab-887e-f0eda085707b) [No such file or directory] >[2016-04-19 07:24:36.227180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55e8909e-2279-41ab-887e-f0eda085707b> (55e8909e-2279-41ab-887e-f0eda085707b) [No such file or directory] >[2016-04-19 07:24:36.227204] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55e8909e-2279-41ab-887e-f0eda085707b> (55e8909e-2279-41ab-887e-f0eda085707b) [No such file or directory] >[2016-04-19 07:24:36.227441] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:55e8909e-2279-41ab-887e-f0eda085707b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.237250] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.238399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c> (0ab6195b-be6f-4701-bcc3-ff81d6daad6c) [No such file or directory] >[2016-04-19 07:24:36.238514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c> (0ab6195b-be6f-4701-bcc3-ff81d6daad6c) [No such file or directory] >[2016-04-19 07:24:36.239641] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0ab6195b-be6f-4701-bcc3-ff81d6daad6c. (Possible split-brain) >[2016-04-19 07:24:36.240707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c> (0ab6195b-be6f-4701-bcc3-ff81d6daad6c) [No such file or directory] >[2016-04-19 07:24:36.240723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c> (0ab6195b-be6f-4701-bcc3-ff81d6daad6c) [No such file or directory] >[2016-04-19 07:24:36.242121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c> (0ab6195b-be6f-4701-bcc3-ff81d6daad6c) [No such file or directory] >[2016-04-19 07:24:36.242439] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c> (0ab6195b-be6f-4701-bcc3-ff81d6daad6c) [No such file or directory] >[2016-04-19 07:24:36.242645] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:36.245402] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0ab6195b-be6f-4701-bcc3-ff81d6daad6c. (Possible split-brain) >[2016-04-19 07:24:36.246615] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c> (0ab6195b-be6f-4701-bcc3-ff81d6daad6c) [No such file or directory] >[2016-04-19 07:24:36.246711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c> (0ab6195b-be6f-4701-bcc3-ff81d6daad6c) [No such file or directory] >[2016-04-19 07:24:36.249289] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c> (0ab6195b-be6f-4701-bcc3-ff81d6daad6c) [No such file or directory] >[2016-04-19 07:24:36.249303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c> (0ab6195b-be6f-4701-bcc3-ff81d6daad6c) [No such file or directory] >[2016-04-19 07:24:36.249796] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0ab6195b-be6f-4701-bcc3-ff81d6daad6c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:36.257774] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.258686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2> (da69bd32-464b-499a-a1fe-463ce702bbe2) [No such file or directory] >[2016-04-19 07:24:36.258940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2> (da69bd32-464b-499a-a1fe-463ce702bbe2) [No such file or directory] >[2016-04-19 07:24:36.261761] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid da69bd32-464b-499a-a1fe-463ce702bbe2. (Possible split-brain) >[2016-04-19 07:24:36.262500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2> (da69bd32-464b-499a-a1fe-463ce702bbe2) [No such file or directory] >[2016-04-19 07:24:36.262780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2> (da69bd32-464b-499a-a1fe-463ce702bbe2) [No such file or directory] >[2016-04-19 07:24:36.263927] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2> (da69bd32-464b-499a-a1fe-463ce702bbe2) [No such file or directory] >[2016-04-19 07:24:36.264448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2> (da69bd32-464b-499a-a1fe-463ce702bbe2) [No such file or directory] >[2016-04-19 07:24:36.264637] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.267234] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid da69bd32-464b-499a-a1fe-463ce702bbe2. (Possible split-brain) >[2016-04-19 07:24:36.268037] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2> (da69bd32-464b-499a-a1fe-463ce702bbe2) [No such file or directory] >[2016-04-19 07:24:36.268415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2> (da69bd32-464b-499a-a1fe-463ce702bbe2) [No such file or directory] >[2016-04-19 07:24:36.271520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2> (da69bd32-464b-499a-a1fe-463ce702bbe2) [No such file or directory] >[2016-04-19 07:24:36.271833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2> (da69bd32-464b-499a-a1fe-463ce702bbe2) [No such file or directory] >[2016-04-19 07:24:36.272130] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:da69bd32-464b-499a-a1fe-463ce702bbe2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:36.280474] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.281218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049> (91a15ed9-2106-4026-92bd-0c2e5fa0e049) [No such file or directory] >[2016-04-19 07:24:36.281581] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049> (91a15ed9-2106-4026-92bd-0c2e5fa0e049) [No such file or directory] >[2016-04-19 07:24:36.282756] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 91a15ed9-2106-4026-92bd-0c2e5fa0e049. (Possible split-brain) >[2016-04-19 07:24:36.283786] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049> (91a15ed9-2106-4026-92bd-0c2e5fa0e049) [No such file or directory] >[2016-04-19 07:24:36.283929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049> (91a15ed9-2106-4026-92bd-0c2e5fa0e049) [No such file or directory] >[2016-04-19 07:24:36.285225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049> (91a15ed9-2106-4026-92bd-0c2e5fa0e049) [No such file or directory] >[2016-04-19 07:24:36.285507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049> (91a15ed9-2106-4026-92bd-0c2e5fa0e049) [No such file or directory] >[2016-04-19 07:24:36.285744] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.288275] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 91a15ed9-2106-4026-92bd-0c2e5fa0e049. (Possible split-brain) >[2016-04-19 07:24:36.289096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049> (91a15ed9-2106-4026-92bd-0c2e5fa0e049) [No such file or directory] >[2016-04-19 07:24:36.289450] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049> (91a15ed9-2106-4026-92bd-0c2e5fa0e049) [No such file or directory] >[2016-04-19 07:24:36.292068] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049> (91a15ed9-2106-4026-92bd-0c2e5fa0e049) [No such file or directory] >[2016-04-19 07:24:36.292445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049> (91a15ed9-2106-4026-92bd-0c2e5fa0e049) [No such file or directory] >[2016-04-19 07:24:36.292629] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:91a15ed9-2106-4026-92bd-0c2e5fa0e049>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.300761] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.301617] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c> (4e210613-5e12-41b8-8b41-6302137ffe5c) [No such file or directory] >[2016-04-19 07:24:36.301713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c> (4e210613-5e12-41b8-8b41-6302137ffe5c) [No such file or directory] >[2016-04-19 07:24:36.304286] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4e210613-5e12-41b8-8b41-6302137ffe5c. (Possible split-brain) >[2016-04-19 07:24:36.305041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c> (4e210613-5e12-41b8-8b41-6302137ffe5c) [No such file or directory] >[2016-04-19 07:24:36.305353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c> (4e210613-5e12-41b8-8b41-6302137ffe5c) [No such file or directory] >[2016-04-19 07:24:36.306545] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c> (4e210613-5e12-41b8-8b41-6302137ffe5c) [No such file or directory] >[2016-04-19 07:24:36.306800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c> (4e210613-5e12-41b8-8b41-6302137ffe5c) [No such file or directory] >[2016-04-19 07:24:36.306960] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.309674] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4e210613-5e12-41b8-8b41-6302137ffe5c. (Possible split-brain) >[2016-04-19 07:24:36.310408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c> (4e210613-5e12-41b8-8b41-6302137ffe5c) [No such file or directory] >[2016-04-19 07:24:36.310766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c> (4e210613-5e12-41b8-8b41-6302137ffe5c) [No such file or directory] >[2016-04-19 07:24:36.313564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c> (4e210613-5e12-41b8-8b41-6302137ffe5c) [No such file or directory] >[2016-04-19 07:24:36.313766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c> (4e210613-5e12-41b8-8b41-6302137ffe5c) [No such file or directory] >[2016-04-19 07:24:36.313948] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4e210613-5e12-41b8-8b41-6302137ffe5c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.323027] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.324047] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986> (077112a7-433e-4af6-9da8-4dd1ddb68986) [No such file or directory] >[2016-04-19 07:24:36.324347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986> (077112a7-433e-4af6-9da8-4dd1ddb68986) [No such file or directory] >[2016-04-19 07:24:36.325227] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 077112a7-433e-4af6-9da8-4dd1ddb68986. (Possible split-brain) >[2016-04-19 07:24:36.326215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986> (077112a7-433e-4af6-9da8-4dd1ddb68986) [No such file or directory] >[2016-04-19 07:24:36.326232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986> (077112a7-433e-4af6-9da8-4dd1ddb68986) [No such file or directory] >[2016-04-19 07:24:36.327579] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986> (077112a7-433e-4af6-9da8-4dd1ddb68986) [No such file or directory] >[2016-04-19 07:24:36.327739] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986> (077112a7-433e-4af6-9da8-4dd1ddb68986) [No such file or directory] >[2016-04-19 07:24:36.327901] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.330630] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 077112a7-433e-4af6-9da8-4dd1ddb68986. (Possible split-brain) >[2016-04-19 07:24:36.331550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986> (077112a7-433e-4af6-9da8-4dd1ddb68986) [No such file or directory] >[2016-04-19 07:24:36.331834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986> (077112a7-433e-4af6-9da8-4dd1ddb68986) [No such file or directory] >[2016-04-19 07:24:36.335126] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986> (077112a7-433e-4af6-9da8-4dd1ddb68986) [No such file or directory] >[2016-04-19 07:24:36.335243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986> (077112a7-433e-4af6-9da8-4dd1ddb68986) [No such file or directory] >[2016-04-19 07:24:36.335395] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:077112a7-433e-4af6-9da8-4dd1ddb68986>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.343181] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.344050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442> (afb8570c-2c79-4471-b8ae-2b4f61fb4442) [No such file or directory] >[2016-04-19 07:24:36.344364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442> (afb8570c-2c79-4471-b8ae-2b4f61fb4442) [No such file or directory] >[2016-04-19 07:24:36.347211] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid afb8570c-2c79-4471-b8ae-2b4f61fb4442. (Possible split-brain) >[2016-04-19 07:24:36.347982] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442> (afb8570c-2c79-4471-b8ae-2b4f61fb4442) [No such file or directory] >[2016-04-19 07:24:36.348421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442> (afb8570c-2c79-4471-b8ae-2b4f61fb4442) [No such file or directory] >[2016-04-19 07:24:36.349616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442> (afb8570c-2c79-4471-b8ae-2b4f61fb4442) [No such file or directory] >[2016-04-19 07:24:36.349886] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442> (afb8570c-2c79-4471-b8ae-2b4f61fb4442) [No such file or directory] >[2016-04-19 07:24:36.350064] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.352627] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid afb8570c-2c79-4471-b8ae-2b4f61fb4442. (Possible split-brain) >[2016-04-19 07:24:36.353353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442> (afb8570c-2c79-4471-b8ae-2b4f61fb4442) [No such file or directory] >[2016-04-19 07:24:36.353714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442> (afb8570c-2c79-4471-b8ae-2b4f61fb4442) [No such file or directory] >[2016-04-19 07:24:36.356276] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442> (afb8570c-2c79-4471-b8ae-2b4f61fb4442) [No such file or directory] >[2016-04-19 07:24:36.356771] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442> (afb8570c-2c79-4471-b8ae-2b4f61fb4442) [No such file or directory] >[2016-04-19 07:24:36.356911] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:afb8570c-2c79-4471-b8ae-2b4f61fb4442>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.365747] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.366475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c> (5b5febaa-8a63-44d2-ba11-ed681269d24c) [No such file or directory] >[2016-04-19 07:24:36.366869] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c> (5b5febaa-8a63-44d2-ba11-ed681269d24c) [No such file or directory] >[2016-04-19 07:24:36.367976] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5b5febaa-8a63-44d2-ba11-ed681269d24c. (Possible split-brain) >[2016-04-19 07:24:36.368664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c> (5b5febaa-8a63-44d2-ba11-ed681269d24c) [No such file or directory] >[2016-04-19 07:24:36.369053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c> (5b5febaa-8a63-44d2-ba11-ed681269d24c) [No such file or directory] >[2016-04-19 07:24:36.370193] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c> (5b5febaa-8a63-44d2-ba11-ed681269d24c) [No such file or directory] >[2016-04-19 07:24:36.370629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c> (5b5febaa-8a63-44d2-ba11-ed681269d24c) [No such file or directory] >[2016-04-19 07:24:36.370789] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.373309] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5b5febaa-8a63-44d2-ba11-ed681269d24c. (Possible split-brain) >[2016-04-19 07:24:36.374029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c> (5b5febaa-8a63-44d2-ba11-ed681269d24c) [No such file or directory] >[2016-04-19 07:24:36.374408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c> (5b5febaa-8a63-44d2-ba11-ed681269d24c) [No such file or directory] >[2016-04-19 07:24:36.377278] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c> (5b5febaa-8a63-44d2-ba11-ed681269d24c) [No such file or directory] >[2016-04-19 07:24:36.377279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c> (5b5febaa-8a63-44d2-ba11-ed681269d24c) [No such file or directory] >[2016-04-19 07:24:36.377539] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5b5febaa-8a63-44d2-ba11-ed681269d24c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.385725] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.386507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62> (fb380ce5-f77e-4068-9299-aab1ae18ff62) [No such file or directory] >[2016-04-19 07:24:36.386841] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62> (fb380ce5-f77e-4068-9299-aab1ae18ff62) [No such file or directory] >[2016-04-19 07:24:36.389925] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fb380ce5-f77e-4068-9299-aab1ae18ff62. (Possible split-brain) >[2016-04-19 07:24:36.390661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62> (fb380ce5-f77e-4068-9299-aab1ae18ff62) [No such file or directory] >[2016-04-19 07:24:36.391173] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62> (fb380ce5-f77e-4068-9299-aab1ae18ff62) [No such file or directory] >[2016-04-19 07:24:36.392406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62> (fb380ce5-f77e-4068-9299-aab1ae18ff62) [No such file or directory] >[2016-04-19 07:24:36.392534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62> (fb380ce5-f77e-4068-9299-aab1ae18ff62) [No such file or directory] >[2016-04-19 07:24:36.392672] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.395371] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fb380ce5-f77e-4068-9299-aab1ae18ff62. (Possible split-brain) >[2016-04-19 07:24:36.396078] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62> (fb380ce5-f77e-4068-9299-aab1ae18ff62) [No such file or directory] >[2016-04-19 07:24:36.396596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62> (fb380ce5-f77e-4068-9299-aab1ae18ff62) [No such file or directory] >[2016-04-19 07:24:36.398976] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62> (fb380ce5-f77e-4068-9299-aab1ae18ff62) [No such file or directory] >[2016-04-19 07:24:36.399421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62> (fb380ce5-f77e-4068-9299-aab1ae18ff62) [No such file or directory] >[2016-04-19 07:24:36.399608] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fb380ce5-f77e-4068-9299-aab1ae18ff62>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.408143] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.408924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f> (ad327d6d-2cd6-4b19-8236-e9e99e15465f) [No such file or directory] >[2016-04-19 07:24:36.409285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f> (ad327d6d-2cd6-4b19-8236-e9e99e15465f) [No such file or directory] >[2016-04-19 07:24:36.412859] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ad327d6d-2cd6-4b19-8236-e9e99e15465f. (Possible split-brain) >[2016-04-19 07:24:36.413580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f> (ad327d6d-2cd6-4b19-8236-e9e99e15465f) [No such file or directory] >[2016-04-19 07:24:36.413843] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f> (ad327d6d-2cd6-4b19-8236-e9e99e15465f) [No such file or directory] >[2016-04-19 07:24:36.415025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f> (ad327d6d-2cd6-4b19-8236-e9e99e15465f) [No such file or directory] >[2016-04-19 07:24:36.415283] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f> (ad327d6d-2cd6-4b19-8236-e9e99e15465f) [No such file or directory] >[2016-04-19 07:24:36.415467] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.418205] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ad327d6d-2cd6-4b19-8236-e9e99e15465f. (Possible split-brain) >[2016-04-19 07:24:36.419144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f> (ad327d6d-2cd6-4b19-8236-e9e99e15465f) [No such file or directory] >[2016-04-19 07:24:36.419255] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f> (ad327d6d-2cd6-4b19-8236-e9e99e15465f) [No such file or directory] >[2016-04-19 07:24:36.422048] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f> (ad327d6d-2cd6-4b19-8236-e9e99e15465f) [No such file or directory] >[2016-04-19 07:24:36.422415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f> (ad327d6d-2cd6-4b19-8236-e9e99e15465f) [No such file or directory] >[2016-04-19 07:24:36.422571] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ad327d6d-2cd6-4b19-8236-e9e99e15465f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.430899] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.431724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac> (143fb453-683e-4b08-affa-50c9cc5c00ac) [No such file or directory] >[2016-04-19 07:24:36.431981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac> (143fb453-683e-4b08-affa-50c9cc5c00ac) [No such file or directory] >[2016-04-19 07:24:36.432940] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 143fb453-683e-4b08-affa-50c9cc5c00ac. (Possible split-brain) >[2016-04-19 07:24:36.433812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac> (143fb453-683e-4b08-affa-50c9cc5c00ac) [No such file or directory] >[2016-04-19 07:24:36.434369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac> (143fb453-683e-4b08-affa-50c9cc5c00ac) [No such file or directory] >[2016-04-19 07:24:36.435535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac> (143fb453-683e-4b08-affa-50c9cc5c00ac) [No such file or directory] >[2016-04-19 07:24:36.435544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac> (143fb453-683e-4b08-affa-50c9cc5c00ac) [No such file or directory] >[2016-04-19 07:24:36.435718] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.438195] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 143fb453-683e-4b08-affa-50c9cc5c00ac. (Possible split-brain) >[2016-04-19 07:24:36.439375] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac> (143fb453-683e-4b08-affa-50c9cc5c00ac) [No such file or directory] >[2016-04-19 07:24:36.439391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac> (143fb453-683e-4b08-affa-50c9cc5c00ac) [No such file or directory] >[2016-04-19 07:24:36.442084] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac> (143fb453-683e-4b08-affa-50c9cc5c00ac) [No such file or directory] >[2016-04-19 07:24:36.442106] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac> (143fb453-683e-4b08-affa-50c9cc5c00ac) [No such file or directory] >[2016-04-19 07:24:36.442338] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:143fb453-683e-4b08-affa-50c9cc5c00ac>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:36.450954] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.451900] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e> (cd70dde6-30f6-4823-8ce2-08c673d93d2e) [No such file or directory] >[2016-04-19 07:24:36.452107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e> (cd70dde6-30f6-4823-8ce2-08c673d93d2e) [No such file or directory] >[2016-04-19 07:24:36.455011] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cd70dde6-30f6-4823-8ce2-08c673d93d2e. (Possible split-brain) >[2016-04-19 07:24:36.455763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e> (cd70dde6-30f6-4823-8ce2-08c673d93d2e) [No such file or directory] >[2016-04-19 07:24:36.456159] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e> (cd70dde6-30f6-4823-8ce2-08c673d93d2e) [No such file or directory] >[2016-04-19 07:24:36.457274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e> (cd70dde6-30f6-4823-8ce2-08c673d93d2e) [No such file or directory] >[2016-04-19 07:24:36.457715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e> (cd70dde6-30f6-4823-8ce2-08c673d93d2e) [No such file or directory] >[2016-04-19 07:24:36.457955] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.460809] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cd70dde6-30f6-4823-8ce2-08c673d93d2e. (Possible split-brain) >[2016-04-19 07:24:36.461723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e> (cd70dde6-30f6-4823-8ce2-08c673d93d2e) [No such file or directory] >[2016-04-19 07:24:36.462029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e> (cd70dde6-30f6-4823-8ce2-08c673d93d2e) [No such file or directory] >[2016-04-19 07:24:36.464418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e> (cd70dde6-30f6-4823-8ce2-08c673d93d2e) [No such file or directory] >[2016-04-19 07:24:36.464595] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e> (cd70dde6-30f6-4823-8ce2-08c673d93d2e) [No such file or directory] >[2016-04-19 07:24:36.464731] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cd70dde6-30f6-4823-8ce2-08c673d93d2e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.473291] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.474034] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65> (236a6202-3b7d-4386-8f9e-cd417225ab65) [No such file or directory] >[2016-04-19 07:24:36.474303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65> (236a6202-3b7d-4386-8f9e-cd417225ab65) [No such file or directory] >[2016-04-19 07:24:36.475209] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 236a6202-3b7d-4386-8f9e-cd417225ab65. (Possible split-brain) >[2016-04-19 07:24:36.476044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65> (236a6202-3b7d-4386-8f9e-cd417225ab65) [No such file or directory] >[2016-04-19 07:24:36.476279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65> (236a6202-3b7d-4386-8f9e-cd417225ab65) [No such file or directory] >[2016-04-19 07:24:36.477553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65> (236a6202-3b7d-4386-8f9e-cd417225ab65) [No such file or directory] >[2016-04-19 07:24:36.477730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65> (236a6202-3b7d-4386-8f9e-cd417225ab65) [No such file or directory] >[2016-04-19 07:24:36.478046] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.480401] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 236a6202-3b7d-4386-8f9e-cd417225ab65. (Possible split-brain) >[2016-04-19 07:24:36.481020] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65> (236a6202-3b7d-4386-8f9e-cd417225ab65) [No such file or directory] >[2016-04-19 07:24:36.481102] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65> (236a6202-3b7d-4386-8f9e-cd417225ab65) [No such file or directory] >[2016-04-19 07:24:36.483879] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65> (236a6202-3b7d-4386-8f9e-cd417225ab65) [No such file or directory] >[2016-04-19 07:24:36.483977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65> (236a6202-3b7d-4386-8f9e-cd417225ab65) [No such file or directory] >[2016-04-19 07:24:36.484242] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:236a6202-3b7d-4386-8f9e-cd417225ab65>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:36.491872] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.492908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a> (dbdc494a-0a34-4ff2-8139-1bc01da9418a) [No such file or directory] >[2016-04-19 07:24:36.493023] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a> (dbdc494a-0a34-4ff2-8139-1bc01da9418a) [No such file or directory] >[2016-04-19 07:24:36.495822] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dbdc494a-0a34-4ff2-8139-1bc01da9418a. (Possible split-brain) >[2016-04-19 07:24:36.496830] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a> (dbdc494a-0a34-4ff2-8139-1bc01da9418a) [No such file or directory] >[2016-04-19 07:24:36.496858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a> (dbdc494a-0a34-4ff2-8139-1bc01da9418a) [No such file or directory] >[2016-04-19 07:24:36.498128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a> (dbdc494a-0a34-4ff2-8139-1bc01da9418a) [No such file or directory] >[2016-04-19 07:24:36.498209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a> (dbdc494a-0a34-4ff2-8139-1bc01da9418a) [No such file or directory] >[2016-04-19 07:24:36.498591] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.501126] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dbdc494a-0a34-4ff2-8139-1bc01da9418a. (Possible split-brain) >[2016-04-19 07:24:36.502302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a> (dbdc494a-0a34-4ff2-8139-1bc01da9418a) [No such file or directory] >[2016-04-19 07:24:36.502401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a> (dbdc494a-0a34-4ff2-8139-1bc01da9418a) [No such file or directory] >[2016-04-19 07:24:36.505042] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a> (dbdc494a-0a34-4ff2-8139-1bc01da9418a) [No such file or directory] >[2016-04-19 07:24:36.505231] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a> (dbdc494a-0a34-4ff2-8139-1bc01da9418a) [No such file or directory] >[2016-04-19 07:24:36.505369] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:dbdc494a-0a34-4ff2-8139-1bc01da9418a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.513169] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.514251] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce> (4bcc1679-a185-44db-bf59-926b1ce216ce) [No such file or directory] >[2016-04-19 07:24:36.514261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce> (4bcc1679-a185-44db-bf59-926b1ce216ce) [No such file or directory] >[2016-04-19 07:24:36.515478] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4bcc1679-a185-44db-bf59-926b1ce216ce. (Possible split-brain) >[2016-04-19 07:24:36.516581] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce> (4bcc1679-a185-44db-bf59-926b1ce216ce) [No such file or directory] >[2016-04-19 07:24:36.516610] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce> (4bcc1679-a185-44db-bf59-926b1ce216ce) [No such file or directory] >[2016-04-19 07:24:36.517842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce> (4bcc1679-a185-44db-bf59-926b1ce216ce) [No such file or directory] >[2016-04-19 07:24:36.518044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce> (4bcc1679-a185-44db-bf59-926b1ce216ce) [No such file or directory] >[2016-04-19 07:24:36.518238] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.520786] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4bcc1679-a185-44db-bf59-926b1ce216ce. (Possible split-brain) >[2016-04-19 07:24:36.521854] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce> (4bcc1679-a185-44db-bf59-926b1ce216ce) [No such file or directory] >[2016-04-19 07:24:36.522196] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce> (4bcc1679-a185-44db-bf59-926b1ce216ce) [No such file or directory] >[2016-04-19 07:24:36.524777] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce> (4bcc1679-a185-44db-bf59-926b1ce216ce) [No such file or directory] >[2016-04-19 07:24:36.524782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce> (4bcc1679-a185-44db-bf59-926b1ce216ce) [No such file or directory] >[2016-04-19 07:24:36.525126] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4bcc1679-a185-44db-bf59-926b1ce216ce>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:36.534434] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.535770] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55c48961-8c7b-4650-99ce-05737a08c285> (55c48961-8c7b-4650-99ce-05737a08c285) [No such file or directory] >[2016-04-19 07:24:36.535955] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55c48961-8c7b-4650-99ce-05737a08c285> (55c48961-8c7b-4650-99ce-05737a08c285) [No such file or directory] >[2016-04-19 07:24:36.536875] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 55c48961-8c7b-4650-99ce-05737a08c285. (Possible split-brain) >[2016-04-19 07:24:36.537792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55c48961-8c7b-4650-99ce-05737a08c285> (55c48961-8c7b-4650-99ce-05737a08c285) [No such file or directory] >[2016-04-19 07:24:36.537907] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55c48961-8c7b-4650-99ce-05737a08c285> (55c48961-8c7b-4650-99ce-05737a08c285) [No such file or directory] >[2016-04-19 07:24:36.539100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55c48961-8c7b-4650-99ce-05737a08c285> (55c48961-8c7b-4650-99ce-05737a08c285) [No such file or directory] >[2016-04-19 07:24:36.539202] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55c48961-8c7b-4650-99ce-05737a08c285> (55c48961-8c7b-4650-99ce-05737a08c285) [No such file or directory] >[2016-04-19 07:24:36.539370] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:55c48961-8c7b-4650-99ce-05737a08c285>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:36.542080] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 55c48961-8c7b-4650-99ce-05737a08c285. (Possible split-brain) >[2016-04-19 07:24:36.543131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55c48961-8c7b-4650-99ce-05737a08c285> (55c48961-8c7b-4650-99ce-05737a08c285) [No such file or directory] >[2016-04-19 07:24:36.543230] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55c48961-8c7b-4650-99ce-05737a08c285> (55c48961-8c7b-4650-99ce-05737a08c285) [No such file or directory] >[2016-04-19 07:24:36.546122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55c48961-8c7b-4650-99ce-05737a08c285> (55c48961-8c7b-4650-99ce-05737a08c285) [No such file or directory] >[2016-04-19 07:24:36.546151] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55c48961-8c7b-4650-99ce-05737a08c285> (55c48961-8c7b-4650-99ce-05737a08c285) [No such file or directory] >[2016-04-19 07:24:36.546366] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:55c48961-8c7b-4650-99ce-05737a08c285>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.555527] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.556546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9> (04ef02e4-9160-49a9-a65e-a68d85df53e9) [No such file or directory] >[2016-04-19 07:24:36.556813] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9> (04ef02e4-9160-49a9-a65e-a68d85df53e9) [No such file or directory] >[2016-04-19 07:24:36.557945] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 04ef02e4-9160-49a9-a65e-a68d85df53e9. (Possible split-brain) >[2016-04-19 07:24:36.559076] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9> (04ef02e4-9160-49a9-a65e-a68d85df53e9) [No such file or directory] >[2016-04-19 07:24:36.559177] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9> (04ef02e4-9160-49a9-a65e-a68d85df53e9) [No such file or directory] >[2016-04-19 07:24:36.560699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9> (04ef02e4-9160-49a9-a65e-a68d85df53e9) [No such file or directory] >[2016-04-19 07:24:36.560750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9> (04ef02e4-9160-49a9-a65e-a68d85df53e9) [No such file or directory] >[2016-04-19 07:24:36.561025] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:36.563619] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 04ef02e4-9160-49a9-a65e-a68d85df53e9. (Possible split-brain) >[2016-04-19 07:24:36.564948] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9> (04ef02e4-9160-49a9-a65e-a68d85df53e9) [No such file or directory] >[2016-04-19 07:24:36.565049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9> (04ef02e4-9160-49a9-a65e-a68d85df53e9) [No such file or directory] >[2016-04-19 07:24:36.567448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9> (04ef02e4-9160-49a9-a65e-a68d85df53e9) [No such file or directory] >[2016-04-19 07:24:36.567550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9> (04ef02e4-9160-49a9-a65e-a68d85df53e9) [No such file or directory] >[2016-04-19 07:24:36.567768] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:04ef02e4-9160-49a9-a65e-a68d85df53e9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.576928] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.577796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a0996787-9711-4084-aff3-737bab63a9a9> (a0996787-9711-4084-aff3-737bab63a9a9) [No such file or directory] >[2016-04-19 07:24:36.578067] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a0996787-9711-4084-aff3-737bab63a9a9> (a0996787-9711-4084-aff3-737bab63a9a9) [No such file or directory] >[2016-04-19 07:24:36.580620] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a0996787-9711-4084-aff3-737bab63a9a9. (Possible split-brain) >[2016-04-19 07:24:36.581380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a0996787-9711-4084-aff3-737bab63a9a9> (a0996787-9711-4084-aff3-737bab63a9a9) [No such file or directory] >[2016-04-19 07:24:36.581762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a0996787-9711-4084-aff3-737bab63a9a9> (a0996787-9711-4084-aff3-737bab63a9a9) [No such file or directory] >[2016-04-19 07:24:36.583001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a0996787-9711-4084-aff3-737bab63a9a9> (a0996787-9711-4084-aff3-737bab63a9a9) [No such file or directory] >[2016-04-19 07:24:36.583309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a0996787-9711-4084-aff3-737bab63a9a9> (a0996787-9711-4084-aff3-737bab63a9a9) [No such file or directory] >[2016-04-19 07:24:36.583497] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a0996787-9711-4084-aff3-737bab63a9a9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.586161] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a0996787-9711-4084-aff3-737bab63a9a9. (Possible split-brain) >[2016-04-19 07:24:36.587002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a0996787-9711-4084-aff3-737bab63a9a9> (a0996787-9711-4084-aff3-737bab63a9a9) [No such file or directory] >[2016-04-19 07:24:36.587402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a0996787-9711-4084-aff3-737bab63a9a9> (a0996787-9711-4084-aff3-737bab63a9a9) [No such file or directory] >[2016-04-19 07:24:36.590183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a0996787-9711-4084-aff3-737bab63a9a9> (a0996787-9711-4084-aff3-737bab63a9a9) [No such file or directory] >[2016-04-19 07:24:36.590455] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a0996787-9711-4084-aff3-737bab63a9a9> (a0996787-9711-4084-aff3-737bab63a9a9) [No such file or directory] >[2016-04-19 07:24:36.590615] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a0996787-9711-4084-aff3-737bab63a9a9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.599113] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.600079] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c539efd-c763-4388-be7b-c737deb26539> (5c539efd-c763-4388-be7b-c737deb26539) [No such file or directory] >[2016-04-19 07:24:36.600379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c539efd-c763-4388-be7b-c737deb26539> (5c539efd-c763-4388-be7b-c737deb26539) [No such file or directory] >[2016-04-19 07:24:36.603393] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5c539efd-c763-4388-be7b-c737deb26539. (Possible split-brain) >[2016-04-19 07:24:36.604424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c539efd-c763-4388-be7b-c737deb26539> (5c539efd-c763-4388-be7b-c737deb26539) [No such file or directory] >[2016-04-19 07:24:36.604434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c539efd-c763-4388-be7b-c737deb26539> (5c539efd-c763-4388-be7b-c737deb26539) [No such file or directory] >[2016-04-19 07:24:36.605633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c539efd-c763-4388-be7b-c737deb26539> (5c539efd-c763-4388-be7b-c737deb26539) [No such file or directory] >[2016-04-19 07:24:36.605932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c539efd-c763-4388-be7b-c737deb26539> (5c539efd-c763-4388-be7b-c737deb26539) [No such file or directory] >[2016-04-19 07:24:36.606149] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5c539efd-c763-4388-be7b-c737deb26539>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:36.608876] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5c539efd-c763-4388-be7b-c737deb26539. (Possible split-brain) >[2016-04-19 07:24:36.609984] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c539efd-c763-4388-be7b-c737deb26539> (5c539efd-c763-4388-be7b-c737deb26539) [No such file or directory] >[2016-04-19 07:24:36.610085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c539efd-c763-4388-be7b-c737deb26539> (5c539efd-c763-4388-be7b-c737deb26539) [No such file or directory] >[2016-04-19 07:24:36.612883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c539efd-c763-4388-be7b-c737deb26539> (5c539efd-c763-4388-be7b-c737deb26539) [No such file or directory] >[2016-04-19 07:24:36.612913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c539efd-c763-4388-be7b-c737deb26539> (5c539efd-c763-4388-be7b-c737deb26539) [No such file or directory] >[2016-04-19 07:24:36.613116] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5c539efd-c763-4388-be7b-c737deb26539>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.621992] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.623084] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c> (5f1256e0-fb24-4210-abfa-a79e0787615c) [No such file or directory] >[2016-04-19 07:24:36.623102] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c> (5f1256e0-fb24-4210-abfa-a79e0787615c) [No such file or directory] >[2016-04-19 07:24:36.625874] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5f1256e0-fb24-4210-abfa-a79e0787615c. (Possible split-brain) >[2016-04-19 07:24:36.626717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c> (5f1256e0-fb24-4210-abfa-a79e0787615c) [No such file or directory] >[2016-04-19 07:24:36.627012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c> (5f1256e0-fb24-4210-abfa-a79e0787615c) [No such file or directory] >[2016-04-19 07:24:36.628462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c> (5f1256e0-fb24-4210-abfa-a79e0787615c) [No such file or directory] >[2016-04-19 07:24:36.628791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c> (5f1256e0-fb24-4210-abfa-a79e0787615c) [No such file or directory] >[2016-04-19 07:24:36.628957] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.631747] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5f1256e0-fb24-4210-abfa-a79e0787615c. (Possible split-brain) >[2016-04-19 07:24:36.632784] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c> (5f1256e0-fb24-4210-abfa-a79e0787615c) [No such file or directory] >[2016-04-19 07:24:36.632890] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c> (5f1256e0-fb24-4210-abfa-a79e0787615c) [No such file or directory] >[2016-04-19 07:24:36.635702] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c> (5f1256e0-fb24-4210-abfa-a79e0787615c) [No such file or directory] >[2016-04-19 07:24:36.635856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c> (5f1256e0-fb24-4210-abfa-a79e0787615c) [No such file or directory] >[2016-04-19 07:24:36.635997] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5f1256e0-fb24-4210-abfa-a79e0787615c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.644616] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.645704] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1> (2361fa9a-3a9d-4bf5-880b-3d3fff9769d1) [No such file or directory] >[2016-04-19 07:24:36.645730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1> (2361fa9a-3a9d-4bf5-880b-3d3fff9769d1) [No such file or directory] >[2016-04-19 07:24:36.646913] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2361fa9a-3a9d-4bf5-880b-3d3fff9769d1. (Possible split-brain) >[2016-04-19 07:24:36.648099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1> (2361fa9a-3a9d-4bf5-880b-3d3fff9769d1) [No such file or directory] >[2016-04-19 07:24:36.648205] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1> (2361fa9a-3a9d-4bf5-880b-3d3fff9769d1) [No such file or directory] >[2016-04-19 07:24:36.649493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1> (2361fa9a-3a9d-4bf5-880b-3d3fff9769d1) [No such file or directory] >[2016-04-19 07:24:36.649532] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1> (2361fa9a-3a9d-4bf5-880b-3d3fff9769d1) [No such file or directory] >[2016-04-19 07:24:36.649768] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.652278] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2361fa9a-3a9d-4bf5-880b-3d3fff9769d1. (Possible split-brain) >[2016-04-19 07:24:36.653421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1> (2361fa9a-3a9d-4bf5-880b-3d3fff9769d1) [No such file or directory] >[2016-04-19 07:24:36.653536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1> (2361fa9a-3a9d-4bf5-880b-3d3fff9769d1) [No such file or directory] >[2016-04-19 07:24:36.656279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1> (2361fa9a-3a9d-4bf5-880b-3d3fff9769d1) [No such file or directory] >[2016-04-19 07:24:36.656420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1> (2361fa9a-3a9d-4bf5-880b-3d3fff9769d1) [No such file or directory] >[2016-04-19 07:24:36.656600] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2361fa9a-3a9d-4bf5-880b-3d3fff9769d1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:36.665382] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.666212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c> (aab42b8f-6003-4739-96c6-f28d1a23b09c) [No such file or directory] >[2016-04-19 07:24:36.666519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c> (aab42b8f-6003-4739-96c6-f28d1a23b09c) [No such file or directory] >[2016-04-19 07:24:36.667677] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid aab42b8f-6003-4739-96c6-f28d1a23b09c. (Possible split-brain) >[2016-04-19 07:24:36.668600] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c> (aab42b8f-6003-4739-96c6-f28d1a23b09c) [No such file or directory] >[2016-04-19 07:24:36.668875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c> (aab42b8f-6003-4739-96c6-f28d1a23b09c) [No such file or directory] >[2016-04-19 07:24:36.670623] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c> (aab42b8f-6003-4739-96c6-f28d1a23b09c) [No such file or directory] >[2016-04-19 07:24:36.670655] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c> (aab42b8f-6003-4739-96c6-f28d1a23b09c) [No such file or directory] >[2016-04-19 07:24:36.670819] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.673347] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid aab42b8f-6003-4739-96c6-f28d1a23b09c. (Possible split-brain) >[2016-04-19 07:24:36.674114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c> (aab42b8f-6003-4739-96c6-f28d1a23b09c) [No such file or directory] >[2016-04-19 07:24:36.674541] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c> (aab42b8f-6003-4739-96c6-f28d1a23b09c) [No such file or directory] >[2016-04-19 07:24:36.677908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c> (aab42b8f-6003-4739-96c6-f28d1a23b09c) [No such file or directory] >[2016-04-19 07:24:36.678160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c> (aab42b8f-6003-4739-96c6-f28d1a23b09c) [No such file or directory] >[2016-04-19 07:24:36.678393] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:aab42b8f-6003-4739-96c6-f28d1a23b09c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.686216] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.687060] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6> (757d2ed7-a2dd-4a9b-bcd6-281b204f96f6) [No such file or directory] >[2016-04-19 07:24:36.687403] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6> (757d2ed7-a2dd-4a9b-bcd6-281b204f96f6) [No such file or directory] >[2016-04-19 07:24:36.688502] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 757d2ed7-a2dd-4a9b-bcd6-281b204f96f6. (Possible split-brain) >[2016-04-19 07:24:36.689276] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6> (757d2ed7-a2dd-4a9b-bcd6-281b204f96f6) [No such file or directory] >[2016-04-19 07:24:36.689649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6> (757d2ed7-a2dd-4a9b-bcd6-281b204f96f6) [No such file or directory] >[2016-04-19 07:24:36.690973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6> (757d2ed7-a2dd-4a9b-bcd6-281b204f96f6) [No such file or directory] >[2016-04-19 07:24:36.691477] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6> (757d2ed7-a2dd-4a9b-bcd6-281b204f96f6) [No such file or directory] >[2016-04-19 07:24:36.691655] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.694130] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 757d2ed7-a2dd-4a9b-bcd6-281b204f96f6. (Possible split-brain) >[2016-04-19 07:24:36.694900] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6> (757d2ed7-a2dd-4a9b-bcd6-281b204f96f6) [No such file or directory] >[2016-04-19 07:24:36.695406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6> (757d2ed7-a2dd-4a9b-bcd6-281b204f96f6) [No such file or directory] >[2016-04-19 07:24:36.698559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6> (757d2ed7-a2dd-4a9b-bcd6-281b204f96f6) [No such file or directory] >[2016-04-19 07:24:36.698567] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6> (757d2ed7-a2dd-4a9b-bcd6-281b204f96f6) [No such file or directory] >[2016-04-19 07:24:36.698766] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:757d2ed7-a2dd-4a9b-bcd6-281b204f96f6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.707373] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.708134] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48c92346-fe4d-4e95-8352-3071127785a3> (48c92346-fe4d-4e95-8352-3071127785a3) [No such file or directory] >[2016-04-19 07:24:36.708567] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48c92346-fe4d-4e95-8352-3071127785a3> (48c92346-fe4d-4e95-8352-3071127785a3) [No such file or directory] >[2016-04-19 07:24:36.709718] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 48c92346-fe4d-4e95-8352-3071127785a3. (Possible split-brain) >[2016-04-19 07:24:36.710681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48c92346-fe4d-4e95-8352-3071127785a3> (48c92346-fe4d-4e95-8352-3071127785a3) [No such file or directory] >[2016-04-19 07:24:36.710942] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48c92346-fe4d-4e95-8352-3071127785a3> (48c92346-fe4d-4e95-8352-3071127785a3) [No such file or directory] >[2016-04-19 07:24:36.712392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48c92346-fe4d-4e95-8352-3071127785a3> (48c92346-fe4d-4e95-8352-3071127785a3) [No such file or directory] >[2016-04-19 07:24:36.712637] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48c92346-fe4d-4e95-8352-3071127785a3> (48c92346-fe4d-4e95-8352-3071127785a3) [No such file or directory] >[2016-04-19 07:24:36.712812] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:48c92346-fe4d-4e95-8352-3071127785a3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.715268] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 48c92346-fe4d-4e95-8352-3071127785a3. (Possible split-brain) >[2016-04-19 07:24:36.716089] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48c92346-fe4d-4e95-8352-3071127785a3> (48c92346-fe4d-4e95-8352-3071127785a3) [No such file or directory] >[2016-04-19 07:24:36.716445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48c92346-fe4d-4e95-8352-3071127785a3> (48c92346-fe4d-4e95-8352-3071127785a3) [No such file or directory] >[2016-04-19 07:24:36.718997] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48c92346-fe4d-4e95-8352-3071127785a3> (48c92346-fe4d-4e95-8352-3071127785a3) [No such file or directory] >[2016-04-19 07:24:36.719295] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48c92346-fe4d-4e95-8352-3071127785a3> (48c92346-fe4d-4e95-8352-3071127785a3) [No such file or directory] >[2016-04-19 07:24:36.719461] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:48c92346-fe4d-4e95-8352-3071127785a3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.726870] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.727698] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294> (c87bd99e-b382-4683-898d-4a1c28de4294) [No such file or directory] >[2016-04-19 07:24:36.728027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294> (c87bd99e-b382-4683-898d-4a1c28de4294) [No such file or directory] >[2016-04-19 07:24:36.729113] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c87bd99e-b382-4683-898d-4a1c28de4294. (Possible split-brain) >[2016-04-19 07:24:36.730364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294> (c87bd99e-b382-4683-898d-4a1c28de4294) [No such file or directory] >[2016-04-19 07:24:36.730445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294> (c87bd99e-b382-4683-898d-4a1c28de4294) [No such file or directory] >[2016-04-19 07:24:36.732038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294> (c87bd99e-b382-4683-898d-4a1c28de4294) [No such file or directory] >[2016-04-19 07:24:36.732053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294> (c87bd99e-b382-4683-898d-4a1c28de4294) [No such file or directory] >[2016-04-19 07:24:36.732206] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.734611] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c87bd99e-b382-4683-898d-4a1c28de4294. (Possible split-brain) >[2016-04-19 07:24:36.735885] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294> (c87bd99e-b382-4683-898d-4a1c28de4294) [No such file or directory] >[2016-04-19 07:24:36.735902] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294> (c87bd99e-b382-4683-898d-4a1c28de4294) [No such file or directory] >[2016-04-19 07:24:36.738543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294> (c87bd99e-b382-4683-898d-4a1c28de4294) [No such file or directory] >[2016-04-19 07:24:36.738880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294> (c87bd99e-b382-4683-898d-4a1c28de4294) [No such file or directory] >[2016-04-19 07:24:36.739046] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c87bd99e-b382-4683-898d-4a1c28de4294>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.747105] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.747908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee> (dc47a59f-dc4b-4a5d-b585-32adb506fcee) [No such file or directory] >[2016-04-19 07:24:36.748367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee> (dc47a59f-dc4b-4a5d-b585-32adb506fcee) [No such file or directory] >[2016-04-19 07:24:36.750881] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid dc47a59f-dc4b-4a5d-b585-32adb506fcee. (Possible split-brain) >[2016-04-19 07:24:36.751696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee> (dc47a59f-dc4b-4a5d-b585-32adb506fcee) [No such file or directory] >[2016-04-19 07:24:36.751868] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee> (dc47a59f-dc4b-4a5d-b585-32adb506fcee) [No such file or directory] >[2016-04-19 07:24:36.753102] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee> (dc47a59f-dc4b-4a5d-b585-32adb506fcee) [No such file or directory] >[2016-04-19 07:24:36.753419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee> (dc47a59f-dc4b-4a5d-b585-32adb506fcee) [No such file or directory] >[2016-04-19 07:24:36.753631] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.756107] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid dc47a59f-dc4b-4a5d-b585-32adb506fcee. (Possible split-brain) >[2016-04-19 07:24:36.756868] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee> (dc47a59f-dc4b-4a5d-b585-32adb506fcee) [No such file or directory] >[2016-04-19 07:24:36.757088] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee> (dc47a59f-dc4b-4a5d-b585-32adb506fcee) [No such file or directory] >[2016-04-19 07:24:36.759989] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee> (dc47a59f-dc4b-4a5d-b585-32adb506fcee) [No such file or directory] >[2016-04-19 07:24:36.760246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee> (dc47a59f-dc4b-4a5d-b585-32adb506fcee) [No such file or directory] >[2016-04-19 07:24:36.760459] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:dc47a59f-dc4b-4a5d-b585-32adb506fcee>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.767884] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.768691] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e> (c3573f1e-6259-4862-a73e-d6705d1a136e) [No such file or directory] >[2016-04-19 07:24:36.769007] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e> (c3573f1e-6259-4862-a73e-d6705d1a136e) [No such file or directory] >[2016-04-19 07:24:36.770178] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c3573f1e-6259-4862-a73e-d6705d1a136e. (Possible split-brain) >[2016-04-19 07:24:36.771060] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e> (c3573f1e-6259-4862-a73e-d6705d1a136e) [No such file or directory] >[2016-04-19 07:24:36.771352] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e> (c3573f1e-6259-4862-a73e-d6705d1a136e) [No such file or directory] >[2016-04-19 07:24:36.772868] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e> (c3573f1e-6259-4862-a73e-d6705d1a136e) [No such file or directory] >[2016-04-19 07:24:36.772992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e> (c3573f1e-6259-4862-a73e-d6705d1a136e) [No such file or directory] >[2016-04-19 07:24:36.773151] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.775638] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c3573f1e-6259-4862-a73e-d6705d1a136e. (Possible split-brain) >[2016-04-19 07:24:36.776460] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e> (c3573f1e-6259-4862-a73e-d6705d1a136e) [No such file or directory] >[2016-04-19 07:24:36.776789] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e> (c3573f1e-6259-4862-a73e-d6705d1a136e) [No such file or directory] >[2016-04-19 07:24:36.779552] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e> (c3573f1e-6259-4862-a73e-d6705d1a136e) [No such file or directory] >[2016-04-19 07:24:36.779992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e> (c3573f1e-6259-4862-a73e-d6705d1a136e) [No such file or directory] >[2016-04-19 07:24:36.780238] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c3573f1e-6259-4862-a73e-d6705d1a136e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.788907] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.789710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d> (01a67c0d-a6ff-4472-a302-61f1309aec9d) [No such file or directory] >[2016-04-19 07:24:36.790043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d> (01a67c0d-a6ff-4472-a302-61f1309aec9d) [No such file or directory] >[2016-04-19 07:24:36.792924] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 01a67c0d-a6ff-4472-a302-61f1309aec9d. (Possible split-brain) >[2016-04-19 07:24:36.794212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d> (01a67c0d-a6ff-4472-a302-61f1309aec9d) [No such file or directory] >[2016-04-19 07:24:36.794274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d> (01a67c0d-a6ff-4472-a302-61f1309aec9d) [No such file or directory] >[2016-04-19 07:24:36.795749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d> (01a67c0d-a6ff-4472-a302-61f1309aec9d) [No such file or directory] >[2016-04-19 07:24:36.796003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d> (01a67c0d-a6ff-4472-a302-61f1309aec9d) [No such file or directory] >[2016-04-19 07:24:36.796186] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.798703] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 01a67c0d-a6ff-4472-a302-61f1309aec9d. (Possible split-brain) >[2016-04-19 07:24:36.799588] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d> (01a67c0d-a6ff-4472-a302-61f1309aec9d) [No such file or directory] >[2016-04-19 07:24:36.799913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d> (01a67c0d-a6ff-4472-a302-61f1309aec9d) [No such file or directory] >[2016-04-19 07:24:36.802877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d> (01a67c0d-a6ff-4472-a302-61f1309aec9d) [No such file or directory] >[2016-04-19 07:24:36.802923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d> (01a67c0d-a6ff-4472-a302-61f1309aec9d) [No such file or directory] >[2016-04-19 07:24:36.803109] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:01a67c0d-a6ff-4472-a302-61f1309aec9d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.810823] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.811638] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c> (13aaeafa-0720-4f2b-b92a-77c885509e2c) [No such file or directory] >[2016-04-19 07:24:36.811887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c> (13aaeafa-0720-4f2b-b92a-77c885509e2c) [No such file or directory] >[2016-04-19 07:24:36.814724] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 13aaeafa-0720-4f2b-b92a-77c885509e2c. (Possible split-brain) >[2016-04-19 07:24:36.815625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c> (13aaeafa-0720-4f2b-b92a-77c885509e2c) [No such file or directory] >[2016-04-19 07:24:36.815953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c> (13aaeafa-0720-4f2b-b92a-77c885509e2c) [No such file or directory] >[2016-04-19 07:24:36.817297] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c> (13aaeafa-0720-4f2b-b92a-77c885509e2c) [No such file or directory] >[2016-04-19 07:24:36.817613] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c> (13aaeafa-0720-4f2b-b92a-77c885509e2c) [No such file or directory] >[2016-04-19 07:24:36.817728] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.820422] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 13aaeafa-0720-4f2b-b92a-77c885509e2c. (Possible split-brain) >[2016-04-19 07:24:36.821275] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c> (13aaeafa-0720-4f2b-b92a-77c885509e2c) [No such file or directory] >[2016-04-19 07:24:36.821646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c> (13aaeafa-0720-4f2b-b92a-77c885509e2c) [No such file or directory] >[2016-04-19 07:24:36.824687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c> (13aaeafa-0720-4f2b-b92a-77c885509e2c) [No such file or directory] >[2016-04-19 07:24:36.824797] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c> (13aaeafa-0720-4f2b-b92a-77c885509e2c) [No such file or directory] >[2016-04-19 07:24:36.824917] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:13aaeafa-0720-4f2b-b92a-77c885509e2c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.834066] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.834886] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58> (03d45009-7d36-4c39-bb66-0124117e6a58) [No such file or directory] >[2016-04-19 07:24:36.835300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58> (03d45009-7d36-4c39-bb66-0124117e6a58) [No such file or directory] >[2016-04-19 07:24:36.836163] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 03d45009-7d36-4c39-bb66-0124117e6a58. (Possible split-brain) >[2016-04-19 07:24:36.837233] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58> (03d45009-7d36-4c39-bb66-0124117e6a58) [No such file or directory] >[2016-04-19 07:24:36.837480] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58> (03d45009-7d36-4c39-bb66-0124117e6a58) [No such file or directory] >[2016-04-19 07:24:36.838678] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58> (03d45009-7d36-4c39-bb66-0124117e6a58) [No such file or directory] >[2016-04-19 07:24:36.838840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58> (03d45009-7d36-4c39-bb66-0124117e6a58) [No such file or directory] >[2016-04-19 07:24:36.839025] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.841515] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 03d45009-7d36-4c39-bb66-0124117e6a58. (Possible split-brain) >[2016-04-19 07:24:36.842823] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58> (03d45009-7d36-4c39-bb66-0124117e6a58) [No such file or directory] >[2016-04-19 07:24:36.842912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58> (03d45009-7d36-4c39-bb66-0124117e6a58) [No such file or directory] >[2016-04-19 07:24:36.845583] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58> (03d45009-7d36-4c39-bb66-0124117e6a58) [No such file or directory] >[2016-04-19 07:24:36.845899] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58> (03d45009-7d36-4c39-bb66-0124117e6a58) [No such file or directory] >[2016-04-19 07:24:36.846149] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:03d45009-7d36-4c39-bb66-0124117e6a58>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.853311] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.854174] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c> (2a5695fe-3566-46d5-99b1-6a79aabbc96c) [No such file or directory] >[2016-04-19 07:24:36.854264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c> (2a5695fe-3566-46d5-99b1-6a79aabbc96c) [No such file or directory] >[2016-04-19 07:24:36.855093] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2a5695fe-3566-46d5-99b1-6a79aabbc96c. (Possible split-brain) >[2016-04-19 07:24:36.855665] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c> (2a5695fe-3566-46d5-99b1-6a79aabbc96c) [No such file or directory] >[2016-04-19 07:24:36.855890] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c> (2a5695fe-3566-46d5-99b1-6a79aabbc96c) [No such file or directory] >[2016-04-19 07:24:36.856694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c> (2a5695fe-3566-46d5-99b1-6a79aabbc96c) [No such file or directory] >[2016-04-19 07:24:36.856801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c> (2a5695fe-3566-46d5-99b1-6a79aabbc96c) [No such file or directory] >[2016-04-19 07:24:36.857572] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:36.860010] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2a5695fe-3566-46d5-99b1-6a79aabbc96c. (Possible split-brain) >[2016-04-19 07:24:36.861028] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c> (2a5695fe-3566-46d5-99b1-6a79aabbc96c) [No such file or directory] >[2016-04-19 07:24:36.861158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c> (2a5695fe-3566-46d5-99b1-6a79aabbc96c) [No such file or directory] >[2016-04-19 07:24:36.863521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c> (2a5695fe-3566-46d5-99b1-6a79aabbc96c) [No such file or directory] >[2016-04-19 07:24:36.864212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c> (2a5695fe-3566-46d5-99b1-6a79aabbc96c) [No such file or directory] >[2016-04-19 07:24:36.864385] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2a5695fe-3566-46d5-99b1-6a79aabbc96c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.873051] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.873603] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34> (11b50cf3-3504-4d75-af2a-c35e8bf6aa34) [No such file or directory] >[2016-04-19 07:24:36.873904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34> (11b50cf3-3504-4d75-af2a-c35e8bf6aa34) [No such file or directory] >[2016-04-19 07:24:36.876389] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 11b50cf3-3504-4d75-af2a-c35e8bf6aa34. (Possible split-brain) >[2016-04-19 07:24:36.877307] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34> (11b50cf3-3504-4d75-af2a-c35e8bf6aa34) [No such file or directory] >[2016-04-19 07:24:36.877478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34> (11b50cf3-3504-4d75-af2a-c35e8bf6aa34) [No such file or directory] >[2016-04-19 07:24:36.878501] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34> (11b50cf3-3504-4d75-af2a-c35e8bf6aa34) [No such file or directory] >[2016-04-19 07:24:36.879046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34> (11b50cf3-3504-4d75-af2a-c35e8bf6aa34) [No such file or directory] >[2016-04-19 07:24:36.879242] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:36.881755] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 11b50cf3-3504-4d75-af2a-c35e8bf6aa34. (Possible split-brain) >[2016-04-19 07:24:36.882601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34> (11b50cf3-3504-4d75-af2a-c35e8bf6aa34) [No such file or directory] >[2016-04-19 07:24:36.882744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34> (11b50cf3-3504-4d75-af2a-c35e8bf6aa34) [No such file or directory] >[2016-04-19 07:24:36.884953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34> (11b50cf3-3504-4d75-af2a-c35e8bf6aa34) [No such file or directory] >[2016-04-19 07:24:36.885507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34> (11b50cf3-3504-4d75-af2a-c35e8bf6aa34) [No such file or directory] >[2016-04-19 07:24:36.886853] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:11b50cf3-3504-4d75-af2a-c35e8bf6aa34>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:36.895044] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.895815] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349> (5b0e2e20-8af5-4f75-bbd5-fbc815c71349) [No such file or directory] >[2016-04-19 07:24:36.896344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349> (5b0e2e20-8af5-4f75-bbd5-fbc815c71349) [No such file or directory] >[2016-04-19 07:24:36.898805] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5b0e2e20-8af5-4f75-bbd5-fbc815c71349. (Possible split-brain) >[2016-04-19 07:24:36.899551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349> (5b0e2e20-8af5-4f75-bbd5-fbc815c71349) [No such file or directory] >[2016-04-19 07:24:36.899933] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349> (5b0e2e20-8af5-4f75-bbd5-fbc815c71349) [No such file or directory] >[2016-04-19 07:24:36.901080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349> (5b0e2e20-8af5-4f75-bbd5-fbc815c71349) [No such file or directory] >[2016-04-19 07:24:36.901438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349> (5b0e2e20-8af5-4f75-bbd5-fbc815c71349) [No such file or directory] >[2016-04-19 07:24:36.901558] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.904048] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5b0e2e20-8af5-4f75-bbd5-fbc815c71349. (Possible split-brain) >[2016-04-19 07:24:36.904829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349> (5b0e2e20-8af5-4f75-bbd5-fbc815c71349) [No such file or directory] >[2016-04-19 07:24:36.905251] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349> (5b0e2e20-8af5-4f75-bbd5-fbc815c71349) [No such file or directory] >[2016-04-19 07:24:36.907862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349> (5b0e2e20-8af5-4f75-bbd5-fbc815c71349) [No such file or directory] >[2016-04-19 07:24:36.908131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349> (5b0e2e20-8af5-4f75-bbd5-fbc815c71349) [No such file or directory] >[2016-04-19 07:24:36.908254] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5b0e2e20-8af5-4f75-bbd5-fbc815c71349>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.917093] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.918037] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44> (ae1344ed-9b19-4684-aeaa-c73625edfd44) [No such file or directory] >[2016-04-19 07:24:36.918274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44> (ae1344ed-9b19-4684-aeaa-c73625edfd44) [No such file or directory] >[2016-04-19 07:24:36.919131] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ae1344ed-9b19-4684-aeaa-c73625edfd44. (Possible split-brain) >[2016-04-19 07:24:36.919891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44> (ae1344ed-9b19-4684-aeaa-c73625edfd44) [No such file or directory] >[2016-04-19 07:24:36.920412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44> (ae1344ed-9b19-4684-aeaa-c73625edfd44) [No such file or directory] >[2016-04-19 07:24:36.921564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44> (ae1344ed-9b19-4684-aeaa-c73625edfd44) [No such file or directory] >[2016-04-19 07:24:36.921805] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44> (ae1344ed-9b19-4684-aeaa-c73625edfd44) [No such file or directory] >[2016-04-19 07:24:36.921953] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.924521] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ae1344ed-9b19-4684-aeaa-c73625edfd44. (Possible split-brain) >[2016-04-19 07:24:36.925440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44> (ae1344ed-9b19-4684-aeaa-c73625edfd44) [No such file or directory] >[2016-04-19 07:24:36.925706] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44> (ae1344ed-9b19-4684-aeaa-c73625edfd44) [No such file or directory] >[2016-04-19 07:24:36.928137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44> (ae1344ed-9b19-4684-aeaa-c73625edfd44) [No such file or directory] >[2016-04-19 07:24:36.928293] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44> (ae1344ed-9b19-4684-aeaa-c73625edfd44) [No such file or directory] >[2016-04-19 07:24:36.928452] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ae1344ed-9b19-4684-aeaa-c73625edfd44>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.935789] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.936510] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096> (b4ee916e-1d6e-4c7a-9c46-db7593bd9096) [No such file or directory] >[2016-04-19 07:24:36.937020] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096> (b4ee916e-1d6e-4c7a-9c46-db7593bd9096) [No such file or directory] >[2016-04-19 07:24:36.939593] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b4ee916e-1d6e-4c7a-9c46-db7593bd9096. (Possible split-brain) >[2016-04-19 07:24:36.940480] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096> (b4ee916e-1d6e-4c7a-9c46-db7593bd9096) [No such file or directory] >[2016-04-19 07:24:36.940728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096> (b4ee916e-1d6e-4c7a-9c46-db7593bd9096) [No such file or directory] >[2016-04-19 07:24:36.941918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096> (b4ee916e-1d6e-4c7a-9c46-db7593bd9096) [No such file or directory] >[2016-04-19 07:24:36.942229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096> (b4ee916e-1d6e-4c7a-9c46-db7593bd9096) [No such file or directory] >[2016-04-19 07:24:36.942372] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.944848] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b4ee916e-1d6e-4c7a-9c46-db7593bd9096. (Possible split-brain) >[2016-04-19 07:24:36.945574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096> (b4ee916e-1d6e-4c7a-9c46-db7593bd9096) [No such file or directory] >[2016-04-19 07:24:36.945901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096> (b4ee916e-1d6e-4c7a-9c46-db7593bd9096) [No such file or directory] >[2016-04-19 07:24:36.949279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096> (b4ee916e-1d6e-4c7a-9c46-db7593bd9096) [No such file or directory] >[2016-04-19 07:24:36.949362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096> (b4ee916e-1d6e-4c7a-9c46-db7593bd9096) [No such file or directory] >[2016-04-19 07:24:36.949543] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b4ee916e-1d6e-4c7a-9c46-db7593bd9096>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.958091] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.958981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0> (1f0116b5-8348-427a-a147-cd91ee617be0) [No such file or directory] >[2016-04-19 07:24:36.959095] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0> (1f0116b5-8348-427a-a147-cd91ee617be0) [No such file or directory] >[2016-04-19 07:24:36.962010] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1f0116b5-8348-427a-a147-cd91ee617be0. (Possible split-brain) >[2016-04-19 07:24:36.962965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0> (1f0116b5-8348-427a-a147-cd91ee617be0) [No such file or directory] >[2016-04-19 07:24:36.963286] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0> (1f0116b5-8348-427a-a147-cd91ee617be0) [No such file or directory] >[2016-04-19 07:24:36.964792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0> (1f0116b5-8348-427a-a147-cd91ee617be0) [No such file or directory] >[2016-04-19 07:24:36.964881] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0> (1f0116b5-8348-427a-a147-cd91ee617be0) [No such file or directory] >[2016-04-19 07:24:36.965067] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.967553] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1f0116b5-8348-427a-a147-cd91ee617be0. (Possible split-brain) >[2016-04-19 07:24:36.968656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0> (1f0116b5-8348-427a-a147-cd91ee617be0) [No such file or directory] >[2016-04-19 07:24:36.968670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0> (1f0116b5-8348-427a-a147-cd91ee617be0) [No such file or directory] >[2016-04-19 07:24:36.971376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0> (1f0116b5-8348-427a-a147-cd91ee617be0) [No such file or directory] >[2016-04-19 07:24:36.971668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0> (1f0116b5-8348-427a-a147-cd91ee617be0) [No such file or directory] >[2016-04-19 07:24:36.971871] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1f0116b5-8348-427a-a147-cd91ee617be0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.979553] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.980352] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17> (f7d92907-2faa-452b-bb42-c35e6306fb17) [No such file or directory] >[2016-04-19 07:24:36.980674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17> (f7d92907-2faa-452b-bb42-c35e6306fb17) [No such file or directory] >[2016-04-19 07:24:36.981528] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f7d92907-2faa-452b-bb42-c35e6306fb17. (Possible split-brain) >[2016-04-19 07:24:36.982263] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17> (f7d92907-2faa-452b-bb42-c35e6306fb17) [No such file or directory] >[2016-04-19 07:24:36.982701] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17> (f7d92907-2faa-452b-bb42-c35e6306fb17) [No such file or directory] >[2016-04-19 07:24:36.983871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17> (f7d92907-2faa-452b-bb42-c35e6306fb17) [No such file or directory] >[2016-04-19 07:24:36.984303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17> (f7d92907-2faa-452b-bb42-c35e6306fb17) [No such file or directory] >[2016-04-19 07:24:36.984485] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:36.986882] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f7d92907-2faa-452b-bb42-c35e6306fb17. (Possible split-brain) >[2016-04-19 07:24:36.987720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17> (f7d92907-2faa-452b-bb42-c35e6306fb17) [No such file or directory] >[2016-04-19 07:24:36.988001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17> (f7d92907-2faa-452b-bb42-c35e6306fb17) [No such file or directory] >[2016-04-19 07:24:36.990583] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17> (f7d92907-2faa-452b-bb42-c35e6306fb17) [No such file or directory] >[2016-04-19 07:24:36.990865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17> (f7d92907-2faa-452b-bb42-c35e6306fb17) [No such file or directory] >[2016-04-19 07:24:36.990983] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f7d92907-2faa-452b-bb42-c35e6306fb17>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:36.999050] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:36.999738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc> (3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc) [No such file or directory] >[2016-04-19 07:24:36.999976] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc> (3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc) [No such file or directory] >[2016-04-19 07:24:37.002497] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc. (Possible split-brain) >[2016-04-19 07:24:37.003361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc> (3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc) [No such file or directory] >[2016-04-19 07:24:37.003520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc> (3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc) [No such file or directory] >[2016-04-19 07:24:37.004643] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc> (3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc) [No such file or directory] >[2016-04-19 07:24:37.004949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc> (3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc) [No such file or directory] >[2016-04-19 07:24:37.005140] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.007630] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc. (Possible split-brain) >[2016-04-19 07:24:37.008356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc> (3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc) [No such file or directory] >[2016-04-19 07:24:37.008862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc> (3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc) [No such file or directory] >[2016-04-19 07:24:37.011605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc> (3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc) [No such file or directory] >[2016-04-19 07:24:37.011639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc> (3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc) [No such file or directory] >[2016-04-19 07:24:37.011827] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3f6d34a1-94de-4f6b-8c41-5ba4b5ce50bc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.019553] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.020482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1> (f800b2c7-5814-4ea3-8d2c-470a9166e4c1) [No such file or directory] >[2016-04-19 07:24:37.020598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1> (f800b2c7-5814-4ea3-8d2c-470a9166e4c1) [No such file or directory] >[2016-04-19 07:24:37.021777] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f800b2c7-5814-4ea3-8d2c-470a9166e4c1. (Possible split-brain) >[2016-04-19 07:24:37.022572] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1> (f800b2c7-5814-4ea3-8d2c-470a9166e4c1) [No such file or directory] >[2016-04-19 07:24:37.022780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1> (f800b2c7-5814-4ea3-8d2c-470a9166e4c1) [No such file or directory] >[2016-04-19 07:24:37.024157] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1> (f800b2c7-5814-4ea3-8d2c-470a9166e4c1) [No such file or directory] >[2016-04-19 07:24:37.024456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1> (f800b2c7-5814-4ea3-8d2c-470a9166e4c1) [No such file or directory] >[2016-04-19 07:24:37.024722] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.027189] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f800b2c7-5814-4ea3-8d2c-470a9166e4c1. (Possible split-brain) >[2016-04-19 07:24:37.028128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1> (f800b2c7-5814-4ea3-8d2c-470a9166e4c1) [No such file or directory] >[2016-04-19 07:24:37.028431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1> (f800b2c7-5814-4ea3-8d2c-470a9166e4c1) [No such file or directory] >[2016-04-19 07:24:37.030897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1> (f800b2c7-5814-4ea3-8d2c-470a9166e4c1) [No such file or directory] >[2016-04-19 07:24:37.030998] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1> (f800b2c7-5814-4ea3-8d2c-470a9166e4c1) [No such file or directory] >[2016-04-19 07:24:37.031200] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f800b2c7-5814-4ea3-8d2c-470a9166e4c1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.039188] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.039943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a> (a56fdcea-5910-48b3-acaa-eb1b75a4443a) [No such file or directory] >[2016-04-19 07:24:37.040038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a> (a56fdcea-5910-48b3-acaa-eb1b75a4443a) [No such file or directory] >[2016-04-19 07:24:37.042584] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a56fdcea-5910-48b3-acaa-eb1b75a4443a. (Possible split-brain) >[2016-04-19 07:24:37.043271] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a> (a56fdcea-5910-48b3-acaa-eb1b75a4443a) [No such file or directory] >[2016-04-19 07:24:37.043526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a> (a56fdcea-5910-48b3-acaa-eb1b75a4443a) [No such file or directory] >[2016-04-19 07:24:37.044999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a> (a56fdcea-5910-48b3-acaa-eb1b75a4443a) [No such file or directory] >[2016-04-19 07:24:37.045135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a> (a56fdcea-5910-48b3-acaa-eb1b75a4443a) [No such file or directory] >[2016-04-19 07:24:37.045282] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.047841] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a56fdcea-5910-48b3-acaa-eb1b75a4443a. (Possible split-brain) >[2016-04-19 07:24:37.048613] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a> (a56fdcea-5910-48b3-acaa-eb1b75a4443a) [No such file or directory] >[2016-04-19 07:24:37.048733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a> (a56fdcea-5910-48b3-acaa-eb1b75a4443a) [No such file or directory] >[2016-04-19 07:24:37.051426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a> (a56fdcea-5910-48b3-acaa-eb1b75a4443a) [No such file or directory] >[2016-04-19 07:24:37.051529] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a> (a56fdcea-5910-48b3-acaa-eb1b75a4443a) [No such file or directory] >[2016-04-19 07:24:37.051729] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a56fdcea-5910-48b3-acaa-eb1b75a4443a>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.059580] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.060292] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08> (70df60c1-ec2f-4fbd-8500-8f174fed7b08) [No such file or directory] >[2016-04-19 07:24:37.060445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08> (70df60c1-ec2f-4fbd-8500-8f174fed7b08) [No such file or directory] >[2016-04-19 07:24:37.061259] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 70df60c1-ec2f-4fbd-8500-8f174fed7b08. (Possible split-brain) >[2016-04-19 07:24:37.062091] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08> (70df60c1-ec2f-4fbd-8500-8f174fed7b08) [No such file or directory] >[2016-04-19 07:24:37.062114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08> (70df60c1-ec2f-4fbd-8500-8f174fed7b08) [No such file or directory] >[2016-04-19 07:24:37.063203] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08> (70df60c1-ec2f-4fbd-8500-8f174fed7b08) [No such file or directory] >[2016-04-19 07:24:37.063491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08> (70df60c1-ec2f-4fbd-8500-8f174fed7b08) [No such file or directory] >[2016-04-19 07:24:37.063654] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.066044] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 70df60c1-ec2f-4fbd-8500-8f174fed7b08. (Possible split-brain) >[2016-04-19 07:24:37.066850] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08> (70df60c1-ec2f-4fbd-8500-8f174fed7b08) [No such file or directory] >[2016-04-19 07:24:37.067161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08> (70df60c1-ec2f-4fbd-8500-8f174fed7b08) [No such file or directory] >[2016-04-19 07:24:37.069686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08> (70df60c1-ec2f-4fbd-8500-8f174fed7b08) [No such file or directory] >[2016-04-19 07:24:37.069763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08> (70df60c1-ec2f-4fbd-8500-8f174fed7b08) [No such file or directory] >[2016-04-19 07:24:37.070380] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:70df60c1-ec2f-4fbd-8500-8f174fed7b08>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.078831] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.079448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66> (b17c487a-2ff0-4eba-825a-a19f339acb66) [No such file or directory] >[2016-04-19 07:24:37.079701] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66> (b17c487a-2ff0-4eba-825a-a19f339acb66) [No such file or directory] >[2016-04-19 07:24:37.081606] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b17c487a-2ff0-4eba-825a-a19f339acb66. (Possible split-brain) >[2016-04-19 07:24:37.082292] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66> (b17c487a-2ff0-4eba-825a-a19f339acb66) [No such file or directory] >[2016-04-19 07:24:37.082781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66> (b17c487a-2ff0-4eba-825a-a19f339acb66) [No such file or directory] >[2016-04-19 07:24:37.084369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66> (b17c487a-2ff0-4eba-825a-a19f339acb66) [No such file or directory] >[2016-04-19 07:24:37.084395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66> (b17c487a-2ff0-4eba-825a-a19f339acb66) [No such file or directory] >[2016-04-19 07:24:37.084550] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.086983] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b17c487a-2ff0-4eba-825a-a19f339acb66. (Possible split-brain) >[2016-04-19 07:24:37.088188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66> (b17c487a-2ff0-4eba-825a-a19f339acb66) [No such file or directory] >[2016-04-19 07:24:37.088275] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66> (b17c487a-2ff0-4eba-825a-a19f339acb66) [No such file or directory] >[2016-04-19 07:24:37.090716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66> (b17c487a-2ff0-4eba-825a-a19f339acb66) [No such file or directory] >[2016-04-19 07:24:37.091008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66> (b17c487a-2ff0-4eba-825a-a19f339acb66) [No such file or directory] >[2016-04-19 07:24:37.091388] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b17c487a-2ff0-4eba-825a-a19f339acb66>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.099608] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.100485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8> (8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8) [No such file or directory] >[2016-04-19 07:24:37.100947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8> (8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8) [No such file or directory] >[2016-04-19 07:24:37.101810] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8. (Possible split-brain) >[2016-04-19 07:24:37.102714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8> (8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8) [No such file or directory] >[2016-04-19 07:24:37.103009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8> (8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8) [No such file or directory] >[2016-04-19 07:24:37.104056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8> (8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8) [No such file or directory] >[2016-04-19 07:24:37.104302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8> (8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8) [No such file or directory] >[2016-04-19 07:24:37.104614] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:37.107021] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8. (Possible split-brain) >[2016-04-19 07:24:37.107916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8> (8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8) [No such file or directory] >[2016-04-19 07:24:37.108199] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8> (8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8) [No such file or directory] >[2016-04-19 07:24:37.110499] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8> (8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8) [No such file or directory] >[2016-04-19 07:24:37.110618] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8> (8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8) [No such file or directory] >[2016-04-19 07:24:37.111003] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8d5a80cc-9b49-4b5e-a15d-ef5f17b800c8>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.119978] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.120741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5> (5f574611-924c-4710-9e28-eff532d4a3c5) [No such file or directory] >[2016-04-19 07:24:37.121200] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5> (5f574611-924c-4710-9e28-eff532d4a3c5) [No such file or directory] >[2016-04-19 07:24:37.122045] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5f574611-924c-4710-9e28-eff532d4a3c5. (Possible split-brain) >[2016-04-19 07:24:37.122794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5> (5f574611-924c-4710-9e28-eff532d4a3c5) [No such file or directory] >[2016-04-19 07:24:37.122986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5> (5f574611-924c-4710-9e28-eff532d4a3c5) [No such file or directory] >[2016-04-19 07:24:37.124494] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5> (5f574611-924c-4710-9e28-eff532d4a3c5) [No such file or directory] >[2016-04-19 07:24:37.124605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5> (5f574611-924c-4710-9e28-eff532d4a3c5) [No such file or directory] >[2016-04-19 07:24:37.124782] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.127234] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5f574611-924c-4710-9e28-eff532d4a3c5. (Possible split-brain) >[2016-04-19 07:24:37.127965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5> (5f574611-924c-4710-9e28-eff532d4a3c5) [No such file or directory] >[2016-04-19 07:24:37.128509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5> (5f574611-924c-4710-9e28-eff532d4a3c5) [No such file or directory] >[2016-04-19 07:24:37.131462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5> (5f574611-924c-4710-9e28-eff532d4a3c5) [No such file or directory] >[2016-04-19 07:24:37.131589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5> (5f574611-924c-4710-9e28-eff532d4a3c5) [No such file or directory] >[2016-04-19 07:24:37.131819] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5f574611-924c-4710-9e28-eff532d4a3c5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.140400] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.141499] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201> (cbf4193a-2a84-4394-8fd5-e10059709201) [No such file or directory] >[2016-04-19 07:24:37.141707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201> (cbf4193a-2a84-4394-8fd5-e10059709201) [No such file or directory] >[2016-04-19 07:24:37.142633] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cbf4193a-2a84-4394-8fd5-e10059709201. (Possible split-brain) >[2016-04-19 07:24:37.143647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201> (cbf4193a-2a84-4394-8fd5-e10059709201) [No such file or directory] >[2016-04-19 07:24:37.143856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201> (cbf4193a-2a84-4394-8fd5-e10059709201) [No such file or directory] >[2016-04-19 07:24:37.145125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201> (cbf4193a-2a84-4394-8fd5-e10059709201) [No such file or directory] >[2016-04-19 07:24:37.145287] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201> (cbf4193a-2a84-4394-8fd5-e10059709201) [No such file or directory] >[2016-04-19 07:24:37.145528] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.147972] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cbf4193a-2a84-4394-8fd5-e10059709201. (Possible split-brain) >[2016-04-19 07:24:37.149150] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201> (cbf4193a-2a84-4394-8fd5-e10059709201) [No such file or directory] >[2016-04-19 07:24:37.149364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201> (cbf4193a-2a84-4394-8fd5-e10059709201) [No such file or directory] >[2016-04-19 07:24:37.151848] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201> (cbf4193a-2a84-4394-8fd5-e10059709201) [No such file or directory] >[2016-04-19 07:24:37.152100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201> (cbf4193a-2a84-4394-8fd5-e10059709201) [No such file or directory] >[2016-04-19 07:24:37.152463] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cbf4193a-2a84-4394-8fd5-e10059709201>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.160868] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.161845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633> (ecce7e10-0443-4f72-bdbc-103f27e85633) [No such file or directory] >[2016-04-19 07:24:37.161954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633> (ecce7e10-0443-4f72-bdbc-103f27e85633) [No such file or directory] >[2016-04-19 07:24:37.164939] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ecce7e10-0443-4f72-bdbc-103f27e85633. (Possible split-brain) >[2016-04-19 07:24:37.166004] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633> (ecce7e10-0443-4f72-bdbc-103f27e85633) [No such file or directory] >[2016-04-19 07:24:37.166291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633> (ecce7e10-0443-4f72-bdbc-103f27e85633) [No such file or directory] >[2016-04-19 07:24:37.167566] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633> (ecce7e10-0443-4f72-bdbc-103f27e85633) [No such file or directory] >[2016-04-19 07:24:37.168049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633> (ecce7e10-0443-4f72-bdbc-103f27e85633) [No such file or directory] >[2016-04-19 07:24:37.168184] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.170788] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ecce7e10-0443-4f72-bdbc-103f27e85633. (Possible split-brain) >[2016-04-19 07:24:37.171647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633> (ecce7e10-0443-4f72-bdbc-103f27e85633) [No such file or directory] >[2016-04-19 07:24:37.171951] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633> (ecce7e10-0443-4f72-bdbc-103f27e85633) [No such file or directory] >[2016-04-19 07:24:37.174710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633> (ecce7e10-0443-4f72-bdbc-103f27e85633) [No such file or directory] >[2016-04-19 07:24:37.175090] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633> (ecce7e10-0443-4f72-bdbc-103f27e85633) [No such file or directory] >[2016-04-19 07:24:37.175297] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ecce7e10-0443-4f72-bdbc-103f27e85633>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.184380] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.185215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c> (e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c) [No such file or directory] >[2016-04-19 07:24:37.185472] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c> (e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c) [No such file or directory] >[2016-04-19 07:24:37.186663] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c. (Possible split-brain) >[2016-04-19 07:24:37.187361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c> (e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c) [No such file or directory] >[2016-04-19 07:24:37.187729] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c> (e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c) [No such file or directory] >[2016-04-19 07:24:37.189383] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c> (e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c) [No such file or directory] >[2016-04-19 07:24:37.189483] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c> (e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c) [No such file or directory] >[2016-04-19 07:24:37.189689] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.192154] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c. (Possible split-brain) >[2016-04-19 07:24:37.192894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c> (e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c) [No such file or directory] >[2016-04-19 07:24:37.193410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c> (e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c) [No such file or directory] >[2016-04-19 07:24:37.195958] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c> (e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c) [No such file or directory] >[2016-04-19 07:24:37.196070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c> (e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c) [No such file or directory] >[2016-04-19 07:24:37.196188] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e5a114a8-7785-4fdd-ae9b-fc1d3e5d2b3c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.205378] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.206284] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6> (c205c038-18d9-4de6-9893-e0e336b9bfb6) [No such file or directory] >[2016-04-19 07:24:37.206552] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6> (c205c038-18d9-4de6-9893-e0e336b9bfb6) [No such file or directory] >[2016-04-19 07:24:37.207424] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c205c038-18d9-4de6-9893-e0e336b9bfb6. (Possible split-brain) >[2016-04-19 07:24:37.208432] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6> (c205c038-18d9-4de6-9893-e0e336b9bfb6) [No such file or directory] >[2016-04-19 07:24:37.208559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6> (c205c038-18d9-4de6-9893-e0e336b9bfb6) [No such file or directory] >[2016-04-19 07:24:37.209446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6> (c205c038-18d9-4de6-9893-e0e336b9bfb6) [No such file or directory] >[2016-04-19 07:24:37.209776] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6> (c205c038-18d9-4de6-9893-e0e336b9bfb6) [No such file or directory] >[2016-04-19 07:24:37.209899] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.212335] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c205c038-18d9-4de6-9893-e0e336b9bfb6. (Possible split-brain) >[2016-04-19 07:24:37.213187] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6> (c205c038-18d9-4de6-9893-e0e336b9bfb6) [No such file or directory] >[2016-04-19 07:24:37.213555] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6> (c205c038-18d9-4de6-9893-e0e336b9bfb6) [No such file or directory] >[2016-04-19 07:24:37.216040] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6> (c205c038-18d9-4de6-9893-e0e336b9bfb6) [No such file or directory] >[2016-04-19 07:24:37.216401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6> (c205c038-18d9-4de6-9893-e0e336b9bfb6) [No such file or directory] >[2016-04-19 07:24:37.216582] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c205c038-18d9-4de6-9893-e0e336b9bfb6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.224730] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.225612] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2> (0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2) [No such file or directory] >[2016-04-19 07:24:37.225889] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2> (0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2) [No such file or directory] >[2016-04-19 07:24:37.226990] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2. (Possible split-brain) >[2016-04-19 07:24:37.227876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2> (0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2) [No such file or directory] >[2016-04-19 07:24:37.228152] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2> (0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2) [No such file or directory] >[2016-04-19 07:24:37.229797] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2> (0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2) [No such file or directory] >[2016-04-19 07:24:37.229844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2> (0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2) [No such file or directory] >[2016-04-19 07:24:37.230007] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.232521] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2. (Possible split-brain) >[2016-04-19 07:24:37.233253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2> (0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2) [No such file or directory] >[2016-04-19 07:24:37.233649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2> (0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2) [No such file or directory] >[2016-04-19 07:24:37.236465] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2> (0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2) [No such file or directory] >[2016-04-19 07:24:37.236589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2> (0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2) [No such file or directory] >[2016-04-19 07:24:37.236710] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0bd82d8a-2786-45e9-b9b1-705e2f9a7eb2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.245761] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.246559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1> (f794b56d-a051-426a-b1a1-417aca5967c1) [No such file or directory] >[2016-04-19 07:24:37.247069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1> (f794b56d-a051-426a-b1a1-417aca5967c1) [No such file or directory] >[2016-04-19 07:24:37.250050] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f794b56d-a051-426a-b1a1-417aca5967c1. (Possible split-brain) >[2016-04-19 07:24:37.250904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1> (f794b56d-a051-426a-b1a1-417aca5967c1) [No such file or directory] >[2016-04-19 07:24:37.251399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1> (f794b56d-a051-426a-b1a1-417aca5967c1) [No such file or directory] >[2016-04-19 07:24:37.252791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1> (f794b56d-a051-426a-b1a1-417aca5967c1) [No such file or directory] >[2016-04-19 07:24:37.253079] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1> (f794b56d-a051-426a-b1a1-417aca5967c1) [No such file or directory] >[2016-04-19 07:24:37.253210] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.255708] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f794b56d-a051-426a-b1a1-417aca5967c1. (Possible split-brain) >[2016-04-19 07:24:37.256847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1> (f794b56d-a051-426a-b1a1-417aca5967c1) [No such file or directory] >[2016-04-19 07:24:37.256932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1> (f794b56d-a051-426a-b1a1-417aca5967c1) [No such file or directory] >[2016-04-19 07:24:37.259545] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1> (f794b56d-a051-426a-b1a1-417aca5967c1) [No such file or directory] >[2016-04-19 07:24:37.259848] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1> (f794b56d-a051-426a-b1a1-417aca5967c1) [No such file or directory] >[2016-04-19 07:24:37.260025] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f794b56d-a051-426a-b1a1-417aca5967c1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.268499] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.269191] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2> (c9928cce-ee5e-4706-b3ed-47100ebe43c2) [No such file or directory] >[2016-04-19 07:24:37.269648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2> (c9928cce-ee5e-4706-b3ed-47100ebe43c2) [No such file or directory] >[2016-04-19 07:24:37.272614] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c9928cce-ee5e-4706-b3ed-47100ebe43c2. (Possible split-brain) >[2016-04-19 07:24:37.273470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2> (c9928cce-ee5e-4706-b3ed-47100ebe43c2) [No such file or directory] >[2016-04-19 07:24:37.273872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2> (c9928cce-ee5e-4706-b3ed-47100ebe43c2) [No such file or directory] >[2016-04-19 07:24:37.275440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2> (c9928cce-ee5e-4706-b3ed-47100ebe43c2) [No such file or directory] >[2016-04-19 07:24:37.275585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2> (c9928cce-ee5e-4706-b3ed-47100ebe43c2) [No such file or directory] >[2016-04-19 07:24:37.275811] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.278306] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c9928cce-ee5e-4706-b3ed-47100ebe43c2. (Possible split-brain) >[2016-04-19 07:24:37.279166] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2> (c9928cce-ee5e-4706-b3ed-47100ebe43c2) [No such file or directory] >[2016-04-19 07:24:37.279435] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2> (c9928cce-ee5e-4706-b3ed-47100ebe43c2) [No such file or directory] >[2016-04-19 07:24:37.282243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2> (c9928cce-ee5e-4706-b3ed-47100ebe43c2) [No such file or directory] >[2016-04-19 07:24:37.282273] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2> (c9928cce-ee5e-4706-b3ed-47100ebe43c2) [No such file or directory] >[2016-04-19 07:24:37.282483] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c9928cce-ee5e-4706-b3ed-47100ebe43c2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.292753] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.293934] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62> (3bdb108b-5509-429f-8ce0-97bf035cac62) [No such file or directory] >[2016-04-19 07:24:37.294204] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62> (3bdb108b-5509-429f-8ce0-97bf035cac62) [No such file or directory] >[2016-04-19 07:24:37.297095] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3bdb108b-5509-429f-8ce0-97bf035cac62. (Possible split-brain) >[2016-04-19 07:24:37.298217] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62> (3bdb108b-5509-429f-8ce0-97bf035cac62) [No such file or directory] >[2016-04-19 07:24:37.298347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62> (3bdb108b-5509-429f-8ce0-97bf035cac62) [No such file or directory] >[2016-04-19 07:24:37.299761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62> (3bdb108b-5509-429f-8ce0-97bf035cac62) [No such file or directory] >[2016-04-19 07:24:37.299811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62> (3bdb108b-5509-429f-8ce0-97bf035cac62) [No such file or directory] >[2016-04-19 07:24:37.300160] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:37.302621] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3bdb108b-5509-429f-8ce0-97bf035cac62. (Possible split-brain) >[2016-04-19 07:24:37.303487] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62> (3bdb108b-5509-429f-8ce0-97bf035cac62) [No such file or directory] >[2016-04-19 07:24:37.303749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62> (3bdb108b-5509-429f-8ce0-97bf035cac62) [No such file or directory] >[2016-04-19 07:24:37.306445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62> (3bdb108b-5509-429f-8ce0-97bf035cac62) [No such file or directory] >[2016-04-19 07:24:37.306547] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62> (3bdb108b-5509-429f-8ce0-97bf035cac62) [No such file or directory] >[2016-04-19 07:24:37.306741] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3bdb108b-5509-429f-8ce0-97bf035cac62>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.315748] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.316640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d> (f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d) [No such file or directory] >[2016-04-19 07:24:37.316968] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d> (f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d) [No such file or directory] >[2016-04-19 07:24:37.318089] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d. (Possible split-brain) >[2016-04-19 07:24:37.319154] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d> (f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d) [No such file or directory] >[2016-04-19 07:24:37.319274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d> (f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d) [No such file or directory] >[2016-04-19 07:24:37.320516] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d> (f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d) [No such file or directory] >[2016-04-19 07:24:37.320568] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d> (f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d) [No such file or directory] >[2016-04-19 07:24:37.320957] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:37.323388] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d. (Possible split-brain) >[2016-04-19 07:24:37.324519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d> (f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d) [No such file or directory] >[2016-04-19 07:24:37.324632] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d> (f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d) [No such file or directory] >[2016-04-19 07:24:37.327590] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d> (f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d) [No such file or directory] >[2016-04-19 07:24:37.327710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d> (f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d) [No such file or directory] >[2016-04-19 07:24:37.327889] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f8b1836a-bbf6-4f6b-9ab1-4da270b0db3d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.336293] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.337184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f> (7cf6770c-af56-488b-83c9-9e887c8a940f) [No such file or directory] >[2016-04-19 07:24:37.337378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f> (7cf6770c-af56-488b-83c9-9e887c8a940f) [No such file or directory] >[2016-04-19 07:24:37.338523] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7cf6770c-af56-488b-83c9-9e887c8a940f. (Possible split-brain) >[2016-04-19 07:24:37.339243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f> (7cf6770c-af56-488b-83c9-9e887c8a940f) [No such file or directory] >[2016-04-19 07:24:37.339575] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f> (7cf6770c-af56-488b-83c9-9e887c8a940f) [No such file or directory] >[2016-04-19 07:24:37.340808] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f> (7cf6770c-af56-488b-83c9-9e887c8a940f) [No such file or directory] >[2016-04-19 07:24:37.340920] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f> (7cf6770c-af56-488b-83c9-9e887c8a940f) [No such file or directory] >[2016-04-19 07:24:37.341032] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.343500] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7cf6770c-af56-488b-83c9-9e887c8a940f. (Possible split-brain) >[2016-04-19 07:24:37.344200] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f> (7cf6770c-af56-488b-83c9-9e887c8a940f) [No such file or directory] >[2016-04-19 07:24:37.344583] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f> (7cf6770c-af56-488b-83c9-9e887c8a940f) [No such file or directory] >[2016-04-19 07:24:37.347409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f> (7cf6770c-af56-488b-83c9-9e887c8a940f) [No such file or directory] >[2016-04-19 07:24:37.347412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f> (7cf6770c-af56-488b-83c9-9e887c8a940f) [No such file or directory] >[2016-04-19 07:24:37.347596] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7cf6770c-af56-488b-83c9-9e887c8a940f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.356491] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.358002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f> (fb7b449f-9aba-419f-b525-62b953b0131f) [No such file or directory] >[2016-04-19 07:24:37.358002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f> (fb7b449f-9aba-419f-b525-62b953b0131f) [No such file or directory] >[2016-04-19 07:24:37.360705] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fb7b449f-9aba-419f-b525-62b953b0131f. (Possible split-brain) >[2016-04-19 07:24:37.361570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f> (fb7b449f-9aba-419f-b525-62b953b0131f) [No such file or directory] >[2016-04-19 07:24:37.361905] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f> (fb7b449f-9aba-419f-b525-62b953b0131f) [No such file or directory] >[2016-04-19 07:24:37.362864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f> (fb7b449f-9aba-419f-b525-62b953b0131f) [No such file or directory] >[2016-04-19 07:24:37.363299] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f> (fb7b449f-9aba-419f-b525-62b953b0131f) [No such file or directory] >[2016-04-19 07:24:37.363547] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:37.365993] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fb7b449f-9aba-419f-b525-62b953b0131f. (Possible split-brain) >[2016-04-19 07:24:37.367007] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f> (fb7b449f-9aba-419f-b525-62b953b0131f) [No such file or directory] >[2016-04-19 07:24:37.367112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f> (fb7b449f-9aba-419f-b525-62b953b0131f) [No such file or directory] >[2016-04-19 07:24:37.369999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f> (fb7b449f-9aba-419f-b525-62b953b0131f) [No such file or directory] >[2016-04-19 07:24:37.370096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f> (fb7b449f-9aba-419f-b525-62b953b0131f) [No such file or directory] >[2016-04-19 07:24:37.370240] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fb7b449f-9aba-419f-b525-62b953b0131f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.379030] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.380022] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549> (e403fbaf-859e-4d49-aba7-628cfdf30549) [No such file or directory] >[2016-04-19 07:24:37.380167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549> (e403fbaf-859e-4d49-aba7-628cfdf30549) [No such file or directory] >[2016-04-19 07:24:37.383071] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e403fbaf-859e-4d49-aba7-628cfdf30549. (Possible split-brain) >[2016-04-19 07:24:37.384133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549> (e403fbaf-859e-4d49-aba7-628cfdf30549) [No such file or directory] >[2016-04-19 07:24:37.384160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549> (e403fbaf-859e-4d49-aba7-628cfdf30549) [No such file or directory] >[2016-04-19 07:24:37.385405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549> (e403fbaf-859e-4d49-aba7-628cfdf30549) [No such file or directory] >[2016-04-19 07:24:37.385440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549> (e403fbaf-859e-4d49-aba7-628cfdf30549) [No such file or directory] >[2016-04-19 07:24:37.385653] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.388087] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e403fbaf-859e-4d49-aba7-628cfdf30549. (Possible split-brain) >[2016-04-19 07:24:37.389213] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549> (e403fbaf-859e-4d49-aba7-628cfdf30549) [No such file or directory] >[2016-04-19 07:24:37.389246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549> (e403fbaf-859e-4d49-aba7-628cfdf30549) [No such file or directory] >[2016-04-19 07:24:37.391879] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549> (e403fbaf-859e-4d49-aba7-628cfdf30549) [No such file or directory] >[2016-04-19 07:24:37.391912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549> (e403fbaf-859e-4d49-aba7-628cfdf30549) [No such file or directory] >[2016-04-19 07:24:37.392035] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e403fbaf-859e-4d49-aba7-628cfdf30549>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.399869] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.400999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577> (168c6b57-d7c8-4c40-a774-5dda39c69577) [No such file or directory] >[2016-04-19 07:24:37.401178] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577> (168c6b57-d7c8-4c40-a774-5dda39c69577) [No such file or directory] >[2016-04-19 07:24:37.402083] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 168c6b57-d7c8-4c40-a774-5dda39c69577. (Possible split-brain) >[2016-04-19 07:24:37.403166] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577> (168c6b57-d7c8-4c40-a774-5dda39c69577) [No such file or directory] >[2016-04-19 07:24:37.403275] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577> (168c6b57-d7c8-4c40-a774-5dda39c69577) [No such file or directory] >[2016-04-19 07:24:37.404452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577> (168c6b57-d7c8-4c40-a774-5dda39c69577) [No such file or directory] >[2016-04-19 07:24:37.404600] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577> (168c6b57-d7c8-4c40-a774-5dda39c69577) [No such file or directory] >[2016-04-19 07:24:37.404771] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.407191] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 168c6b57-d7c8-4c40-a774-5dda39c69577. (Possible split-brain) >[2016-04-19 07:24:37.408212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577> (168c6b57-d7c8-4c40-a774-5dda39c69577) [No such file or directory] >[2016-04-19 07:24:37.408225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577> (168c6b57-d7c8-4c40-a774-5dda39c69577) [No such file or directory] >[2016-04-19 07:24:37.410948] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577> (168c6b57-d7c8-4c40-a774-5dda39c69577) [No such file or directory] >[2016-04-19 07:24:37.410973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577> (168c6b57-d7c8-4c40-a774-5dda39c69577) [No such file or directory] >[2016-04-19 07:24:37.411399] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:168c6b57-d7c8-4c40-a774-5dda39c69577>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.419957] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.421121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c> (ef82abe0-c322-4a6b-be35-0280080eff2c) [No such file or directory] >[2016-04-19 07:24:37.421145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c> (ef82abe0-c322-4a6b-be35-0280080eff2c) [No such file or directory] >[2016-04-19 07:24:37.423680] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ef82abe0-c322-4a6b-be35-0280080eff2c. (Possible split-brain) >[2016-04-19 07:24:37.424692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c> (ef82abe0-c322-4a6b-be35-0280080eff2c) [No such file or directory] >[2016-04-19 07:24:37.424801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c> (ef82abe0-c322-4a6b-be35-0280080eff2c) [No such file or directory] >[2016-04-19 07:24:37.425976] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c> (ef82abe0-c322-4a6b-be35-0280080eff2c) [No such file or directory] >[2016-04-19 07:24:37.426010] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c> (ef82abe0-c322-4a6b-be35-0280080eff2c) [No such file or directory] >[2016-04-19 07:24:37.426453] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:37.429066] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ef82abe0-c322-4a6b-be35-0280080eff2c. (Possible split-brain) >[2016-04-19 07:24:37.429938] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c> (ef82abe0-c322-4a6b-be35-0280080eff2c) [No such file or directory] >[2016-04-19 07:24:37.430296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c> (ef82abe0-c322-4a6b-be35-0280080eff2c) [No such file or directory] >[2016-04-19 07:24:37.432651] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c> (ef82abe0-c322-4a6b-be35-0280080eff2c) [No such file or directory] >[2016-04-19 07:24:37.433039] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c> (ef82abe0-c322-4a6b-be35-0280080eff2c) [No such file or directory] >[2016-04-19 07:24:37.433404] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ef82abe0-c322-4a6b-be35-0280080eff2c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.442295] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.443407] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7801348d-d94a-417a-b920-5f292d144aa8> (7801348d-d94a-417a-b920-5f292d144aa8) [No such file or directory] >[2016-04-19 07:24:37.443413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7801348d-d94a-417a-b920-5f292d144aa8> (7801348d-d94a-417a-b920-5f292d144aa8) [No such file or directory] >[2016-04-19 07:24:37.446093] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7801348d-d94a-417a-b920-5f292d144aa8. (Possible split-brain) >[2016-04-19 07:24:37.447109] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7801348d-d94a-417a-b920-5f292d144aa8> (7801348d-d94a-417a-b920-5f292d144aa8) [No such file or directory] >[2016-04-19 07:24:37.447222] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7801348d-d94a-417a-b920-5f292d144aa8> (7801348d-d94a-417a-b920-5f292d144aa8) [No such file or directory] >[2016-04-19 07:24:37.448647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7801348d-d94a-417a-b920-5f292d144aa8> (7801348d-d94a-417a-b920-5f292d144aa8) [No such file or directory] >[2016-04-19 07:24:37.448655] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7801348d-d94a-417a-b920-5f292d144aa8> (7801348d-d94a-417a-b920-5f292d144aa8) [No such file or directory] >[2016-04-19 07:24:37.448866] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7801348d-d94a-417a-b920-5f292d144aa8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.451376] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7801348d-d94a-417a-b920-5f292d144aa8. (Possible split-brain) >[2016-04-19 07:24:37.452543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7801348d-d94a-417a-b920-5f292d144aa8> (7801348d-d94a-417a-b920-5f292d144aa8) [No such file or directory] >[2016-04-19 07:24:37.452648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7801348d-d94a-417a-b920-5f292d144aa8> (7801348d-d94a-417a-b920-5f292d144aa8) [No such file or directory] >[2016-04-19 07:24:37.455167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7801348d-d94a-417a-b920-5f292d144aa8> (7801348d-d94a-417a-b920-5f292d144aa8) [No such file or directory] >[2016-04-19 07:24:37.455408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7801348d-d94a-417a-b920-5f292d144aa8> (7801348d-d94a-417a-b920-5f292d144aa8) [No such file or directory] >[2016-04-19 07:24:37.455618] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7801348d-d94a-417a-b920-5f292d144aa8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.465471] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.466526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38> (bfee732b-3c68-4e2c-ab6b-bd6031f0cb38) [No such file or directory] >[2016-04-19 07:24:37.466543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38> (bfee732b-3c68-4e2c-ab6b-bd6031f0cb38) [No such file or directory] >[2016-04-19 07:24:37.469119] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bfee732b-3c68-4e2c-ab6b-bd6031f0cb38. (Possible split-brain) >[2016-04-19 07:24:37.470130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38> (bfee732b-3c68-4e2c-ab6b-bd6031f0cb38) [No such file or directory] >[2016-04-19 07:24:37.470234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38> (bfee732b-3c68-4e2c-ab6b-bd6031f0cb38) [No such file or directory] >[2016-04-19 07:24:37.471497] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38> (bfee732b-3c68-4e2c-ab6b-bd6031f0cb38) [No such file or directory] >[2016-04-19 07:24:37.471677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38> (bfee732b-3c68-4e2c-ab6b-bd6031f0cb38) [No such file or directory] >[2016-04-19 07:24:37.471839] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.474309] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bfee732b-3c68-4e2c-ab6b-bd6031f0cb38. (Possible split-brain) >[2016-04-19 07:24:37.475364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38> (bfee732b-3c68-4e2c-ab6b-bd6031f0cb38) [No such file or directory] >[2016-04-19 07:24:37.475473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38> (bfee732b-3c68-4e2c-ab6b-bd6031f0cb38) [No such file or directory] >[2016-04-19 07:24:37.477886] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38> (bfee732b-3c68-4e2c-ab6b-bd6031f0cb38) [No such file or directory] >[2016-04-19 07:24:37.478002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38> (bfee732b-3c68-4e2c-ab6b-bd6031f0cb38) [No such file or directory] >[2016-04-19 07:24:37.478786] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bfee732b-3c68-4e2c-ab6b-bd6031f0cb38>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.487177] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.488301] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae> (c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae) [No such file or directory] >[2016-04-19 07:24:37.488428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae> (c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae) [No such file or directory] >[2016-04-19 07:24:37.489504] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae. (Possible split-brain) >[2016-04-19 07:24:37.490538] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae> (c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae) [No such file or directory] >[2016-04-19 07:24:37.490570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae> (c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae) [No such file or directory] >[2016-04-19 07:24:37.491781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae> (c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae) [No such file or directory] >[2016-04-19 07:24:37.491884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae> (c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae) [No such file or directory] >[2016-04-19 07:24:37.492014] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.494485] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae. (Possible split-brain) >[2016-04-19 07:24:37.495431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae> (c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae) [No such file or directory] >[2016-04-19 07:24:37.495438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae> (c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae) [No such file or directory] >[2016-04-19 07:24:37.497969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae> (c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae) [No such file or directory] >[2016-04-19 07:24:37.498094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae> (c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae) [No such file or directory] >[2016-04-19 07:24:37.498363] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c534ebc7-7d3c-4cd7-ad9e-5cd5e58b97ae>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.507185] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.508293] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd> (ddd01876-2726-4908-8f3e-efb5b57d87fd) [No such file or directory] >[2016-04-19 07:24:37.508431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd> (ddd01876-2726-4908-8f3e-efb5b57d87fd) [No such file or directory] >[2016-04-19 07:24:37.509639] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ddd01876-2726-4908-8f3e-efb5b57d87fd. (Possible split-brain) >[2016-04-19 07:24:37.510486] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd> (ddd01876-2726-4908-8f3e-efb5b57d87fd) [No such file or directory] >[2016-04-19 07:24:37.510715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd> (ddd01876-2726-4908-8f3e-efb5b57d87fd) [No such file or directory] >[2016-04-19 07:24:37.511834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd> (ddd01876-2726-4908-8f3e-efb5b57d87fd) [No such file or directory] >[2016-04-19 07:24:37.511903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd> (ddd01876-2726-4908-8f3e-efb5b57d87fd) [No such file or directory] >[2016-04-19 07:24:37.512203] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.514649] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ddd01876-2726-4908-8f3e-efb5b57d87fd. (Possible split-brain) >[2016-04-19 07:24:37.515682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd> (ddd01876-2726-4908-8f3e-efb5b57d87fd) [No such file or directory] >[2016-04-19 07:24:37.515702] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd> (ddd01876-2726-4908-8f3e-efb5b57d87fd) [No such file or directory] >[2016-04-19 07:24:37.518178] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd> (ddd01876-2726-4908-8f3e-efb5b57d87fd) [No such file or directory] >[2016-04-19 07:24:37.518484] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd> (ddd01876-2726-4908-8f3e-efb5b57d87fd) [No such file or directory] >[2016-04-19 07:24:37.518694] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ddd01876-2726-4908-8f3e-efb5b57d87fd>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.527366] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.528210] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab> (1cec422d-91ac-4a43-b0a1-5b23e51532ab) [No such file or directory] >[2016-04-19 07:24:37.528544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab> (1cec422d-91ac-4a43-b0a1-5b23e51532ab) [No such file or directory] >[2016-04-19 07:24:37.531398] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1cec422d-91ac-4a43-b0a1-5b23e51532ab. (Possible split-brain) >[2016-04-19 07:24:37.532450] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab> (1cec422d-91ac-4a43-b0a1-5b23e51532ab) [No such file or directory] >[2016-04-19 07:24:37.532555] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab> (1cec422d-91ac-4a43-b0a1-5b23e51532ab) [No such file or directory] >[2016-04-19 07:24:37.533738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab> (1cec422d-91ac-4a43-b0a1-5b23e51532ab) [No such file or directory] >[2016-04-19 07:24:37.534054] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab> (1cec422d-91ac-4a43-b0a1-5b23e51532ab) [No such file or directory] >[2016-04-19 07:24:37.534244] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:37.536773] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1cec422d-91ac-4a43-b0a1-5b23e51532ab. (Possible split-brain) >[2016-04-19 07:24:37.537653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab> (1cec422d-91ac-4a43-b0a1-5b23e51532ab) [No such file or directory] >[2016-04-19 07:24:37.537930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab> (1cec422d-91ac-4a43-b0a1-5b23e51532ab) [No such file or directory] >[2016-04-19 07:24:37.540356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab> (1cec422d-91ac-4a43-b0a1-5b23e51532ab) [No such file or directory] >[2016-04-19 07:24:37.540660] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab> (1cec422d-91ac-4a43-b0a1-5b23e51532ab) [No such file or directory] >[2016-04-19 07:24:37.540825] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1cec422d-91ac-4a43-b0a1-5b23e51532ab>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.549204] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.550430] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696> (e8faddb1-610b-4ed0-8118-3f6c1525a696) [No such file or directory] >[2016-04-19 07:24:37.550454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696> (e8faddb1-610b-4ed0-8118-3f6c1525a696) [No such file or directory] >[2016-04-19 07:24:37.551412] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e8faddb1-610b-4ed0-8118-3f6c1525a696. (Possible split-brain) >[2016-04-19 07:24:37.552434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696> (e8faddb1-610b-4ed0-8118-3f6c1525a696) [No such file or directory] >[2016-04-19 07:24:37.552441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696> (e8faddb1-610b-4ed0-8118-3f6c1525a696) [No such file or directory] >[2016-04-19 07:24:37.553817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696> (e8faddb1-610b-4ed0-8118-3f6c1525a696) [No such file or directory] >[2016-04-19 07:24:37.553894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696> (e8faddb1-610b-4ed0-8118-3f6c1525a696) [No such file or directory] >[2016-04-19 07:24:37.554086] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.556579] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e8faddb1-610b-4ed0-8118-3f6c1525a696. (Possible split-brain) >[2016-04-19 07:24:37.557546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696> (e8faddb1-610b-4ed0-8118-3f6c1525a696) [No such file or directory] >[2016-04-19 07:24:37.557584] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696> (e8faddb1-610b-4ed0-8118-3f6c1525a696) [No such file or directory] >[2016-04-19 07:24:37.560438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696> (e8faddb1-610b-4ed0-8118-3f6c1525a696) [No such file or directory] >[2016-04-19 07:24:37.560628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696> (e8faddb1-610b-4ed0-8118-3f6c1525a696) [No such file or directory] >[2016-04-19 07:24:37.560810] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e8faddb1-610b-4ed0-8118-3f6c1525a696>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.569361] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.570111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce> (ac93a693-81fd-4130-9f19-2ce7196153ce) [No such file or directory] >[2016-04-19 07:24:37.570581] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce> (ac93a693-81fd-4130-9f19-2ce7196153ce) [No such file or directory] >[2016-04-19 07:24:37.571720] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ac93a693-81fd-4130-9f19-2ce7196153ce. (Possible split-brain) >[2016-04-19 07:24:37.572451] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce> (ac93a693-81fd-4130-9f19-2ce7196153ce) [No such file or directory] >[2016-04-19 07:24:37.572999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce> (ac93a693-81fd-4130-9f19-2ce7196153ce) [No such file or directory] >[2016-04-19 07:24:37.574266] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce> (ac93a693-81fd-4130-9f19-2ce7196153ce) [No such file or directory] >[2016-04-19 07:24:37.574555] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce> (ac93a693-81fd-4130-9f19-2ce7196153ce) [No such file or directory] >[2016-04-19 07:24:37.574693] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.577097] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ac93a693-81fd-4130-9f19-2ce7196153ce. (Possible split-brain) >[2016-04-19 07:24:37.577895] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce> (ac93a693-81fd-4130-9f19-2ce7196153ce) [No such file or directory] >[2016-04-19 07:24:37.578198] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce> (ac93a693-81fd-4130-9f19-2ce7196153ce) [No such file or directory] >[2016-04-19 07:24:37.581312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce> (ac93a693-81fd-4130-9f19-2ce7196153ce) [No such file or directory] >[2016-04-19 07:24:37.581509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce> (ac93a693-81fd-4130-9f19-2ce7196153ce) [No such file or directory] >[2016-04-19 07:24:37.581695] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ac93a693-81fd-4130-9f19-2ce7196153ce>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.590852] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.591613] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72> (d5f55d1e-d12e-4c98-8daf-79726ad3fa72) [No such file or directory] >[2016-04-19 07:24:37.592045] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72> (d5f55d1e-d12e-4c98-8daf-79726ad3fa72) [No such file or directory] >[2016-04-19 07:24:37.593136] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d5f55d1e-d12e-4c98-8daf-79726ad3fa72. (Possible split-brain) >[2016-04-19 07:24:37.593867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72> (d5f55d1e-d12e-4c98-8daf-79726ad3fa72) [No such file or directory] >[2016-04-19 07:24:37.594345] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72> (d5f55d1e-d12e-4c98-8daf-79726ad3fa72) [No such file or directory] >[2016-04-19 07:24:37.595658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72> (d5f55d1e-d12e-4c98-8daf-79726ad3fa72) [No such file or directory] >[2016-04-19 07:24:37.596014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72> (d5f55d1e-d12e-4c98-8daf-79726ad3fa72) [No such file or directory] >[2016-04-19 07:24:37.596150] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.598625] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d5f55d1e-d12e-4c98-8daf-79726ad3fa72. (Possible split-brain) >[2016-04-19 07:24:37.599362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72> (d5f55d1e-d12e-4c98-8daf-79726ad3fa72) [No such file or directory] >[2016-04-19 07:24:37.599840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72> (d5f55d1e-d12e-4c98-8daf-79726ad3fa72) [No such file or directory] >[2016-04-19 07:24:37.602371] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72> (d5f55d1e-d12e-4c98-8daf-79726ad3fa72) [No such file or directory] >[2016-04-19 07:24:37.602721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72> (d5f55d1e-d12e-4c98-8daf-79726ad3fa72) [No such file or directory] >[2016-04-19 07:24:37.602901] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d5f55d1e-d12e-4c98-8daf-79726ad3fa72>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.611201] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.612403] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3> (530eed98-124f-4b7a-9228-cfba75ee2cf3) [No such file or directory] >[2016-04-19 07:24:37.612415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3> (530eed98-124f-4b7a-9228-cfba75ee2cf3) [No such file or directory] >[2016-04-19 07:24:37.613639] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 530eed98-124f-4b7a-9228-cfba75ee2cf3. (Possible split-brain) >[2016-04-19 07:24:37.614476] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3> (530eed98-124f-4b7a-9228-cfba75ee2cf3) [No such file or directory] >[2016-04-19 07:24:37.614766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3> (530eed98-124f-4b7a-9228-cfba75ee2cf3) [No such file or directory] >[2016-04-19 07:24:37.615628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3> (530eed98-124f-4b7a-9228-cfba75ee2cf3) [No such file or directory] >[2016-04-19 07:24:37.615956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3> (530eed98-124f-4b7a-9228-cfba75ee2cf3) [No such file or directory] >[2016-04-19 07:24:37.616111] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.618594] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 530eed98-124f-4b7a-9228-cfba75ee2cf3. (Possible split-brain) >[2016-04-19 07:24:37.619599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3> (530eed98-124f-4b7a-9228-cfba75ee2cf3) [No such file or directory] >[2016-04-19 07:24:37.619940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3> (530eed98-124f-4b7a-9228-cfba75ee2cf3) [No such file or directory] >[2016-04-19 07:24:37.622998] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3> (530eed98-124f-4b7a-9228-cfba75ee2cf3) [No such file or directory] >[2016-04-19 07:24:37.623120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3> (530eed98-124f-4b7a-9228-cfba75ee2cf3) [No such file or directory] >[2016-04-19 07:24:37.623411] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:530eed98-124f-4b7a-9228-cfba75ee2cf3>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.632784] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.633787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d> (04c29e1b-8e12-4514-8cad-ef443d02449d) [No such file or directory] >[2016-04-19 07:24:37.633889] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d> (04c29e1b-8e12-4514-8cad-ef443d02449d) [No such file or directory] >[2016-04-19 07:24:37.636742] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 04c29e1b-8e12-4514-8cad-ef443d02449d. (Possible split-brain) >[2016-04-19 07:24:37.637917] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d> (04c29e1b-8e12-4514-8cad-ef443d02449d) [No such file or directory] >[2016-04-19 07:24:37.637924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d> (04c29e1b-8e12-4514-8cad-ef443d02449d) [No such file or directory] >[2016-04-19 07:24:37.639385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d> (04c29e1b-8e12-4514-8cad-ef443d02449d) [No such file or directory] >[2016-04-19 07:24:37.639538] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d> (04c29e1b-8e12-4514-8cad-ef443d02449d) [No such file or directory] >[2016-04-19 07:24:37.639730] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.642241] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 04c29e1b-8e12-4514-8cad-ef443d02449d. (Possible split-brain) >[2016-04-19 07:24:37.643295] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d> (04c29e1b-8e12-4514-8cad-ef443d02449d) [No such file or directory] >[2016-04-19 07:24:37.643350] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d> (04c29e1b-8e12-4514-8cad-ef443d02449d) [No such file or directory] >[2016-04-19 07:24:37.645787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d> (04c29e1b-8e12-4514-8cad-ef443d02449d) [No such file or directory] >[2016-04-19 07:24:37.645989] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d> (04c29e1b-8e12-4514-8cad-ef443d02449d) [No such file or directory] >[2016-04-19 07:24:37.646125] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:04c29e1b-8e12-4514-8cad-ef443d02449d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.654791] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.655761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac> (4dbfac8c-2177-4329-9344-42938f1bdbac) [No such file or directory] >[2016-04-19 07:24:37.656037] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac> (4dbfac8c-2177-4329-9344-42938f1bdbac) [No such file or directory] >[2016-04-19 07:24:37.657133] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4dbfac8c-2177-4329-9344-42938f1bdbac. (Possible split-brain) >[2016-04-19 07:24:37.658194] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac> (4dbfac8c-2177-4329-9344-42938f1bdbac) [No such file or directory] >[2016-04-19 07:24:37.658223] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac> (4dbfac8c-2177-4329-9344-42938f1bdbac) [No such file or directory] >[2016-04-19 07:24:37.659510] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac> (4dbfac8c-2177-4329-9344-42938f1bdbac) [No such file or directory] >[2016-04-19 07:24:37.659712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac> (4dbfac8c-2177-4329-9344-42938f1bdbac) [No such file or directory] >[2016-04-19 07:24:37.659858] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.662392] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4dbfac8c-2177-4329-9344-42938f1bdbac. (Possible split-brain) >[2016-04-19 07:24:37.663370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac> (4dbfac8c-2177-4329-9344-42938f1bdbac) [No such file or directory] >[2016-04-19 07:24:37.663399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac> (4dbfac8c-2177-4329-9344-42938f1bdbac) [No such file or directory] >[2016-04-19 07:24:37.665147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac> (4dbfac8c-2177-4329-9344-42938f1bdbac) [No such file or directory] >[2016-04-19 07:24:37.665207] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac> (4dbfac8c-2177-4329-9344-42938f1bdbac) [No such file or directory] >[2016-04-19 07:24:37.665477] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4dbfac8c-2177-4329-9344-42938f1bdbac>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.673610] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.674394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef> (1a5b740f-d3c2-4cce-9d6a-570e0fdaedef) [No such file or directory] >[2016-04-19 07:24:37.674726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef> (1a5b740f-d3c2-4cce-9d6a-570e0fdaedef) [No such file or directory] >[2016-04-19 07:24:37.675841] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1a5b740f-d3c2-4cce-9d6a-570e0fdaedef. (Possible split-brain) >[2016-04-19 07:24:37.676582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef> (1a5b740f-d3c2-4cce-9d6a-570e0fdaedef) [No such file or directory] >[2016-04-19 07:24:37.676884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef> (1a5b740f-d3c2-4cce-9d6a-570e0fdaedef) [No such file or directory] >[2016-04-19 07:24:37.678121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef> (1a5b740f-d3c2-4cce-9d6a-570e0fdaedef) [No such file or directory] >[2016-04-19 07:24:37.678452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef> (1a5b740f-d3c2-4cce-9d6a-570e0fdaedef) [No such file or directory] >[2016-04-19 07:24:37.678614] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.681060] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1a5b740f-d3c2-4cce-9d6a-570e0fdaedef. (Possible split-brain) >[2016-04-19 07:24:37.681825] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef> (1a5b740f-d3c2-4cce-9d6a-570e0fdaedef) [No such file or directory] >[2016-04-19 07:24:37.682132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef> (1a5b740f-d3c2-4cce-9d6a-570e0fdaedef) [No such file or directory] >[2016-04-19 07:24:37.685094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef> (1a5b740f-d3c2-4cce-9d6a-570e0fdaedef) [No such file or directory] >[2016-04-19 07:24:37.685226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef> (1a5b740f-d3c2-4cce-9d6a-570e0fdaedef) [No such file or directory] >[2016-04-19 07:24:37.685416] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1a5b740f-d3c2-4cce-9d6a-570e0fdaedef>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.694305] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.695466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6> (de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6) [No such file or directory] >[2016-04-19 07:24:37.695478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6> (de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6) [No such file or directory] >[2016-04-19 07:24:37.696647] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6. (Possible split-brain) >[2016-04-19 07:24:37.697710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6> (de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6) [No such file or directory] >[2016-04-19 07:24:37.697723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6> (de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6) [No such file or directory] >[2016-04-19 07:24:37.698965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6> (de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6) [No such file or directory] >[2016-04-19 07:24:37.698990] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6> (de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6) [No such file or directory] >[2016-04-19 07:24:37.699146] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.701647] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6. (Possible split-brain) >[2016-04-19 07:24:37.702701] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6> (de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6) [No such file or directory] >[2016-04-19 07:24:37.702809] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6> (de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6) [No such file or directory] >[2016-04-19 07:24:37.705619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6> (de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6) [No such file or directory] >[2016-04-19 07:24:37.705998] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6> (de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6) [No such file or directory] >[2016-04-19 07:24:37.706141] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:de0eb9b6-b1e0-4930-9ac0-bfe98ccee0f6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.714504] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.715241] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936> (84fe5132-bda5-4524-ab8d-5088bf501936) [No such file or directory] >[2016-04-19 07:24:37.715504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936> (84fe5132-bda5-4524-ab8d-5088bf501936) [No such file or directory] >[2016-04-19 07:24:37.718143] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 84fe5132-bda5-4524-ab8d-5088bf501936. (Possible split-brain) >[2016-04-19 07:24:37.718911] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936> (84fe5132-bda5-4524-ab8d-5088bf501936) [No such file or directory] >[2016-04-19 07:24:37.719192] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936> (84fe5132-bda5-4524-ab8d-5088bf501936) [No such file or directory] >[2016-04-19 07:24:37.720764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936> (84fe5132-bda5-4524-ab8d-5088bf501936) [No such file or directory] >[2016-04-19 07:24:37.720888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936> (84fe5132-bda5-4524-ab8d-5088bf501936) [No such file or directory] >[2016-04-19 07:24:37.721062] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.723529] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 84fe5132-bda5-4524-ab8d-5088bf501936. (Possible split-brain) >[2016-04-19 07:24:37.724264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936> (84fe5132-bda5-4524-ab8d-5088bf501936) [No such file or directory] >[2016-04-19 07:24:37.724643] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936> (84fe5132-bda5-4524-ab8d-5088bf501936) [No such file or directory] >[2016-04-19 07:24:37.727517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936> (84fe5132-bda5-4524-ab8d-5088bf501936) [No such file or directory] >[2016-04-19 07:24:37.727597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936> (84fe5132-bda5-4524-ab8d-5088bf501936) [No such file or directory] >[2016-04-19 07:24:37.727734] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:84fe5132-bda5-4524-ab8d-5088bf501936>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.736213] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.737369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872> (5e8bd4c2-a04a-4b91-a41a-927916aa6872) [No such file or directory] >[2016-04-19 07:24:37.737379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872> (5e8bd4c2-a04a-4b91-a41a-927916aa6872) [No such file or directory] >[2016-04-19 07:24:37.738554] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5e8bd4c2-a04a-4b91-a41a-927916aa6872. (Possible split-brain) >[2016-04-19 07:24:37.739444] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872> (5e8bd4c2-a04a-4b91-a41a-927916aa6872) [No such file or directory] >[2016-04-19 07:24:37.739731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872> (5e8bd4c2-a04a-4b91-a41a-927916aa6872) [No such file or directory] >[2016-04-19 07:24:37.740774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872> (5e8bd4c2-a04a-4b91-a41a-927916aa6872) [No such file or directory] >[2016-04-19 07:24:37.741085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872> (5e8bd4c2-a04a-4b91-a41a-927916aa6872) [No such file or directory] >[2016-04-19 07:24:37.741264] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:37.743771] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5e8bd4c2-a04a-4b91-a41a-927916aa6872. (Possible split-brain) >[2016-04-19 07:24:37.744724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872> (5e8bd4c2-a04a-4b91-a41a-927916aa6872) [No such file or directory] >[2016-04-19 07:24:37.744985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872> (5e8bd4c2-a04a-4b91-a41a-927916aa6872) [No such file or directory] >[2016-04-19 07:24:37.747248] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872> (5e8bd4c2-a04a-4b91-a41a-927916aa6872) [No such file or directory] >[2016-04-19 07:24:37.747391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872> (5e8bd4c2-a04a-4b91-a41a-927916aa6872) [No such file or directory] >[2016-04-19 07:24:37.747551] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5e8bd4c2-a04a-4b91-a41a-927916aa6872>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.756482] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.757358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b> (a56a9fc0-6d88-42bb-b6b1-c4285717480b) [No such file or directory] >[2016-04-19 07:24:37.757644] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b> (a56a9fc0-6d88-42bb-b6b1-c4285717480b) [No such file or directory] >[2016-04-19 07:24:37.759967] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a56a9fc0-6d88-42bb-b6b1-c4285717480b. (Possible split-brain) >[2016-04-19 07:24:37.760932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b> (a56a9fc0-6d88-42bb-b6b1-c4285717480b) [No such file or directory] >[2016-04-19 07:24:37.760988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b> (a56a9fc0-6d88-42bb-b6b1-c4285717480b) [No such file or directory] >[2016-04-19 07:24:37.762020] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b> (a56a9fc0-6d88-42bb-b6b1-c4285717480b) [No such file or directory] >[2016-04-19 07:24:37.762067] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b> (a56a9fc0-6d88-42bb-b6b1-c4285717480b) [No such file or directory] >[2016-04-19 07:24:37.762384] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.763904] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a56a9fc0-6d88-42bb-b6b1-c4285717480b. (Possible split-brain) >[2016-04-19 07:24:37.764769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b> (a56a9fc0-6d88-42bb-b6b1-c4285717480b) [No such file or directory] >[2016-04-19 07:24:37.764817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b> (a56a9fc0-6d88-42bb-b6b1-c4285717480b) [No such file or directory] >[2016-04-19 07:24:37.766680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b> (a56a9fc0-6d88-42bb-b6b1-c4285717480b) [No such file or directory] >[2016-04-19 07:24:37.766836] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b> (a56a9fc0-6d88-42bb-b6b1-c4285717480b) [No such file or directory] >[2016-04-19 07:24:37.767020] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a56a9fc0-6d88-42bb-b6b1-c4285717480b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.774880] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.775834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55> (062e760e-6b3e-42e4-94eb-52b280071f55) [No such file or directory] >[2016-04-19 07:24:37.775924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55> (062e760e-6b3e-42e4-94eb-52b280071f55) [No such file or directory] >[2016-04-19 07:24:37.777057] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 062e760e-6b3e-42e4-94eb-52b280071f55. (Possible split-brain) >[2016-04-19 07:24:37.778029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55> (062e760e-6b3e-42e4-94eb-52b280071f55) [No such file or directory] >[2016-04-19 07:24:37.778132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55> (062e760e-6b3e-42e4-94eb-52b280071f55) [No such file or directory] >[2016-04-19 07:24:37.779137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55> (062e760e-6b3e-42e4-94eb-52b280071f55) [No such file or directory] >[2016-04-19 07:24:37.779453] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55> (062e760e-6b3e-42e4-94eb-52b280071f55) [No such file or directory] >[2016-04-19 07:24:37.779626] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.782097] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 062e760e-6b3e-42e4-94eb-52b280071f55. (Possible split-brain) >[2016-04-19 07:24:37.782929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55> (062e760e-6b3e-42e4-94eb-52b280071f55) [No such file or directory] >[2016-04-19 07:24:37.783340] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55> (062e760e-6b3e-42e4-94eb-52b280071f55) [No such file or directory] >[2016-04-19 07:24:37.785784] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55> (062e760e-6b3e-42e4-94eb-52b280071f55) [No such file or directory] >[2016-04-19 07:24:37.785889] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55> (062e760e-6b3e-42e4-94eb-52b280071f55) [No such file or directory] >[2016-04-19 07:24:37.786478] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:062e760e-6b3e-42e4-94eb-52b280071f55>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.795131] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.795937] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d> (9ff7d984-3126-494b-b64e-c8c83a07ec7d) [No such file or directory] >[2016-04-19 07:24:37.796123] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d> (9ff7d984-3126-494b-b64e-c8c83a07ec7d) [No such file or directory] >[2016-04-19 07:24:37.798688] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9ff7d984-3126-494b-b64e-c8c83a07ec7d. (Possible split-brain) >[2016-04-19 07:24:37.799427] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d> (9ff7d984-3126-494b-b64e-c8c83a07ec7d) [No such file or directory] >[2016-04-19 07:24:37.799737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d> (9ff7d984-3126-494b-b64e-c8c83a07ec7d) [No such file or directory] >[2016-04-19 07:24:37.800973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d> (9ff7d984-3126-494b-b64e-c8c83a07ec7d) [No such file or directory] >[2016-04-19 07:24:37.801376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d> (9ff7d984-3126-494b-b64e-c8c83a07ec7d) [No such file or directory] >[2016-04-19 07:24:37.801545] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.804110] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9ff7d984-3126-494b-b64e-c8c83a07ec7d. (Possible split-brain) >[2016-04-19 07:24:37.805094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d> (9ff7d984-3126-494b-b64e-c8c83a07ec7d) [No such file or directory] >[2016-04-19 07:24:37.805099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d> (9ff7d984-3126-494b-b64e-c8c83a07ec7d) [No such file or directory] >[2016-04-19 07:24:37.807723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d> (9ff7d984-3126-494b-b64e-c8c83a07ec7d) [No such file or directory] >[2016-04-19 07:24:37.808008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d> (9ff7d984-3126-494b-b64e-c8c83a07ec7d) [No such file or directory] >[2016-04-19 07:24:37.808196] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9ff7d984-3126-494b-b64e-c8c83a07ec7d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.816339] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.817346] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192> (1c9af25e-dfb9-4451-b762-78b48de4d192) [No such file or directory] >[2016-04-19 07:24:37.817611] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192> (1c9af25e-dfb9-4451-b762-78b48de4d192) [No such file or directory] >[2016-04-19 07:24:37.820242] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1c9af25e-dfb9-4451-b762-78b48de4d192. (Possible split-brain) >[2016-04-19 07:24:37.821256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192> (1c9af25e-dfb9-4451-b762-78b48de4d192) [No such file or directory] >[2016-04-19 07:24:37.821386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192> (1c9af25e-dfb9-4451-b762-78b48de4d192) [No such file or directory] >[2016-04-19 07:24:37.822572] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192> (1c9af25e-dfb9-4451-b762-78b48de4d192) [No such file or directory] >[2016-04-19 07:24:37.822759] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192> (1c9af25e-dfb9-4451-b762-78b48de4d192) [No such file or directory] >[2016-04-19 07:24:37.822997] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.825451] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1c9af25e-dfb9-4451-b762-78b48de4d192. (Possible split-brain) >[2016-04-19 07:24:37.826635] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192> (1c9af25e-dfb9-4451-b762-78b48de4d192) [No such file or directory] >[2016-04-19 07:24:37.826639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192> (1c9af25e-dfb9-4451-b762-78b48de4d192) [No such file or directory] >[2016-04-19 07:24:37.829157] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192> (1c9af25e-dfb9-4451-b762-78b48de4d192) [No such file or directory] >[2016-04-19 07:24:37.829265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192> (1c9af25e-dfb9-4451-b762-78b48de4d192) [No such file or directory] >[2016-04-19 07:24:37.829414] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1c9af25e-dfb9-4451-b762-78b48de4d192>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.838437] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.839436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b> (55d2fb58-915b-4b64-b0cd-f61f99b5d52b) [No such file or directory] >[2016-04-19 07:24:37.839449] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b> (55d2fb58-915b-4b64-b0cd-f61f99b5d52b) [No such file or directory] >[2016-04-19 07:24:37.840616] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 55d2fb58-915b-4b64-b0cd-f61f99b5d52b. (Possible split-brain) >[2016-04-19 07:24:37.841547] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b> (55d2fb58-915b-4b64-b0cd-f61f99b5d52b) [No such file or directory] >[2016-04-19 07:24:37.841560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b> (55d2fb58-915b-4b64-b0cd-f61f99b5d52b) [No such file or directory] >[2016-04-19 07:24:37.842586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b> (55d2fb58-915b-4b64-b0cd-f61f99b5d52b) [No such file or directory] >[2016-04-19 07:24:37.842983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b> (55d2fb58-915b-4b64-b0cd-f61f99b5d52b) [No such file or directory] >[2016-04-19 07:24:37.843159] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.845592] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 55d2fb58-915b-4b64-b0cd-f61f99b5d52b. (Possible split-brain) >[2016-04-19 07:24:37.846461] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b> (55d2fb58-915b-4b64-b0cd-f61f99b5d52b) [No such file or directory] >[2016-04-19 07:24:37.846851] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b> (55d2fb58-915b-4b64-b0cd-f61f99b5d52b) [No such file or directory] >[2016-04-19 07:24:37.849354] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b> (55d2fb58-915b-4b64-b0cd-f61f99b5d52b) [No such file or directory] >[2016-04-19 07:24:37.849431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b> (55d2fb58-915b-4b64-b0cd-f61f99b5d52b) [No such file or directory] >[2016-04-19 07:24:37.849632] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:55d2fb58-915b-4b64-b0cd-f61f99b5d52b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.857004] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.857852] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828> (25ac191d-0a68-4647-a075-be48b3eb0828) [No such file or directory] >[2016-04-19 07:24:37.857956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828> (25ac191d-0a68-4647-a075-be48b3eb0828) [No such file or directory] >[2016-04-19 07:24:37.860576] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 25ac191d-0a68-4647-a075-be48b3eb0828. (Possible split-brain) >[2016-04-19 07:24:37.861379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828> (25ac191d-0a68-4647-a075-be48b3eb0828) [No such file or directory] >[2016-04-19 07:24:37.861595] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828> (25ac191d-0a68-4647-a075-be48b3eb0828) [No such file or directory] >[2016-04-19 07:24:37.862700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828> (25ac191d-0a68-4647-a075-be48b3eb0828) [No such file or directory] >[2016-04-19 07:24:37.862970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828> (25ac191d-0a68-4647-a075-be48b3eb0828) [No such file or directory] >[2016-04-19 07:24:37.863129] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.865661] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 25ac191d-0a68-4647-a075-be48b3eb0828. (Possible split-brain) >[2016-04-19 07:24:37.866358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828> (25ac191d-0a68-4647-a075-be48b3eb0828) [No such file or directory] >[2016-04-19 07:24:37.866716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828> (25ac191d-0a68-4647-a075-be48b3eb0828) [No such file or directory] >[2016-04-19 07:24:37.869455] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828> (25ac191d-0a68-4647-a075-be48b3eb0828) [No such file or directory] >[2016-04-19 07:24:37.869482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828> (25ac191d-0a68-4647-a075-be48b3eb0828) [No such file or directory] >[2016-04-19 07:24:37.869657] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:25ac191d-0a68-4647-a075-be48b3eb0828>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.877161] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.877953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70> (116bde0a-a922-4574-98dc-dcdd69f45c70) [No such file or directory] >[2016-04-19 07:24:37.878347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70> (116bde0a-a922-4574-98dc-dcdd69f45c70) [No such file or directory] >[2016-04-19 07:24:37.879503] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 116bde0a-a922-4574-98dc-dcdd69f45c70. (Possible split-brain) >[2016-04-19 07:24:37.880238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70> (116bde0a-a922-4574-98dc-dcdd69f45c70) [No such file or directory] >[2016-04-19 07:24:37.880604] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70> (116bde0a-a922-4574-98dc-dcdd69f45c70) [No such file or directory] >[2016-04-19 07:24:37.881625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70> (116bde0a-a922-4574-98dc-dcdd69f45c70) [No such file or directory] >[2016-04-19 07:24:37.882064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70> (116bde0a-a922-4574-98dc-dcdd69f45c70) [No such file or directory] >[2016-04-19 07:24:37.882214] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.884743] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 116bde0a-a922-4574-98dc-dcdd69f45c70. (Possible split-brain) >[2016-04-19 07:24:37.885484] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70> (116bde0a-a922-4574-98dc-dcdd69f45c70) [No such file or directory] >[2016-04-19 07:24:37.885818] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70> (116bde0a-a922-4574-98dc-dcdd69f45c70) [No such file or directory] >[2016-04-19 07:24:37.888356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70> (116bde0a-a922-4574-98dc-dcdd69f45c70) [No such file or directory] >[2016-04-19 07:24:37.888764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70> (116bde0a-a922-4574-98dc-dcdd69f45c70) [No such file or directory] >[2016-04-19 07:24:37.888940] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:116bde0a-a922-4574-98dc-dcdd69f45c70>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.896617] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.897359] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f> (e7358fac-d298-429a-bb72-334dd4b20f6f) [No such file or directory] >[2016-04-19 07:24:37.897691] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f> (e7358fac-d298-429a-bb72-334dd4b20f6f) [No such file or directory] >[2016-04-19 07:24:37.900228] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e7358fac-d298-429a-bb72-334dd4b20f6f. (Possible split-brain) >[2016-04-19 07:24:37.901021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f> (e7358fac-d298-429a-bb72-334dd4b20f6f) [No such file or directory] >[2016-04-19 07:24:37.901421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f> (e7358fac-d298-429a-bb72-334dd4b20f6f) [No such file or directory] >[2016-04-19 07:24:37.902560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f> (e7358fac-d298-429a-bb72-334dd4b20f6f) [No such file or directory] >[2016-04-19 07:24:37.902748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f> (e7358fac-d298-429a-bb72-334dd4b20f6f) [No such file or directory] >[2016-04-19 07:24:37.903030] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.905519] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e7358fac-d298-429a-bb72-334dd4b20f6f. (Possible split-brain) >[2016-04-19 07:24:37.906246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f> (e7358fac-d298-429a-bb72-334dd4b20f6f) [No such file or directory] >[2016-04-19 07:24:37.906584] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f> (e7358fac-d298-429a-bb72-334dd4b20f6f) [No such file or directory] >[2016-04-19 07:24:37.908944] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f> (e7358fac-d298-429a-bb72-334dd4b20f6f) [No such file or directory] >[2016-04-19 07:24:37.909436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f> (e7358fac-d298-429a-bb72-334dd4b20f6f) [No such file or directory] >[2016-04-19 07:24:37.909665] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e7358fac-d298-429a-bb72-334dd4b20f6f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.918077] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.918901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13> (491a2e27-6679-423c-9c01-a9fd0c67cb13) [No such file or directory] >[2016-04-19 07:24:37.919006] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13> (491a2e27-6679-423c-9c01-a9fd0c67cb13) [No such file or directory] >[2016-04-19 07:24:37.921513] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 491a2e27-6679-423c-9c01-a9fd0c67cb13. (Possible split-brain) >[2016-04-19 07:24:37.922713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13> (491a2e27-6679-423c-9c01-a9fd0c67cb13) [No such file or directory] >[2016-04-19 07:24:37.922920] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13> (491a2e27-6679-423c-9c01-a9fd0c67cb13) [No such file or directory] >[2016-04-19 07:24:37.924078] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13> (491a2e27-6679-423c-9c01-a9fd0c67cb13) [No such file or directory] >[2016-04-19 07:24:37.924555] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13> (491a2e27-6679-423c-9c01-a9fd0c67cb13) [No such file or directory] >[2016-04-19 07:24:37.924784] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.927205] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 491a2e27-6679-423c-9c01-a9fd0c67cb13. (Possible split-brain) >[2016-04-19 07:24:37.928101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13> (491a2e27-6679-423c-9c01-a9fd0c67cb13) [No such file or directory] >[2016-04-19 07:24:37.928441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13> (491a2e27-6679-423c-9c01-a9fd0c67cb13) [No such file or directory] >[2016-04-19 07:24:37.930873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13> (491a2e27-6679-423c-9c01-a9fd0c67cb13) [No such file or directory] >[2016-04-19 07:24:37.931030] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13> (491a2e27-6679-423c-9c01-a9fd0c67cb13) [No such file or directory] >[2016-04-19 07:24:37.931155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:491a2e27-6679-423c-9c01-a9fd0c67cb13>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.940312] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.941372] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8> (d7e27acf-ed0d-495f-af1e-20a9461d3be8) [No such file or directory] >[2016-04-19 07:24:37.941376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8> (d7e27acf-ed0d-495f-af1e-20a9461d3be8) [No such file or directory] >[2016-04-19 07:24:37.944022] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d7e27acf-ed0d-495f-af1e-20a9461d3be8. (Possible split-brain) >[2016-04-19 07:24:37.945000] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8> (d7e27acf-ed0d-495f-af1e-20a9461d3be8) [No such file or directory] >[2016-04-19 07:24:37.945069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8> (d7e27acf-ed0d-495f-af1e-20a9461d3be8) [No such file or directory] >[2016-04-19 07:24:37.946354] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8> (d7e27acf-ed0d-495f-af1e-20a9461d3be8) [No such file or directory] >[2016-04-19 07:24:37.946387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8> (d7e27acf-ed0d-495f-af1e-20a9461d3be8) [No such file or directory] >[2016-04-19 07:24:37.946564] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.948998] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d7e27acf-ed0d-495f-af1e-20a9461d3be8. (Possible split-brain) >[2016-04-19 07:24:37.950037] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8> (d7e27acf-ed0d-495f-af1e-20a9461d3be8) [No such file or directory] >[2016-04-19 07:24:37.950062] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8> (d7e27acf-ed0d-495f-af1e-20a9461d3be8) [No such file or directory] >[2016-04-19 07:24:37.952526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8> (d7e27acf-ed0d-495f-af1e-20a9461d3be8) [No such file or directory] >[2016-04-19 07:24:37.952554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8> (d7e27acf-ed0d-495f-af1e-20a9461d3be8) [No such file or directory] >[2016-04-19 07:24:37.952860] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d7e27acf-ed0d-495f-af1e-20a9461d3be8>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:37.960527] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.961410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0> (cf9ab463-e704-4796-b328-4c26419b33a0) [No such file or directory] >[2016-04-19 07:24:37.961732] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0> (cf9ab463-e704-4796-b328-4c26419b33a0) [No such file or directory] >[2016-04-19 07:24:37.964199] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cf9ab463-e704-4796-b328-4c26419b33a0. (Possible split-brain) >[2016-04-19 07:24:37.964973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0> (cf9ab463-e704-4796-b328-4c26419b33a0) [No such file or directory] >[2016-04-19 07:24:37.965312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0> (cf9ab463-e704-4796-b328-4c26419b33a0) [No such file or directory] >[2016-04-19 07:24:37.966490] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0> (cf9ab463-e704-4796-b328-4c26419b33a0) [No such file or directory] >[2016-04-19 07:24:37.966831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0> (cf9ab463-e704-4796-b328-4c26419b33a0) [No such file or directory] >[2016-04-19 07:24:37.966953] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:37.969384] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cf9ab463-e704-4796-b328-4c26419b33a0. (Possible split-brain) >[2016-04-19 07:24:37.970115] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0> (cf9ab463-e704-4796-b328-4c26419b33a0) [No such file or directory] >[2016-04-19 07:24:37.970680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0> (cf9ab463-e704-4796-b328-4c26419b33a0) [No such file or directory] >[2016-04-19 07:24:37.972963] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0> (cf9ab463-e704-4796-b328-4c26419b33a0) [No such file or directory] >[2016-04-19 07:24:37.973433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0> (cf9ab463-e704-4796-b328-4c26419b33a0) [No such file or directory] >[2016-04-19 07:24:37.973558] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cf9ab463-e704-4796-b328-4c26419b33a0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:37.981055] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:37.982027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c61e51c4-7a2a-495d-b805-92375384e302> (c61e51c4-7a2a-495d-b805-92375384e302) [No such file or directory] >[2016-04-19 07:24:37.982040] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c61e51c4-7a2a-495d-b805-92375384e302> (c61e51c4-7a2a-495d-b805-92375384e302) [No such file or directory] >[2016-04-19 07:24:37.982940] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c61e51c4-7a2a-495d-b805-92375384e302. (Possible split-brain) >[2016-04-19 07:24:37.983835] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c61e51c4-7a2a-495d-b805-92375384e302> (c61e51c4-7a2a-495d-b805-92375384e302) [No such file or directory] >[2016-04-19 07:24:37.984028] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c61e51c4-7a2a-495d-b805-92375384e302> (c61e51c4-7a2a-495d-b805-92375384e302) [No such file or directory] >[2016-04-19 07:24:37.985382] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c61e51c4-7a2a-495d-b805-92375384e302> (c61e51c4-7a2a-495d-b805-92375384e302) [No such file or directory] >[2016-04-19 07:24:37.985411] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c61e51c4-7a2a-495d-b805-92375384e302> (c61e51c4-7a2a-495d-b805-92375384e302) [No such file or directory] >[2016-04-19 07:24:37.985546] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c61e51c4-7a2a-495d-b805-92375384e302>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:37.987955] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c61e51c4-7a2a-495d-b805-92375384e302. (Possible split-brain) >[2016-04-19 07:24:37.988980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c61e51c4-7a2a-495d-b805-92375384e302> (c61e51c4-7a2a-495d-b805-92375384e302) [No such file or directory] >[2016-04-19 07:24:37.989216] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c61e51c4-7a2a-495d-b805-92375384e302> (c61e51c4-7a2a-495d-b805-92375384e302) [No such file or directory] >[2016-04-19 07:24:37.991473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c61e51c4-7a2a-495d-b805-92375384e302> (c61e51c4-7a2a-495d-b805-92375384e302) [No such file or directory] >[2016-04-19 07:24:37.991778] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c61e51c4-7a2a-495d-b805-92375384e302> (c61e51c4-7a2a-495d-b805-92375384e302) [No such file or directory] >[2016-04-19 07:24:37.992016] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c61e51c4-7a2a-495d-b805-92375384e302>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.000407] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.001236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a6667766-8ef1-4736-866a-c698e9906330> (a6667766-8ef1-4736-866a-c698e9906330) [No such file or directory] >[2016-04-19 07:24:38.001591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a6667766-8ef1-4736-866a-c698e9906330> (a6667766-8ef1-4736-866a-c698e9906330) [No such file or directory] >[2016-04-19 07:24:38.004155] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a6667766-8ef1-4736-866a-c698e9906330. (Possible split-brain) >[2016-04-19 07:24:38.005014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a6667766-8ef1-4736-866a-c698e9906330> (a6667766-8ef1-4736-866a-c698e9906330) [No such file or directory] >[2016-04-19 07:24:38.005424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a6667766-8ef1-4736-866a-c698e9906330> (a6667766-8ef1-4736-866a-c698e9906330) [No such file or directory] >[2016-04-19 07:24:38.006598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a6667766-8ef1-4736-866a-c698e9906330> (a6667766-8ef1-4736-866a-c698e9906330) [No such file or directory] >[2016-04-19 07:24:38.006953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a6667766-8ef1-4736-866a-c698e9906330> (a6667766-8ef1-4736-866a-c698e9906330) [No such file or directory] >[2016-04-19 07:24:38.007115] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a6667766-8ef1-4736-866a-c698e9906330>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.009630] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a6667766-8ef1-4736-866a-c698e9906330. (Possible split-brain) >[2016-04-19 07:24:38.010358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a6667766-8ef1-4736-866a-c698e9906330> (a6667766-8ef1-4736-866a-c698e9906330) [No such file or directory] >[2016-04-19 07:24:38.010767] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a6667766-8ef1-4736-866a-c698e9906330> (a6667766-8ef1-4736-866a-c698e9906330) [No such file or directory] >[2016-04-19 07:24:38.013285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a6667766-8ef1-4736-866a-c698e9906330> (a6667766-8ef1-4736-866a-c698e9906330) [No such file or directory] >[2016-04-19 07:24:38.013592] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a6667766-8ef1-4736-866a-c698e9906330> (a6667766-8ef1-4736-866a-c698e9906330) [No such file or directory] >[2016-04-19 07:24:38.013707] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a6667766-8ef1-4736-866a-c698e9906330>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.021104] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.022156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1> (393b63f9-8e92-4259-aa6d-6d7df7b133f1) [No such file or directory] >[2016-04-19 07:24:38.022387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1> (393b63f9-8e92-4259-aa6d-6d7df7b133f1) [No such file or directory] >[2016-04-19 07:24:38.023238] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 393b63f9-8e92-4259-aa6d-6d7df7b133f1. (Possible split-brain) >[2016-04-19 07:24:38.024246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1> (393b63f9-8e92-4259-aa6d-6d7df7b133f1) [No such file or directory] >[2016-04-19 07:24:38.024415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1> (393b63f9-8e92-4259-aa6d-6d7df7b133f1) [No such file or directory] >[2016-04-19 07:24:38.025434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1> (393b63f9-8e92-4259-aa6d-6d7df7b133f1) [No such file or directory] >[2016-04-19 07:24:38.025551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1> (393b63f9-8e92-4259-aa6d-6d7df7b133f1) [No such file or directory] >[2016-04-19 07:24:38.026051] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.028526] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 393b63f9-8e92-4259-aa6d-6d7df7b133f1. (Possible split-brain) >[2016-04-19 07:24:38.029651] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1> (393b63f9-8e92-4259-aa6d-6d7df7b133f1) [No such file or directory] >[2016-04-19 07:24:38.029627] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1> (393b63f9-8e92-4259-aa6d-6d7df7b133f1) [No such file or directory] >[2016-04-19 07:24:38.032368] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1> (393b63f9-8e92-4259-aa6d-6d7df7b133f1) [No such file or directory] >[2016-04-19 07:24:38.032428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1> (393b63f9-8e92-4259-aa6d-6d7df7b133f1) [No such file or directory] >[2016-04-19 07:24:38.032660] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:393b63f9-8e92-4259-aa6d-6d7df7b133f1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.040595] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.041355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8> (bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8) [No such file or directory] >[2016-04-19 07:24:38.041609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8> (bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8) [No such file or directory] >[2016-04-19 07:24:38.044094] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8. (Possible split-brain) >[2016-04-19 07:24:38.045208] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8> (bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8) [No such file or directory] >[2016-04-19 07:24:38.045309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8> (bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8) [No such file or directory] >[2016-04-19 07:24:38.046518] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8> (bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8) [No such file or directory] >[2016-04-19 07:24:38.046890] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8> (bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8) [No such file or directory] >[2016-04-19 07:24:38.047053] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.049555] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8. (Possible split-brain) >[2016-04-19 07:24:38.050390] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8> (bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8) [No such file or directory] >[2016-04-19 07:24:38.050728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8> (bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8) [No such file or directory] >[2016-04-19 07:24:38.053176] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8> (bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8) [No such file or directory] >[2016-04-19 07:24:38.053271] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8> (bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8) [No such file or directory] >[2016-04-19 07:24:38.053457] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bbdd25e0-0e8a-4fa3-b559-e5aff9b377b8>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.061354] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.062360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4> (cf0ddb7d-4382-40cf-9992-29c0968790e4) [No such file or directory] >[2016-04-19 07:24:38.062441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4> (cf0ddb7d-4382-40cf-9992-29c0968790e4) [No such file or directory] >[2016-04-19 07:24:38.063285] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cf0ddb7d-4382-40cf-9992-29c0968790e4. (Possible split-brain) >[2016-04-19 07:24:38.064356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4> (cf0ddb7d-4382-40cf-9992-29c0968790e4) [No such file or directory] >[2016-04-19 07:24:38.064362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4> (cf0ddb7d-4382-40cf-9992-29c0968790e4) [No such file or directory] >[2016-04-19 07:24:38.065475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4> (cf0ddb7d-4382-40cf-9992-29c0968790e4) [No such file or directory] >[2016-04-19 07:24:38.065504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4> (cf0ddb7d-4382-40cf-9992-29c0968790e4) [No such file or directory] >[2016-04-19 07:24:38.065862] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.068248] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cf0ddb7d-4382-40cf-9992-29c0968790e4. (Possible split-brain) >[2016-04-19 07:24:38.069392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4> (cf0ddb7d-4382-40cf-9992-29c0968790e4) [No such file or directory] >[2016-04-19 07:24:38.069507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4> (cf0ddb7d-4382-40cf-9992-29c0968790e4) [No such file or directory] >[2016-04-19 07:24:38.071969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4> (cf0ddb7d-4382-40cf-9992-29c0968790e4) [No such file or directory] >[2016-04-19 07:24:38.071982] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4> (cf0ddb7d-4382-40cf-9992-29c0968790e4) [No such file or directory] >[2016-04-19 07:24:38.072429] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cf0ddb7d-4382-40cf-9992-29c0968790e4>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.081145] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.082215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db> (6aace537-a6a1-4a09-9cfd-c2bcda1c43db) [No such file or directory] >[2016-04-19 07:24:38.082312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db> (6aace537-a6a1-4a09-9cfd-c2bcda1c43db) [No such file or directory] >[2016-04-19 07:24:38.083163] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6aace537-a6a1-4a09-9cfd-c2bcda1c43db. (Possible split-brain) >[2016-04-19 07:24:38.084109] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db> (6aace537-a6a1-4a09-9cfd-c2bcda1c43db) [No such file or directory] >[2016-04-19 07:24:38.084243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db> (6aace537-a6a1-4a09-9cfd-c2bcda1c43db) [No such file or directory] >[2016-04-19 07:24:38.085299] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db> (6aace537-a6a1-4a09-9cfd-c2bcda1c43db) [No such file or directory] >[2016-04-19 07:24:38.085528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db> (6aace537-a6a1-4a09-9cfd-c2bcda1c43db) [No such file or directory] >[2016-04-19 07:24:38.085741] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.088210] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6aace537-a6a1-4a09-9cfd-c2bcda1c43db. (Possible split-brain) >[2016-04-19 07:24:38.089424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db> (6aace537-a6a1-4a09-9cfd-c2bcda1c43db) [No such file or directory] >[2016-04-19 07:24:38.089510] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db> (6aace537-a6a1-4a09-9cfd-c2bcda1c43db) [No such file or directory] >[2016-04-19 07:24:38.092046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db> (6aace537-a6a1-4a09-9cfd-c2bcda1c43db) [No such file or directory] >[2016-04-19 07:24:38.092132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db> (6aace537-a6a1-4a09-9cfd-c2bcda1c43db) [No such file or directory] >[2016-04-19 07:24:38.092361] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6aace537-a6a1-4a09-9cfd-c2bcda1c43db>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.099849] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.100608] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035> (3deabfc8-1135-4ea3-8263-5900ce92f035) [No such file or directory] >[2016-04-19 07:24:38.100813] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035> (3deabfc8-1135-4ea3-8263-5900ce92f035) [No such file or directory] >[2016-04-19 07:24:38.103361] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3deabfc8-1135-4ea3-8263-5900ce92f035. (Possible split-brain) >[2016-04-19 07:24:38.104066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035> (3deabfc8-1135-4ea3-8263-5900ce92f035) [No such file or directory] >[2016-04-19 07:24:38.104409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035> (3deabfc8-1135-4ea3-8263-5900ce92f035) [No such file or directory] >[2016-04-19 07:24:38.106121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035> (3deabfc8-1135-4ea3-8263-5900ce92f035) [No such file or directory] >[2016-04-19 07:24:38.106130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035> (3deabfc8-1135-4ea3-8263-5900ce92f035) [No such file or directory] >[2016-04-19 07:24:38.106281] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.108776] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3deabfc8-1135-4ea3-8263-5900ce92f035. (Possible split-brain) >[2016-04-19 07:24:38.109696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035> (3deabfc8-1135-4ea3-8263-5900ce92f035) [No such file or directory] >[2016-04-19 07:24:38.110033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035> (3deabfc8-1135-4ea3-8263-5900ce92f035) [No such file or directory] >[2016-04-19 07:24:38.112923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035> (3deabfc8-1135-4ea3-8263-5900ce92f035) [No such file or directory] >[2016-04-19 07:24:38.113250] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035> (3deabfc8-1135-4ea3-8263-5900ce92f035) [No such file or directory] >[2016-04-19 07:24:38.113484] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3deabfc8-1135-4ea3-8263-5900ce92f035>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.121412] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.122200] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9> (b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9) [No such file or directory] >[2016-04-19 07:24:38.122355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9> (b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9) [No such file or directory] >[2016-04-19 07:24:38.123192] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9. (Possible split-brain) >[2016-04-19 07:24:38.124021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9> (b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9) [No such file or directory] >[2016-04-19 07:24:38.124116] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9> (b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9) [No such file or directory] >[2016-04-19 07:24:38.125168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9> (b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9) [No such file or directory] >[2016-04-19 07:24:38.125304] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9> (b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9) [No such file or directory] >[2016-04-19 07:24:38.125504] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.127914] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9. (Possible split-brain) >[2016-04-19 07:24:38.128843] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9> (b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9) [No such file or directory] >[2016-04-19 07:24:38.128844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9> (b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9) [No such file or directory] >[2016-04-19 07:24:38.131365] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9> (b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9) [No such file or directory] >[2016-04-19 07:24:38.131621] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9> (b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9) [No such file or directory] >[2016-04-19 07:24:38.131820] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b9164f7b-2fec-4d5a-b01e-ce913e1fa6a9>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.139399] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.140270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bc848533-d688-494b-acfd-1553500c8d6a> (bc848533-d688-494b-acfd-1553500c8d6a) [No such file or directory] >[2016-04-19 07:24:38.140723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bc848533-d688-494b-acfd-1553500c8d6a> (bc848533-d688-494b-acfd-1553500c8d6a) [No such file or directory] >[2016-04-19 07:24:38.143252] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bc848533-d688-494b-acfd-1553500c8d6a. (Possible split-brain) >[2016-04-19 07:24:38.144175] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bc848533-d688-494b-acfd-1553500c8d6a> (bc848533-d688-494b-acfd-1553500c8d6a) [No such file or directory] >[2016-04-19 07:24:38.144368] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bc848533-d688-494b-acfd-1553500c8d6a> (bc848533-d688-494b-acfd-1553500c8d6a) [No such file or directory] >[2016-04-19 07:24:38.145511] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bc848533-d688-494b-acfd-1553500c8d6a> (bc848533-d688-494b-acfd-1553500c8d6a) [No such file or directory] >[2016-04-19 07:24:38.145611] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bc848533-d688-494b-acfd-1553500c8d6a> (bc848533-d688-494b-acfd-1553500c8d6a) [No such file or directory] >[2016-04-19 07:24:38.145958] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bc848533-d688-494b-acfd-1553500c8d6a>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.148440] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bc848533-d688-494b-acfd-1553500c8d6a. (Possible split-brain) >[2016-04-19 07:24:38.149426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bc848533-d688-494b-acfd-1553500c8d6a> (bc848533-d688-494b-acfd-1553500c8d6a) [No such file or directory] >[2016-04-19 07:24:38.149748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bc848533-d688-494b-acfd-1553500c8d6a> (bc848533-d688-494b-acfd-1553500c8d6a) [No such file or directory] >[2016-04-19 07:24:38.152124] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bc848533-d688-494b-acfd-1553500c8d6a> (bc848533-d688-494b-acfd-1553500c8d6a) [No such file or directory] >[2016-04-19 07:24:38.152246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bc848533-d688-494b-acfd-1553500c8d6a> (bc848533-d688-494b-acfd-1553500c8d6a) [No such file or directory] >[2016-04-19 07:24:38.152806] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bc848533-d688-494b-acfd-1553500c8d6a>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.161242] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.162131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946> (13085a7e-857f-40ca-bf19-a7c9936f9946) [No such file or directory] >[2016-04-19 07:24:38.162155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946> (13085a7e-857f-40ca-bf19-a7c9936f9946) [No such file or directory] >[2016-04-19 07:24:38.163044] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 13085a7e-857f-40ca-bf19-a7c9936f9946. (Possible split-brain) >[2016-04-19 07:24:38.164285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946> (13085a7e-857f-40ca-bf19-a7c9936f9946) [No such file or directory] >[2016-04-19 07:24:38.164307] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946> (13085a7e-857f-40ca-bf19-a7c9936f9946) [No such file or directory] >[2016-04-19 07:24:38.165875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946> (13085a7e-857f-40ca-bf19-a7c9936f9946) [No such file or directory] >[2016-04-19 07:24:38.165977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946> (13085a7e-857f-40ca-bf19-a7c9936f9946) [No such file or directory] >[2016-04-19 07:24:38.166079] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.168535] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 13085a7e-857f-40ca-bf19-a7c9936f9946. (Possible split-brain) >[2016-04-19 07:24:38.169618] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946> (13085a7e-857f-40ca-bf19-a7c9936f9946) [No such file or directory] >[2016-04-19 07:24:38.169923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946> (13085a7e-857f-40ca-bf19-a7c9936f9946) [No such file or directory] >[2016-04-19 07:24:38.172541] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946> (13085a7e-857f-40ca-bf19-a7c9936f9946) [No such file or directory] >[2016-04-19 07:24:38.172849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946> (13085a7e-857f-40ca-bf19-a7c9936f9946) [No such file or directory] >[2016-04-19 07:24:38.172978] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:13085a7e-857f-40ca-bf19-a7c9936f9946>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.181341] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.182162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c> (47d45a71-4514-4757-a97c-503c23fcf52c) [No such file or directory] >[2016-04-19 07:24:38.182245] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c> (47d45a71-4514-4757-a97c-503c23fcf52c) [No such file or directory] >[2016-04-19 07:24:38.184781] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 47d45a71-4514-4757-a97c-503c23fcf52c. (Possible split-brain) >[2016-04-19 07:24:38.185534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c> (47d45a71-4514-4757-a97c-503c23fcf52c) [No such file or directory] >[2016-04-19 07:24:38.185840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c> (47d45a71-4514-4757-a97c-503c23fcf52c) [No such file or directory] >[2016-04-19 07:24:38.187123] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c> (47d45a71-4514-4757-a97c-503c23fcf52c) [No such file or directory] >[2016-04-19 07:24:38.187406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c> (47d45a71-4514-4757-a97c-503c23fcf52c) [No such file or directory] >[2016-04-19 07:24:38.187594] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.190046] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 47d45a71-4514-4757-a97c-503c23fcf52c. (Possible split-brain) >[2016-04-19 07:24:38.191051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c> (47d45a71-4514-4757-a97c-503c23fcf52c) [No such file or directory] >[2016-04-19 07:24:38.191169] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c> (47d45a71-4514-4757-a97c-503c23fcf52c) [No such file or directory] >[2016-04-19 07:24:38.193834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c> (47d45a71-4514-4757-a97c-503c23fcf52c) [No such file or directory] >[2016-04-19 07:24:38.193846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c> (47d45a71-4514-4757-a97c-503c23fcf52c) [No such file or directory] >[2016-04-19 07:24:38.194199] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:47d45a71-4514-4757-a97c-503c23fcf52c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.202769] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.203838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7> (4cbc6d21-a4e6-4781-a208-e764690924d7) [No such file or directory] >[2016-04-19 07:24:38.203858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7> (4cbc6d21-a4e6-4781-a208-e764690924d7) [No such file or directory] >[2016-04-19 07:24:38.204975] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4cbc6d21-a4e6-4781-a208-e764690924d7. (Possible split-brain) >[2016-04-19 07:24:38.205876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7> (4cbc6d21-a4e6-4781-a208-e764690924d7) [No such file or directory] >[2016-04-19 07:24:38.205975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7> (4cbc6d21-a4e6-4781-a208-e764690924d7) [No such file or directory] >[2016-04-19 07:24:38.207511] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7> (4cbc6d21-a4e6-4781-a208-e764690924d7) [No such file or directory] >[2016-04-19 07:24:38.207513] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7> (4cbc6d21-a4e6-4781-a208-e764690924d7) [No such file or directory] >[2016-04-19 07:24:38.207696] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.210134] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4cbc6d21-a4e6-4781-a208-e764690924d7. (Possible split-brain) >[2016-04-19 07:24:38.211011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7> (4cbc6d21-a4e6-4781-a208-e764690924d7) [No such file or directory] >[2016-04-19 07:24:38.211405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7> (4cbc6d21-a4e6-4781-a208-e764690924d7) [No such file or directory] >[2016-04-19 07:24:38.214292] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7> (4cbc6d21-a4e6-4781-a208-e764690924d7) [No such file or directory] >[2016-04-19 07:24:38.214468] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7> (4cbc6d21-a4e6-4781-a208-e764690924d7) [No such file or directory] >[2016-04-19 07:24:38.214609] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4cbc6d21-a4e6-4781-a208-e764690924d7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.221994] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.222746] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5> (71ead204-9fbc-4203-9a3a-031181a8a4d5) [No such file or directory] >[2016-04-19 07:24:38.222847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5> (71ead204-9fbc-4203-9a3a-031181a8a4d5) [No such file or directory] >[2016-04-19 07:24:38.225354] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 71ead204-9fbc-4203-9a3a-031181a8a4d5. (Possible split-brain) >[2016-04-19 07:24:38.226223] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5> (71ead204-9fbc-4203-9a3a-031181a8a4d5) [No such file or directory] >[2016-04-19 07:24:38.226435] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5> (71ead204-9fbc-4203-9a3a-031181a8a4d5) [No such file or directory] >[2016-04-19 07:24:38.227685] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5> (71ead204-9fbc-4203-9a3a-031181a8a4d5) [No such file or directory] >[2016-04-19 07:24:38.227792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5> (71ead204-9fbc-4203-9a3a-031181a8a4d5) [No such file or directory] >[2016-04-19 07:24:38.227957] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.230550] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 71ead204-9fbc-4203-9a3a-031181a8a4d5. (Possible split-brain) >[2016-04-19 07:24:38.231273] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5> (71ead204-9fbc-4203-9a3a-031181a8a4d5) [No such file or directory] >[2016-04-19 07:24:38.231701] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5> (71ead204-9fbc-4203-9a3a-031181a8a4d5) [No such file or directory] >[2016-04-19 07:24:38.234247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5> (71ead204-9fbc-4203-9a3a-031181a8a4d5) [No such file or directory] >[2016-04-19 07:24:38.234506] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5> (71ead204-9fbc-4203-9a3a-031181a8a4d5) [No such file or directory] >[2016-04-19 07:24:38.234654] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:71ead204-9fbc-4203-9a3a-031181a8a4d5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.244412] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.245179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417> (2e4c193c-3d06-4f2b-b4eb-bd265fac2417) [No such file or directory] >[2016-04-19 07:24:38.245388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417> (2e4c193c-3d06-4f2b-b4eb-bd265fac2417) [No such file or directory] >[2016-04-19 07:24:38.246534] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e4c193c-3d06-4f2b-b4eb-bd265fac2417. (Possible split-brain) >[2016-04-19 07:24:38.247505] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417> (2e4c193c-3d06-4f2b-b4eb-bd265fac2417) [No such file or directory] >[2016-04-19 07:24:38.247803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417> (2e4c193c-3d06-4f2b-b4eb-bd265fac2417) [No such file or directory] >[2016-04-19 07:24:38.249057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417> (2e4c193c-3d06-4f2b-b4eb-bd265fac2417) [No such file or directory] >[2016-04-19 07:24:38.249357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417> (2e4c193c-3d06-4f2b-b4eb-bd265fac2417) [No such file or directory] >[2016-04-19 07:24:38.249509] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.252028] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e4c193c-3d06-4f2b-b4eb-bd265fac2417. (Possible split-brain) >[2016-04-19 07:24:38.252826] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417> (2e4c193c-3d06-4f2b-b4eb-bd265fac2417) [No such file or directory] >[2016-04-19 07:24:38.252930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417> (2e4c193c-3d06-4f2b-b4eb-bd265fac2417) [No such file or directory] >[2016-04-19 07:24:38.255870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417> (2e4c193c-3d06-4f2b-b4eb-bd265fac2417) [No such file or directory] >[2016-04-19 07:24:38.256013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417> (2e4c193c-3d06-4f2b-b4eb-bd265fac2417) [No such file or directory] >[2016-04-19 07:24:38.256143] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2e4c193c-3d06-4f2b-b4eb-bd265fac2417>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.264379] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.265180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d> (27e0a96f-a01e-444f-b909-a67cdf5c5a6d) [No such file or directory] >[2016-04-19 07:24:38.265488] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d> (27e0a96f-a01e-444f-b909-a67cdf5c5a6d) [No such file or directory] >[2016-04-19 07:24:38.266680] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 27e0a96f-a01e-444f-b909-a67cdf5c5a6d. (Possible split-brain) >[2016-04-19 07:24:38.267565] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d> (27e0a96f-a01e-444f-b909-a67cdf5c5a6d) [No such file or directory] >[2016-04-19 07:24:38.267703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d> (27e0a96f-a01e-444f-b909-a67cdf5c5a6d) [No such file or directory] >[2016-04-19 07:24:38.268746] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d> (27e0a96f-a01e-444f-b909-a67cdf5c5a6d) [No such file or directory] >[2016-04-19 07:24:38.269092] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d> (27e0a96f-a01e-444f-b909-a67cdf5c5a6d) [No such file or directory] >[2016-04-19 07:24:38.269229] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.271706] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 27e0a96f-a01e-444f-b909-a67cdf5c5a6d. (Possible split-brain) >[2016-04-19 07:24:38.272485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d> (27e0a96f-a01e-444f-b909-a67cdf5c5a6d) [No such file or directory] >[2016-04-19 07:24:38.272786] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d> (27e0a96f-a01e-444f-b909-a67cdf5c5a6d) [No such file or directory] >[2016-04-19 07:24:38.275472] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d> (27e0a96f-a01e-444f-b909-a67cdf5c5a6d) [No such file or directory] >[2016-04-19 07:24:38.275507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d> (27e0a96f-a01e-444f-b909-a67cdf5c5a6d) [No such file or directory] >[2016-04-19 07:24:38.275754] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:27e0a96f-a01e-444f-b909-a67cdf5c5a6d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.284559] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.285514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74> (75e90018-f77b-4358-bd60-a33f0add8b74) [No such file or directory] >[2016-04-19 07:24:38.285828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74> (75e90018-f77b-4358-bd60-a33f0add8b74) [No such file or directory] >[2016-04-19 07:24:38.286765] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 75e90018-f77b-4358-bd60-a33f0add8b74. (Possible split-brain) >[2016-04-19 07:24:38.287815] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74> (75e90018-f77b-4358-bd60-a33f0add8b74) [No such file or directory] >[2016-04-19 07:24:38.287821] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74> (75e90018-f77b-4358-bd60-a33f0add8b74) [No such file or directory] >[2016-04-19 07:24:38.289307] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74> (75e90018-f77b-4358-bd60-a33f0add8b74) [No such file or directory] >[2016-04-19 07:24:38.289353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74> (75e90018-f77b-4358-bd60-a33f0add8b74) [No such file or directory] >[2016-04-19 07:24:38.289517] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.292015] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 75e90018-f77b-4358-bd60-a33f0add8b74. (Possible split-brain) >[2016-04-19 07:24:38.293179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74> (75e90018-f77b-4358-bd60-a33f0add8b74) [No such file or directory] >[2016-04-19 07:24:38.293286] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74> (75e90018-f77b-4358-bd60-a33f0add8b74) [No such file or directory] >[2016-04-19 07:24:38.295911] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74> (75e90018-f77b-4358-bd60-a33f0add8b74) [No such file or directory] >[2016-04-19 07:24:38.296200] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74> (75e90018-f77b-4358-bd60-a33f0add8b74) [No such file or directory] >[2016-04-19 07:24:38.296431] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:75e90018-f77b-4358-bd60-a33f0add8b74>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.304822] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.305712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7> (c8a2cd7f-4999-44c4-802c-bbe40781ebe7) [No such file or directory] >[2016-04-19 07:24:38.306042] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7> (c8a2cd7f-4999-44c4-802c-bbe40781ebe7) [No such file or directory] >[2016-04-19 07:24:38.308947] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c8a2cd7f-4999-44c4-802c-bbe40781ebe7. (Possible split-brain) >[2016-04-19 07:24:38.310138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7> (c8a2cd7f-4999-44c4-802c-bbe40781ebe7) [No such file or directory] >[2016-04-19 07:24:38.310139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7> (c8a2cd7f-4999-44c4-802c-bbe40781ebe7) [No such file or directory] >[2016-04-19 07:24:38.311669] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7> (c8a2cd7f-4999-44c4-802c-bbe40781ebe7) [No such file or directory] >[2016-04-19 07:24:38.311536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7> (c8a2cd7f-4999-44c4-802c-bbe40781ebe7) [No such file or directory] >[2016-04-19 07:24:38.311865] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.314408] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c8a2cd7f-4999-44c4-802c-bbe40781ebe7. (Possible split-brain) >[2016-04-19 07:24:38.315532] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7> (c8a2cd7f-4999-44c4-802c-bbe40781ebe7) [No such file or directory] >[2016-04-19 07:24:38.315806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7> (c8a2cd7f-4999-44c4-802c-bbe40781ebe7) [No such file or directory] >[2016-04-19 07:24:38.318386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7> (c8a2cd7f-4999-44c4-802c-bbe40781ebe7) [No such file or directory] >[2016-04-19 07:24:38.318802] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7> (c8a2cd7f-4999-44c4-802c-bbe40781ebe7) [No such file or directory] >[2016-04-19 07:24:38.318986] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c8a2cd7f-4999-44c4-802c-bbe40781ebe7>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.327985] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.328979] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78> (d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78) [No such file or directory] >[2016-04-19 07:24:38.329002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78> (d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78) [No such file or directory] >[2016-04-19 07:24:38.331880] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78. (Possible split-brain) >[2016-04-19 07:24:38.332990] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78> (d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78) [No such file or directory] >[2016-04-19 07:24:38.333000] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78> (d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78) [No such file or directory] >[2016-04-19 07:24:38.334437] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78> (d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78) [No such file or directory] >[2016-04-19 07:24:38.334530] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78> (d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78) [No such file or directory] >[2016-04-19 07:24:38.334674] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.337157] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78. (Possible split-brain) >[2016-04-19 07:24:38.338156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78> (d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78) [No such file or directory] >[2016-04-19 07:24:38.338186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78> (d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78) [No such file or directory] >[2016-04-19 07:24:38.340703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78> (d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78) [No such file or directory] >[2016-04-19 07:24:38.341041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78> (d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78) [No such file or directory] >[2016-04-19 07:24:38.341195] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d517f1d4-08ae-4bd5-93ba-16e3ef6e1a78>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.349265] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.350050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6> (4da3fc1c-25c8-4c63-8d34-5958152a3fc6) [No such file or directory] >[2016-04-19 07:24:38.350400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6> (4da3fc1c-25c8-4c63-8d34-5958152a3fc6) [No such file or directory] >[2016-04-19 07:24:38.353224] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4da3fc1c-25c8-4c63-8d34-5958152a3fc6. (Possible split-brain) >[2016-04-19 07:24:38.354153] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6> (4da3fc1c-25c8-4c63-8d34-5958152a3fc6) [No such file or directory] >[2016-04-19 07:24:38.354264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6> (4da3fc1c-25c8-4c63-8d34-5958152a3fc6) [No such file or directory] >[2016-04-19 07:24:38.355482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6> (4da3fc1c-25c8-4c63-8d34-5958152a3fc6) [No such file or directory] >[2016-04-19 07:24:38.355813] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6> (4da3fc1c-25c8-4c63-8d34-5958152a3fc6) [No such file or directory] >[2016-04-19 07:24:38.355966] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.358452] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4da3fc1c-25c8-4c63-8d34-5958152a3fc6. (Possible split-brain) >[2016-04-19 07:24:38.359204] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6> (4da3fc1c-25c8-4c63-8d34-5958152a3fc6) [No such file or directory] >[2016-04-19 07:24:38.359561] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6> (4da3fc1c-25c8-4c63-8d34-5958152a3fc6) [No such file or directory] >[2016-04-19 07:24:38.362408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6> (4da3fc1c-25c8-4c63-8d34-5958152a3fc6) [No such file or directory] >[2016-04-19 07:24:38.362520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6> (4da3fc1c-25c8-4c63-8d34-5958152a3fc6) [No such file or directory] >[2016-04-19 07:24:38.362716] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4da3fc1c-25c8-4c63-8d34-5958152a3fc6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.371873] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.372896] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b> (d11ae089-20b0-4ae9-b8d2-e487d158010b) [No such file or directory] >[2016-04-19 07:24:38.373244] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b> (d11ae089-20b0-4ae9-b8d2-e487d158010b) [No such file or directory] >[2016-04-19 07:24:38.374469] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d11ae089-20b0-4ae9-b8d2-e487d158010b. (Possible split-brain) >[2016-04-19 07:24:38.375570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b> (d11ae089-20b0-4ae9-b8d2-e487d158010b) [No such file or directory] >[2016-04-19 07:24:38.375561] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b> (d11ae089-20b0-4ae9-b8d2-e487d158010b) [No such file or directory] >[2016-04-19 07:24:38.376929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b> (d11ae089-20b0-4ae9-b8d2-e487d158010b) [No such file or directory] >[2016-04-19 07:24:38.377010] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b> (d11ae089-20b0-4ae9-b8d2-e487d158010b) [No such file or directory] >[2016-04-19 07:24:38.377168] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.379638] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d11ae089-20b0-4ae9-b8d2-e487d158010b. (Possible split-brain) >[2016-04-19 07:24:38.380524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b> (d11ae089-20b0-4ae9-b8d2-e487d158010b) [No such file or directory] >[2016-04-19 07:24:38.380587] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b> (d11ae089-20b0-4ae9-b8d2-e487d158010b) [No such file or directory] >[2016-04-19 07:24:38.383220] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b> (d11ae089-20b0-4ae9-b8d2-e487d158010b) [No such file or directory] >[2016-04-19 07:24:38.383226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b> (d11ae089-20b0-4ae9-b8d2-e487d158010b) [No such file or directory] >[2016-04-19 07:24:38.383587] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d11ae089-20b0-4ae9-b8d2-e487d158010b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.391731] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.392707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b> (3f2c9a18-88fc-4df1-b198-b062e825a73b) [No such file or directory] >[2016-04-19 07:24:38.393101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b> (3f2c9a18-88fc-4df1-b198-b062e825a73b) [No such file or directory] >[2016-04-19 07:24:38.394270] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3f2c9a18-88fc-4df1-b198-b062e825a73b. (Possible split-brain) >[2016-04-19 07:24:38.395388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b> (3f2c9a18-88fc-4df1-b198-b062e825a73b) [No such file or directory] >[2016-04-19 07:24:38.395562] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b> (3f2c9a18-88fc-4df1-b198-b062e825a73b) [No such file or directory] >[2016-04-19 07:24:38.396692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b> (3f2c9a18-88fc-4df1-b198-b062e825a73b) [No such file or directory] >[2016-04-19 07:24:38.397037] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b> (3f2c9a18-88fc-4df1-b198-b062e825a73b) [No such file or directory] >[2016-04-19 07:24:38.397195] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.399703] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3f2c9a18-88fc-4df1-b198-b062e825a73b. (Possible split-brain) >[2016-04-19 07:24:38.400728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b> (3f2c9a18-88fc-4df1-b198-b062e825a73b) [No such file or directory] >[2016-04-19 07:24:38.400831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b> (3f2c9a18-88fc-4df1-b198-b062e825a73b) [No such file or directory] >[2016-04-19 07:24:38.403369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b> (3f2c9a18-88fc-4df1-b198-b062e825a73b) [No such file or directory] >[2016-04-19 07:24:38.403467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b> (3f2c9a18-88fc-4df1-b198-b062e825a73b) [No such file or directory] >[2016-04-19 07:24:38.403625] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3f2c9a18-88fc-4df1-b198-b062e825a73b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.411923] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.412883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a> (cfffe384-5c6b-4be7-9bcf-ee57d73cb05a) [No such file or directory] >[2016-04-19 07:24:38.413160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a> (cfffe384-5c6b-4be7-9bcf-ee57d73cb05a) [No such file or directory] >[2016-04-19 07:24:38.414354] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cfffe384-5c6b-4be7-9bcf-ee57d73cb05a. (Possible split-brain) >[2016-04-19 07:24:38.415405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a> (cfffe384-5c6b-4be7-9bcf-ee57d73cb05a) [No such file or directory] >[2016-04-19 07:24:38.415421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a> (cfffe384-5c6b-4be7-9bcf-ee57d73cb05a) [No such file or directory] >[2016-04-19 07:24:38.416645] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a> (cfffe384-5c6b-4be7-9bcf-ee57d73cb05a) [No such file or directory] >[2016-04-19 07:24:38.416930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a> (cfffe384-5c6b-4be7-9bcf-ee57d73cb05a) [No such file or directory] >[2016-04-19 07:24:38.417112] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.419595] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cfffe384-5c6b-4be7-9bcf-ee57d73cb05a. (Possible split-brain) >[2016-04-19 07:24:38.420695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a> (cfffe384-5c6b-4be7-9bcf-ee57d73cb05a) [No such file or directory] >[2016-04-19 07:24:38.420799] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a> (cfffe384-5c6b-4be7-9bcf-ee57d73cb05a) [No such file or directory] >[2016-04-19 07:24:38.423385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a> (cfffe384-5c6b-4be7-9bcf-ee57d73cb05a) [No such file or directory] >[2016-04-19 07:24:38.423414] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a> (cfffe384-5c6b-4be7-9bcf-ee57d73cb05a) [No such file or directory] >[2016-04-19 07:24:38.423580] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cfffe384-5c6b-4be7-9bcf-ee57d73cb05a>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.431199] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.431940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a> (25872bc9-86c8-458f-9f62-99fb30d0e86a) [No such file or directory] >[2016-04-19 07:24:38.432344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a> (25872bc9-86c8-458f-9f62-99fb30d0e86a) [No such file or directory] >[2016-04-19 07:24:38.433486] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 25872bc9-86c8-458f-9f62-99fb30d0e86a. (Possible split-brain) >[2016-04-19 07:24:38.434213] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a> (25872bc9-86c8-458f-9f62-99fb30d0e86a) [No such file or directory] >[2016-04-19 07:24:38.434559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a> (25872bc9-86c8-458f-9f62-99fb30d0e86a) [No such file or directory] >[2016-04-19 07:24:38.435823] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a> (25872bc9-86c8-458f-9f62-99fb30d0e86a) [No such file or directory] >[2016-04-19 07:24:38.435931] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a> (25872bc9-86c8-458f-9f62-99fb30d0e86a) [No such file or directory] >[2016-04-19 07:24:38.436047] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.438541] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 25872bc9-86c8-458f-9f62-99fb30d0e86a. (Possible split-brain) >[2016-04-19 07:24:38.439230] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a> (25872bc9-86c8-458f-9f62-99fb30d0e86a) [No such file or directory] >[2016-04-19 07:24:38.439569] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a> (25872bc9-86c8-458f-9f62-99fb30d0e86a) [No such file or directory] >[2016-04-19 07:24:38.442261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a> (25872bc9-86c8-458f-9f62-99fb30d0e86a) [No such file or directory] >[2016-04-19 07:24:38.442392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a> (25872bc9-86c8-458f-9f62-99fb30d0e86a) [No such file or directory] >[2016-04-19 07:24:38.442592] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:25872bc9-86c8-458f-9f62-99fb30d0e86a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.452382] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.453562] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a> (273ae558-e716-4768-9122-9108c9ea0d2a) [No such file or directory] >[2016-04-19 07:24:38.453770] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a> (273ae558-e716-4768-9122-9108c9ea0d2a) [No such file or directory] >[2016-04-19 07:24:38.454743] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 273ae558-e716-4768-9122-9108c9ea0d2a. (Possible split-brain) >[2016-04-19 07:24:38.455706] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a> (273ae558-e716-4768-9122-9108c9ea0d2a) [No such file or directory] >[2016-04-19 07:24:38.456042] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a> (273ae558-e716-4768-9122-9108c9ea0d2a) [No such file or directory] >[2016-04-19 07:24:38.457163] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a> (273ae558-e716-4768-9122-9108c9ea0d2a) [No such file or directory] >[2016-04-19 07:24:38.457544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a> (273ae558-e716-4768-9122-9108c9ea0d2a) [No such file or directory] >[2016-04-19 07:24:38.457682] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.460190] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 273ae558-e716-4768-9122-9108c9ea0d2a. (Possible split-brain) >[2016-04-19 07:24:38.461240] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a> (273ae558-e716-4768-9122-9108c9ea0d2a) [No such file or directory] >[2016-04-19 07:24:38.461371] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a> (273ae558-e716-4768-9122-9108c9ea0d2a) [No such file or directory] >[2016-04-19 07:24:38.463999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a> (273ae558-e716-4768-9122-9108c9ea0d2a) [No such file or directory] >[2016-04-19 07:24:38.464050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a> (273ae558-e716-4768-9122-9108c9ea0d2a) [No such file or directory] >[2016-04-19 07:24:38.464450] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:273ae558-e716-4768-9122-9108c9ea0d2a>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.472227] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.473009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892> (2ab5cb79-8eee-40f1-baa5-2e715b6d5892) [No such file or directory] >[2016-04-19 07:24:38.473351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892> (2ab5cb79-8eee-40f1-baa5-2e715b6d5892) [No such file or directory] >[2016-04-19 07:24:38.475913] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2ab5cb79-8eee-40f1-baa5-2e715b6d5892. (Possible split-brain) >[2016-04-19 07:24:38.476711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892> (2ab5cb79-8eee-40f1-baa5-2e715b6d5892) [No such file or directory] >[2016-04-19 07:24:38.476830] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892> (2ab5cb79-8eee-40f1-baa5-2e715b6d5892) [No such file or directory] >[2016-04-19 07:24:38.478021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892> (2ab5cb79-8eee-40f1-baa5-2e715b6d5892) [No such file or directory] >[2016-04-19 07:24:38.478370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892> (2ab5cb79-8eee-40f1-baa5-2e715b6d5892) [No such file or directory] >[2016-04-19 07:24:38.478514] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.480999] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2ab5cb79-8eee-40f1-baa5-2e715b6d5892. (Possible split-brain) >[2016-04-19 07:24:38.481715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892> (2ab5cb79-8eee-40f1-baa5-2e715b6d5892) [No such file or directory] >[2016-04-19 07:24:38.482138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892> (2ab5cb79-8eee-40f1-baa5-2e715b6d5892) [No such file or directory] >[2016-04-19 07:24:38.484646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892> (2ab5cb79-8eee-40f1-baa5-2e715b6d5892) [No such file or directory] >[2016-04-19 07:24:38.485012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892> (2ab5cb79-8eee-40f1-baa5-2e715b6d5892) [No such file or directory] >[2016-04-19 07:24:38.485155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2ab5cb79-8eee-40f1-baa5-2e715b6d5892>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.493916] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.494673] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda> (01deba2e-7576-496d-a54d-28d6a8b91eda) [No such file or directory] >[2016-04-19 07:24:38.495041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda> (01deba2e-7576-496d-a54d-28d6a8b91eda) [No such file or directory] >[2016-04-19 07:24:38.497854] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 01deba2e-7576-496d-a54d-28d6a8b91eda. (Possible split-brain) >[2016-04-19 07:24:38.498569] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda> (01deba2e-7576-496d-a54d-28d6a8b91eda) [No such file or directory] >[2016-04-19 07:24:38.498938] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda> (01deba2e-7576-496d-a54d-28d6a8b91eda) [No such file or directory] >[2016-04-19 07:24:38.500122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda> (01deba2e-7576-496d-a54d-28d6a8b91eda) [No such file or directory] >[2016-04-19 07:24:38.500394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda> (01deba2e-7576-496d-a54d-28d6a8b91eda) [No such file or directory] >[2016-04-19 07:24:38.500522] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.503081] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 01deba2e-7576-496d-a54d-28d6a8b91eda. (Possible split-brain) >[2016-04-19 07:24:38.503903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda> (01deba2e-7576-496d-a54d-28d6a8b91eda) [No such file or directory] >[2016-04-19 07:24:38.504003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda> (01deba2e-7576-496d-a54d-28d6a8b91eda) [No such file or directory] >[2016-04-19 07:24:38.506804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda> (01deba2e-7576-496d-a54d-28d6a8b91eda) [No such file or directory] >[2016-04-19 07:24:38.506817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda> (01deba2e-7576-496d-a54d-28d6a8b91eda) [No such file or directory] >[2016-04-19 07:24:38.507048] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:01deba2e-7576-496d-a54d-28d6a8b91eda>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.515287] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.516202] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04> (1abc3403-a2e4-43f2-828f-6e7acb85ed04) [No such file or directory] >[2016-04-19 07:24:38.516224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04> (1abc3403-a2e4-43f2-828f-6e7acb85ed04) [No such file or directory] >[2016-04-19 07:24:38.519078] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1abc3403-a2e4-43f2-828f-6e7acb85ed04. (Possible split-brain) >[2016-04-19 07:24:38.520169] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04> (1abc3403-a2e4-43f2-828f-6e7acb85ed04) [No such file or directory] >[2016-04-19 07:24:38.520278] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04> (1abc3403-a2e4-43f2-828f-6e7acb85ed04) [No such file or directory] >[2016-04-19 07:24:38.521613] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04> (1abc3403-a2e4-43f2-828f-6e7acb85ed04) [No such file or directory] >[2016-04-19 07:24:38.521638] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04> (1abc3403-a2e4-43f2-828f-6e7acb85ed04) [No such file or directory] >[2016-04-19 07:24:38.521822] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.524304] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1abc3403-a2e4-43f2-828f-6e7acb85ed04. (Possible split-brain) >[2016-04-19 07:24:38.525303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04> (1abc3403-a2e4-43f2-828f-6e7acb85ed04) [No such file or directory] >[2016-04-19 07:24:38.525346] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04> (1abc3403-a2e4-43f2-828f-6e7acb85ed04) [No such file or directory] >[2016-04-19 07:24:38.527985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04> (1abc3403-a2e4-43f2-828f-6e7acb85ed04) [No such file or directory] >[2016-04-19 07:24:38.528034] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04> (1abc3403-a2e4-43f2-828f-6e7acb85ed04) [No such file or directory] >[2016-04-19 07:24:38.528287] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1abc3403-a2e4-43f2-828f-6e7acb85ed04>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.536638] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.537751] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7> (633eb6df-9844-4ff4-836b-487d658cbee7) [No such file or directory] >[2016-04-19 07:24:38.537853] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7> (633eb6df-9844-4ff4-836b-487d658cbee7) [No such file or directory] >[2016-04-19 07:24:38.539009] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 633eb6df-9844-4ff4-836b-487d658cbee7. (Possible split-brain) >[2016-04-19 07:24:38.540190] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7> (633eb6df-9844-4ff4-836b-487d658cbee7) [No such file or directory] >[2016-04-19 07:24:38.540197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7> (633eb6df-9844-4ff4-836b-487d658cbee7) [No such file or directory] >[2016-04-19 07:24:38.541429] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7> (633eb6df-9844-4ff4-836b-487d658cbee7) [No such file or directory] >[2016-04-19 07:24:38.541708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7> (633eb6df-9844-4ff4-836b-487d658cbee7) [No such file or directory] >[2016-04-19 07:24:38.541870] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.544297] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 633eb6df-9844-4ff4-836b-487d658cbee7. (Possible split-brain) >[2016-04-19 07:24:38.545416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7> (633eb6df-9844-4ff4-836b-487d658cbee7) [No such file or directory] >[2016-04-19 07:24:38.545440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7> (633eb6df-9844-4ff4-836b-487d658cbee7) [No such file or directory] >[2016-04-19 07:24:38.547858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7> (633eb6df-9844-4ff4-836b-487d658cbee7) [No such file or directory] >[2016-04-19 07:24:38.547906] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7> (633eb6df-9844-4ff4-836b-487d658cbee7) [No such file or directory] >[2016-04-19 07:24:38.548089] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:633eb6df-9844-4ff4-836b-487d658cbee7>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.555212] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.556075] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9215069-683c-4180-8df3-89baa393343f> (b9215069-683c-4180-8df3-89baa393343f) [No such file or directory] >[2016-04-19 07:24:38.556476] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9215069-683c-4180-8df3-89baa393343f> (b9215069-683c-4180-8df3-89baa393343f) [No such file or directory] >[2016-04-19 07:24:38.559006] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b9215069-683c-4180-8df3-89baa393343f. (Possible split-brain) >[2016-04-19 07:24:38.559761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9215069-683c-4180-8df3-89baa393343f> (b9215069-683c-4180-8df3-89baa393343f) [No such file or directory] >[2016-04-19 07:24:38.560114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9215069-683c-4180-8df3-89baa393343f> (b9215069-683c-4180-8df3-89baa393343f) [No such file or directory] >[2016-04-19 07:24:38.561360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9215069-683c-4180-8df3-89baa393343f> (b9215069-683c-4180-8df3-89baa393343f) [No such file or directory] >[2016-04-19 07:24:38.561647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9215069-683c-4180-8df3-89baa393343f> (b9215069-683c-4180-8df3-89baa393343f) [No such file or directory] >[2016-04-19 07:24:38.561800] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b9215069-683c-4180-8df3-89baa393343f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.564277] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b9215069-683c-4180-8df3-89baa393343f. (Possible split-brain) >[2016-04-19 07:24:38.565207] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9215069-683c-4180-8df3-89baa393343f> (b9215069-683c-4180-8df3-89baa393343f) [No such file or directory] >[2016-04-19 07:24:38.565309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9215069-683c-4180-8df3-89baa393343f> (b9215069-683c-4180-8df3-89baa393343f) [No such file or directory] >[2016-04-19 07:24:38.567996] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9215069-683c-4180-8df3-89baa393343f> (b9215069-683c-4180-8df3-89baa393343f) [No such file or directory] >[2016-04-19 07:24:38.568098] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9215069-683c-4180-8df3-89baa393343f> (b9215069-683c-4180-8df3-89baa393343f) [No such file or directory] >[2016-04-19 07:24:38.568236] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b9215069-683c-4180-8df3-89baa393343f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.577293] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.578398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44> (ceef452d-cdd7-4d36-8e70-f7ade0979a44) [No such file or directory] >[2016-04-19 07:24:38.578500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44> (ceef452d-cdd7-4d36-8e70-f7ade0979a44) [No such file or directory] >[2016-04-19 07:24:38.581012] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ceef452d-cdd7-4d36-8e70-f7ade0979a44. (Possible split-brain) >[2016-04-19 07:24:38.582123] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44> (ceef452d-cdd7-4d36-8e70-f7ade0979a44) [No such file or directory] >[2016-04-19 07:24:38.582244] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44> (ceef452d-cdd7-4d36-8e70-f7ade0979a44) [No such file or directory] >[2016-04-19 07:24:38.583662] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44> (ceef452d-cdd7-4d36-8e70-f7ade0979a44) [No such file or directory] >[2016-04-19 07:24:38.583759] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44> (ceef452d-cdd7-4d36-8e70-f7ade0979a44) [No such file or directory] >[2016-04-19 07:24:38.583891] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.586405] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ceef452d-cdd7-4d36-8e70-f7ade0979a44. (Possible split-brain) >[2016-04-19 07:24:38.587201] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44> (ceef452d-cdd7-4d36-8e70-f7ade0979a44) [No such file or directory] >[2016-04-19 07:24:38.587568] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44> (ceef452d-cdd7-4d36-8e70-f7ade0979a44) [No such file or directory] >[2016-04-19 07:24:38.590561] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44> (ceef452d-cdd7-4d36-8e70-f7ade0979a44) [No such file or directory] >[2016-04-19 07:24:38.590682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44> (ceef452d-cdd7-4d36-8e70-f7ade0979a44) [No such file or directory] >[2016-04-19 07:24:38.590802] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ceef452d-cdd7-4d36-8e70-f7ade0979a44>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.599442] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.600434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4> (ae8062fb-7723-4c20-b98c-4a660a461db4) [No such file or directory] >[2016-04-19 07:24:38.600451] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4> (ae8062fb-7723-4c20-b98c-4a660a461db4) [No such file or directory] >[2016-04-19 07:24:38.603372] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ae8062fb-7723-4c20-b98c-4a660a461db4. (Possible split-brain) >[2016-04-19 07:24:38.604392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4> (ae8062fb-7723-4c20-b98c-4a660a461db4) [No such file or directory] >[2016-04-19 07:24:38.604712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4> (ae8062fb-7723-4c20-b98c-4a660a461db4) [No such file or directory] >[2016-04-19 07:24:38.605970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4> (ae8062fb-7723-4c20-b98c-4a660a461db4) [No such file or directory] >[2016-04-19 07:24:38.606073] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4> (ae8062fb-7723-4c20-b98c-4a660a461db4) [No such file or directory] >[2016-04-19 07:24:38.606244] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.608781] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ae8062fb-7723-4c20-b98c-4a660a461db4. (Possible split-brain) >[2016-04-19 07:24:38.609928] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4> (ae8062fb-7723-4c20-b98c-4a660a461db4) [No such file or directory] >[2016-04-19 07:24:38.609955] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4> (ae8062fb-7723-4c20-b98c-4a660a461db4) [No such file or directory] >[2016-04-19 07:24:38.612660] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4> (ae8062fb-7723-4c20-b98c-4a660a461db4) [No such file or directory] >[2016-04-19 07:24:38.612762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4> (ae8062fb-7723-4c20-b98c-4a660a461db4) [No such file or directory] >[2016-04-19 07:24:38.612913] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ae8062fb-7723-4c20-b98c-4a660a461db4>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.621663] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.622457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c> (92734f71-acbc-48e8-beef-26d58ff11d9c) [No such file or directory] >[2016-04-19 07:24:38.622836] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c> (92734f71-acbc-48e8-beef-26d58ff11d9c) [No such file or directory] >[2016-04-19 07:24:38.625794] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 92734f71-acbc-48e8-beef-26d58ff11d9c. (Possible split-brain) >[2016-04-19 07:24:38.626919] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c> (92734f71-acbc-48e8-beef-26d58ff11d9c) [No such file or directory] >[2016-04-19 07:24:38.627033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c> (92734f71-acbc-48e8-beef-26d58ff11d9c) [No such file or directory] >[2016-04-19 07:24:38.628300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c> (92734f71-acbc-48e8-beef-26d58ff11d9c) [No such file or directory] >[2016-04-19 07:24:38.628396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c> (92734f71-acbc-48e8-beef-26d58ff11d9c) [No such file or directory] >[2016-04-19 07:24:38.628606] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.631148] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 92734f71-acbc-48e8-beef-26d58ff11d9c. (Possible split-brain) >[2016-04-19 07:24:38.632148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c> (92734f71-acbc-48e8-beef-26d58ff11d9c) [No such file or directory] >[2016-04-19 07:24:38.632180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c> (92734f71-acbc-48e8-beef-26d58ff11d9c) [No such file or directory] >[2016-04-19 07:24:38.634750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c> (92734f71-acbc-48e8-beef-26d58ff11d9c) [No such file or directory] >[2016-04-19 07:24:38.634783] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c> (92734f71-acbc-48e8-beef-26d58ff11d9c) [No such file or directory] >[2016-04-19 07:24:38.634996] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:92734f71-acbc-48e8-beef-26d58ff11d9c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.643363] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.644451] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd> (f3588aaf-ad12-419e-ac55-084a1d5c52fd) [No such file or directory] >[2016-04-19 07:24:38.644535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd> (f3588aaf-ad12-419e-ac55-084a1d5c52fd) [No such file or directory] >[2016-04-19 07:24:38.647424] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f3588aaf-ad12-419e-ac55-084a1d5c52fd. (Possible split-brain) >[2016-04-19 07:24:38.648519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd> (f3588aaf-ad12-419e-ac55-084a1d5c52fd) [No such file or directory] >[2016-04-19 07:24:38.648542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd> (f3588aaf-ad12-419e-ac55-084a1d5c52fd) [No such file or directory] >[2016-04-19 07:24:38.649820] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd> (f3588aaf-ad12-419e-ac55-084a1d5c52fd) [No such file or directory] >[2016-04-19 07:24:38.649943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd> (f3588aaf-ad12-419e-ac55-084a1d5c52fd) [No such file or directory] >[2016-04-19 07:24:38.650118] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.652701] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f3588aaf-ad12-419e-ac55-084a1d5c52fd. (Possible split-brain) >[2016-04-19 07:24:38.653926] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd> (f3588aaf-ad12-419e-ac55-084a1d5c52fd) [No such file or directory] >[2016-04-19 07:24:38.654029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd> (f3588aaf-ad12-419e-ac55-084a1d5c52fd) [No such file or directory] >[2016-04-19 07:24:38.656465] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd> (f3588aaf-ad12-419e-ac55-084a1d5c52fd) [No such file or directory] >[2016-04-19 07:24:38.656760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd> (f3588aaf-ad12-419e-ac55-084a1d5c52fd) [No such file or directory] >[2016-04-19 07:24:38.656920] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f3588aaf-ad12-419e-ac55-084a1d5c52fd>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.666252] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.667254] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8> (a40f27f9-78f8-496b-ba9e-311538f5a5a8) [No such file or directory] >[2016-04-19 07:24:38.667278] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8> (a40f27f9-78f8-496b-ba9e-311538f5a5a8) [No such file or directory] >[2016-04-19 07:24:38.668511] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a40f27f9-78f8-496b-ba9e-311538f5a5a8. (Possible split-brain) >[2016-04-19 07:24:38.669523] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8> (a40f27f9-78f8-496b-ba9e-311538f5a5a8) [No such file or directory] >[2016-04-19 07:24:38.669579] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8> (a40f27f9-78f8-496b-ba9e-311538f5a5a8) [No such file or directory] >[2016-04-19 07:24:38.670622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8> (a40f27f9-78f8-496b-ba9e-311538f5a5a8) [No such file or directory] >[2016-04-19 07:24:38.670768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8> (a40f27f9-78f8-496b-ba9e-311538f5a5a8) [No such file or directory] >[2016-04-19 07:24:38.670972] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.673515] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a40f27f9-78f8-496b-ba9e-311538f5a5a8. (Possible split-brain) >[2016-04-19 07:24:38.674580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8> (a40f27f9-78f8-496b-ba9e-311538f5a5a8) [No such file or directory] >[2016-04-19 07:24:38.674634] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8> (a40f27f9-78f8-496b-ba9e-311538f5a5a8) [No such file or directory] >[2016-04-19 07:24:38.677140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8> (a40f27f9-78f8-496b-ba9e-311538f5a5a8) [No such file or directory] >[2016-04-19 07:24:38.677166] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8> (a40f27f9-78f8-496b-ba9e-311538f5a5a8) [No such file or directory] >[2016-04-19 07:24:38.677553] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a40f27f9-78f8-496b-ba9e-311538f5a5a8>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.685996] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.687119] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:36061519-0d26-42ff-bfe2-e5832b453853> (36061519-0d26-42ff-bfe2-e5832b453853) [No such file or directory] >[2016-04-19 07:24:38.687132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:36061519-0d26-42ff-bfe2-e5832b453853> (36061519-0d26-42ff-bfe2-e5832b453853) [No such file or directory] >[2016-04-19 07:24:38.689892] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 36061519-0d26-42ff-bfe2-e5832b453853. (Possible split-brain) >[2016-04-19 07:24:38.690920] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:36061519-0d26-42ff-bfe2-e5832b453853> (36061519-0d26-42ff-bfe2-e5832b453853) [No such file or directory] >[2016-04-19 07:24:38.690944] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:36061519-0d26-42ff-bfe2-e5832b453853> (36061519-0d26-42ff-bfe2-e5832b453853) [No such file or directory] >[2016-04-19 07:24:38.692153] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:36061519-0d26-42ff-bfe2-e5832b453853> (36061519-0d26-42ff-bfe2-e5832b453853) [No such file or directory] >[2016-04-19 07:24:38.692186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:36061519-0d26-42ff-bfe2-e5832b453853> (36061519-0d26-42ff-bfe2-e5832b453853) [No such file or directory] >[2016-04-19 07:24:38.692678] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:36061519-0d26-42ff-bfe2-e5832b453853>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.695210] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 36061519-0d26-42ff-bfe2-e5832b453853. (Possible split-brain) >[2016-04-19 07:24:38.696356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:36061519-0d26-42ff-bfe2-e5832b453853> (36061519-0d26-42ff-bfe2-e5832b453853) [No such file or directory] >[2016-04-19 07:24:38.696465] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:36061519-0d26-42ff-bfe2-e5832b453853> (36061519-0d26-42ff-bfe2-e5832b453853) [No such file or directory] >[2016-04-19 07:24:38.698794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:36061519-0d26-42ff-bfe2-e5832b453853> (36061519-0d26-42ff-bfe2-e5832b453853) [No such file or directory] >[2016-04-19 07:24:38.698804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:36061519-0d26-42ff-bfe2-e5832b453853> (36061519-0d26-42ff-bfe2-e5832b453853) [No such file or directory] >[2016-04-19 07:24:38.699161] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:36061519-0d26-42ff-bfe2-e5832b453853>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.707404] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.708227] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6> (2d9790e8-99b3-4a52-b249-77238f4e3aa6) [No such file or directory] >[2016-04-19 07:24:38.708275] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6> (2d9790e8-99b3-4a52-b249-77238f4e3aa6) [No such file or directory] >[2016-04-19 07:24:38.709398] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2d9790e8-99b3-4a52-b249-77238f4e3aa6. (Possible split-brain) >[2016-04-19 07:24:38.710363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6> (2d9790e8-99b3-4a52-b249-77238f4e3aa6) [No such file or directory] >[2016-04-19 07:24:38.710385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6> (2d9790e8-99b3-4a52-b249-77238f4e3aa6) [No such file or directory] >[2016-04-19 07:24:38.711443] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6> (2d9790e8-99b3-4a52-b249-77238f4e3aa6) [No such file or directory] >[2016-04-19 07:24:38.711437] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6> (2d9790e8-99b3-4a52-b249-77238f4e3aa6) [No such file or directory] >[2016-04-19 07:24:38.711841] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.714287] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2d9790e8-99b3-4a52-b249-77238f4e3aa6. (Possible split-brain) >[2016-04-19 07:24:38.715192] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6> (2d9790e8-99b3-4a52-b249-77238f4e3aa6) [No such file or directory] >[2016-04-19 07:24:38.715517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6> (2d9790e8-99b3-4a52-b249-77238f4e3aa6) [No such file or directory] >[2016-04-19 07:24:38.717942] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6> (2d9790e8-99b3-4a52-b249-77238f4e3aa6) [No such file or directory] >[2016-04-19 07:24:38.718066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6> (2d9790e8-99b3-4a52-b249-77238f4e3aa6) [No such file or directory] >[2016-04-19 07:24:38.718547] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2d9790e8-99b3-4a52-b249-77238f4e3aa6>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.726622] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.727635] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2> (7e720508-6bc8-4c6c-92f8-d2842a10c0c2) [No such file or directory] >[2016-04-19 07:24:38.727653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2> (7e720508-6bc8-4c6c-92f8-d2842a10c0c2) [No such file or directory] >[2016-04-19 07:24:38.728835] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7e720508-6bc8-4c6c-92f8-d2842a10c0c2. (Possible split-brain) >[2016-04-19 07:24:38.729643] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2> (7e720508-6bc8-4c6c-92f8-d2842a10c0c2) [No such file or directory] >[2016-04-19 07:24:38.729903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2> (7e720508-6bc8-4c6c-92f8-d2842a10c0c2) [No such file or directory] >[2016-04-19 07:24:38.731024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2> (7e720508-6bc8-4c6c-92f8-d2842a10c0c2) [No such file or directory] >[2016-04-19 07:24:38.731294] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2> (7e720508-6bc8-4c6c-92f8-d2842a10c0c2) [No such file or directory] >[2016-04-19 07:24:38.731455] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.733957] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7e720508-6bc8-4c6c-92f8-d2842a10c0c2. (Possible split-brain) >[2016-04-19 07:24:38.734741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2> (7e720508-6bc8-4c6c-92f8-d2842a10c0c2) [No such file or directory] >[2016-04-19 07:24:38.734871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2> (7e720508-6bc8-4c6c-92f8-d2842a10c0c2) [No such file or directory] >[2016-04-19 07:24:38.737520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2> (7e720508-6bc8-4c6c-92f8-d2842a10c0c2) [No such file or directory] >[2016-04-19 07:24:38.737545] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2> (7e720508-6bc8-4c6c-92f8-d2842a10c0c2) [No such file or directory] >[2016-04-19 07:24:38.737750] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7e720508-6bc8-4c6c-92f8-d2842a10c0c2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.746282] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.747041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7> (c5092ad5-b678-4844-83fb-897f58e923f7) [No such file or directory] >[2016-04-19 07:24:38.747343] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7> (c5092ad5-b678-4844-83fb-897f58e923f7) [No such file or directory] >[2016-04-19 07:24:38.749869] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c5092ad5-b678-4844-83fb-897f58e923f7. (Possible split-brain) >[2016-04-19 07:24:38.750815] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7> (c5092ad5-b678-4844-83fb-897f58e923f7) [No such file or directory] >[2016-04-19 07:24:38.751069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7> (c5092ad5-b678-4844-83fb-897f58e923f7) [No such file or directory] >[2016-04-19 07:24:38.752183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7> (c5092ad5-b678-4844-83fb-897f58e923f7) [No such file or directory] >[2016-04-19 07:24:38.752639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7> (c5092ad5-b678-4844-83fb-897f58e923f7) [No such file or directory] >[2016-04-19 07:24:38.752759] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.755191] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c5092ad5-b678-4844-83fb-897f58e923f7. (Possible split-brain) >[2016-04-19 07:24:38.755937] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7> (c5092ad5-b678-4844-83fb-897f58e923f7) [No such file or directory] >[2016-04-19 07:24:38.756378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7> (c5092ad5-b678-4844-83fb-897f58e923f7) [No such file or directory] >[2016-04-19 07:24:38.759007] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7> (c5092ad5-b678-4844-83fb-897f58e923f7) [No such file or directory] >[2016-04-19 07:24:38.759081] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7> (c5092ad5-b678-4844-83fb-897f58e923f7) [No such file or directory] >[2016-04-19 07:24:38.759262] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c5092ad5-b678-4844-83fb-897f58e923f7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.767501] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.768183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46> (67c626bc-33f1-48fe-955c-c5738a842f46) [No such file or directory] >[2016-04-19 07:24:38.768619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46> (67c626bc-33f1-48fe-955c-c5738a842f46) [No such file or directory] >[2016-04-19 07:24:38.771119] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 67c626bc-33f1-48fe-955c-c5738a842f46. (Possible split-brain) >[2016-04-19 07:24:38.771828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46> (67c626bc-33f1-48fe-955c-c5738a842f46) [No such file or directory] >[2016-04-19 07:24:38.772227] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46> (67c626bc-33f1-48fe-955c-c5738a842f46) [No such file or directory] >[2016-04-19 07:24:38.773454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46> (67c626bc-33f1-48fe-955c-c5738a842f46) [No such file or directory] >[2016-04-19 07:24:38.773787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46> (67c626bc-33f1-48fe-955c-c5738a842f46) [No such file or directory] >[2016-04-19 07:24:38.773934] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.776353] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 67c626bc-33f1-48fe-955c-c5738a842f46. (Possible split-brain) >[2016-04-19 07:24:38.777203] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46> (67c626bc-33f1-48fe-955c-c5738a842f46) [No such file or directory] >[2016-04-19 07:24:38.777396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46> (67c626bc-33f1-48fe-955c-c5738a842f46) [No such file or directory] >[2016-04-19 07:24:38.779750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46> (67c626bc-33f1-48fe-955c-c5738a842f46) [No such file or directory] >[2016-04-19 07:24:38.779975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46> (67c626bc-33f1-48fe-955c-c5738a842f46) [No such file or directory] >[2016-04-19 07:24:38.780096] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:67c626bc-33f1-48fe-955c-c5738a842f46>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.788636] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.789759] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421> (42f5242d-b804-43c7-a0e8-9af0e185f421) [No such file or directory] >[2016-04-19 07:24:38.789768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421> (42f5242d-b804-43c7-a0e8-9af0e185f421) [No such file or directory] >[2016-04-19 07:24:38.792466] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 42f5242d-b804-43c7-a0e8-9af0e185f421. (Possible split-brain) >[2016-04-19 07:24:38.793555] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421> (42f5242d-b804-43c7-a0e8-9af0e185f421) [No such file or directory] >[2016-04-19 07:24:38.793673] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421> (42f5242d-b804-43c7-a0e8-9af0e185f421) [No such file or directory] >[2016-04-19 07:24:38.794874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421> (42f5242d-b804-43c7-a0e8-9af0e185f421) [No such file or directory] >[2016-04-19 07:24:38.795010] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421> (42f5242d-b804-43c7-a0e8-9af0e185f421) [No such file or directory] >[2016-04-19 07:24:38.795185] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.797746] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 42f5242d-b804-43c7-a0e8-9af0e185f421. (Possible split-brain) >[2016-04-19 07:24:38.798734] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421> (42f5242d-b804-43c7-a0e8-9af0e185f421) [No such file or directory] >[2016-04-19 07:24:38.799028] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421> (42f5242d-b804-43c7-a0e8-9af0e185f421) [No such file or directory] >[2016-04-19 07:24:38.801445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421> (42f5242d-b804-43c7-a0e8-9af0e185f421) [No such file or directory] >[2016-04-19 07:24:38.801475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421> (42f5242d-b804-43c7-a0e8-9af0e185f421) [No such file or directory] >[2016-04-19 07:24:38.801754] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:42f5242d-b804-43c7-a0e8-9af0e185f421>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.809377] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.810111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522> (7d5a83b1-5be1-4096-984a-7ca8733ef522) [No such file or directory] >[2016-04-19 07:24:38.810345] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522> (7d5a83b1-5be1-4096-984a-7ca8733ef522) [No such file or directory] >[2016-04-19 07:24:38.812933] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7d5a83b1-5be1-4096-984a-7ca8733ef522. (Possible split-brain) >[2016-04-19 07:24:38.813996] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522> (7d5a83b1-5be1-4096-984a-7ca8733ef522) [No such file or directory] >[2016-04-19 07:24:38.814106] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522> (7d5a83b1-5be1-4096-984a-7ca8733ef522) [No such file or directory] >[2016-04-19 07:24:38.815233] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522> (7d5a83b1-5be1-4096-984a-7ca8733ef522) [No such file or directory] >[2016-04-19 07:24:38.815549] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522> (7d5a83b1-5be1-4096-984a-7ca8733ef522) [No such file or directory] >[2016-04-19 07:24:38.815711] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.818204] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7d5a83b1-5be1-4096-984a-7ca8733ef522. (Possible split-brain) >[2016-04-19 07:24:38.819381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522> (7d5a83b1-5be1-4096-984a-7ca8733ef522) [No such file or directory] >[2016-04-19 07:24:38.819509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522> (7d5a83b1-5be1-4096-984a-7ca8733ef522) [No such file or directory] >[2016-04-19 07:24:38.822159] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522> (7d5a83b1-5be1-4096-984a-7ca8733ef522) [No such file or directory] >[2016-04-19 07:24:38.822389] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522> (7d5a83b1-5be1-4096-984a-7ca8733ef522) [No such file or directory] >[2016-04-19 07:24:38.822600] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7d5a83b1-5be1-4096-984a-7ca8733ef522>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.830449] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.831180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc> (c5ac1a4c-183e-4735-83db-e03849e1cffc) [No such file or directory] >[2016-04-19 07:24:38.831546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc> (c5ac1a4c-183e-4735-83db-e03849e1cffc) [No such file or directory] >[2016-04-19 07:24:38.832489] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c5ac1a4c-183e-4735-83db-e03849e1cffc. (Possible split-brain) >[2016-04-19 07:24:38.833155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc> (c5ac1a4c-183e-4735-83db-e03849e1cffc) [No such file or directory] >[2016-04-19 07:24:38.833617] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc> (c5ac1a4c-183e-4735-83db-e03849e1cffc) [No such file or directory] >[2016-04-19 07:24:38.834859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc> (c5ac1a4c-183e-4735-83db-e03849e1cffc) [No such file or directory] >[2016-04-19 07:24:38.835128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc> (c5ac1a4c-183e-4735-83db-e03849e1cffc) [No such file or directory] >[2016-04-19 07:24:38.835261] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.837730] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c5ac1a4c-183e-4735-83db-e03849e1cffc. (Possible split-brain) >[2016-04-19 07:24:38.838456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc> (c5ac1a4c-183e-4735-83db-e03849e1cffc) [No such file or directory] >[2016-04-19 07:24:38.838561] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc> (c5ac1a4c-183e-4735-83db-e03849e1cffc) [No such file or directory] >[2016-04-19 07:24:38.841267] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc> (c5ac1a4c-183e-4735-83db-e03849e1cffc) [No such file or directory] >[2016-04-19 07:24:38.841508] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc> (c5ac1a4c-183e-4735-83db-e03849e1cffc) [No such file or directory] >[2016-04-19 07:24:38.841730] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c5ac1a4c-183e-4735-83db-e03849e1cffc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.849691] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.850503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb> (720ca7a3-0038-4e4e-b89f-e9d44156f6cb) [No such file or directory] >[2016-04-19 07:24:38.850619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb> (720ca7a3-0038-4e4e-b89f-e9d44156f6cb) [No such file or directory] >[2016-04-19 07:24:38.851460] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 720ca7a3-0038-4e4e-b89f-e9d44156f6cb. (Possible split-brain) >[2016-04-19 07:24:38.852311] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb> (720ca7a3-0038-4e4e-b89f-e9d44156f6cb) [No such file or directory] >[2016-04-19 07:24:38.852796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb> (720ca7a3-0038-4e4e-b89f-e9d44156f6cb) [No such file or directory] >[2016-04-19 07:24:38.854112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb> (720ca7a3-0038-4e4e-b89f-e9d44156f6cb) [No such file or directory] >[2016-04-19 07:24:38.854423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb> (720ca7a3-0038-4e4e-b89f-e9d44156f6cb) [No such file or directory] >[2016-04-19 07:24:38.854551] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.857031] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 720ca7a3-0038-4e4e-b89f-e9d44156f6cb. (Possible split-brain) >[2016-04-19 07:24:38.858050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb> (720ca7a3-0038-4e4e-b89f-e9d44156f6cb) [No such file or directory] >[2016-04-19 07:24:38.858225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb> (720ca7a3-0038-4e4e-b89f-e9d44156f6cb) [No such file or directory] >[2016-04-19 07:24:38.860766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb> (720ca7a3-0038-4e4e-b89f-e9d44156f6cb) [No such file or directory] >[2016-04-19 07:24:38.860874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb> (720ca7a3-0038-4e4e-b89f-e9d44156f6cb) [No such file or directory] >[2016-04-19 07:24:38.861027] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:720ca7a3-0038-4e4e-b89f-e9d44156f6cb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:38.869598] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.870626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27> (0d9814d5-5902-42e8-a53b-dd80922d4b27) [No such file or directory] >[2016-04-19 07:24:38.870830] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27> (0d9814d5-5902-42e8-a53b-dd80922d4b27) [No such file or directory] >[2016-04-19 07:24:38.873372] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0d9814d5-5902-42e8-a53b-dd80922d4b27. (Possible split-brain) >[2016-04-19 07:24:38.874415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27> (0d9814d5-5902-42e8-a53b-dd80922d4b27) [No such file or directory] >[2016-04-19 07:24:38.874417] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27> (0d9814d5-5902-42e8-a53b-dd80922d4b27) [No such file or directory] >[2016-04-19 07:24:38.875409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27> (0d9814d5-5902-42e8-a53b-dd80922d4b27) [No such file or directory] >[2016-04-19 07:24:38.875838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27> (0d9814d5-5902-42e8-a53b-dd80922d4b27) [No such file or directory] >[2016-04-19 07:24:38.876025] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.878502] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0d9814d5-5902-42e8-a53b-dd80922d4b27. (Possible split-brain) >[2016-04-19 07:24:38.879473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27> (0d9814d5-5902-42e8-a53b-dd80922d4b27) [No such file or directory] >[2016-04-19 07:24:38.879564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27> (0d9814d5-5902-42e8-a53b-dd80922d4b27) [No such file or directory] >[2016-04-19 07:24:38.881754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27> (0d9814d5-5902-42e8-a53b-dd80922d4b27) [No such file or directory] >[2016-04-19 07:24:38.882061] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27> (0d9814d5-5902-42e8-a53b-dd80922d4b27) [No such file or directory] >[2016-04-19 07:24:38.882292] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0d9814d5-5902-42e8-a53b-dd80922d4b27>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.890531] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.891390] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b> (b8b568e0-35a2-4ba8-a0d6-552a88a4695b) [No such file or directory] >[2016-04-19 07:24:38.891491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b> (b8b568e0-35a2-4ba8-a0d6-552a88a4695b) [No such file or directory] >[2016-04-19 07:24:38.892393] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b8b568e0-35a2-4ba8-a0d6-552a88a4695b. (Possible split-brain) >[2016-04-19 07:24:38.893547] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b> (b8b568e0-35a2-4ba8-a0d6-552a88a4695b) [No such file or directory] >[2016-04-19 07:24:38.893843] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b> (b8b568e0-35a2-4ba8-a0d6-552a88a4695b) [No such file or directory] >[2016-04-19 07:24:38.895017] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b> (b8b568e0-35a2-4ba8-a0d6-552a88a4695b) [No such file or directory] >[2016-04-19 07:24:38.895379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b> (b8b568e0-35a2-4ba8-a0d6-552a88a4695b) [No such file or directory] >[2016-04-19 07:24:38.895543] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.897997] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b8b568e0-35a2-4ba8-a0d6-552a88a4695b. (Possible split-brain) >[2016-04-19 07:24:38.899006] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b> (b8b568e0-35a2-4ba8-a0d6-552a88a4695b) [No such file or directory] >[2016-04-19 07:24:38.899126] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b> (b8b568e0-35a2-4ba8-a0d6-552a88a4695b) [No such file or directory] >[2016-04-19 07:24:38.900928] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b> (b8b568e0-35a2-4ba8-a0d6-552a88a4695b) [No such file or directory] >[2016-04-19 07:24:38.901160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b> (b8b568e0-35a2-4ba8-a0d6-552a88a4695b) [No such file or directory] >[2016-04-19 07:24:38.901502] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b8b568e0-35a2-4ba8-a0d6-552a88a4695b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.910928] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.911331] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9> (6c43e595-816a-4e55-9dc8-e51b4b49fbf9) [No such file or directory] >[2016-04-19 07:24:38.911865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9> (6c43e595-816a-4e55-9dc8-e51b4b49fbf9) [No such file or directory] >[2016-04-19 07:24:38.912418] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6c43e595-816a-4e55-9dc8-e51b4b49fbf9. (Possible split-brain) >[2016-04-19 07:24:38.912883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9> (6c43e595-816a-4e55-9dc8-e51b4b49fbf9) [No such file or directory] >[2016-04-19 07:24:38.913179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9> (6c43e595-816a-4e55-9dc8-e51b4b49fbf9) [No such file or directory] >[2016-04-19 07:24:38.914463] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9> (6c43e595-816a-4e55-9dc8-e51b4b49fbf9) [No such file or directory] >[2016-04-19 07:24:38.914862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9> (6c43e595-816a-4e55-9dc8-e51b4b49fbf9) [No such file or directory] >[2016-04-19 07:24:38.915045] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:38.917557] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6c43e595-816a-4e55-9dc8-e51b4b49fbf9. (Possible split-brain) >[2016-04-19 07:24:38.918778] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9> (6c43e595-816a-4e55-9dc8-e51b4b49fbf9) [No such file or directory] >[2016-04-19 07:24:38.918772] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9> (6c43e595-816a-4e55-9dc8-e51b4b49fbf9) [No such file or directory] >[2016-04-19 07:24:38.921155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9> (6c43e595-816a-4e55-9dc8-e51b4b49fbf9) [No such file or directory] >[2016-04-19 07:24:38.921198] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9> (6c43e595-816a-4e55-9dc8-e51b4b49fbf9) [No such file or directory] >[2016-04-19 07:24:38.921397] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6c43e595-816a-4e55-9dc8-e51b4b49fbf9>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.934219] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.935429] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5> (9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5) [No such file or directory] >[2016-04-19 07:24:38.935534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5> (9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5) [No such file or directory] >[2016-04-19 07:24:38.936482] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5. (Possible split-brain) >[2016-04-19 07:24:38.937398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5> (9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5) [No such file or directory] >[2016-04-19 07:24:38.937552] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5> (9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5) [No such file or directory] >[2016-04-19 07:24:38.939367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5> (9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5) [No such file or directory] >[2016-04-19 07:24:38.939460] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5> (9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5) [No such file or directory] >[2016-04-19 07:24:38.940700] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.942582] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5. (Possible split-brain) >[2016-04-19 07:24:38.943695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5> (9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5) [No such file or directory] >[2016-04-19 07:24:38.943710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5> (9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5) [No such file or directory] >[2016-04-19 07:24:38.946415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5> (9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5) [No such file or directory] >[2016-04-19 07:24:38.946705] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5> (9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5) [No such file or directory] >[2016-04-19 07:24:38.946811] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9d736e9a-1bf2-4cc7-a578-e31c6a62b7b5>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.955804] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.956816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce> (8b9b5859-182e-4468-8fa5-e324947568ce) [No such file or directory] >[2016-04-19 07:24:38.956991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce> (8b9b5859-182e-4468-8fa5-e324947568ce) [No such file or directory] >[2016-04-19 07:24:38.959621] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8b9b5859-182e-4468-8fa5-e324947568ce. (Possible split-brain) >[2016-04-19 07:24:38.960892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce> (8b9b5859-182e-4468-8fa5-e324947568ce) [No such file or directory] >[2016-04-19 07:24:38.960983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce> (8b9b5859-182e-4468-8fa5-e324947568ce) [No such file or directory] >[2016-04-19 07:24:38.962098] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce> (8b9b5859-182e-4468-8fa5-e324947568ce) [No such file or directory] >[2016-04-19 07:24:38.962272] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce> (8b9b5859-182e-4468-8fa5-e324947568ce) [No such file or directory] >[2016-04-19 07:24:38.962598] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.965072] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8b9b5859-182e-4468-8fa5-e324947568ce. (Possible split-brain) >[2016-04-19 07:24:38.966004] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce> (8b9b5859-182e-4468-8fa5-e324947568ce) [No such file or directory] >[2016-04-19 07:24:38.966210] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce> (8b9b5859-182e-4468-8fa5-e324947568ce) [No such file or directory] >[2016-04-19 07:24:38.968768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce> (8b9b5859-182e-4468-8fa5-e324947568ce) [No such file or directory] >[2016-04-19 07:24:38.968859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce> (8b9b5859-182e-4468-8fa5-e324947568ce) [No such file or directory] >[2016-04-19 07:24:38.969369] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8b9b5859-182e-4468-8fa5-e324947568ce>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.977146] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:38.978273] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad> (c42a4b08-ce80-48ee-8450-2c0d629056ad) [No such file or directory] >[2016-04-19 07:24:38.978384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad> (c42a4b08-ce80-48ee-8450-2c0d629056ad) [No such file or directory] >[2016-04-19 07:24:38.980909] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c42a4b08-ce80-48ee-8450-2c0d629056ad. (Possible split-brain) >[2016-04-19 07:24:38.982022] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad> (c42a4b08-ce80-48ee-8450-2c0d629056ad) [No such file or directory] >[2016-04-19 07:24:38.982098] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad> (c42a4b08-ce80-48ee-8450-2c0d629056ad) [No such file or directory] >[2016-04-19 07:24:38.983354] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad> (c42a4b08-ce80-48ee-8450-2c0d629056ad) [No such file or directory] >[2016-04-19 07:24:38.983437] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad> (c42a4b08-ce80-48ee-8450-2c0d629056ad) [No such file or directory] >[2016-04-19 07:24:38.983616] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:38.986116] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c42a4b08-ce80-48ee-8450-2c0d629056ad. (Possible split-brain) >[2016-04-19 07:24:38.987097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad> (c42a4b08-ce80-48ee-8450-2c0d629056ad) [No such file or directory] >[2016-04-19 07:24:38.987107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad> (c42a4b08-ce80-48ee-8450-2c0d629056ad) [No such file or directory] >[2016-04-19 07:24:38.989778] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad> (c42a4b08-ce80-48ee-8450-2c0d629056ad) [No such file or directory] >[2016-04-19 07:24:38.989804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad> (c42a4b08-ce80-48ee-8450-2c0d629056ad) [No such file or directory] >[2016-04-19 07:24:38.990488] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c42a4b08-ce80-48ee-8450-2c0d629056ad>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:38.999877] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.000988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00c7224e-e937-4e71-938c-cb73e62db680> (00c7224e-e937-4e71-938c-cb73e62db680) [No such file or directory] >[2016-04-19 07:24:39.001101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00c7224e-e937-4e71-938c-cb73e62db680> (00c7224e-e937-4e71-938c-cb73e62db680) [No such file or directory] >[2016-04-19 07:24:39.001952] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 00c7224e-e937-4e71-938c-cb73e62db680. (Possible split-brain) >[2016-04-19 07:24:39.002702] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00c7224e-e937-4e71-938c-cb73e62db680> (00c7224e-e937-4e71-938c-cb73e62db680) [No such file or directory] >[2016-04-19 07:24:39.003084] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00c7224e-e937-4e71-938c-cb73e62db680> (00c7224e-e937-4e71-938c-cb73e62db680) [No such file or directory] >[2016-04-19 07:24:39.004356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00c7224e-e937-4e71-938c-cb73e62db680> (00c7224e-e937-4e71-938c-cb73e62db680) [No such file or directory] >[2016-04-19 07:24:39.004661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00c7224e-e937-4e71-938c-cb73e62db680> (00c7224e-e937-4e71-938c-cb73e62db680) [No such file or directory] >[2016-04-19 07:24:39.004835] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:00c7224e-e937-4e71-938c-cb73e62db680>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.007256] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 00c7224e-e937-4e71-938c-cb73e62db680. (Possible split-brain) >[2016-04-19 07:24:39.007975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00c7224e-e937-4e71-938c-cb73e62db680> (00c7224e-e937-4e71-938c-cb73e62db680) [No such file or directory] >[2016-04-19 07:24:39.008384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00c7224e-e937-4e71-938c-cb73e62db680> (00c7224e-e937-4e71-938c-cb73e62db680) [No such file or directory] >[2016-04-19 07:24:39.010904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00c7224e-e937-4e71-938c-cb73e62db680> (00c7224e-e937-4e71-938c-cb73e62db680) [No such file or directory] >[2016-04-19 07:24:39.011273] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00c7224e-e937-4e71-938c-cb73e62db680> (00c7224e-e937-4e71-938c-cb73e62db680) [No such file or directory] >[2016-04-19 07:24:39.011512] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:00c7224e-e937-4e71-938c-cb73e62db680>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.019408] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.020091] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ab85208a-6f51-488e-a209-b219ce351db5> (ab85208a-6f51-488e-a209-b219ce351db5) [No such file or directory] >[2016-04-19 07:24:39.020574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ab85208a-6f51-488e-a209-b219ce351db5> (ab85208a-6f51-488e-a209-b219ce351db5) [No such file or directory] >[2016-04-19 07:24:39.021470] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ab85208a-6f51-488e-a209-b219ce351db5. (Possible split-brain) >[2016-04-19 07:24:39.022297] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ab85208a-6f51-488e-a209-b219ce351db5> (ab85208a-6f51-488e-a209-b219ce351db5) [No such file or directory] >[2016-04-19 07:24:39.022420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ab85208a-6f51-488e-a209-b219ce351db5> (ab85208a-6f51-488e-a209-b219ce351db5) [No such file or directory] >[2016-04-19 07:24:39.023593] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ab85208a-6f51-488e-a209-b219ce351db5> (ab85208a-6f51-488e-a209-b219ce351db5) [No such file or directory] >[2016-04-19 07:24:39.023749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ab85208a-6f51-488e-a209-b219ce351db5> (ab85208a-6f51-488e-a209-b219ce351db5) [No such file or directory] >[2016-04-19 07:24:39.023871] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ab85208a-6f51-488e-a209-b219ce351db5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.026363] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ab85208a-6f51-488e-a209-b219ce351db5. (Possible split-brain) >[2016-04-19 07:24:39.027087] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ab85208a-6f51-488e-a209-b219ce351db5> (ab85208a-6f51-488e-a209-b219ce351db5) [No such file or directory] >[2016-04-19 07:24:39.027536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ab85208a-6f51-488e-a209-b219ce351db5> (ab85208a-6f51-488e-a209-b219ce351db5) [No such file or directory] >[2016-04-19 07:24:39.030197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ab85208a-6f51-488e-a209-b219ce351db5> (ab85208a-6f51-488e-a209-b219ce351db5) [No such file or directory] >[2016-04-19 07:24:39.030558] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ab85208a-6f51-488e-a209-b219ce351db5> (ab85208a-6f51-488e-a209-b219ce351db5) [No such file or directory] >[2016-04-19 07:24:39.030727] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ab85208a-6f51-488e-a209-b219ce351db5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.038625] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.039653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2> (2c7991a9-e182-44fd-8687-9c7566832bd2) [No such file or directory] >[2016-04-19 07:24:39.039743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2> (2c7991a9-e182-44fd-8687-9c7566832bd2) [No such file or directory] >[2016-04-19 07:24:39.042210] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2c7991a9-e182-44fd-8687-9c7566832bd2. (Possible split-brain) >[2016-04-19 07:24:39.043252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2> (2c7991a9-e182-44fd-8687-9c7566832bd2) [No such file or directory] >[2016-04-19 07:24:39.043261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2> (2c7991a9-e182-44fd-8687-9c7566832bd2) [No such file or directory] >[2016-04-19 07:24:39.044478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2> (2c7991a9-e182-44fd-8687-9c7566832bd2) [No such file or directory] >[2016-04-19 07:24:39.044689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2> (2c7991a9-e182-44fd-8687-9c7566832bd2) [No such file or directory] >[2016-04-19 07:24:39.044793] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.047309] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2c7991a9-e182-44fd-8687-9c7566832bd2. (Possible split-brain) >[2016-04-19 07:24:39.048355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2> (2c7991a9-e182-44fd-8687-9c7566832bd2) [No such file or directory] >[2016-04-19 07:24:39.048593] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2> (2c7991a9-e182-44fd-8687-9c7566832bd2) [No such file or directory] >[2016-04-19 07:24:39.051374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2> (2c7991a9-e182-44fd-8687-9c7566832bd2) [No such file or directory] >[2016-04-19 07:24:39.051398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2> (2c7991a9-e182-44fd-8687-9c7566832bd2) [No such file or directory] >[2016-04-19 07:24:39.051711] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2c7991a9-e182-44fd-8687-9c7566832bd2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.059373] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.060221] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3> (65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3) [No such file or directory] >[2016-04-19 07:24:39.060493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3> (65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3) [No such file or directory] >[2016-04-19 07:24:39.061373] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3. (Possible split-brain) >[2016-04-19 07:24:39.062758] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3> (65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3) [No such file or directory] >[2016-04-19 07:24:39.062852] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3> (65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3) [No such file or directory] >[2016-04-19 07:24:39.064202] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3> (65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3) [No such file or directory] >[2016-04-19 07:24:39.064232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3> (65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3) [No such file or directory] >[2016-04-19 07:24:39.064448] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:39.066906] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3. (Possible split-brain) >[2016-04-19 07:24:39.067970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3> (65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3) [No such file or directory] >[2016-04-19 07:24:39.068257] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3> (65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3) [No such file or directory] >[2016-04-19 07:24:39.071010] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3> (65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3) [No such file or directory] >[2016-04-19 07:24:39.071163] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3> (65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3) [No such file or directory] >[2016-04-19 07:24:39.071464] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:65298a62-4cd5-4b08-8cb6-69d4f1e0c0e3>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.080295] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.081351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20> (20be42ab-ca95-4d1a-8225-affeba08cb20) [No such file or directory] >[2016-04-19 07:24:39.081457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20> (20be42ab-ca95-4d1a-8225-affeba08cb20) [No such file or directory] >[2016-04-19 07:24:39.082342] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 20be42ab-ca95-4d1a-8225-affeba08cb20. (Possible split-brain) >[2016-04-19 07:24:39.083265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20> (20be42ab-ca95-4d1a-8225-affeba08cb20) [No such file or directory] >[2016-04-19 07:24:39.083389] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20> (20be42ab-ca95-4d1a-8225-affeba08cb20) [No such file or directory] >[2016-04-19 07:24:39.084666] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20> (20be42ab-ca95-4d1a-8225-affeba08cb20) [No such file or directory] >[2016-04-19 07:24:39.084773] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20> (20be42ab-ca95-4d1a-8225-affeba08cb20) [No such file or directory] >[2016-04-19 07:24:39.084985] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.087421] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 20be42ab-ca95-4d1a-8225-affeba08cb20. (Possible split-brain) >[2016-04-19 07:24:39.088561] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20> (20be42ab-ca95-4d1a-8225-affeba08cb20) [No such file or directory] >[2016-04-19 07:24:39.088871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20> (20be42ab-ca95-4d1a-8225-affeba08cb20) [No such file or directory] >[2016-04-19 07:24:39.091671] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20> (20be42ab-ca95-4d1a-8225-affeba08cb20) [No such file or directory] >[2016-04-19 07:24:39.091760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20> (20be42ab-ca95-4d1a-8225-affeba08cb20) [No such file or directory] >[2016-04-19 07:24:39.091943] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:20be42ab-ca95-4d1a-8225-affeba08cb20>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.101037] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.102147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de> (ad8aa44f-0cf2-468c-98c7-081dddda03de) [No such file or directory] >[2016-04-19 07:24:39.102155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de> (ad8aa44f-0cf2-468c-98c7-081dddda03de) [No such file or directory] >[2016-04-19 07:24:39.104781] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ad8aa44f-0cf2-468c-98c7-081dddda03de. (Possible split-brain) >[2016-04-19 07:24:39.105794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de> (ad8aa44f-0cf2-468c-98c7-081dddda03de) [No such file or directory] >[2016-04-19 07:24:39.105864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de> (ad8aa44f-0cf2-468c-98c7-081dddda03de) [No such file or directory] >[2016-04-19 07:24:39.107342] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de> (ad8aa44f-0cf2-468c-98c7-081dddda03de) [No such file or directory] >[2016-04-19 07:24:39.107378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de> (ad8aa44f-0cf2-468c-98c7-081dddda03de) [No such file or directory] >[2016-04-19 07:24:39.107544] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.110115] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ad8aa44f-0cf2-468c-98c7-081dddda03de. (Possible split-brain) >[2016-04-19 07:24:39.111198] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de> (ad8aa44f-0cf2-468c-98c7-081dddda03de) [No such file or directory] >[2016-04-19 07:24:39.111298] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de> (ad8aa44f-0cf2-468c-98c7-081dddda03de) [No such file or directory] >[2016-04-19 07:24:39.113764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de> (ad8aa44f-0cf2-468c-98c7-081dddda03de) [No such file or directory] >[2016-04-19 07:24:39.114048] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de> (ad8aa44f-0cf2-468c-98c7-081dddda03de) [No such file or directory] >[2016-04-19 07:24:39.114167] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ad8aa44f-0cf2-468c-98c7-081dddda03de>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.122728] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.123700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc> (6379b7ec-3f34-4da0-ac43-2ee5d448c5cc) [No such file or directory] >[2016-04-19 07:24:39.123719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc> (6379b7ec-3f34-4da0-ac43-2ee5d448c5cc) [No such file or directory] >[2016-04-19 07:24:39.125189] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6379b7ec-3f34-4da0-ac43-2ee5d448c5cc. (Possible split-brain) >[2016-04-19 07:24:39.126168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc> (6379b7ec-3f34-4da0-ac43-2ee5d448c5cc) [No such file or directory] >[2016-04-19 07:24:39.126451] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc> (6379b7ec-3f34-4da0-ac43-2ee5d448c5cc) [No such file or directory] >[2016-04-19 07:24:39.127876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc> (6379b7ec-3f34-4da0-ac43-2ee5d448c5cc) [No such file or directory] >[2016-04-19 07:24:39.127907] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc> (6379b7ec-3f34-4da0-ac43-2ee5d448c5cc) [No such file or directory] >[2016-04-19 07:24:39.128121] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.130605] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6379b7ec-3f34-4da0-ac43-2ee5d448c5cc. (Possible split-brain) >[2016-04-19 07:24:39.131618] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc> (6379b7ec-3f34-4da0-ac43-2ee5d448c5cc) [No such file or directory] >[2016-04-19 07:24:39.131929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc> (6379b7ec-3f34-4da0-ac43-2ee5d448c5cc) [No such file or directory] >[2016-04-19 07:24:39.134753] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc> (6379b7ec-3f34-4da0-ac43-2ee5d448c5cc) [No such file or directory] >[2016-04-19 07:24:39.134757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc> (6379b7ec-3f34-4da0-ac43-2ee5d448c5cc) [No such file or directory] >[2016-04-19 07:24:39.134913] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6379b7ec-3f34-4da0-ac43-2ee5d448c5cc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.143571] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.144653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1> (8f0d254f-4c70-4663-976b-8efaef59e6a1) [No such file or directory] >[2016-04-19 07:24:39.144711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1> (8f0d254f-4c70-4663-976b-8efaef59e6a1) [No such file or directory] >[2016-04-19 07:24:39.147288] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8f0d254f-4c70-4663-976b-8efaef59e6a1. (Possible split-brain) >[2016-04-19 07:24:39.148366] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1> (8f0d254f-4c70-4663-976b-8efaef59e6a1) [No such file or directory] >[2016-04-19 07:24:39.148293] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1> (8f0d254f-4c70-4663-976b-8efaef59e6a1) [No such file or directory] >[2016-04-19 07:24:39.150235] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1> (8f0d254f-4c70-4663-976b-8efaef59e6a1) [No such file or directory] >[2016-04-19 07:24:39.150436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1> (8f0d254f-4c70-4663-976b-8efaef59e6a1) [No such file or directory] >[2016-04-19 07:24:39.150680] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.153219] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8f0d254f-4c70-4663-976b-8efaef59e6a1. (Possible split-brain) >[2016-04-19 07:24:39.154436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1> (8f0d254f-4c70-4663-976b-8efaef59e6a1) [No such file or directory] >[2016-04-19 07:24:39.154596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1> (8f0d254f-4c70-4663-976b-8efaef59e6a1) [No such file or directory] >[2016-04-19 07:24:39.157297] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1> (8f0d254f-4c70-4663-976b-8efaef59e6a1) [No such file or directory] >[2016-04-19 07:24:39.157419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1> (8f0d254f-4c70-4663-976b-8efaef59e6a1) [No such file or directory] >[2016-04-19 07:24:39.157558] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8f0d254f-4c70-4663-976b-8efaef59e6a1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.166299] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.167432] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e> (d922a405-3c15-4b9f-9153-5f6c74d7b46e) [No such file or directory] >[2016-04-19 07:24:39.167468] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e> (d922a405-3c15-4b9f-9153-5f6c74d7b46e) [No such file or directory] >[2016-04-19 07:24:39.168591] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d922a405-3c15-4b9f-9153-5f6c74d7b46e. (Possible split-brain) >[2016-04-19 07:24:39.169622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e> (d922a405-3c15-4b9f-9153-5f6c74d7b46e) [No such file or directory] >[2016-04-19 07:24:39.169939] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e> (d922a405-3c15-4b9f-9153-5f6c74d7b46e) [No such file or directory] >[2016-04-19 07:24:39.171279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e> (d922a405-3c15-4b9f-9153-5f6c74d7b46e) [No such file or directory] >[2016-04-19 07:24:39.171435] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e> (d922a405-3c15-4b9f-9153-5f6c74d7b46e) [No such file or directory] >[2016-04-19 07:24:39.171775] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:39.174215] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d922a405-3c15-4b9f-9153-5f6c74d7b46e. (Possible split-brain) >[2016-04-19 07:24:39.175250] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e> (d922a405-3c15-4b9f-9153-5f6c74d7b46e) [No such file or directory] >[2016-04-19 07:24:39.175259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e> (d922a405-3c15-4b9f-9153-5f6c74d7b46e) [No such file or directory] >[2016-04-19 07:24:39.177806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e> (d922a405-3c15-4b9f-9153-5f6c74d7b46e) [No such file or directory] >[2016-04-19 07:24:39.177973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e> (d922a405-3c15-4b9f-9153-5f6c74d7b46e) [No such file or directory] >[2016-04-19 07:24:39.178141] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d922a405-3c15-4b9f-9153-5f6c74d7b46e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.186303] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.187464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587> (219bd7ad-f9a5-47e3-89ae-5dea4b82b587) [No such file or directory] >[2016-04-19 07:24:39.187494] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587> (219bd7ad-f9a5-47e3-89ae-5dea4b82b587) [No such file or directory] >[2016-04-19 07:24:39.190100] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 219bd7ad-f9a5-47e3-89ae-5dea4b82b587. (Possible split-brain) >[2016-04-19 07:24:39.191149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587> (219bd7ad-f9a5-47e3-89ae-5dea4b82b587) [No such file or directory] >[2016-04-19 07:24:39.191242] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587> (219bd7ad-f9a5-47e3-89ae-5dea4b82b587) [No such file or directory] >[2016-04-19 07:24:39.192727] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587> (219bd7ad-f9a5-47e3-89ae-5dea4b82b587) [No such file or directory] >[2016-04-19 07:24:39.192737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587> (219bd7ad-f9a5-47e3-89ae-5dea4b82b587) [No such file or directory] >[2016-04-19 07:24:39.192967] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.195511] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 219bd7ad-f9a5-47e3-89ae-5dea4b82b587. (Possible split-brain) >[2016-04-19 07:24:39.196530] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587> (219bd7ad-f9a5-47e3-89ae-5dea4b82b587) [No such file or directory] >[2016-04-19 07:24:39.196791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587> (219bd7ad-f9a5-47e3-89ae-5dea4b82b587) [No such file or directory] >[2016-04-19 07:24:39.199394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587> (219bd7ad-f9a5-47e3-89ae-5dea4b82b587) [No such file or directory] >[2016-04-19 07:24:39.199492] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587> (219bd7ad-f9a5-47e3-89ae-5dea4b82b587) [No such file or directory] >[2016-04-19 07:24:39.199657] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:219bd7ad-f9a5-47e3-89ae-5dea4b82b587>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.208146] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.208953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735> (1213823f-14d7-454e-8cd1-e0ae64ae1735) [No such file or directory] >[2016-04-19 07:24:39.209302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735> (1213823f-14d7-454e-8cd1-e0ae64ae1735) [No such file or directory] >[2016-04-19 07:24:39.210482] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1213823f-14d7-454e-8cd1-e0ae64ae1735. (Possible split-brain) >[2016-04-19 07:24:39.211408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735> (1213823f-14d7-454e-8cd1-e0ae64ae1735) [No such file or directory] >[2016-04-19 07:24:39.211772] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735> (1213823f-14d7-454e-8cd1-e0ae64ae1735) [No such file or directory] >[2016-04-19 07:24:39.212932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735> (1213823f-14d7-454e-8cd1-e0ae64ae1735) [No such file or directory] >[2016-04-19 07:24:39.213053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735> (1213823f-14d7-454e-8cd1-e0ae64ae1735) [No such file or directory] >[2016-04-19 07:24:39.213474] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:39.215931] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1213823f-14d7-454e-8cd1-e0ae64ae1735. (Possible split-brain) >[2016-04-19 07:24:39.216932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735> (1213823f-14d7-454e-8cd1-e0ae64ae1735) [No such file or directory] >[2016-04-19 07:24:39.217356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735> (1213823f-14d7-454e-8cd1-e0ae64ae1735) [No such file or directory] >[2016-04-19 07:24:39.220392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735> (1213823f-14d7-454e-8cd1-e0ae64ae1735) [No such file or directory] >[2016-04-19 07:24:39.220491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735> (1213823f-14d7-454e-8cd1-e0ae64ae1735) [No such file or directory] >[2016-04-19 07:24:39.220601] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1213823f-14d7-454e-8cd1-e0ae64ae1735>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.228302] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.229519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6> (33d1beea-0f01-4ae1-8135-9bdcfdd7bff6) [No such file or directory] >[2016-04-19 07:24:39.229727] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6> (33d1beea-0f01-4ae1-8135-9bdcfdd7bff6) [No such file or directory] >[2016-04-19 07:24:39.232665] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 33d1beea-0f01-4ae1-8135-9bdcfdd7bff6. (Possible split-brain) >[2016-04-19 07:24:39.233485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6> (33d1beea-0f01-4ae1-8135-9bdcfdd7bff6) [No such file or directory] >[2016-04-19 07:24:39.233800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6> (33d1beea-0f01-4ae1-8135-9bdcfdd7bff6) [No such file or directory] >[2016-04-19 07:24:39.235114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6> (33d1beea-0f01-4ae1-8135-9bdcfdd7bff6) [No such file or directory] >[2016-04-19 07:24:39.235434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6> (33d1beea-0f01-4ae1-8135-9bdcfdd7bff6) [No such file or directory] >[2016-04-19 07:24:39.235599] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.238147] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 33d1beea-0f01-4ae1-8135-9bdcfdd7bff6. (Possible split-brain) >[2016-04-19 07:24:39.238963] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6> (33d1beea-0f01-4ae1-8135-9bdcfdd7bff6) [No such file or directory] >[2016-04-19 07:24:39.239419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6> (33d1beea-0f01-4ae1-8135-9bdcfdd7bff6) [No such file or directory] >[2016-04-19 07:24:39.242036] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6> (33d1beea-0f01-4ae1-8135-9bdcfdd7bff6) [No such file or directory] >[2016-04-19 07:24:39.242237] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6> (33d1beea-0f01-4ae1-8135-9bdcfdd7bff6) [No such file or directory] >[2016-04-19 07:24:39.242435] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:33d1beea-0f01-4ae1-8135-9bdcfdd7bff6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.251864] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.252791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266> (9c3a36db-a374-45fa-bd8a-7f00d5345266) [No such file or directory] >[2016-04-19 07:24:39.253043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266> (9c3a36db-a374-45fa-bd8a-7f00d5345266) [No such file or directory] >[2016-04-19 07:24:39.253978] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9c3a36db-a374-45fa-bd8a-7f00d5345266. (Possible split-brain) >[2016-04-19 07:24:39.255046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266> (9c3a36db-a374-45fa-bd8a-7f00d5345266) [No such file or directory] >[2016-04-19 07:24:39.255076] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266> (9c3a36db-a374-45fa-bd8a-7f00d5345266) [No such file or directory] >[2016-04-19 07:24:39.256255] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266> (9c3a36db-a374-45fa-bd8a-7f00d5345266) [No such file or directory] >[2016-04-19 07:24:39.256490] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266> (9c3a36db-a374-45fa-bd8a-7f00d5345266) [No such file or directory] >[2016-04-19 07:24:39.256662] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.259098] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9c3a36db-a374-45fa-bd8a-7f00d5345266. (Possible split-brain) >[2016-04-19 07:24:39.259891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266> (9c3a36db-a374-45fa-bd8a-7f00d5345266) [No such file or directory] >[2016-04-19 07:24:39.260280] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266> (9c3a36db-a374-45fa-bd8a-7f00d5345266) [No such file or directory] >[2016-04-19 07:24:39.262856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266> (9c3a36db-a374-45fa-bd8a-7f00d5345266) [No such file or directory] >[2016-04-19 07:24:39.263125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266> (9c3a36db-a374-45fa-bd8a-7f00d5345266) [No such file or directory] >[2016-04-19 07:24:39.263245] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9c3a36db-a374-45fa-bd8a-7f00d5345266>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.272248] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.273233] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:39d133df-5916-4570-9df1-bc0731f537ef> (39d133df-5916-4570-9df1-bc0731f537ef) [No such file or directory] >[2016-04-19 07:24:39.273528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:39d133df-5916-4570-9df1-bc0731f537ef> (39d133df-5916-4570-9df1-bc0731f537ef) [No such file or directory] >[2016-04-19 07:24:39.274627] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 39d133df-5916-4570-9df1-bc0731f537ef. (Possible split-brain) >[2016-04-19 07:24:39.275417] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:39d133df-5916-4570-9df1-bc0731f537ef> (39d133df-5916-4570-9df1-bc0731f537ef) [No such file or directory] >[2016-04-19 07:24:39.275855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:39d133df-5916-4570-9df1-bc0731f537ef> (39d133df-5916-4570-9df1-bc0731f537ef) [No such file or directory] >[2016-04-19 07:24:39.277018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:39d133df-5916-4570-9df1-bc0731f537ef> (39d133df-5916-4570-9df1-bc0731f537ef) [No such file or directory] >[2016-04-19 07:24:39.277133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:39d133df-5916-4570-9df1-bc0731f537ef> (39d133df-5916-4570-9df1-bc0731f537ef) [No such file or directory] >[2016-04-19 07:24:39.277458] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:39d133df-5916-4570-9df1-bc0731f537ef>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:39.279984] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 39d133df-5916-4570-9df1-bc0731f537ef. (Possible split-brain) >[2016-04-19 07:24:39.280936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:39d133df-5916-4570-9df1-bc0731f537ef> (39d133df-5916-4570-9df1-bc0731f537ef) [No such file or directory] >[2016-04-19 07:24:39.280942] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:39d133df-5916-4570-9df1-bc0731f537ef> (39d133df-5916-4570-9df1-bc0731f537ef) [No such file or directory] >[2016-04-19 07:24:39.283762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:39d133df-5916-4570-9df1-bc0731f537ef> (39d133df-5916-4570-9df1-bc0731f537ef) [No such file or directory] >[2016-04-19 07:24:39.283823] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:39d133df-5916-4570-9df1-bc0731f537ef> (39d133df-5916-4570-9df1-bc0731f537ef) [No such file or directory] >[2016-04-19 07:24:39.283977] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:39d133df-5916-4570-9df1-bc0731f537ef>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.293759] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.294599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25> (137560f4-2922-4c99-a0c4-ef2b367a3c25) [No such file or directory] >[2016-04-19 07:24:39.294813] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25> (137560f4-2922-4c99-a0c4-ef2b367a3c25) [No such file or directory] >[2016-04-19 07:24:39.297753] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 137560f4-2922-4c99-a0c4-ef2b367a3c25. (Possible split-brain) >[2016-04-19 07:24:39.298792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25> (137560f4-2922-4c99-a0c4-ef2b367a3c25) [No such file or directory] >[2016-04-19 07:24:39.298894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25> (137560f4-2922-4c99-a0c4-ef2b367a3c25) [No such file or directory] >[2016-04-19 07:24:39.300257] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25> (137560f4-2922-4c99-a0c4-ef2b367a3c25) [No such file or directory] >[2016-04-19 07:24:39.300421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25> (137560f4-2922-4c99-a0c4-ef2b367a3c25) [No such file or directory] >[2016-04-19 07:24:39.300669] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.303189] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 137560f4-2922-4c99-a0c4-ef2b367a3c25. (Possible split-brain) >[2016-04-19 07:24:39.304096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25> (137560f4-2922-4c99-a0c4-ef2b367a3c25) [No such file or directory] >[2016-04-19 07:24:39.304375] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25> (137560f4-2922-4c99-a0c4-ef2b367a3c25) [No such file or directory] >[2016-04-19 07:24:39.307047] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25> (137560f4-2922-4c99-a0c4-ef2b367a3c25) [No such file or directory] >[2016-04-19 07:24:39.307406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25> (137560f4-2922-4c99-a0c4-ef2b367a3c25) [No such file or directory] >[2016-04-19 07:24:39.307576] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:137560f4-2922-4c99-a0c4-ef2b367a3c25>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.317355] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.318551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311> (408b3016-e6a1-4857-8cf2-df54048bf311) [No such file or directory] >[2016-04-19 07:24:39.318636] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311> (408b3016-e6a1-4857-8cf2-df54048bf311) [No such file or directory] >[2016-04-19 07:24:39.321509] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 408b3016-e6a1-4857-8cf2-df54048bf311. (Possible split-brain) >[2016-04-19 07:24:39.322480] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311> (408b3016-e6a1-4857-8cf2-df54048bf311) [No such file or directory] >[2016-04-19 07:24:39.322599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311> (408b3016-e6a1-4857-8cf2-df54048bf311) [No such file or directory] >[2016-04-19 07:24:39.323821] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311> (408b3016-e6a1-4857-8cf2-df54048bf311) [No such file or directory] >[2016-04-19 07:24:39.324001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311> (408b3016-e6a1-4857-8cf2-df54048bf311) [No such file or directory] >[2016-04-19 07:24:39.324232] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.326785] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 408b3016-e6a1-4857-8cf2-df54048bf311. (Possible split-brain) >[2016-04-19 07:24:39.327795] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311> (408b3016-e6a1-4857-8cf2-df54048bf311) [No such file or directory] >[2016-04-19 07:24:39.327816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311> (408b3016-e6a1-4857-8cf2-df54048bf311) [No such file or directory] >[2016-04-19 07:24:39.330281] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311> (408b3016-e6a1-4857-8cf2-df54048bf311) [No such file or directory] >[2016-04-19 07:24:39.330488] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311> (408b3016-e6a1-4857-8cf2-df54048bf311) [No such file or directory] >[2016-04-19 07:24:39.330768] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:408b3016-e6a1-4857-8cf2-df54048bf311>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.340242] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.341134] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7468a511-6398-4460-a2da-544560963910> (7468a511-6398-4460-a2da-544560963910) [No such file or directory] >[2016-04-19 07:24:39.341434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7468a511-6398-4460-a2da-544560963910> (7468a511-6398-4460-a2da-544560963910) [No such file or directory] >[2016-04-19 07:24:39.342602] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7468a511-6398-4460-a2da-544560963910. (Possible split-brain) >[2016-04-19 07:24:39.343544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7468a511-6398-4460-a2da-544560963910> (7468a511-6398-4460-a2da-544560963910) [No such file or directory] >[2016-04-19 07:24:39.343810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7468a511-6398-4460-a2da-544560963910> (7468a511-6398-4460-a2da-544560963910) [No such file or directory] >[2016-04-19 07:24:39.345132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7468a511-6398-4460-a2da-544560963910> (7468a511-6398-4460-a2da-544560963910) [No such file or directory] >[2016-04-19 07:24:39.345226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7468a511-6398-4460-a2da-544560963910> (7468a511-6398-4460-a2da-544560963910) [No such file or directory] >[2016-04-19 07:24:39.345470] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7468a511-6398-4460-a2da-544560963910>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:39.347932] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7468a511-6398-4460-a2da-544560963910. (Possible split-brain) >[2016-04-19 07:24:39.348882] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7468a511-6398-4460-a2da-544560963910> (7468a511-6398-4460-a2da-544560963910) [No such file or directory] >[2016-04-19 07:24:39.349134] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7468a511-6398-4460-a2da-544560963910> (7468a511-6398-4460-a2da-544560963910) [No such file or directory] >[2016-04-19 07:24:39.351861] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7468a511-6398-4460-a2da-544560963910> (7468a511-6398-4460-a2da-544560963910) [No such file or directory] >[2016-04-19 07:24:39.351977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7468a511-6398-4460-a2da-544560963910> (7468a511-6398-4460-a2da-544560963910) [No such file or directory] >[2016-04-19 07:24:39.352119] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7468a511-6398-4460-a2da-544560963910>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.360731] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.361777] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b> (6da76e93-55dc-4a9c-85f9-730ceadecc0b) [No such file or directory] >[2016-04-19 07:24:39.361862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b> (6da76e93-55dc-4a9c-85f9-730ceadecc0b) [No such file or directory] >[2016-04-19 07:24:39.362985] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6da76e93-55dc-4a9c-85f9-730ceadecc0b. (Possible split-brain) >[2016-04-19 07:24:39.364049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b> (6da76e93-55dc-4a9c-85f9-730ceadecc0b) [No such file or directory] >[2016-04-19 07:24:39.364145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b> (6da76e93-55dc-4a9c-85f9-730ceadecc0b) [No such file or directory] >[2016-04-19 07:24:39.365722] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b> (6da76e93-55dc-4a9c-85f9-730ceadecc0b) [No such file or directory] >[2016-04-19 07:24:39.365908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b> (6da76e93-55dc-4a9c-85f9-730ceadecc0b) [No such file or directory] >[2016-04-19 07:24:39.366127] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.368572] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6da76e93-55dc-4a9c-85f9-730ceadecc0b. (Possible split-brain) >[2016-04-19 07:24:39.369420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b> (6da76e93-55dc-4a9c-85f9-730ceadecc0b) [No such file or directory] >[2016-04-19 07:24:39.369767] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b> (6da76e93-55dc-4a9c-85f9-730ceadecc0b) [No such file or directory] >[2016-04-19 07:24:39.372582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b> (6da76e93-55dc-4a9c-85f9-730ceadecc0b) [No such file or directory] >[2016-04-19 07:24:39.372681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b> (6da76e93-55dc-4a9c-85f9-730ceadecc0b) [No such file or directory] >[2016-04-19 07:24:39.372981] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6da76e93-55dc-4a9c-85f9-730ceadecc0b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.383486] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.384236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782> (866a85a8-223b-424d-97fc-f326ca9cc782) [No such file or directory] >[2016-04-19 07:24:39.384557] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782> (866a85a8-223b-424d-97fc-f326ca9cc782) [No such file or directory] >[2016-04-19 07:24:39.387440] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 866a85a8-223b-424d-97fc-f326ca9cc782. (Possible split-brain) >[2016-04-19 07:24:39.388197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782> (866a85a8-223b-424d-97fc-f326ca9cc782) [No such file or directory] >[2016-04-19 07:24:39.388577] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782> (866a85a8-223b-424d-97fc-f326ca9cc782) [No such file or directory] >[2016-04-19 07:24:39.390024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782> (866a85a8-223b-424d-97fc-f326ca9cc782) [No such file or directory] >[2016-04-19 07:24:39.390121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782> (866a85a8-223b-424d-97fc-f326ca9cc782) [No such file or directory] >[2016-04-19 07:24:39.390293] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.392935] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 866a85a8-223b-424d-97fc-f326ca9cc782. (Possible split-brain) >[2016-04-19 07:24:39.393818] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782> (866a85a8-223b-424d-97fc-f326ca9cc782) [No such file or directory] >[2016-04-19 07:24:39.394031] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782> (866a85a8-223b-424d-97fc-f326ca9cc782) [No such file or directory] >[2016-04-19 07:24:39.396780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782> (866a85a8-223b-424d-97fc-f326ca9cc782) [No such file or directory] >[2016-04-19 07:24:39.396968] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782> (866a85a8-223b-424d-97fc-f326ca9cc782) [No such file or directory] >[2016-04-19 07:24:39.397206] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:866a85a8-223b-424d-97fc-f326ca9cc782>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.407060] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.408302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc> (f7b59261-f752-40ae-bc05-7f29d0deffbc) [No such file or directory] >[2016-04-19 07:24:39.408342] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc> (f7b59261-f752-40ae-bc05-7f29d0deffbc) [No such file or directory] >[2016-04-19 07:24:39.411261] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f7b59261-f752-40ae-bc05-7f29d0deffbc. (Possible split-brain) >[2016-04-19 07:24:39.412349] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc> (f7b59261-f752-40ae-bc05-7f29d0deffbc) [No such file or directory] >[2016-04-19 07:24:39.412664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc> (f7b59261-f752-40ae-bc05-7f29d0deffbc) [No such file or directory] >[2016-04-19 07:24:39.414067] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc> (f7b59261-f752-40ae-bc05-7f29d0deffbc) [No such file or directory] >[2016-04-19 07:24:39.414090] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc> (f7b59261-f752-40ae-bc05-7f29d0deffbc) [No such file or directory] >[2016-04-19 07:24:39.414245] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.416831] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f7b59261-f752-40ae-bc05-7f29d0deffbc. (Possible split-brain) >[2016-04-19 07:24:39.417833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc> (f7b59261-f752-40ae-bc05-7f29d0deffbc) [No such file or directory] >[2016-04-19 07:24:39.417936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc> (f7b59261-f752-40ae-bc05-7f29d0deffbc) [No such file or directory] >[2016-04-19 07:24:39.420515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc> (f7b59261-f752-40ae-bc05-7f29d0deffbc) [No such file or directory] >[2016-04-19 07:24:39.420541] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc> (f7b59261-f752-40ae-bc05-7f29d0deffbc) [No such file or directory] >[2016-04-19 07:24:39.420777] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f7b59261-f752-40ae-bc05-7f29d0deffbc>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.430761] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.431700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:60147edc-8471-400b-8ef6-14c2015e8947> (60147edc-8471-400b-8ef6-14c2015e8947) [No such file or directory] >[2016-04-19 07:24:39.431792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:60147edc-8471-400b-8ef6-14c2015e8947> (60147edc-8471-400b-8ef6-14c2015e8947) [No such file or directory] >[2016-04-19 07:24:39.432959] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 60147edc-8471-400b-8ef6-14c2015e8947. (Possible split-brain) >[2016-04-19 07:24:39.433929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:60147edc-8471-400b-8ef6-14c2015e8947> (60147edc-8471-400b-8ef6-14c2015e8947) [No such file or directory] >[2016-04-19 07:24:39.434010] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:60147edc-8471-400b-8ef6-14c2015e8947> (60147edc-8471-400b-8ef6-14c2015e8947) [No such file or directory] >[2016-04-19 07:24:39.435547] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:60147edc-8471-400b-8ef6-14c2015e8947> (60147edc-8471-400b-8ef6-14c2015e8947) [No such file or directory] >[2016-04-19 07:24:39.435649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:60147edc-8471-400b-8ef6-14c2015e8947> (60147edc-8471-400b-8ef6-14c2015e8947) [No such file or directory] >[2016-04-19 07:24:39.435766] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:60147edc-8471-400b-8ef6-14c2015e8947>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.438226] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 60147edc-8471-400b-8ef6-14c2015e8947. (Possible split-brain) >[2016-04-19 07:24:39.439064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:60147edc-8471-400b-8ef6-14c2015e8947> (60147edc-8471-400b-8ef6-14c2015e8947) [No such file or directory] >[2016-04-19 07:24:39.439483] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:60147edc-8471-400b-8ef6-14c2015e8947> (60147edc-8471-400b-8ef6-14c2015e8947) [No such file or directory] >[2016-04-19 07:24:39.442648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:60147edc-8471-400b-8ef6-14c2015e8947> (60147edc-8471-400b-8ef6-14c2015e8947) [No such file or directory] >[2016-04-19 07:24:39.442659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:60147edc-8471-400b-8ef6-14c2015e8947> (60147edc-8471-400b-8ef6-14c2015e8947) [No such file or directory] >[2016-04-19 07:24:39.442933] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:60147edc-8471-400b-8ef6-14c2015e8947>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.452117] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.452903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c935caf0-e464-4309-aed8-764101dce343> (c935caf0-e464-4309-aed8-764101dce343) [No such file or directory] >[2016-04-19 07:24:39.453234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c935caf0-e464-4309-aed8-764101dce343> (c935caf0-e464-4309-aed8-764101dce343) [No such file or directory] >[2016-04-19 07:24:39.454361] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c935caf0-e464-4309-aed8-764101dce343. (Possible split-brain) >[2016-04-19 07:24:39.455224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c935caf0-e464-4309-aed8-764101dce343> (c935caf0-e464-4309-aed8-764101dce343) [No such file or directory] >[2016-04-19 07:24:39.455565] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c935caf0-e464-4309-aed8-764101dce343> (c935caf0-e464-4309-aed8-764101dce343) [No such file or directory] >[2016-04-19 07:24:39.456944] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c935caf0-e464-4309-aed8-764101dce343> (c935caf0-e464-4309-aed8-764101dce343) [No such file or directory] >[2016-04-19 07:24:39.456969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c935caf0-e464-4309-aed8-764101dce343> (c935caf0-e464-4309-aed8-764101dce343) [No such file or directory] >[2016-04-19 07:24:39.457158] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c935caf0-e464-4309-aed8-764101dce343>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.459668] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c935caf0-e464-4309-aed8-764101dce343. (Possible split-brain) >[2016-04-19 07:24:39.460395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c935caf0-e464-4309-aed8-764101dce343> (c935caf0-e464-4309-aed8-764101dce343) [No such file or directory] >[2016-04-19 07:24:39.460744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c935caf0-e464-4309-aed8-764101dce343> (c935caf0-e464-4309-aed8-764101dce343) [No such file or directory] >[2016-04-19 07:24:39.463479] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c935caf0-e464-4309-aed8-764101dce343> (c935caf0-e464-4309-aed8-764101dce343) [No such file or directory] >[2016-04-19 07:24:39.463599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c935caf0-e464-4309-aed8-764101dce343> (c935caf0-e464-4309-aed8-764101dce343) [No such file or directory] >[2016-04-19 07:24:39.463810] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c935caf0-e464-4309-aed8-764101dce343>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.472873] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.473639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6> (cadee6db-03fc-4240-86df-401f56a1fcd6) [No such file or directory] >[2016-04-19 07:24:39.473888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6> (cadee6db-03fc-4240-86df-401f56a1fcd6) [No such file or directory] >[2016-04-19 07:24:39.476795] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cadee6db-03fc-4240-86df-401f56a1fcd6. (Possible split-brain) >[2016-04-19 07:24:39.477524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6> (cadee6db-03fc-4240-86df-401f56a1fcd6) [No such file or directory] >[2016-04-19 07:24:39.477811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6> (cadee6db-03fc-4240-86df-401f56a1fcd6) [No such file or directory] >[2016-04-19 07:24:39.478965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6> (cadee6db-03fc-4240-86df-401f56a1fcd6) [No such file or directory] >[2016-04-19 07:24:39.479092] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6> (cadee6db-03fc-4240-86df-401f56a1fcd6) [No such file or directory] >[2016-04-19 07:24:39.479193] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.481776] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cadee6db-03fc-4240-86df-401f56a1fcd6. (Possible split-brain) >[2016-04-19 07:24:39.482805] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6> (cadee6db-03fc-4240-86df-401f56a1fcd6) [No such file or directory] >[2016-04-19 07:24:39.482915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6> (cadee6db-03fc-4240-86df-401f56a1fcd6) [No such file or directory] >[2016-04-19 07:24:39.485426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6> (cadee6db-03fc-4240-86df-401f56a1fcd6) [No such file or directory] >[2016-04-19 07:24:39.485640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6> (cadee6db-03fc-4240-86df-401f56a1fcd6) [No such file or directory] >[2016-04-19 07:24:39.485809] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cadee6db-03fc-4240-86df-401f56a1fcd6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.494770] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.495784] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd> (6cdf3698-7fbf-4981-8147-907b9432dbcd) [No such file or directory] >[2016-04-19 07:24:39.495865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd> (6cdf3698-7fbf-4981-8147-907b9432dbcd) [No such file or directory] >[2016-04-19 07:24:39.497007] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6cdf3698-7fbf-4981-8147-907b9432dbcd. (Possible split-brain) >[2016-04-19 07:24:39.498013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd> (6cdf3698-7fbf-4981-8147-907b9432dbcd) [No such file or directory] >[2016-04-19 07:24:39.498044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd> (6cdf3698-7fbf-4981-8147-907b9432dbcd) [No such file or directory] >[2016-04-19 07:24:39.499448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd> (6cdf3698-7fbf-4981-8147-907b9432dbcd) [No such file or directory] >[2016-04-19 07:24:39.499536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd> (6cdf3698-7fbf-4981-8147-907b9432dbcd) [No such file or directory] >[2016-04-19 07:24:39.499746] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.502220] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6cdf3698-7fbf-4981-8147-907b9432dbcd. (Possible split-brain) >[2016-04-19 07:24:39.503438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd> (6cdf3698-7fbf-4981-8147-907b9432dbcd) [No such file or directory] >[2016-04-19 07:24:39.503438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd> (6cdf3698-7fbf-4981-8147-907b9432dbcd) [No such file or directory] >[2016-04-19 07:24:39.506122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd> (6cdf3698-7fbf-4981-8147-907b9432dbcd) [No such file or directory] >[2016-04-19 07:24:39.506227] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd> (6cdf3698-7fbf-4981-8147-907b9432dbcd) [No such file or directory] >[2016-04-19 07:24:39.506784] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6cdf3698-7fbf-4981-8147-907b9432dbcd>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.515442] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.516184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d> (99d5b289-c01a-4c12-aa76-82bf23d54d7d) [No such file or directory] >[2016-04-19 07:24:39.516514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d> (99d5b289-c01a-4c12-aa76-82bf23d54d7d) [No such file or directory] >[2016-04-19 07:24:39.517649] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 99d5b289-c01a-4c12-aa76-82bf23d54d7d. (Possible split-brain) >[2016-04-19 07:24:39.518309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d> (99d5b289-c01a-4c12-aa76-82bf23d54d7d) [No such file or directory] >[2016-04-19 07:24:39.518666] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d> (99d5b289-c01a-4c12-aa76-82bf23d54d7d) [No such file or directory] >[2016-04-19 07:24:39.519791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d> (99d5b289-c01a-4c12-aa76-82bf23d54d7d) [No such file or directory] >[2016-04-19 07:24:39.520064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d> (99d5b289-c01a-4c12-aa76-82bf23d54d7d) [No such file or directory] >[2016-04-19 07:24:39.520195] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.522757] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 99d5b289-c01a-4c12-aa76-82bf23d54d7d. (Possible split-brain) >[2016-04-19 07:24:39.523533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d> (99d5b289-c01a-4c12-aa76-82bf23d54d7d) [No such file or directory] >[2016-04-19 07:24:39.523893] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d> (99d5b289-c01a-4c12-aa76-82bf23d54d7d) [No such file or directory] >[2016-04-19 07:24:39.526250] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d> (99d5b289-c01a-4c12-aa76-82bf23d54d7d) [No such file or directory] >[2016-04-19 07:24:39.526727] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d> (99d5b289-c01a-4c12-aa76-82bf23d54d7d) [No such file or directory] >[2016-04-19 07:24:39.526867] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:99d5b289-c01a-4c12-aa76-82bf23d54d7d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.536489] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.537524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8> (e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8) [No such file or directory] >[2016-04-19 07:24:39.537616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8> (e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8) [No such file or directory] >[2016-04-19 07:24:39.540521] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8. (Possible split-brain) >[2016-04-19 07:24:39.541468] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8> (e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8) [No such file or directory] >[2016-04-19 07:24:39.541747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8> (e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8) [No such file or directory] >[2016-04-19 07:24:39.542670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8> (e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8) [No such file or directory] >[2016-04-19 07:24:39.543186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8> (e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8) [No such file or directory] >[2016-04-19 07:24:39.543433] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:39.546006] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8. (Possible split-brain) >[2016-04-19 07:24:39.547051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8> (e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8) [No such file or directory] >[2016-04-19 07:24:39.547360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8> (e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8) [No such file or directory] >[2016-04-19 07:24:39.549829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8> (e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8) [No such file or directory] >[2016-04-19 07:24:39.549853] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8> (e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8) [No such file or directory] >[2016-04-19 07:24:39.550012] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e0ce31db-df62-4ada-81d7-bbc2cbbf5ca8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.559501] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.560204] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c4aee186-c423-477e-b339-09f41c361be0> (c4aee186-c423-477e-b339-09f41c361be0) [No such file or directory] >[2016-04-19 07:24:39.560557] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c4aee186-c423-477e-b339-09f41c361be0> (c4aee186-c423-477e-b339-09f41c361be0) [No such file or directory] >[2016-04-19 07:24:39.561749] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c4aee186-c423-477e-b339-09f41c361be0. (Possible split-brain) >[2016-04-19 07:24:39.562803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c4aee186-c423-477e-b339-09f41c361be0> (c4aee186-c423-477e-b339-09f41c361be0) [No such file or directory] >[2016-04-19 07:24:39.562820] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c4aee186-c423-477e-b339-09f41c361be0> (c4aee186-c423-477e-b339-09f41c361be0) [No such file or directory] >[2016-04-19 07:24:39.564118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c4aee186-c423-477e-b339-09f41c361be0> (c4aee186-c423-477e-b339-09f41c361be0) [No such file or directory] >[2016-04-19 07:24:39.564473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c4aee186-c423-477e-b339-09f41c361be0> (c4aee186-c423-477e-b339-09f41c361be0) [No such file or directory] >[2016-04-19 07:24:39.564688] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c4aee186-c423-477e-b339-09f41c361be0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.567150] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c4aee186-c423-477e-b339-09f41c361be0. (Possible split-brain) >[2016-04-19 07:24:39.567953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c4aee186-c423-477e-b339-09f41c361be0> (c4aee186-c423-477e-b339-09f41c361be0) [No such file or directory] >[2016-04-19 07:24:39.568224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c4aee186-c423-477e-b339-09f41c361be0> (c4aee186-c423-477e-b339-09f41c361be0) [No such file or directory] >[2016-04-19 07:24:39.571360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c4aee186-c423-477e-b339-09f41c361be0> (c4aee186-c423-477e-b339-09f41c361be0) [No such file or directory] >[2016-04-19 07:24:39.571517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c4aee186-c423-477e-b339-09f41c361be0> (c4aee186-c423-477e-b339-09f41c361be0) [No such file or directory] >[2016-04-19 07:24:39.571722] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c4aee186-c423-477e-b339-09f41c361be0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.581044] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.582113] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4> (1804c663-e7e3-4716-aad5-1e5edb802bc4) [No such file or directory] >[2016-04-19 07:24:39.582122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4> (1804c663-e7e3-4716-aad5-1e5edb802bc4) [No such file or directory] >[2016-04-19 07:24:39.583300] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1804c663-e7e3-4716-aad5-1e5edb802bc4. (Possible split-brain) >[2016-04-19 07:24:39.584203] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4> (1804c663-e7e3-4716-aad5-1e5edb802bc4) [No such file or directory] >[2016-04-19 07:24:39.584515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4> (1804c663-e7e3-4716-aad5-1e5edb802bc4) [No such file or directory] >[2016-04-19 07:24:39.586054] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4> (1804c663-e7e3-4716-aad5-1e5edb802bc4) [No such file or directory] >[2016-04-19 07:24:39.586069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4> (1804c663-e7e3-4716-aad5-1e5edb802bc4) [No such file or directory] >[2016-04-19 07:24:39.586256] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.588710] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1804c663-e7e3-4716-aad5-1e5edb802bc4. (Possible split-brain) >[2016-04-19 07:24:39.589901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4> (1804c663-e7e3-4716-aad5-1e5edb802bc4) [No such file or directory] >[2016-04-19 07:24:39.590032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4> (1804c663-e7e3-4716-aad5-1e5edb802bc4) [No such file or directory] >[2016-04-19 07:24:39.592884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4> (1804c663-e7e3-4716-aad5-1e5edb802bc4) [No such file or directory] >[2016-04-19 07:24:39.593032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4> (1804c663-e7e3-4716-aad5-1e5edb802bc4) [No such file or directory] >[2016-04-19 07:24:39.593155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1804c663-e7e3-4716-aad5-1e5edb802bc4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.602191] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.603161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138> (b5b8e95b-8546-4f79-bd85-9acee8936138) [No such file or directory] >[2016-04-19 07:24:39.603184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138> (b5b8e95b-8546-4f79-bd85-9acee8936138) [No such file or directory] >[2016-04-19 07:24:39.606084] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b5b8e95b-8546-4f79-bd85-9acee8936138. (Possible split-brain) >[2016-04-19 07:24:39.606980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138> (b5b8e95b-8546-4f79-bd85-9acee8936138) [No such file or directory] >[2016-04-19 07:24:39.607070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138> (b5b8e95b-8546-4f79-bd85-9acee8936138) [No such file or directory] >[2016-04-19 07:24:39.608410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138> (b5b8e95b-8546-4f79-bd85-9acee8936138) [No such file or directory] >[2016-04-19 07:24:39.608527] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138> (b5b8e95b-8546-4f79-bd85-9acee8936138) [No such file or directory] >[2016-04-19 07:24:39.608724] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.611239] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b5b8e95b-8546-4f79-bd85-9acee8936138. (Possible split-brain) >[2016-04-19 07:24:39.612358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138> (b5b8e95b-8546-4f79-bd85-9acee8936138) [No such file or directory] >[2016-04-19 07:24:39.612675] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138> (b5b8e95b-8546-4f79-bd85-9acee8936138) [No such file or directory] >[2016-04-19 07:24:39.615194] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138> (b5b8e95b-8546-4f79-bd85-9acee8936138) [No such file or directory] >[2016-04-19 07:24:39.615296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138> (b5b8e95b-8546-4f79-bd85-9acee8936138) [No such file or directory] >[2016-04-19 07:24:39.615443] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b5b8e95b-8546-4f79-bd85-9acee8936138>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.624948] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.625907] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7> (92dc0aad-f8a8-43be-8a4f-2d4d88620cf7) [No such file or directory] >[2016-04-19 07:24:39.625993] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7> (92dc0aad-f8a8-43be-8a4f-2d4d88620cf7) [No such file or directory] >[2016-04-19 07:24:39.627146] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 92dc0aad-f8a8-43be-8a4f-2d4d88620cf7. (Possible split-brain) >[2016-04-19 07:24:39.628184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7> (92dc0aad-f8a8-43be-8a4f-2d4d88620cf7) [No such file or directory] >[2016-04-19 07:24:39.628199] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7> (92dc0aad-f8a8-43be-8a4f-2d4d88620cf7) [No such file or directory] >[2016-04-19 07:24:39.629236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7> (92dc0aad-f8a8-43be-8a4f-2d4d88620cf7) [No such file or directory] >[2016-04-19 07:24:39.629689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7> (92dc0aad-f8a8-43be-8a4f-2d4d88620cf7) [No such file or directory] >[2016-04-19 07:24:39.629919] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.632383] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 92dc0aad-f8a8-43be-8a4f-2d4d88620cf7. (Possible split-brain) >[2016-04-19 07:24:39.632964] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7> (92dc0aad-f8a8-43be-8a4f-2d4d88620cf7) [No such file or directory] >[2016-04-19 07:24:39.633243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7> (92dc0aad-f8a8-43be-8a4f-2d4d88620cf7) [No such file or directory] >[2016-04-19 07:24:39.635239] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7> (92dc0aad-f8a8-43be-8a4f-2d4d88620cf7) [No such file or directory] >[2016-04-19 07:24:39.635471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7> (92dc0aad-f8a8-43be-8a4f-2d4d88620cf7) [No such file or directory] >[2016-04-19 07:24:39.635978] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:92dc0aad-f8a8-43be-8a4f-2d4d88620cf7>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.646136] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.647056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5> (e7cd5129-e508-47a8-8ef4-a40314a832f5) [No such file or directory] >[2016-04-19 07:24:39.647390] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5> (e7cd5129-e508-47a8-8ef4-a40314a832f5) [No such file or directory] >[2016-04-19 07:24:39.648543] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e7cd5129-e508-47a8-8ef4-a40314a832f5. (Possible split-brain) >[2016-04-19 07:24:39.649576] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5> (e7cd5129-e508-47a8-8ef4-a40314a832f5) [No such file or directory] >[2016-04-19 07:24:39.649598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5> (e7cd5129-e508-47a8-8ef4-a40314a832f5) [No such file or directory] >[2016-04-19 07:24:39.650730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5> (e7cd5129-e508-47a8-8ef4-a40314a832f5) [No such file or directory] >[2016-04-19 07:24:39.650816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5> (e7cd5129-e508-47a8-8ef4-a40314a832f5) [No such file or directory] >[2016-04-19 07:24:39.651041] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:39.652494] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e7cd5129-e508-47a8-8ef4-a40314a832f5. (Possible split-brain) >[2016-04-19 07:24:39.653064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5> (e7cd5129-e508-47a8-8ef4-a40314a832f5) [No such file or directory] >[2016-04-19 07:24:39.653120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5> (e7cd5129-e508-47a8-8ef4-a40314a832f5) [No such file or directory] >[2016-04-19 07:24:39.655438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5> (e7cd5129-e508-47a8-8ef4-a40314a832f5) [No such file or directory] >[2016-04-19 07:24:39.655802] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5> (e7cd5129-e508-47a8-8ef4-a40314a832f5) [No such file or directory] >[2016-04-19 07:24:39.655979] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e7cd5129-e508-47a8-8ef4-a40314a832f5>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.664968] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.665942] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e> (a230756f-baa4-4367-b412-faf54ff0a24e) [No such file or directory] >[2016-04-19 07:24:39.666029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e> (a230756f-baa4-4367-b412-faf54ff0a24e) [No such file or directory] >[2016-04-19 07:24:39.667133] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a230756f-baa4-4367-b412-faf54ff0a24e. (Possible split-brain) >[2016-04-19 07:24:39.668171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e> (a230756f-baa4-4367-b412-faf54ff0a24e) [No such file or directory] >[2016-04-19 07:24:39.668194] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e> (a230756f-baa4-4367-b412-faf54ff0a24e) [No such file or directory] >[2016-04-19 07:24:39.669344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e> (a230756f-baa4-4367-b412-faf54ff0a24e) [No such file or directory] >[2016-04-19 07:24:39.669395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e> (a230756f-baa4-4367-b412-faf54ff0a24e) [No such file or directory] >[2016-04-19 07:24:39.669587] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.672090] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a230756f-baa4-4367-b412-faf54ff0a24e. (Possible split-brain) >[2016-04-19 07:24:39.673097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e> (a230756f-baa4-4367-b412-faf54ff0a24e) [No such file or directory] >[2016-04-19 07:24:39.673114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e> (a230756f-baa4-4367-b412-faf54ff0a24e) [No such file or directory] >[2016-04-19 07:24:39.675571] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e> (a230756f-baa4-4367-b412-faf54ff0a24e) [No such file or directory] >[2016-04-19 07:24:39.675735] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e> (a230756f-baa4-4367-b412-faf54ff0a24e) [No such file or directory] >[2016-04-19 07:24:39.675855] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a230756f-baa4-4367-b412-faf54ff0a24e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.685839] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.686561] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760> (3b6d9cd9-2a62-4c34-bfe1-6b834047d760) [No such file or directory] >[2016-04-19 07:24:39.686986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760> (3b6d9cd9-2a62-4c34-bfe1-6b834047d760) [No such file or directory] >[2016-04-19 07:24:39.689941] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3b6d9cd9-2a62-4c34-bfe1-6b834047d760. (Possible split-brain) >[2016-04-19 07:24:39.691076] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760> (3b6d9cd9-2a62-4c34-bfe1-6b834047d760) [No such file or directory] >[2016-04-19 07:24:39.691181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760> (3b6d9cd9-2a62-4c34-bfe1-6b834047d760) [No such file or directory] >[2016-04-19 07:24:39.692537] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760> (3b6d9cd9-2a62-4c34-bfe1-6b834047d760) [No such file or directory] >[2016-04-19 07:24:39.692569] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760> (3b6d9cd9-2a62-4c34-bfe1-6b834047d760) [No such file or directory] >[2016-04-19 07:24:39.692755] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.695295] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3b6d9cd9-2a62-4c34-bfe1-6b834047d760. (Possible split-brain) >[2016-04-19 07:24:39.696357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760> (3b6d9cd9-2a62-4c34-bfe1-6b834047d760) [No such file or directory] >[2016-04-19 07:24:39.696364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760> (3b6d9cd9-2a62-4c34-bfe1-6b834047d760) [No such file or directory] >[2016-04-19 07:24:39.698929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760> (3b6d9cd9-2a62-4c34-bfe1-6b834047d760) [No such file or directory] >[2016-04-19 07:24:39.699186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760> (3b6d9cd9-2a62-4c34-bfe1-6b834047d760) [No such file or directory] >[2016-04-19 07:24:39.699381] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3b6d9cd9-2a62-4c34-bfe1-6b834047d760>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.709162] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.710235] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581> (5f66d228-e4d9-42e0-b98b-9e8d873b5581) [No such file or directory] >[2016-04-19 07:24:39.710426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581> (5f66d228-e4d9-42e0-b98b-9e8d873b5581) [No such file or directory] >[2016-04-19 07:24:39.712980] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5f66d228-e4d9-42e0-b98b-9e8d873b5581. (Possible split-brain) >[2016-04-19 07:24:39.713834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581> (5f66d228-e4d9-42e0-b98b-9e8d873b5581) [No such file or directory] >[2016-04-19 07:24:39.714089] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581> (5f66d228-e4d9-42e0-b98b-9e8d873b5581) [No such file or directory] >[2016-04-19 07:24:39.715236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581> (5f66d228-e4d9-42e0-b98b-9e8d873b5581) [No such file or directory] >[2016-04-19 07:24:39.715524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581> (5f66d228-e4d9-42e0-b98b-9e8d873b5581) [No such file or directory] >[2016-04-19 07:24:39.715669] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.718128] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5f66d228-e4d9-42e0-b98b-9e8d873b5581. (Possible split-brain) >[2016-04-19 07:24:39.719082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581> (5f66d228-e4d9-42e0-b98b-9e8d873b5581) [No such file or directory] >[2016-04-19 07:24:39.719238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581> (5f66d228-e4d9-42e0-b98b-9e8d873b5581) [No such file or directory] >[2016-04-19 07:24:39.721810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581> (5f66d228-e4d9-42e0-b98b-9e8d873b5581) [No such file or directory] >[2016-04-19 07:24:39.721835] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581> (5f66d228-e4d9-42e0-b98b-9e8d873b5581) [No such file or directory] >[2016-04-19 07:24:39.721979] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5f66d228-e4d9-42e0-b98b-9e8d873b5581>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.731056] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.731829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f> (44a381c7-b568-4841-a6d7-454cf20d185f) [No such file or directory] >[2016-04-19 07:24:39.732236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f> (44a381c7-b568-4841-a6d7-454cf20d185f) [No such file or directory] >[2016-04-19 07:24:39.733382] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 44a381c7-b568-4841-a6d7-454cf20d185f. (Possible split-brain) >[2016-04-19 07:24:39.734074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f> (44a381c7-b568-4841-a6d7-454cf20d185f) [No such file or directory] >[2016-04-19 07:24:39.734546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f> (44a381c7-b568-4841-a6d7-454cf20d185f) [No such file or directory] >[2016-04-19 07:24:39.735830] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f> (44a381c7-b568-4841-a6d7-454cf20d185f) [No such file or directory] >[2016-04-19 07:24:39.736178] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f> (44a381c7-b568-4841-a6d7-454cf20d185f) [No such file or directory] >[2016-04-19 07:24:39.736306] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.738858] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 44a381c7-b568-4841-a6d7-454cf20d185f. (Possible split-brain) >[2016-04-19 07:24:39.739683] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f> (44a381c7-b568-4841-a6d7-454cf20d185f) [No such file or directory] >[2016-04-19 07:24:39.740000] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f> (44a381c7-b568-4841-a6d7-454cf20d185f) [No such file or directory] >[2016-04-19 07:24:39.742974] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f> (44a381c7-b568-4841-a6d7-454cf20d185f) [No such file or directory] >[2016-04-19 07:24:39.743098] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f> (44a381c7-b568-4841-a6d7-454cf20d185f) [No such file or directory] >[2016-04-19 07:24:39.743503] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:44a381c7-b568-4841-a6d7-454cf20d185f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.752190] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.753161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb> (1478777e-75d8-4d5f-a7e4-0c23da7d94eb) [No such file or directory] >[2016-04-19 07:24:39.753198] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb> (1478777e-75d8-4d5f-a7e4-0c23da7d94eb) [No such file or directory] >[2016-04-19 07:24:39.754298] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1478777e-75d8-4d5f-a7e4-0c23da7d94eb. (Possible split-brain) >[2016-04-19 07:24:39.755200] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb> (1478777e-75d8-4d5f-a7e4-0c23da7d94eb) [No such file or directory] >[2016-04-19 07:24:39.755271] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb> (1478777e-75d8-4d5f-a7e4-0c23da7d94eb) [No such file or directory] >[2016-04-19 07:24:39.756987] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb> (1478777e-75d8-4d5f-a7e4-0c23da7d94eb) [No such file or directory] >[2016-04-19 07:24:39.757003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb> (1478777e-75d8-4d5f-a7e4-0c23da7d94eb) [No such file or directory] >[2016-04-19 07:24:39.757224] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.759711] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1478777e-75d8-4d5f-a7e4-0c23da7d94eb. (Possible split-brain) >[2016-04-19 07:24:39.760775] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb> (1478777e-75d8-4d5f-a7e4-0c23da7d94eb) [No such file or directory] >[2016-04-19 07:24:39.760844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb> (1478777e-75d8-4d5f-a7e4-0c23da7d94eb) [No such file or directory] >[2016-04-19 07:24:39.764428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb> (1478777e-75d8-4d5f-a7e4-0c23da7d94eb) [No such file or directory] >[2016-04-19 07:24:39.764573] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb> (1478777e-75d8-4d5f-a7e4-0c23da7d94eb) [No such file or directory] >[2016-04-19 07:24:39.764729] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1478777e-75d8-4d5f-a7e4-0c23da7d94eb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.774909] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.775732] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:83f7ef95-d398-4577-9a37-19e989940605> (83f7ef95-d398-4577-9a37-19e989940605) [No such file or directory] >[2016-04-19 07:24:39.775958] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:83f7ef95-d398-4577-9a37-19e989940605> (83f7ef95-d398-4577-9a37-19e989940605) [No such file or directory] >[2016-04-19 07:24:39.778485] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 83f7ef95-d398-4577-9a37-19e989940605. (Possible split-brain) >[2016-04-19 07:24:39.779424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:83f7ef95-d398-4577-9a37-19e989940605> (83f7ef95-d398-4577-9a37-19e989940605) [No such file or directory] >[2016-04-19 07:24:39.779564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:83f7ef95-d398-4577-9a37-19e989940605> (83f7ef95-d398-4577-9a37-19e989940605) [No such file or directory] >[2016-04-19 07:24:39.780542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:83f7ef95-d398-4577-9a37-19e989940605> (83f7ef95-d398-4577-9a37-19e989940605) [No such file or directory] >[2016-04-19 07:24:39.780960] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:83f7ef95-d398-4577-9a37-19e989940605> (83f7ef95-d398-4577-9a37-19e989940605) [No such file or directory] >[2016-04-19 07:24:39.781144] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:83f7ef95-d398-4577-9a37-19e989940605>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:39.783788] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 83f7ef95-d398-4577-9a37-19e989940605. (Possible split-brain) >[2016-04-19 07:24:39.784822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:83f7ef95-d398-4577-9a37-19e989940605> (83f7ef95-d398-4577-9a37-19e989940605) [No such file or directory] >[2016-04-19 07:24:39.784926] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:83f7ef95-d398-4577-9a37-19e989940605> (83f7ef95-d398-4577-9a37-19e989940605) [No such file or directory] >[2016-04-19 07:24:39.787728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:83f7ef95-d398-4577-9a37-19e989940605> (83f7ef95-d398-4577-9a37-19e989940605) [No such file or directory] >[2016-04-19 07:24:39.788308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:83f7ef95-d398-4577-9a37-19e989940605> (83f7ef95-d398-4577-9a37-19e989940605) [No such file or directory] >[2016-04-19 07:24:39.788490] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:83f7ef95-d398-4577-9a37-19e989940605>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.797852] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.798607] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a> (4e1cb9a7-0720-4775-b112-505d44e9d67a) [No such file or directory] >[2016-04-19 07:24:39.798942] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a> (4e1cb9a7-0720-4775-b112-505d44e9d67a) [No such file or directory] >[2016-04-19 07:24:39.801554] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4e1cb9a7-0720-4775-b112-505d44e9d67a. (Possible split-brain) >[2016-04-19 07:24:39.802570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a> (4e1cb9a7-0720-4775-b112-505d44e9d67a) [No such file or directory] >[2016-04-19 07:24:39.802678] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a> (4e1cb9a7-0720-4775-b112-505d44e9d67a) [No such file or directory] >[2016-04-19 07:24:39.803979] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a> (4e1cb9a7-0720-4775-b112-505d44e9d67a) [No such file or directory] >[2016-04-19 07:24:39.804300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a> (4e1cb9a7-0720-4775-b112-505d44e9d67a) [No such file or directory] >[2016-04-19 07:24:39.804507] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.807037] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4e1cb9a7-0720-4775-b112-505d44e9d67a. (Possible split-brain) >[2016-04-19 07:24:39.808127] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a> (4e1cb9a7-0720-4775-b112-505d44e9d67a) [No such file or directory] >[2016-04-19 07:24:39.808475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a> (4e1cb9a7-0720-4775-b112-505d44e9d67a) [No such file or directory] >[2016-04-19 07:24:39.811668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a> (4e1cb9a7-0720-4775-b112-505d44e9d67a) [No such file or directory] >[2016-04-19 07:24:39.811911] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a> (4e1cb9a7-0720-4775-b112-505d44e9d67a) [No such file or directory] >[2016-04-19 07:24:39.812064] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4e1cb9a7-0720-4775-b112-505d44e9d67a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.821201] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.822045] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7> (ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7) [No such file or directory] >[2016-04-19 07:24:39.822499] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7> (ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7) [No such file or directory] >[2016-04-19 07:24:39.823633] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7. (Possible split-brain) >[2016-04-19 07:24:39.824408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7> (ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7) [No such file or directory] >[2016-04-19 07:24:39.824684] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7> (ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7) [No such file or directory] >[2016-04-19 07:24:39.825658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7> (ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7) [No such file or directory] >[2016-04-19 07:24:39.826062] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7> (ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7) [No such file or directory] >[2016-04-19 07:24:39.826195] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.828708] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7. (Possible split-brain) >[2016-04-19 07:24:39.829744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7> (ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7) [No such file or directory] >[2016-04-19 07:24:39.829748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7> (ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7) [No such file or directory] >[2016-04-19 07:24:39.832348] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7> (ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7) [No such file or directory] >[2016-04-19 07:24:39.832811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7> (ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7) [No such file or directory] >[2016-04-19 07:24:39.833013] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ff00f3f8-3a3e-4c7e-9fa1-06eef57e39a7>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.840758] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.841533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb> (8533ef85-5a1c-42fe-912a-6841aac663bb) [No such file or directory] >[2016-04-19 07:24:39.841803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb> (8533ef85-5a1c-42fe-912a-6841aac663bb) [No such file or directory] >[2016-04-19 07:24:39.844399] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8533ef85-5a1c-42fe-912a-6841aac663bb. (Possible split-brain) >[2016-04-19 07:24:39.845126] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb> (8533ef85-5a1c-42fe-912a-6841aac663bb) [No such file or directory] >[2016-04-19 07:24:39.845521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb> (8533ef85-5a1c-42fe-912a-6841aac663bb) [No such file or directory] >[2016-04-19 07:24:39.846825] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb> (8533ef85-5a1c-42fe-912a-6841aac663bb) [No such file or directory] >[2016-04-19 07:24:39.846867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb> (8533ef85-5a1c-42fe-912a-6841aac663bb) [No such file or directory] >[2016-04-19 07:24:39.847064] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.849546] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8533ef85-5a1c-42fe-912a-6841aac663bb. (Possible split-brain) >[2016-04-19 07:24:39.850539] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb> (8533ef85-5a1c-42fe-912a-6841aac663bb) [No such file or directory] >[2016-04-19 07:24:39.850662] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb> (8533ef85-5a1c-42fe-912a-6841aac663bb) [No such file or directory] >[2016-04-19 07:24:39.853259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb> (8533ef85-5a1c-42fe-912a-6841aac663bb) [No such file or directory] >[2016-04-19 07:24:39.853309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb> (8533ef85-5a1c-42fe-912a-6841aac663bb) [No such file or directory] >[2016-04-19 07:24:39.853522] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8533ef85-5a1c-42fe-912a-6841aac663bb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.862567] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.863489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef> (5503e8c0-e0e1-4072-a730-61c73c0c14ef) [No such file or directory] >[2016-04-19 07:24:39.863588] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef> (5503e8c0-e0e1-4072-a730-61c73c0c14ef) [No such file or directory] >[2016-04-19 07:24:39.864672] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5503e8c0-e0e1-4072-a730-61c73c0c14ef. (Possible split-brain) >[2016-04-19 07:24:39.865629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef> (5503e8c0-e0e1-4072-a730-61c73c0c14ef) [No such file or directory] >[2016-04-19 07:24:39.865653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef> (5503e8c0-e0e1-4072-a730-61c73c0c14ef) [No such file or directory] >[2016-04-19 07:24:39.866915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef> (5503e8c0-e0e1-4072-a730-61c73c0c14ef) [No such file or directory] >[2016-04-19 07:24:39.867399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef> (5503e8c0-e0e1-4072-a730-61c73c0c14ef) [No such file or directory] >[2016-04-19 07:24:39.867566] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.869981] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5503e8c0-e0e1-4072-a730-61c73c0c14ef. (Possible split-brain) >[2016-04-19 07:24:39.870839] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef> (5503e8c0-e0e1-4072-a730-61c73c0c14ef) [No such file or directory] >[2016-04-19 07:24:39.870812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef> (5503e8c0-e0e1-4072-a730-61c73c0c14ef) [No such file or directory] >[2016-04-19 07:24:39.874129] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef> (5503e8c0-e0e1-4072-a730-61c73c0c14ef) [No such file or directory] >[2016-04-19 07:24:39.874741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef> (5503e8c0-e0e1-4072-a730-61c73c0c14ef) [No such file or directory] >[2016-04-19 07:24:39.874905] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5503e8c0-e0e1-4072-a730-61c73c0c14ef>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.883530] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.884370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c> (f3006e32-8c48-4783-b380-0cb977d9bf8c) [No such file or directory] >[2016-04-19 07:24:39.884680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c> (f3006e32-8c48-4783-b380-0cb977d9bf8c) [No such file or directory] >[2016-04-19 07:24:39.885765] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f3006e32-8c48-4783-b380-0cb977d9bf8c. (Possible split-brain) >[2016-04-19 07:24:39.886829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c> (f3006e32-8c48-4783-b380-0cb977d9bf8c) [No such file or directory] >[2016-04-19 07:24:39.886918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c> (f3006e32-8c48-4783-b380-0cb977d9bf8c) [No such file or directory] >[2016-04-19 07:24:39.888482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c> (f3006e32-8c48-4783-b380-0cb977d9bf8c) [No such file or directory] >[2016-04-19 07:24:39.888566] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c> (f3006e32-8c48-4783-b380-0cb977d9bf8c) [No such file or directory] >[2016-04-19 07:24:39.888684] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.891148] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f3006e32-8c48-4783-b380-0cb977d9bf8c. (Possible split-brain) >[2016-04-19 07:24:39.892281] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c> (f3006e32-8c48-4783-b380-0cb977d9bf8c) [No such file or directory] >[2016-04-19 07:24:39.892417] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c> (f3006e32-8c48-4783-b380-0cb977d9bf8c) [No such file or directory] >[2016-04-19 07:24:39.895410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c> (f3006e32-8c48-4783-b380-0cb977d9bf8c) [No such file or directory] >[2016-04-19 07:24:39.895601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c> (f3006e32-8c48-4783-b380-0cb977d9bf8c) [No such file or directory] >[2016-04-19 07:24:39.895784] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f3006e32-8c48-4783-b380-0cb977d9bf8c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.905023] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.906021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4852f10f-1751-4263-8331-5248109c0047> (4852f10f-1751-4263-8331-5248109c0047) [No such file or directory] >[2016-04-19 07:24:39.906029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4852f10f-1751-4263-8331-5248109c0047> (4852f10f-1751-4263-8331-5248109c0047) [No such file or directory] >[2016-04-19 07:24:39.908616] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4852f10f-1751-4263-8331-5248109c0047. (Possible split-brain) >[2016-04-19 07:24:39.909306] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4852f10f-1751-4263-8331-5248109c0047> (4852f10f-1751-4263-8331-5248109c0047) [No such file or directory] >[2016-04-19 07:24:39.909699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4852f10f-1751-4263-8331-5248109c0047> (4852f10f-1751-4263-8331-5248109c0047) [No such file or directory] >[2016-04-19 07:24:39.910997] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4852f10f-1751-4263-8331-5248109c0047> (4852f10f-1751-4263-8331-5248109c0047) [No such file or directory] >[2016-04-19 07:24:39.911083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4852f10f-1751-4263-8331-5248109c0047> (4852f10f-1751-4263-8331-5248109c0047) [No such file or directory] >[2016-04-19 07:24:39.911192] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4852f10f-1751-4263-8331-5248109c0047>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.913733] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4852f10f-1751-4263-8331-5248109c0047. (Possible split-brain) >[2016-04-19 07:24:39.914466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4852f10f-1751-4263-8331-5248109c0047> (4852f10f-1751-4263-8331-5248109c0047) [No such file or directory] >[2016-04-19 07:24:39.914710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4852f10f-1751-4263-8331-5248109c0047> (4852f10f-1751-4263-8331-5248109c0047) [No such file or directory] >[2016-04-19 07:24:39.917364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4852f10f-1751-4263-8331-5248109c0047> (4852f10f-1751-4263-8331-5248109c0047) [No such file or directory] >[2016-04-19 07:24:39.917797] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4852f10f-1751-4263-8331-5248109c0047> (4852f10f-1751-4263-8331-5248109c0047) [No such file or directory] >[2016-04-19 07:24:39.918009] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4852f10f-1751-4263-8331-5248109c0047>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.926361] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.927065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9> (0850d20e-5ff8-4ae1-a990-a42cce8976c9) [No such file or directory] >[2016-04-19 07:24:39.927438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9> (0850d20e-5ff8-4ae1-a990-a42cce8976c9) [No such file or directory] >[2016-04-19 07:24:39.930053] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0850d20e-5ff8-4ae1-a990-a42cce8976c9. (Possible split-brain) >[2016-04-19 07:24:39.931014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9> (0850d20e-5ff8-4ae1-a990-a42cce8976c9) [No such file or directory] >[2016-04-19 07:24:39.931386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9> (0850d20e-5ff8-4ae1-a990-a42cce8976c9) [No such file or directory] >[2016-04-19 07:24:39.932786] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9> (0850d20e-5ff8-4ae1-a990-a42cce8976c9) [No such file or directory] >[2016-04-19 07:24:39.932912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9> (0850d20e-5ff8-4ae1-a990-a42cce8976c9) [No such file or directory] >[2016-04-19 07:24:39.933038] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.935566] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0850d20e-5ff8-4ae1-a990-a42cce8976c9. (Possible split-brain) >[2016-04-19 07:24:39.936380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9> (0850d20e-5ff8-4ae1-a990-a42cce8976c9) [No such file or directory] >[2016-04-19 07:24:39.936616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9> (0850d20e-5ff8-4ae1-a990-a42cce8976c9) [No such file or directory] >[2016-04-19 07:24:39.939289] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9> (0850d20e-5ff8-4ae1-a990-a42cce8976c9) [No such file or directory] >[2016-04-19 07:24:39.939757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9> (0850d20e-5ff8-4ae1-a990-a42cce8976c9) [No such file or directory] >[2016-04-19 07:24:39.939906] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0850d20e-5ff8-4ae1-a990-a42cce8976c9>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:39.949523] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.950360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118> (072a6cc1-a7ff-4e36-957e-49f79814b118) [No such file or directory] >[2016-04-19 07:24:39.950559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118> (072a6cc1-a7ff-4e36-957e-49f79814b118) [No such file or directory] >[2016-04-19 07:24:39.953112] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 072a6cc1-a7ff-4e36-957e-49f79814b118. (Possible split-brain) >[2016-04-19 07:24:39.953942] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118> (072a6cc1-a7ff-4e36-957e-49f79814b118) [No such file or directory] >[2016-04-19 07:24:39.954065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118> (072a6cc1-a7ff-4e36-957e-49f79814b118) [No such file or directory] >[2016-04-19 07:24:39.955415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118> (072a6cc1-a7ff-4e36-957e-49f79814b118) [No such file or directory] >[2016-04-19 07:24:39.955682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118> (072a6cc1-a7ff-4e36-957e-49f79814b118) [No such file or directory] >[2016-04-19 07:24:39.955805] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.958347] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 072a6cc1-a7ff-4e36-957e-49f79814b118. (Possible split-brain) >[2016-04-19 07:24:39.959134] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118> (072a6cc1-a7ff-4e36-957e-49f79814b118) [No such file or directory] >[2016-04-19 07:24:39.959464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118> (072a6cc1-a7ff-4e36-957e-49f79814b118) [No such file or directory] >[2016-04-19 07:24:39.962206] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118> (072a6cc1-a7ff-4e36-957e-49f79814b118) [No such file or directory] >[2016-04-19 07:24:39.962286] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118> (072a6cc1-a7ff-4e36-957e-49f79814b118) [No such file or directory] >[2016-04-19 07:24:39.962426] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:072a6cc1-a7ff-4e36-957e-49f79814b118>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.970659] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.971427] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6ad634de-3b0c-4463-967d-d62d52531360> (6ad634de-3b0c-4463-967d-d62d52531360) [No such file or directory] >[2016-04-19 07:24:39.971775] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6ad634de-3b0c-4463-967d-d62d52531360> (6ad634de-3b0c-4463-967d-d62d52531360) [No such file or directory] >[2016-04-19 07:24:39.974271] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6ad634de-3b0c-4463-967d-d62d52531360. (Possible split-brain) >[2016-04-19 07:24:39.975067] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6ad634de-3b0c-4463-967d-d62d52531360> (6ad634de-3b0c-4463-967d-d62d52531360) [No such file or directory] >[2016-04-19 07:24:39.975494] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6ad634de-3b0c-4463-967d-d62d52531360> (6ad634de-3b0c-4463-967d-d62d52531360) [No such file or directory] >[2016-04-19 07:24:39.976966] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6ad634de-3b0c-4463-967d-d62d52531360> (6ad634de-3b0c-4463-967d-d62d52531360) [No such file or directory] >[2016-04-19 07:24:39.977454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6ad634de-3b0c-4463-967d-d62d52531360> (6ad634de-3b0c-4463-967d-d62d52531360) [No such file or directory] >[2016-04-19 07:24:39.977652] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6ad634de-3b0c-4463-967d-d62d52531360>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:39.980207] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6ad634de-3b0c-4463-967d-d62d52531360. (Possible split-brain) >[2016-04-19 07:24:39.980995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6ad634de-3b0c-4463-967d-d62d52531360> (6ad634de-3b0c-4463-967d-d62d52531360) [No such file or directory] >[2016-04-19 07:24:39.981356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6ad634de-3b0c-4463-967d-d62d52531360> (6ad634de-3b0c-4463-967d-d62d52531360) [No such file or directory] >[2016-04-19 07:24:39.984123] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6ad634de-3b0c-4463-967d-d62d52531360> (6ad634de-3b0c-4463-967d-d62d52531360) [No such file or directory] >[2016-04-19 07:24:39.984181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6ad634de-3b0c-4463-967d-d62d52531360> (6ad634de-3b0c-4463-967d-d62d52531360) [No such file or directory] >[2016-04-19 07:24:39.984366] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6ad634de-3b0c-4463-967d-d62d52531360>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:39.993853] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:39.994835] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040> (6da23cbe-f6ce-4df7-bd3c-287a00a60040) [No such file or directory] >[2016-04-19 07:24:39.994850] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040> (6da23cbe-f6ce-4df7-bd3c-287a00a60040) [No such file or directory] >[2016-04-19 07:24:39.997867] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6da23cbe-f6ce-4df7-bd3c-287a00a60040. (Possible split-brain) >[2016-04-19 07:24:39.998919] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040> (6da23cbe-f6ce-4df7-bd3c-287a00a60040) [No such file or directory] >[2016-04-19 07:24:39.998931] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040> (6da23cbe-f6ce-4df7-bd3c-287a00a60040) [No such file or directory] >[2016-04-19 07:24:40.000595] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040> (6da23cbe-f6ce-4df7-bd3c-287a00a60040) [No such file or directory] >[2016-04-19 07:24:40.000863] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040> (6da23cbe-f6ce-4df7-bd3c-287a00a60040) [No such file or directory] >[2016-04-19 07:24:40.001059] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.003579] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6da23cbe-f6ce-4df7-bd3c-287a00a60040. (Possible split-brain) >[2016-04-19 07:24:40.004420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040> (6da23cbe-f6ce-4df7-bd3c-287a00a60040) [No such file or directory] >[2016-04-19 07:24:40.004608] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040> (6da23cbe-f6ce-4df7-bd3c-287a00a60040) [No such file or directory] >[2016-04-19 07:24:40.007749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040> (6da23cbe-f6ce-4df7-bd3c-287a00a60040) [No such file or directory] >[2016-04-19 07:24:40.008407] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040> (6da23cbe-f6ce-4df7-bd3c-287a00a60040) [No such file or directory] >[2016-04-19 07:24:40.008529] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6da23cbe-f6ce-4df7-bd3c-287a00a60040>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.017718] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.018520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917> (9687372d-32d4-4e0b-b666-79769eaa0917) [No such file or directory] >[2016-04-19 07:24:40.018728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917> (9687372d-32d4-4e0b-b666-79769eaa0917) [No such file or directory] >[2016-04-19 07:24:40.021251] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9687372d-32d4-4e0b-b666-79769eaa0917. (Possible split-brain) >[2016-04-19 07:24:40.022234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917> (9687372d-32d4-4e0b-b666-79769eaa0917) [No such file or directory] >[2016-04-19 07:24:40.022352] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917> (9687372d-32d4-4e0b-b666-79769eaa0917) [No such file or directory] >[2016-04-19 07:24:40.023368] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917> (9687372d-32d4-4e0b-b666-79769eaa0917) [No such file or directory] >[2016-04-19 07:24:40.023838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917> (9687372d-32d4-4e0b-b666-79769eaa0917) [No such file or directory] >[2016-04-19 07:24:40.023989] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.026536] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9687372d-32d4-4e0b-b666-79769eaa0917. (Possible split-brain) >[2016-04-19 07:24:40.027531] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917> (9687372d-32d4-4e0b-b666-79769eaa0917) [No such file or directory] >[2016-04-19 07:24:40.027600] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917> (9687372d-32d4-4e0b-b666-79769eaa0917) [No such file or directory] >[2016-04-19 07:24:40.029905] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917> (9687372d-32d4-4e0b-b666-79769eaa0917) [No such file or directory] >[2016-04-19 07:24:40.030171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917> (9687372d-32d4-4e0b-b666-79769eaa0917) [No such file or directory] >[2016-04-19 07:24:40.030489] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9687372d-32d4-4e0b-b666-79769eaa0917>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:40.040253] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.041116] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588> (afdcd350-d0ba-4dd4-bf2d-c39260bf2588) [No such file or directory] >[2016-04-19 07:24:40.041415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588> (afdcd350-d0ba-4dd4-bf2d-c39260bf2588) [No such file or directory] >[2016-04-19 07:24:40.043985] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid afdcd350-d0ba-4dd4-bf2d-c39260bf2588. (Possible split-brain) >[2016-04-19 07:24:40.044911] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588> (afdcd350-d0ba-4dd4-bf2d-c39260bf2588) [No such file or directory] >[2016-04-19 07:24:40.045151] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588> (afdcd350-d0ba-4dd4-bf2d-c39260bf2588) [No such file or directory] >[2016-04-19 07:24:40.046351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588> (afdcd350-d0ba-4dd4-bf2d-c39260bf2588) [No such file or directory] >[2016-04-19 07:24:40.046710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588> (afdcd350-d0ba-4dd4-bf2d-c39260bf2588) [No such file or directory] >[2016-04-19 07:24:40.046825] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.049278] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid afdcd350-d0ba-4dd4-bf2d-c39260bf2588. (Possible split-brain) >[2016-04-19 07:24:40.050068] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588> (afdcd350-d0ba-4dd4-bf2d-c39260bf2588) [No such file or directory] >[2016-04-19 07:24:40.050371] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588> (afdcd350-d0ba-4dd4-bf2d-c39260bf2588) [No such file or directory] >[2016-04-19 07:24:40.053088] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588> (afdcd350-d0ba-4dd4-bf2d-c39260bf2588) [No such file or directory] >[2016-04-19 07:24:40.053265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588> (afdcd350-d0ba-4dd4-bf2d-c39260bf2588) [No such file or directory] >[2016-04-19 07:24:40.053417] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:afdcd350-d0ba-4dd4-bf2d-c39260bf2588>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.062843] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.063667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5> (b3278b7a-66c8-485f-8f95-aad935a3e8c5) [No such file or directory] >[2016-04-19 07:24:40.064168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5> (b3278b7a-66c8-485f-8f95-aad935a3e8c5) [No such file or directory] >[2016-04-19 07:24:40.065259] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b3278b7a-66c8-485f-8f95-aad935a3e8c5. (Possible split-brain) >[2016-04-19 07:24:40.066416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5> (b3278b7a-66c8-485f-8f95-aad935a3e8c5) [No such file or directory] >[2016-04-19 07:24:40.066510] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5> (b3278b7a-66c8-485f-8f95-aad935a3e8c5) [No such file or directory] >[2016-04-19 07:24:40.068024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5> (b3278b7a-66c8-485f-8f95-aad935a3e8c5) [No such file or directory] >[2016-04-19 07:24:40.068128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5> (b3278b7a-66c8-485f-8f95-aad935a3e8c5) [No such file or directory] >[2016-04-19 07:24:40.068244] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.070716] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b3278b7a-66c8-485f-8f95-aad935a3e8c5. (Possible split-brain) >[2016-04-19 07:24:40.071772] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5> (b3278b7a-66c8-485f-8f95-aad935a3e8c5) [No such file or directory] >[2016-04-19 07:24:40.071791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5> (b3278b7a-66c8-485f-8f95-aad935a3e8c5) [No such file or directory] >[2016-04-19 07:24:40.074285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5> (b3278b7a-66c8-485f-8f95-aad935a3e8c5) [No such file or directory] >[2016-04-19 07:24:40.074429] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5> (b3278b7a-66c8-485f-8f95-aad935a3e8c5) [No such file or directory] >[2016-04-19 07:24:40.074787] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b3278b7a-66c8-485f-8f95-aad935a3e8c5>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:40.084800] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.085882] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58> (c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58) [No such file or directory] >[2016-04-19 07:24:40.086522] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58> (c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58) [No such file or directory] >[2016-04-19 07:24:40.089108] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58. (Possible split-brain) >[2016-04-19 07:24:40.090167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58> (c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58) [No such file or directory] >[2016-04-19 07:24:40.090245] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58> (c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58) [No such file or directory] >[2016-04-19 07:24:40.091086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58> (c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58) [No such file or directory] >[2016-04-19 07:24:40.091149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58> (c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58) [No such file or directory] >[2016-04-19 07:24:40.091655] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.094122] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58. (Possible split-brain) >[2016-04-19 07:24:40.095094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58> (c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58) [No such file or directory] >[2016-04-19 07:24:40.095168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58> (c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58) [No such file or directory] >[2016-04-19 07:24:40.096763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58> (c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58) [No such file or directory] >[2016-04-19 07:24:40.097139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58> (c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58) [No such file or directory] >[2016-04-19 07:24:40.097251] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c6438dcf-5ef9-46ce-bfd6-c4ae8c90ab58>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.104707] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.105535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67> (fb22fbdd-76a5-4892-8840-d7ac18b0ea67) [No such file or directory] >[2016-04-19 07:24:40.106033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67> (fb22fbdd-76a5-4892-8840-d7ac18b0ea67) [No such file or directory] >[2016-04-19 07:24:40.106932] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fb22fbdd-76a5-4892-8840-d7ac18b0ea67. (Possible split-brain) >[2016-04-19 07:24:40.107677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67> (fb22fbdd-76a5-4892-8840-d7ac18b0ea67) [No such file or directory] >[2016-04-19 07:24:40.108061] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67> (fb22fbdd-76a5-4892-8840-d7ac18b0ea67) [No such file or directory] >[2016-04-19 07:24:40.109025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67> (fb22fbdd-76a5-4892-8840-d7ac18b0ea67) [No such file or directory] >[2016-04-19 07:24:40.109385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67> (fb22fbdd-76a5-4892-8840-d7ac18b0ea67) [No such file or directory] >[2016-04-19 07:24:40.109515] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.111774] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fb22fbdd-76a5-4892-8840-d7ac18b0ea67. (Possible split-brain) >[2016-04-19 07:24:40.112806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67> (fb22fbdd-76a5-4892-8840-d7ac18b0ea67) [No such file or directory] >[2016-04-19 07:24:40.112981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67> (fb22fbdd-76a5-4892-8840-d7ac18b0ea67) [No such file or directory] >[2016-04-19 07:24:40.115574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67> (fb22fbdd-76a5-4892-8840-d7ac18b0ea67) [No such file or directory] >[2016-04-19 07:24:40.115906] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67> (fb22fbdd-76a5-4892-8840-d7ac18b0ea67) [No such file or directory] >[2016-04-19 07:24:40.116055] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fb22fbdd-76a5-4892-8840-d7ac18b0ea67>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:40.125427] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.126198] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b> (0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b) [No such file or directory] >[2016-04-19 07:24:40.126267] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b> (0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b) [No such file or directory] >[2016-04-19 07:24:40.129141] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b. (Possible split-brain) >[2016-04-19 07:24:40.130123] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b> (0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b) [No such file or directory] >[2016-04-19 07:24:40.130256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b> (0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b) [No such file or directory] >[2016-04-19 07:24:40.131214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b> (0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b) [No such file or directory] >[2016-04-19 07:24:40.131334] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b> (0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b) [No such file or directory] >[2016-04-19 07:24:40.131470] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.133972] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b. (Possible split-brain) >[2016-04-19 07:24:40.134827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b> (0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b) [No such file or directory] >[2016-04-19 07:24:40.134827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b> (0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b) [No such file or directory] >[2016-04-19 07:24:40.137180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b> (0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b) [No such file or directory] >[2016-04-19 07:24:40.137304] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b> (0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b) [No such file or directory] >[2016-04-19 07:24:40.137562] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0f1a3a20-474a-47a9-aa70-f2a3cd0afb2b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.147254] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.148062] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9> (5178f453-ba64-47bb-a93d-bfec255a27e9) [No such file or directory] >[2016-04-19 07:24:40.148347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9> (5178f453-ba64-47bb-a93d-bfec255a27e9) [No such file or directory] >[2016-04-19 07:24:40.149236] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5178f453-ba64-47bb-a93d-bfec255a27e9. (Possible split-brain) >[2016-04-19 07:24:40.150188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9> (5178f453-ba64-47bb-a93d-bfec255a27e9) [No such file or directory] >[2016-04-19 07:24:40.150562] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9> (5178f453-ba64-47bb-a93d-bfec255a27e9) [No such file or directory] >[2016-04-19 07:24:40.151840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9> (5178f453-ba64-47bb-a93d-bfec255a27e9) [No such file or directory] >[2016-04-19 07:24:40.152133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9> (5178f453-ba64-47bb-a93d-bfec255a27e9) [No such file or directory] >[2016-04-19 07:24:40.152290] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.154965] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5178f453-ba64-47bb-a93d-bfec255a27e9. (Possible split-brain) >[2016-04-19 07:24:40.155765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9> (5178f453-ba64-47bb-a93d-bfec255a27e9) [No such file or directory] >[2016-04-19 07:24:40.155949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9> (5178f453-ba64-47bb-a93d-bfec255a27e9) [No such file or directory] >[2016-04-19 07:24:40.158727] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9> (5178f453-ba64-47bb-a93d-bfec255a27e9) [No such file or directory] >[2016-04-19 07:24:40.158792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9> (5178f453-ba64-47bb-a93d-bfec255a27e9) [No such file or directory] >[2016-04-19 07:24:40.158972] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5178f453-ba64-47bb-a93d-bfec255a27e9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.168930] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.169698] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb> (cb25c8f4-116e-4b42-8782-119972abd6eb) [No such file or directory] >[2016-04-19 07:24:40.169899] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb> (cb25c8f4-116e-4b42-8782-119972abd6eb) [No such file or directory] >[2016-04-19 07:24:40.172451] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cb25c8f4-116e-4b42-8782-119972abd6eb. (Possible split-brain) >[2016-04-19 07:24:40.173252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb> (cb25c8f4-116e-4b42-8782-119972abd6eb) [No such file or directory] >[2016-04-19 07:24:40.173593] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb> (cb25c8f4-116e-4b42-8782-119972abd6eb) [No such file or directory] >[2016-04-19 07:24:40.174726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb> (cb25c8f4-116e-4b42-8782-119972abd6eb) [No such file or directory] >[2016-04-19 07:24:40.174976] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb> (cb25c8f4-116e-4b42-8782-119972abd6eb) [No such file or directory] >[2016-04-19 07:24:40.175126] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.177699] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cb25c8f4-116e-4b42-8782-119972abd6eb. (Possible split-brain) >[2016-04-19 07:24:40.178559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb> (cb25c8f4-116e-4b42-8782-119972abd6eb) [No such file or directory] >[2016-04-19 07:24:40.178668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb> (cb25c8f4-116e-4b42-8782-119972abd6eb) [No such file or directory] >[2016-04-19 07:24:40.181401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb> (cb25c8f4-116e-4b42-8782-119972abd6eb) [No such file or directory] >[2016-04-19 07:24:40.181484] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb> (cb25c8f4-116e-4b42-8782-119972abd6eb) [No such file or directory] >[2016-04-19 07:24:40.181614] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cb25c8f4-116e-4b42-8782-119972abd6eb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.191586] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.192392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7> (cbc87ace-e777-4170-9ecc-87aac7a647e7) [No such file or directory] >[2016-04-19 07:24:40.192695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7> (cbc87ace-e777-4170-9ecc-87aac7a647e7) [No such file or directory] >[2016-04-19 07:24:40.195628] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cbc87ace-e777-4170-9ecc-87aac7a647e7. (Possible split-brain) >[2016-04-19 07:24:40.196447] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7> (cbc87ace-e777-4170-9ecc-87aac7a647e7) [No such file or directory] >[2016-04-19 07:24:40.196844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7> (cbc87ace-e777-4170-9ecc-87aac7a647e7) [No such file or directory] >[2016-04-19 07:24:40.197786] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7> (cbc87ace-e777-4170-9ecc-87aac7a647e7) [No such file or directory] >[2016-04-19 07:24:40.198172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7> (cbc87ace-e777-4170-9ecc-87aac7a647e7) [No such file or directory] >[2016-04-19 07:24:40.198541] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.201164] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cbc87ace-e777-4170-9ecc-87aac7a647e7. (Possible split-brain) >[2016-04-19 07:24:40.202073] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7> (cbc87ace-e777-4170-9ecc-87aac7a647e7) [No such file or directory] >[2016-04-19 07:24:40.202361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7> (cbc87ace-e777-4170-9ecc-87aac7a647e7) [No such file or directory] >[2016-04-19 07:24:40.204716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7> (cbc87ace-e777-4170-9ecc-87aac7a647e7) [No such file or directory] >[2016-04-19 07:24:40.205422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7> (cbc87ace-e777-4170-9ecc-87aac7a647e7) [No such file or directory] >[2016-04-19 07:24:40.205569] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cbc87ace-e777-4170-9ecc-87aac7a647e7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.215741] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.216889] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:aead06dc-9bda-4841-b625-01f3def819a6> (aead06dc-9bda-4841-b625-01f3def819a6) [No such file or directory] >[2016-04-19 07:24:40.216909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:aead06dc-9bda-4841-b625-01f3def819a6> (aead06dc-9bda-4841-b625-01f3def819a6) [No such file or directory] >[2016-04-19 07:24:40.219850] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid aead06dc-9bda-4841-b625-01f3def819a6. (Possible split-brain) >[2016-04-19 07:24:40.220967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:aead06dc-9bda-4841-b625-01f3def819a6> (aead06dc-9bda-4841-b625-01f3def819a6) [No such file or directory] >[2016-04-19 07:24:40.221067] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:aead06dc-9bda-4841-b625-01f3def819a6> (aead06dc-9bda-4841-b625-01f3def819a6) [No such file or directory] >[2016-04-19 07:24:40.222489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:aead06dc-9bda-4841-b625-01f3def819a6> (aead06dc-9bda-4841-b625-01f3def819a6) [No such file or directory] >[2016-04-19 07:24:40.222539] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:aead06dc-9bda-4841-b625-01f3def819a6> (aead06dc-9bda-4841-b625-01f3def819a6) [No such file or directory] >[2016-04-19 07:24:40.222751] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:aead06dc-9bda-4841-b625-01f3def819a6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.225212] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid aead06dc-9bda-4841-b625-01f3def819a6. (Possible split-brain) >[2016-04-19 07:24:40.226246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:aead06dc-9bda-4841-b625-01f3def819a6> (aead06dc-9bda-4841-b625-01f3def819a6) [No such file or directory] >[2016-04-19 07:24:40.226378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:aead06dc-9bda-4841-b625-01f3def819a6> (aead06dc-9bda-4841-b625-01f3def819a6) [No such file or directory] >[2016-04-19 07:24:40.229081] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:aead06dc-9bda-4841-b625-01f3def819a6> (aead06dc-9bda-4841-b625-01f3def819a6) [No such file or directory] >[2016-04-19 07:24:40.229105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:aead06dc-9bda-4841-b625-01f3def819a6> (aead06dc-9bda-4841-b625-01f3def819a6) [No such file or directory] >[2016-04-19 07:24:40.229311] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:aead06dc-9bda-4841-b625-01f3def819a6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.238654] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.239720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa> (00efc54f-9b3e-40c5-a24a-32e64d5504aa) [No such file or directory] >[2016-04-19 07:24:40.239732] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa> (00efc54f-9b3e-40c5-a24a-32e64d5504aa) [No such file or directory] >[2016-04-19 07:24:40.240911] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 00efc54f-9b3e-40c5-a24a-32e64d5504aa. (Possible split-brain) >[2016-04-19 07:24:40.241718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa> (00efc54f-9b3e-40c5-a24a-32e64d5504aa) [No such file or directory] >[2016-04-19 07:24:40.241999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa> (00efc54f-9b3e-40c5-a24a-32e64d5504aa) [No such file or directory] >[2016-04-19 07:24:40.243521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa> (00efc54f-9b3e-40c5-a24a-32e64d5504aa) [No such file or directory] >[2016-04-19 07:24:40.243621] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa> (00efc54f-9b3e-40c5-a24a-32e64d5504aa) [No such file or directory] >[2016-04-19 07:24:40.243731] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.246224] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 00efc54f-9b3e-40c5-a24a-32e64d5504aa. (Possible split-brain) >[2016-04-19 07:24:40.247165] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa> (00efc54f-9b3e-40c5-a24a-32e64d5504aa) [No such file or directory] >[2016-04-19 07:24:40.247250] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa> (00efc54f-9b3e-40c5-a24a-32e64d5504aa) [No such file or directory] >[2016-04-19 07:24:40.250577] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa> (00efc54f-9b3e-40c5-a24a-32e64d5504aa) [No such file or directory] >[2016-04-19 07:24:40.250609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa> (00efc54f-9b3e-40c5-a24a-32e64d5504aa) [No such file or directory] >[2016-04-19 07:24:40.250826] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:00efc54f-9b3e-40c5-a24a-32e64d5504aa>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.260646] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.261601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846> (d80fc10a-9d42-4544-ba34-711d6f184846) [No such file or directory] >[2016-04-19 07:24:40.261632] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846> (d80fc10a-9d42-4544-ba34-711d6f184846) [No such file or directory] >[2016-04-19 07:24:40.262834] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d80fc10a-9d42-4544-ba34-711d6f184846. (Possible split-brain) >[2016-04-19 07:24:40.263667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846> (d80fc10a-9d42-4544-ba34-711d6f184846) [No such file or directory] >[2016-04-19 07:24:40.263745] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846> (d80fc10a-9d42-4544-ba34-711d6f184846) [No such file or directory] >[2016-04-19 07:24:40.265110] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846> (d80fc10a-9d42-4544-ba34-711d6f184846) [No such file or directory] >[2016-04-19 07:24:40.265138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846> (d80fc10a-9d42-4544-ba34-711d6f184846) [No such file or directory] >[2016-04-19 07:24:40.265302] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.267795] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d80fc10a-9d42-4544-ba34-711d6f184846. (Possible split-brain) >[2016-04-19 07:24:40.268639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846> (d80fc10a-9d42-4544-ba34-711d6f184846) [No such file or directory] >[2016-04-19 07:24:40.268921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846> (d80fc10a-9d42-4544-ba34-711d6f184846) [No such file or directory] >[2016-04-19 07:24:40.271574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846> (d80fc10a-9d42-4544-ba34-711d6f184846) [No such file or directory] >[2016-04-19 07:24:40.271583] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846> (d80fc10a-9d42-4544-ba34-711d6f184846) [No such file or directory] >[2016-04-19 07:24:40.271779] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d80fc10a-9d42-4544-ba34-711d6f184846>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.280017] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.280907] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48096fab-f091-4d50-b8d5-460889c47e38> (48096fab-f091-4d50-b8d5-460889c47e38) [No such file or directory] >[2016-04-19 07:24:40.280912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48096fab-f091-4d50-b8d5-460889c47e38> (48096fab-f091-4d50-b8d5-460889c47e38) [No such file or directory] >[2016-04-19 07:24:40.283499] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 48096fab-f091-4d50-b8d5-460889c47e38. (Possible split-brain) >[2016-04-19 07:24:40.284312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48096fab-f091-4d50-b8d5-460889c47e38> (48096fab-f091-4d50-b8d5-460889c47e38) [No such file or directory] >[2016-04-19 07:24:40.284609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48096fab-f091-4d50-b8d5-460889c47e38> (48096fab-f091-4d50-b8d5-460889c47e38) [No such file or directory] >[2016-04-19 07:24:40.285856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48096fab-f091-4d50-b8d5-460889c47e38> (48096fab-f091-4d50-b8d5-460889c47e38) [No such file or directory] >[2016-04-19 07:24:40.285943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48096fab-f091-4d50-b8d5-460889c47e38> (48096fab-f091-4d50-b8d5-460889c47e38) [No such file or directory] >[2016-04-19 07:24:40.286068] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:48096fab-f091-4d50-b8d5-460889c47e38>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.288566] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 48096fab-f091-4d50-b8d5-460889c47e38. (Possible split-brain) >[2016-04-19 07:24:40.289641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48096fab-f091-4d50-b8d5-460889c47e38> (48096fab-f091-4d50-b8d5-460889c47e38) [No such file or directory] >[2016-04-19 07:24:40.289646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48096fab-f091-4d50-b8d5-460889c47e38> (48096fab-f091-4d50-b8d5-460889c47e38) [No such file or directory] >[2016-04-19 07:24:40.292542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48096fab-f091-4d50-b8d5-460889c47e38> (48096fab-f091-4d50-b8d5-460889c47e38) [No such file or directory] >[2016-04-19 07:24:40.292626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48096fab-f091-4d50-b8d5-460889c47e38> (48096fab-f091-4d50-b8d5-460889c47e38) [No such file or directory] >[2016-04-19 07:24:40.292741] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:48096fab-f091-4d50-b8d5-460889c47e38>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.303356] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.304468] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a> (902fc779-5e9e-4e42-af58-25f9249f057a) [No such file or directory] >[2016-04-19 07:24:40.304578] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a> (902fc779-5e9e-4e42-af58-25f9249f057a) [No such file or directory] >[2016-04-19 07:24:40.305681] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 902fc779-5e9e-4e42-af58-25f9249f057a. (Possible split-brain) >[2016-04-19 07:24:40.306654] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a> (902fc779-5e9e-4e42-af58-25f9249f057a) [No such file or directory] >[2016-04-19 07:24:40.307046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a> (902fc779-5e9e-4e42-af58-25f9249f057a) [No such file or directory] >[2016-04-19 07:24:40.308112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a> (902fc779-5e9e-4e42-af58-25f9249f057a) [No such file or directory] >[2016-04-19 07:24:40.308591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a> (902fc779-5e9e-4e42-af58-25f9249f057a) [No such file or directory] >[2016-04-19 07:24:40.308735] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.311211] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 902fc779-5e9e-4e42-af58-25f9249f057a. (Possible split-brain) >[2016-04-19 07:24:40.312358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a> (902fc779-5e9e-4e42-af58-25f9249f057a) [No such file or directory] >[2016-04-19 07:24:40.312478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a> (902fc779-5e9e-4e42-af58-25f9249f057a) [No such file or directory] >[2016-04-19 07:24:40.315741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a> (902fc779-5e9e-4e42-af58-25f9249f057a) [No such file or directory] >[2016-04-19 07:24:40.315772] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a> (902fc779-5e9e-4e42-af58-25f9249f057a) [No such file or directory] >[2016-04-19 07:24:40.315965] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:902fc779-5e9e-4e42-af58-25f9249f057a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.324407] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.325185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ea729d98-00ff-478c-b085-732f608128c2> (ea729d98-00ff-478c-b085-732f608128c2) [No such file or directory] >[2016-04-19 07:24:40.325533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ea729d98-00ff-478c-b085-732f608128c2> (ea729d98-00ff-478c-b085-732f608128c2) [No such file or directory] >[2016-04-19 07:24:40.328422] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ea729d98-00ff-478c-b085-732f608128c2. (Possible split-brain) >[2016-04-19 07:24:40.329457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ea729d98-00ff-478c-b085-732f608128c2> (ea729d98-00ff-478c-b085-732f608128c2) [No such file or directory] >[2016-04-19 07:24:40.329445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ea729d98-00ff-478c-b085-732f608128c2> (ea729d98-00ff-478c-b085-732f608128c2) [No such file or directory] >[2016-04-19 07:24:40.330880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ea729d98-00ff-478c-b085-732f608128c2> (ea729d98-00ff-478c-b085-732f608128c2) [No such file or directory] >[2016-04-19 07:24:40.330952] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ea729d98-00ff-478c-b085-732f608128c2> (ea729d98-00ff-478c-b085-732f608128c2) [No such file or directory] >[2016-04-19 07:24:40.331113] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ea729d98-00ff-478c-b085-732f608128c2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.333643] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ea729d98-00ff-478c-b085-732f608128c2. (Possible split-brain) >[2016-04-19 07:24:40.334504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ea729d98-00ff-478c-b085-732f608128c2> (ea729d98-00ff-478c-b085-732f608128c2) [No such file or directory] >[2016-04-19 07:24:40.334706] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ea729d98-00ff-478c-b085-732f608128c2> (ea729d98-00ff-478c-b085-732f608128c2) [No such file or directory] >[2016-04-19 07:24:40.338101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ea729d98-00ff-478c-b085-732f608128c2> (ea729d98-00ff-478c-b085-732f608128c2) [No such file or directory] >[2016-04-19 07:24:40.338199] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ea729d98-00ff-478c-b085-732f608128c2> (ea729d98-00ff-478c-b085-732f608128c2) [No such file or directory] >[2016-04-19 07:24:40.338367] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ea729d98-00ff-478c-b085-732f608128c2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.349219] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.350356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:095cc20b-1a00-4597-ba68-3324b85df355> (095cc20b-1a00-4597-ba68-3324b85df355) [No such file or directory] >[2016-04-19 07:24:40.350431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:095cc20b-1a00-4597-ba68-3324b85df355> (095cc20b-1a00-4597-ba68-3324b85df355) [No such file or directory] >[2016-04-19 07:24:40.353066] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 095cc20b-1a00-4597-ba68-3324b85df355. (Possible split-brain) >[2016-04-19 07:24:40.354156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:095cc20b-1a00-4597-ba68-3324b85df355> (095cc20b-1a00-4597-ba68-3324b85df355) [No such file or directory] >[2016-04-19 07:24:40.354480] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:095cc20b-1a00-4597-ba68-3324b85df355> (095cc20b-1a00-4597-ba68-3324b85df355) [No such file or directory] >[2016-04-19 07:24:40.355833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:095cc20b-1a00-4597-ba68-3324b85df355> (095cc20b-1a00-4597-ba68-3324b85df355) [No such file or directory] >[2016-04-19 07:24:40.355923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:095cc20b-1a00-4597-ba68-3324b85df355> (095cc20b-1a00-4597-ba68-3324b85df355) [No such file or directory] >[2016-04-19 07:24:40.356067] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:095cc20b-1a00-4597-ba68-3324b85df355>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.358594] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 095cc20b-1a00-4597-ba68-3324b85df355. (Possible split-brain) >[2016-04-19 07:24:40.359689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:095cc20b-1a00-4597-ba68-3324b85df355> (095cc20b-1a00-4597-ba68-3324b85df355) [No such file or directory] >[2016-04-19 07:24:40.359779] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:095cc20b-1a00-4597-ba68-3324b85df355> (095cc20b-1a00-4597-ba68-3324b85df355) [No such file or directory] >[2016-04-19 07:24:40.362657] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:095cc20b-1a00-4597-ba68-3324b85df355> (095cc20b-1a00-4597-ba68-3324b85df355) [No such file or directory] >[2016-04-19 07:24:40.363106] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:095cc20b-1a00-4597-ba68-3324b85df355> (095cc20b-1a00-4597-ba68-3324b85df355) [No such file or directory] >[2016-04-19 07:24:40.363298] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:095cc20b-1a00-4597-ba68-3324b85df355>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:40.372131] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.372976] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e> (5a84f239-0889-4c83-a0d4-6ac78500908e) [No such file or directory] >[2016-04-19 07:24:40.373229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e> (5a84f239-0889-4c83-a0d4-6ac78500908e) [No such file or directory] >[2016-04-19 07:24:40.375776] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5a84f239-0889-4c83-a0d4-6ac78500908e. (Possible split-brain) >[2016-04-19 07:24:40.376728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e> (5a84f239-0889-4c83-a0d4-6ac78500908e) [No such file or directory] >[2016-04-19 07:24:40.376878] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e> (5a84f239-0889-4c83-a0d4-6ac78500908e) [No such file or directory] >[2016-04-19 07:24:40.378149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e> (5a84f239-0889-4c83-a0d4-6ac78500908e) [No such file or directory] >[2016-04-19 07:24:40.378402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e> (5a84f239-0889-4c83-a0d4-6ac78500908e) [No such file or directory] >[2016-04-19 07:24:40.378546] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.381156] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5a84f239-0889-4c83-a0d4-6ac78500908e. (Possible split-brain) >[2016-04-19 07:24:40.381929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e> (5a84f239-0889-4c83-a0d4-6ac78500908e) [No such file or directory] >[2016-04-19 07:24:40.382154] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e> (5a84f239-0889-4c83-a0d4-6ac78500908e) [No such file or directory] >[2016-04-19 07:24:40.385704] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e> (5a84f239-0889-4c83-a0d4-6ac78500908e) [No such file or directory] >[2016-04-19 07:24:40.385713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e> (5a84f239-0889-4c83-a0d4-6ac78500908e) [No such file or directory] >[2016-04-19 07:24:40.385945] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5a84f239-0889-4c83-a0d4-6ac78500908e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.396743] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.397620] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93> (5d91abf6-486c-4896-8bb9-26a730acdd93) [No such file or directory] >[2016-04-19 07:24:40.397879] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93> (5d91abf6-486c-4896-8bb9-26a730acdd93) [No such file or directory] >[2016-04-19 07:24:40.398989] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5d91abf6-486c-4896-8bb9-26a730acdd93. (Possible split-brain) >[2016-04-19 07:24:40.399890] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93> (5d91abf6-486c-4896-8bb9-26a730acdd93) [No such file or directory] >[2016-04-19 07:24:40.399995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93> (5d91abf6-486c-4896-8bb9-26a730acdd93) [No such file or directory] >[2016-04-19 07:24:40.401150] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93> (5d91abf6-486c-4896-8bb9-26a730acdd93) [No such file or directory] >[2016-04-19 07:24:40.401253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93> (5d91abf6-486c-4896-8bb9-26a730acdd93) [No such file or directory] >[2016-04-19 07:24:40.401673] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.404102] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5d91abf6-486c-4896-8bb9-26a730acdd93. (Possible split-brain) >[2016-04-19 07:24:40.405144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93> (5d91abf6-486c-4896-8bb9-26a730acdd93) [No such file or directory] >[2016-04-19 07:24:40.405232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93> (5d91abf6-486c-4896-8bb9-26a730acdd93) [No such file or directory] >[2016-04-19 07:24:40.407770] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93> (5d91abf6-486c-4896-8bb9-26a730acdd93) [No such file or directory] >[2016-04-19 07:24:40.407997] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93> (5d91abf6-486c-4896-8bb9-26a730acdd93) [No such file or directory] >[2016-04-19 07:24:40.408470] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5d91abf6-486c-4896-8bb9-26a730acdd93>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:40.417642] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.418566] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45> (b14194f8-aac8-45fd-9744-dc2164b94c45) [No such file or directory] >[2016-04-19 07:24:40.418578] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45> (b14194f8-aac8-45fd-9744-dc2164b94c45) [No such file or directory] >[2016-04-19 07:24:40.419509] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b14194f8-aac8-45fd-9744-dc2164b94c45. (Possible split-brain) >[2016-04-19 07:24:40.420570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45> (b14194f8-aac8-45fd-9744-dc2164b94c45) [No such file or directory] >[2016-04-19 07:24:40.420829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45> (b14194f8-aac8-45fd-9744-dc2164b94c45) [No such file or directory] >[2016-04-19 07:24:40.422119] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45> (b14194f8-aac8-45fd-9744-dc2164b94c45) [No such file or directory] >[2016-04-19 07:24:40.422201] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45> (b14194f8-aac8-45fd-9744-dc2164b94c45) [No such file or directory] >[2016-04-19 07:24:40.422312] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.424831] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b14194f8-aac8-45fd-9744-dc2164b94c45. (Possible split-brain) >[2016-04-19 07:24:40.425809] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45> (b14194f8-aac8-45fd-9744-dc2164b94c45) [No such file or directory] >[2016-04-19 07:24:40.425897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45> (b14194f8-aac8-45fd-9744-dc2164b94c45) [No such file or directory] >[2016-04-19 07:24:40.429432] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45> (b14194f8-aac8-45fd-9744-dc2164b94c45) [No such file or directory] >[2016-04-19 07:24:40.429504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45> (b14194f8-aac8-45fd-9744-dc2164b94c45) [No such file or directory] >[2016-04-19 07:24:40.429727] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b14194f8-aac8-45fd-9744-dc2164b94c45>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.440211] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.441307] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84> (fe4e9742-06d9-4ebc-85d1-1b06eba10e84) [No such file or directory] >[2016-04-19 07:24:40.441460] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84> (fe4e9742-06d9-4ebc-85d1-1b06eba10e84) [No such file or directory] >[2016-04-19 07:24:40.442449] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fe4e9742-06d9-4ebc-85d1-1b06eba10e84. (Possible split-brain) >[2016-04-19 07:24:40.443518] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84> (fe4e9742-06d9-4ebc-85d1-1b06eba10e84) [No such file or directory] >[2016-04-19 07:24:40.443609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84> (fe4e9742-06d9-4ebc-85d1-1b06eba10e84) [No such file or directory] >[2016-04-19 07:24:40.444521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84> (fe4e9742-06d9-4ebc-85d1-1b06eba10e84) [No such file or directory] >[2016-04-19 07:24:40.445017] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84> (fe4e9742-06d9-4ebc-85d1-1b06eba10e84) [No such file or directory] >[2016-04-19 07:24:40.445215] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.447716] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fe4e9742-06d9-4ebc-85d1-1b06eba10e84. (Possible split-brain) >[2016-04-19 07:24:40.448885] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84> (fe4e9742-06d9-4ebc-85d1-1b06eba10e84) [No such file or directory] >[2016-04-19 07:24:40.448969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84> (fe4e9742-06d9-4ebc-85d1-1b06eba10e84) [No such file or directory] >[2016-04-19 07:24:40.451459] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84> (fe4e9742-06d9-4ebc-85d1-1b06eba10e84) [No such file or directory] >[2016-04-19 07:24:40.451769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84> (fe4e9742-06d9-4ebc-85d1-1b06eba10e84) [No such file or directory] >[2016-04-19 07:24:40.451959] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fe4e9742-06d9-4ebc-85d1-1b06eba10e84>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.461372] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.462385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dc901c01-35f4-452d-906b-bd753a45988f> (dc901c01-35f4-452d-906b-bd753a45988f) [No such file or directory] >[2016-04-19 07:24:40.462400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dc901c01-35f4-452d-906b-bd753a45988f> (dc901c01-35f4-452d-906b-bd753a45988f) [No such file or directory] >[2016-04-19 07:24:40.465361] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dc901c01-35f4-452d-906b-bd753a45988f. (Possible split-brain) >[2016-04-19 07:24:40.466407] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dc901c01-35f4-452d-906b-bd753a45988f> (dc901c01-35f4-452d-906b-bd753a45988f) [No such file or directory] >[2016-04-19 07:24:40.466417] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dc901c01-35f4-452d-906b-bd753a45988f> (dc901c01-35f4-452d-906b-bd753a45988f) [No such file or directory] >[2016-04-19 07:24:40.467542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dc901c01-35f4-452d-906b-bd753a45988f> (dc901c01-35f4-452d-906b-bd753a45988f) [No such file or directory] >[2016-04-19 07:24:40.467626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dc901c01-35f4-452d-906b-bd753a45988f> (dc901c01-35f4-452d-906b-bd753a45988f) [No such file or directory] >[2016-04-19 07:24:40.468014] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:dc901c01-35f4-452d-906b-bd753a45988f>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.470583] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dc901c01-35f4-452d-906b-bd753a45988f. (Possible split-brain) >[2016-04-19 07:24:40.471636] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dc901c01-35f4-452d-906b-bd753a45988f> (dc901c01-35f4-452d-906b-bd753a45988f) [No such file or directory] >[2016-04-19 07:24:40.471723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dc901c01-35f4-452d-906b-bd753a45988f> (dc901c01-35f4-452d-906b-bd753a45988f) [No such file or directory] >[2016-04-19 07:24:40.474400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dc901c01-35f4-452d-906b-bd753a45988f> (dc901c01-35f4-452d-906b-bd753a45988f) [No such file or directory] >[2016-04-19 07:24:40.474429] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dc901c01-35f4-452d-906b-bd753a45988f> (dc901c01-35f4-452d-906b-bd753a45988f) [No such file or directory] >[2016-04-19 07:24:40.474897] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:dc901c01-35f4-452d-906b-bd753a45988f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:40.485388] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.486558] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66> (38f2bf1b-3d67-4988-8bc0-7178d4280b66) [No such file or directory] >[2016-04-19 07:24:40.486586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66> (38f2bf1b-3d67-4988-8bc0-7178d4280b66) [No such file or directory] >[2016-04-19 07:24:40.489202] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 38f2bf1b-3d67-4988-8bc0-7178d4280b66. (Possible split-brain) >[2016-04-19 07:24:40.490410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66> (38f2bf1b-3d67-4988-8bc0-7178d4280b66) [No such file or directory] >[2016-04-19 07:24:40.490519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66> (38f2bf1b-3d67-4988-8bc0-7178d4280b66) [No such file or directory] >[2016-04-19 07:24:40.491569] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66> (38f2bf1b-3d67-4988-8bc0-7178d4280b66) [No such file or directory] >[2016-04-19 07:24:40.491599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66> (38f2bf1b-3d67-4988-8bc0-7178d4280b66) [No such file or directory] >[2016-04-19 07:24:40.492085] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.494742] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 38f2bf1b-3d67-4988-8bc0-7178d4280b66. (Possible split-brain) >[2016-04-19 07:24:40.495905] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66> (38f2bf1b-3d67-4988-8bc0-7178d4280b66) [No such file or directory] >[2016-04-19 07:24:40.495994] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66> (38f2bf1b-3d67-4988-8bc0-7178d4280b66) [No such file or directory] >[2016-04-19 07:24:40.498448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66> (38f2bf1b-3d67-4988-8bc0-7178d4280b66) [No such file or directory] >[2016-04-19 07:24:40.498741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66> (38f2bf1b-3d67-4988-8bc0-7178d4280b66) [No such file or directory] >[2016-04-19 07:24:40.498925] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:38f2bf1b-3d67-4988-8bc0-7178d4280b66>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:40.508698] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.509776] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8> (62c1c6d2-dc4c-489a-92cd-88e950c1c8a8) [No such file or directory] >[2016-04-19 07:24:40.510029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8> (62c1c6d2-dc4c-489a-92cd-88e950c1c8a8) [No such file or directory] >[2016-04-19 07:24:40.512936] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 62c1c6d2-dc4c-489a-92cd-88e950c1c8a8. (Possible split-brain) >[2016-04-19 07:24:40.513933] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8> (62c1c6d2-dc4c-489a-92cd-88e950c1c8a8) [No such file or directory] >[2016-04-19 07:24:40.513951] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8> (62c1c6d2-dc4c-489a-92cd-88e950c1c8a8) [No such file or directory] >[2016-04-19 07:24:40.515395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8> (62c1c6d2-dc4c-489a-92cd-88e950c1c8a8) [No such file or directory] >[2016-04-19 07:24:40.515421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8> (62c1c6d2-dc4c-489a-92cd-88e950c1c8a8) [No such file or directory] >[2016-04-19 07:24:40.515621] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.518210] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 62c1c6d2-dc4c-489a-92cd-88e950c1c8a8. (Possible split-brain) >[2016-04-19 07:24:40.519359] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8> (62c1c6d2-dc4c-489a-92cd-88e950c1c8a8) [No such file or directory] >[2016-04-19 07:24:40.519368] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8> (62c1c6d2-dc4c-489a-92cd-88e950c1c8a8) [No such file or directory] >[2016-04-19 07:24:40.521490] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8> (62c1c6d2-dc4c-489a-92cd-88e950c1c8a8) [No such file or directory] >[2016-04-19 07:24:40.521857] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8> (62c1c6d2-dc4c-489a-92cd-88e950c1c8a8) [No such file or directory] >[2016-04-19 07:24:40.522004] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:62c1c6d2-dc4c-489a-92cd-88e950c1c8a8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.530150] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.531051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0> (188cbc54-bff0-4ec8-a43e-ec1d9b5649b0) [No such file or directory] >[2016-04-19 07:24:40.531229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0> (188cbc54-bff0-4ec8-a43e-ec1d9b5649b0) [No such file or directory] >[2016-04-19 07:24:40.532162] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 188cbc54-bff0-4ec8-a43e-ec1d9b5649b0. (Possible split-brain) >[2016-04-19 07:24:40.533072] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0> (188cbc54-bff0-4ec8-a43e-ec1d9b5649b0) [No such file or directory] >[2016-04-19 07:24:40.533180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0> (188cbc54-bff0-4ec8-a43e-ec1d9b5649b0) [No such file or directory] >[2016-04-19 07:24:40.534719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0> (188cbc54-bff0-4ec8-a43e-ec1d9b5649b0) [No such file or directory] >[2016-04-19 07:24:40.534733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0> (188cbc54-bff0-4ec8-a43e-ec1d9b5649b0) [No such file or directory] >[2016-04-19 07:24:40.535215] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.537750] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 188cbc54-bff0-4ec8-a43e-ec1d9b5649b0. (Possible split-brain) >[2016-04-19 07:24:40.538795] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0> (188cbc54-bff0-4ec8-a43e-ec1d9b5649b0) [No such file or directory] >[2016-04-19 07:24:40.538892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0> (188cbc54-bff0-4ec8-a43e-ec1d9b5649b0) [No such file or directory] >[2016-04-19 07:24:40.541881] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0> (188cbc54-bff0-4ec8-a43e-ec1d9b5649b0) [No such file or directory] >[2016-04-19 07:24:40.542066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0> (188cbc54-bff0-4ec8-a43e-ec1d9b5649b0) [No such file or directory] >[2016-04-19 07:24:40.542155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:188cbc54-bff0-4ec8-a43e-ec1d9b5649b0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.550093] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.550723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab> (0ed49d13-aa49-4893-a7d9-fc1918e09bab) [No such file or directory] >[2016-04-19 07:24:40.550972] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab> (0ed49d13-aa49-4893-a7d9-fc1918e09bab) [No such file or directory] >[2016-04-19 07:24:40.553669] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0ed49d13-aa49-4893-a7d9-fc1918e09bab. (Possible split-brain) >[2016-04-19 07:24:40.554500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab> (0ed49d13-aa49-4893-a7d9-fc1918e09bab) [No such file or directory] >[2016-04-19 07:24:40.554696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab> (0ed49d13-aa49-4893-a7d9-fc1918e09bab) [No such file or directory] >[2016-04-19 07:24:40.556139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab> (0ed49d13-aa49-4893-a7d9-fc1918e09bab) [No such file or directory] >[2016-04-19 07:24:40.556227] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab> (0ed49d13-aa49-4893-a7d9-fc1918e09bab) [No such file or directory] >[2016-04-19 07:24:40.556376] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.558990] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0ed49d13-aa49-4893-a7d9-fc1918e09bab. (Possible split-brain) >[2016-04-19 07:24:40.560107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab> (0ed49d13-aa49-4893-a7d9-fc1918e09bab) [No such file or directory] >[2016-04-19 07:24:40.560115] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab> (0ed49d13-aa49-4893-a7d9-fc1918e09bab) [No such file or directory] >[2016-04-19 07:24:40.563215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab> (0ed49d13-aa49-4893-a7d9-fc1918e09bab) [No such file or directory] >[2016-04-19 07:24:40.563528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab> (0ed49d13-aa49-4893-a7d9-fc1918e09bab) [No such file or directory] >[2016-04-19 07:24:40.563678] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0ed49d13-aa49-4893-a7d9-fc1918e09bab>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.573990] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.575044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb> (0386c55b-4472-4377-9d43-7adddd785ecb) [No such file or directory] >[2016-04-19 07:24:40.575046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb> (0386c55b-4472-4377-9d43-7adddd785ecb) [No such file or directory] >[2016-04-19 07:24:40.576501] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0386c55b-4472-4377-9d43-7adddd785ecb. (Possible split-brain) >[2016-04-19 07:24:40.577470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb> (0386c55b-4472-4377-9d43-7adddd785ecb) [No such file or directory] >[2016-04-19 07:24:40.577586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb> (0386c55b-4472-4377-9d43-7adddd785ecb) [No such file or directory] >[2016-04-19 07:24:40.578872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb> (0386c55b-4472-4377-9d43-7adddd785ecb) [No such file or directory] >[2016-04-19 07:24:40.579005] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb> (0386c55b-4472-4377-9d43-7adddd785ecb) [No such file or directory] >[2016-04-19 07:24:40.579238] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.582083] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0386c55b-4472-4377-9d43-7adddd785ecb. (Possible split-brain) >[2016-04-19 07:24:40.583005] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb> (0386c55b-4472-4377-9d43-7adddd785ecb) [No such file or directory] >[2016-04-19 07:24:40.583131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb> (0386c55b-4472-4377-9d43-7adddd785ecb) [No such file or directory] >[2016-04-19 07:24:40.586760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb> (0386c55b-4472-4377-9d43-7adddd785ecb) [No such file or directory] >[2016-04-19 07:24:40.586794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb> (0386c55b-4472-4377-9d43-7adddd785ecb) [No such file or directory] >[2016-04-19 07:24:40.586981] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0386c55b-4472-4377-9d43-7adddd785ecb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.596492] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.597506] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e> (14e2686c-2766-4cc8-bae2-a339fa2d2f6e) [No such file or directory] >[2016-04-19 07:24:40.597603] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e> (14e2686c-2766-4cc8-bae2-a339fa2d2f6e) [No such file or directory] >[2016-04-19 07:24:40.599790] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 14e2686c-2766-4cc8-bae2-a339fa2d2f6e. (Possible split-brain) >[2016-04-19 07:24:40.600748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e> (14e2686c-2766-4cc8-bae2-a339fa2d2f6e) [No such file or directory] >[2016-04-19 07:24:40.601043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e> (14e2686c-2766-4cc8-bae2-a339fa2d2f6e) [No such file or directory] >[2016-04-19 07:24:40.602126] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e> (14e2686c-2766-4cc8-bae2-a339fa2d2f6e) [No such file or directory] >[2016-04-19 07:24:40.602335] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e> (14e2686c-2766-4cc8-bae2-a339fa2d2f6e) [No such file or directory] >[2016-04-19 07:24:40.602835] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.605794] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 14e2686c-2766-4cc8-bae2-a339fa2d2f6e. (Possible split-brain) >[2016-04-19 07:24:40.606682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e> (14e2686c-2766-4cc8-bae2-a339fa2d2f6e) [No such file or directory] >[2016-04-19 07:24:40.607345] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e> (14e2686c-2766-4cc8-bae2-a339fa2d2f6e) [No such file or directory] >[2016-04-19 07:24:40.610940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e> (14e2686c-2766-4cc8-bae2-a339fa2d2f6e) [No such file or directory] >[2016-04-19 07:24:40.611408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e> (14e2686c-2766-4cc8-bae2-a339fa2d2f6e) [No such file or directory] >[2016-04-19 07:24:40.611842] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:14e2686c-2766-4cc8-bae2-a339fa2d2f6e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.622373] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.623478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:74e27e10-fb3b-400a-8159-197a38571658> (74e27e10-fb3b-400a-8159-197a38571658) [No such file or directory] >[2016-04-19 07:24:40.623480] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:74e27e10-fb3b-400a-8159-197a38571658> (74e27e10-fb3b-400a-8159-197a38571658) [No such file or directory] >[2016-04-19 07:24:40.624558] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 74e27e10-fb3b-400a-8159-197a38571658. (Possible split-brain) >[2016-04-19 07:24:40.625687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:74e27e10-fb3b-400a-8159-197a38571658> (74e27e10-fb3b-400a-8159-197a38571658) [No such file or directory] >[2016-04-19 07:24:40.625820] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:74e27e10-fb3b-400a-8159-197a38571658> (74e27e10-fb3b-400a-8159-197a38571658) [No such file or directory] >[2016-04-19 07:24:40.626752] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:74e27e10-fb3b-400a-8159-197a38571658> (74e27e10-fb3b-400a-8159-197a38571658) [No such file or directory] >[2016-04-19 07:24:40.627209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:74e27e10-fb3b-400a-8159-197a38571658> (74e27e10-fb3b-400a-8159-197a38571658) [No such file or directory] >[2016-04-19 07:24:40.627751] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:74e27e10-fb3b-400a-8159-197a38571658>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.630503] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 74e27e10-fb3b-400a-8159-197a38571658. (Possible split-brain) >[2016-04-19 07:24:40.631650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:74e27e10-fb3b-400a-8159-197a38571658> (74e27e10-fb3b-400a-8159-197a38571658) [No such file or directory] >[2016-04-19 07:24:40.631734] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:74e27e10-fb3b-400a-8159-197a38571658> (74e27e10-fb3b-400a-8159-197a38571658) [No such file or directory] >[2016-04-19 07:24:40.634924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:74e27e10-fb3b-400a-8159-197a38571658> (74e27e10-fb3b-400a-8159-197a38571658) [No such file or directory] >[2016-04-19 07:24:40.635653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:74e27e10-fb3b-400a-8159-197a38571658> (74e27e10-fb3b-400a-8159-197a38571658) [No such file or directory] >[2016-04-19 07:24:40.635985] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:74e27e10-fb3b-400a-8159-197a38571658>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:40.647710] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.648887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b23865f-9d03-44b4-a052-11c97e644969> (8b23865f-9d03-44b4-a052-11c97e644969) [No such file or directory] >[2016-04-19 07:24:40.648964] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b23865f-9d03-44b4-a052-11c97e644969> (8b23865f-9d03-44b4-a052-11c97e644969) [No such file or directory] >[2016-04-19 07:24:40.649909] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8b23865f-9d03-44b4-a052-11c97e644969. (Possible split-brain) >[2016-04-19 07:24:40.650834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b23865f-9d03-44b4-a052-11c97e644969> (8b23865f-9d03-44b4-a052-11c97e644969) [No such file or directory] >[2016-04-19 07:24:40.653193] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b23865f-9d03-44b4-a052-11c97e644969> (8b23865f-9d03-44b4-a052-11c97e644969) [No such file or directory] >[2016-04-19 07:24:40.654551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b23865f-9d03-44b4-a052-11c97e644969> (8b23865f-9d03-44b4-a052-11c97e644969) [No such file or directory] >[2016-04-19 07:24:40.654669] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b23865f-9d03-44b4-a052-11c97e644969> (8b23865f-9d03-44b4-a052-11c97e644969) [No such file or directory] >[2016-04-19 07:24:40.654821] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8b23865f-9d03-44b4-a052-11c97e644969>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.657764] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8b23865f-9d03-44b4-a052-11c97e644969. (Possible split-brain) >[2016-04-19 07:24:40.659660] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b23865f-9d03-44b4-a052-11c97e644969> (8b23865f-9d03-44b4-a052-11c97e644969) [No such file or directory] >[2016-04-19 07:24:40.659756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b23865f-9d03-44b4-a052-11c97e644969> (8b23865f-9d03-44b4-a052-11c97e644969) [No such file or directory] >[2016-04-19 07:24:40.662746] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b23865f-9d03-44b4-a052-11c97e644969> (8b23865f-9d03-44b4-a052-11c97e644969) [No such file or directory] >[2016-04-19 07:24:40.662858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b23865f-9d03-44b4-a052-11c97e644969> (8b23865f-9d03-44b4-a052-11c97e644969) [No such file or directory] >[2016-04-19 07:24:40.662985] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8b23865f-9d03-44b4-a052-11c97e644969>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.672617] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.673452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7e5254ea-6073-41ac-b234-012c5733833d> (7e5254ea-6073-41ac-b234-012c5733833d) [No such file or directory] >[2016-04-19 07:24:40.673741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7e5254ea-6073-41ac-b234-012c5733833d> (7e5254ea-6073-41ac-b234-012c5733833d) [No such file or directory] >[2016-04-19 07:24:40.674581] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7e5254ea-6073-41ac-b234-012c5733833d. (Possible split-brain) >[2016-04-19 07:24:40.675367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7e5254ea-6073-41ac-b234-012c5733833d> (7e5254ea-6073-41ac-b234-012c5733833d) [No such file or directory] >[2016-04-19 07:24:40.675568] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7e5254ea-6073-41ac-b234-012c5733833d> (7e5254ea-6073-41ac-b234-012c5733833d) [No such file or directory] >[2016-04-19 07:24:40.676831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7e5254ea-6073-41ac-b234-012c5733833d> (7e5254ea-6073-41ac-b234-012c5733833d) [No such file or directory] >[2016-04-19 07:24:40.677077] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7e5254ea-6073-41ac-b234-012c5733833d> (7e5254ea-6073-41ac-b234-012c5733833d) [No such file or directory] >[2016-04-19 07:24:40.677234] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7e5254ea-6073-41ac-b234-012c5733833d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.679785] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7e5254ea-6073-41ac-b234-012c5733833d. (Possible split-brain) >[2016-04-19 07:24:40.680639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7e5254ea-6073-41ac-b234-012c5733833d> (7e5254ea-6073-41ac-b234-012c5733833d) [No such file or directory] >[2016-04-19 07:24:40.680707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7e5254ea-6073-41ac-b234-012c5733833d> (7e5254ea-6073-41ac-b234-012c5733833d) [No such file or directory] >[2016-04-19 07:24:40.683466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7e5254ea-6073-41ac-b234-012c5733833d> (7e5254ea-6073-41ac-b234-012c5733833d) [No such file or directory] >[2016-04-19 07:24:40.683605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7e5254ea-6073-41ac-b234-012c5733833d> (7e5254ea-6073-41ac-b234-012c5733833d) [No such file or directory] >[2016-04-19 07:24:40.683722] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7e5254ea-6073-41ac-b234-012c5733833d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.693046] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.694137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6885ba9-898f-4780-8d15-02f428001968> (c6885ba9-898f-4780-8d15-02f428001968) [No such file or directory] >[2016-04-19 07:24:40.694165] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6885ba9-898f-4780-8d15-02f428001968> (c6885ba9-898f-4780-8d15-02f428001968) [No such file or directory] >[2016-04-19 07:24:40.696973] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c6885ba9-898f-4780-8d15-02f428001968. (Possible split-brain) >[2016-04-19 07:24:40.697865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6885ba9-898f-4780-8d15-02f428001968> (c6885ba9-898f-4780-8d15-02f428001968) [No such file or directory] >[2016-04-19 07:24:40.698195] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6885ba9-898f-4780-8d15-02f428001968> (c6885ba9-898f-4780-8d15-02f428001968) [No such file or directory] >[2016-04-19 07:24:40.699546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6885ba9-898f-4780-8d15-02f428001968> (c6885ba9-898f-4780-8d15-02f428001968) [No such file or directory] >[2016-04-19 07:24:40.699652] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6885ba9-898f-4780-8d15-02f428001968> (c6885ba9-898f-4780-8d15-02f428001968) [No such file or directory] >[2016-04-19 07:24:40.699808] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c6885ba9-898f-4780-8d15-02f428001968>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.702299] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c6885ba9-898f-4780-8d15-02f428001968. (Possible split-brain) >[2016-04-19 07:24:40.703404] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6885ba9-898f-4780-8d15-02f428001968> (c6885ba9-898f-4780-8d15-02f428001968) [No such file or directory] >[2016-04-19 07:24:40.703417] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6885ba9-898f-4780-8d15-02f428001968> (c6885ba9-898f-4780-8d15-02f428001968) [No such file or directory] >[2016-04-19 07:24:40.706428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6885ba9-898f-4780-8d15-02f428001968> (c6885ba9-898f-4780-8d15-02f428001968) [No such file or directory] >[2016-04-19 07:24:40.706526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6885ba9-898f-4780-8d15-02f428001968> (c6885ba9-898f-4780-8d15-02f428001968) [No such file or directory] >[2016-04-19 07:24:40.706659] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c6885ba9-898f-4780-8d15-02f428001968>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.715877] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.716794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3> (125bbda7-f7f2-436b-803c-b7cea42b26b3) [No such file or directory] >[2016-04-19 07:24:40.716860] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3> (125bbda7-f7f2-436b-803c-b7cea42b26b3) [No such file or directory] >[2016-04-19 07:24:40.717758] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 125bbda7-f7f2-436b-803c-b7cea42b26b3. (Possible split-brain) >[2016-04-19 07:24:40.718661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3> (125bbda7-f7f2-436b-803c-b7cea42b26b3) [No such file or directory] >[2016-04-19 07:24:40.718764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3> (125bbda7-f7f2-436b-803c-b7cea42b26b3) [No such file or directory] >[2016-04-19 07:24:40.719809] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3> (125bbda7-f7f2-436b-803c-b7cea42b26b3) [No such file or directory] >[2016-04-19 07:24:40.720240] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3> (125bbda7-f7f2-436b-803c-b7cea42b26b3) [No such file or directory] >[2016-04-19 07:24:40.720411] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.722883] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 125bbda7-f7f2-436b-803c-b7cea42b26b3. (Possible split-brain) >[2016-04-19 07:24:40.723890] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3> (125bbda7-f7f2-436b-803c-b7cea42b26b3) [No such file or directory] >[2016-04-19 07:24:40.723988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3> (125bbda7-f7f2-436b-803c-b7cea42b26b3) [No such file or directory] >[2016-04-19 07:24:40.726689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3> (125bbda7-f7f2-436b-803c-b7cea42b26b3) [No such file or directory] >[2016-04-19 07:24:40.726776] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3> (125bbda7-f7f2-436b-803c-b7cea42b26b3) [No such file or directory] >[2016-04-19 07:24:40.726917] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:125bbda7-f7f2-436b-803c-b7cea42b26b3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.736121] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.737158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864> (85bc989b-2f6f-4c69-90b2-6b4030a92864) [No such file or directory] >[2016-04-19 07:24:40.737239] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864> (85bc989b-2f6f-4c69-90b2-6b4030a92864) [No such file or directory] >[2016-04-19 07:24:40.740182] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 85bc989b-2f6f-4c69-90b2-6b4030a92864. (Possible split-brain) >[2016-04-19 07:24:40.741343] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864> (85bc989b-2f6f-4c69-90b2-6b4030a92864) [No such file or directory] >[2016-04-19 07:24:40.741374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864> (85bc989b-2f6f-4c69-90b2-6b4030a92864) [No such file or directory] >[2016-04-19 07:24:40.742603] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864> (85bc989b-2f6f-4c69-90b2-6b4030a92864) [No such file or directory] >[2016-04-19 07:24:40.742668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864> (85bc989b-2f6f-4c69-90b2-6b4030a92864) [No such file or directory] >[2016-04-19 07:24:40.742864] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.745417] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 85bc989b-2f6f-4c69-90b2-6b4030a92864. (Possible split-brain) >[2016-04-19 07:24:40.746428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864> (85bc989b-2f6f-4c69-90b2-6b4030a92864) [No such file or directory] >[2016-04-19 07:24:40.746598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864> (85bc989b-2f6f-4c69-90b2-6b4030a92864) [No such file or directory] >[2016-04-19 07:24:40.749690] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864> (85bc989b-2f6f-4c69-90b2-6b4030a92864) [No such file or directory] >[2016-04-19 07:24:40.749785] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864> (85bc989b-2f6f-4c69-90b2-6b4030a92864) [No such file or directory] >[2016-04-19 07:24:40.750055] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:85bc989b-2f6f-4c69-90b2-6b4030a92864>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.759791] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.760567] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44> (5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44) [No such file or directory] >[2016-04-19 07:24:40.760890] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44> (5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44) [No such file or directory] >[2016-04-19 07:24:40.763850] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44. (Possible split-brain) >[2016-04-19 07:24:40.764904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44> (5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44) [No such file or directory] >[2016-04-19 07:24:40.764917] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44> (5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44) [No such file or directory] >[2016-04-19 07:24:40.766286] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44> (5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44) [No such file or directory] >[2016-04-19 07:24:40.766593] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44> (5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44) [No such file or directory] >[2016-04-19 07:24:40.766738] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.769196] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44. (Possible split-brain) >[2016-04-19 07:24:40.770068] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44> (5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44) [No such file or directory] >[2016-04-19 07:24:40.770244] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44> (5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44) [No such file or directory] >[2016-04-19 07:24:40.773409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44> (5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44) [No such file or directory] >[2016-04-19 07:24:40.773564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44> (5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44) [No such file or directory] >[2016-04-19 07:24:40.773703] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5277baeb-2ba4-40b5-a9b1-1ff24c6b3d44>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.782740] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.783619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a> (265f2e6c-366b-4f02-8bd1-dc410734d36a) [No such file or directory] >[2016-04-19 07:24:40.783916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a> (265f2e6c-366b-4f02-8bd1-dc410734d36a) [No such file or directory] >[2016-04-19 07:24:40.784818] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 265f2e6c-366b-4f02-8bd1-dc410734d36a. (Possible split-brain) >[2016-04-19 07:24:40.785847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a> (265f2e6c-366b-4f02-8bd1-dc410734d36a) [No such file or directory] >[2016-04-19 07:24:40.785871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a> (265f2e6c-366b-4f02-8bd1-dc410734d36a) [No such file or directory] >[2016-04-19 07:24:40.787240] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a> (265f2e6c-366b-4f02-8bd1-dc410734d36a) [No such file or directory] >[2016-04-19 07:24:40.787691] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a> (265f2e6c-366b-4f02-8bd1-dc410734d36a) [No such file or directory] >[2016-04-19 07:24:40.787858] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.790388] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 265f2e6c-366b-4f02-8bd1-dc410734d36a. (Possible split-brain) >[2016-04-19 07:24:40.791401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a> (265f2e6c-366b-4f02-8bd1-dc410734d36a) [No such file or directory] >[2016-04-19 07:24:40.791751] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a> (265f2e6c-366b-4f02-8bd1-dc410734d36a) [No such file or directory] >[2016-04-19 07:24:40.794521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a> (265f2e6c-366b-4f02-8bd1-dc410734d36a) [No such file or directory] >[2016-04-19 07:24:40.794646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a> (265f2e6c-366b-4f02-8bd1-dc410734d36a) [No such file or directory] >[2016-04-19 07:24:40.794797] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:265f2e6c-366b-4f02-8bd1-dc410734d36a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.803935] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.804891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e> (aa83afb7-de37-401f-9b96-2db4b410af5e) [No such file or directory] >[2016-04-19 07:24:40.804891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e> (aa83afb7-de37-401f-9b96-2db4b410af5e) [No such file or directory] >[2016-04-19 07:24:40.807519] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid aa83afb7-de37-401f-9b96-2db4b410af5e. (Possible split-brain) >[2016-04-19 07:24:40.808722] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e> (aa83afb7-de37-401f-9b96-2db4b410af5e) [No such file or directory] >[2016-04-19 07:24:40.808844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e> (aa83afb7-de37-401f-9b96-2db4b410af5e) [No such file or directory] >[2016-04-19 07:24:40.810121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e> (aa83afb7-de37-401f-9b96-2db4b410af5e) [No such file or directory] >[2016-04-19 07:24:40.810222] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e> (aa83afb7-de37-401f-9b96-2db4b410af5e) [No such file or directory] >[2016-04-19 07:24:40.810386] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.812928] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid aa83afb7-de37-401f-9b96-2db4b410af5e. (Possible split-brain) >[2016-04-19 07:24:40.813742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e> (aa83afb7-de37-401f-9b96-2db4b410af5e) [No such file or directory] >[2016-04-19 07:24:40.813988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e> (aa83afb7-de37-401f-9b96-2db4b410af5e) [No such file or directory] >[2016-04-19 07:24:40.816562] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e> (aa83afb7-de37-401f-9b96-2db4b410af5e) [No such file or directory] >[2016-04-19 07:24:40.816724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e> (aa83afb7-de37-401f-9b96-2db4b410af5e) [No such file or directory] >[2016-04-19 07:24:40.816855] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:aa83afb7-de37-401f-9b96-2db4b410af5e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.824967] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.825694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884> (e8dc528c-20e1-4866-9c9d-7befbd253884) [No such file or directory] >[2016-04-19 07:24:40.825969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884> (e8dc528c-20e1-4866-9c9d-7befbd253884) [No such file or directory] >[2016-04-19 07:24:40.826847] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e8dc528c-20e1-4866-9c9d-7befbd253884. (Possible split-brain) >[2016-04-19 07:24:40.827753] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884> (e8dc528c-20e1-4866-9c9d-7befbd253884) [No such file or directory] >[2016-04-19 07:24:40.827912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884> (e8dc528c-20e1-4866-9c9d-7befbd253884) [No such file or directory] >[2016-04-19 07:24:40.829264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884> (e8dc528c-20e1-4866-9c9d-7befbd253884) [No such file or directory] >[2016-04-19 07:24:40.829293] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884> (e8dc528c-20e1-4866-9c9d-7befbd253884) [No such file or directory] >[2016-04-19 07:24:40.829470] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.831935] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e8dc528c-20e1-4866-9c9d-7befbd253884. (Possible split-brain) >[2016-04-19 07:24:40.832738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884> (e8dc528c-20e1-4866-9c9d-7befbd253884) [No such file or directory] >[2016-04-19 07:24:40.832846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884> (e8dc528c-20e1-4866-9c9d-7befbd253884) [No such file or directory] >[2016-04-19 07:24:40.835953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884> (e8dc528c-20e1-4866-9c9d-7befbd253884) [No such file or directory] >[2016-04-19 07:24:40.836036] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884> (e8dc528c-20e1-4866-9c9d-7befbd253884) [No such file or directory] >[2016-04-19 07:24:40.836142] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e8dc528c-20e1-4866-9c9d-7befbd253884>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.844617] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.845670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c> (d6c489a0-db28-49fa-b3b6-d1265a7bd60c) [No such file or directory] >[2016-04-19 07:24:40.845692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c> (d6c489a0-db28-49fa-b3b6-d1265a7bd60c) [No such file or directory] >[2016-04-19 07:24:40.846863] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d6c489a0-db28-49fa-b3b6-d1265a7bd60c. (Possible split-brain) >[2016-04-19 07:24:40.847697] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c> (d6c489a0-db28-49fa-b3b6-d1265a7bd60c) [No such file or directory] >[2016-04-19 07:24:40.847825] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c> (d6c489a0-db28-49fa-b3b6-d1265a7bd60c) [No such file or directory] >[2016-04-19 07:24:40.849080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c> (d6c489a0-db28-49fa-b3b6-d1265a7bd60c) [No such file or directory] >[2016-04-19 07:24:40.849145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c> (d6c489a0-db28-49fa-b3b6-d1265a7bd60c) [No such file or directory] >[2016-04-19 07:24:40.849276] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.851753] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d6c489a0-db28-49fa-b3b6-d1265a7bd60c. (Possible split-brain) >[2016-04-19 07:24:40.852626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c> (d6c489a0-db28-49fa-b3b6-d1265a7bd60c) [No such file or directory] >[2016-04-19 07:24:40.852725] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c> (d6c489a0-db28-49fa-b3b6-d1265a7bd60c) [No such file or directory] >[2016-04-19 07:24:40.856223] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c> (d6c489a0-db28-49fa-b3b6-d1265a7bd60c) [No such file or directory] >[2016-04-19 07:24:40.856245] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c> (d6c489a0-db28-49fa-b3b6-d1265a7bd60c) [No such file or directory] >[2016-04-19 07:24:40.856454] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d6c489a0-db28-49fa-b3b6-d1265a7bd60c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.865578] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.866650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c> (044703c0-c26a-475e-a094-60dd5c45e02c) [No such file or directory] >[2016-04-19 07:24:40.866675] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c> (044703c0-c26a-475e-a094-60dd5c45e02c) [No such file or directory] >[2016-04-19 07:24:40.867810] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 044703c0-c26a-475e-a094-60dd5c45e02c. (Possible split-brain) >[2016-04-19 07:24:40.869044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c> (044703c0-c26a-475e-a094-60dd5c45e02c) [No such file or directory] >[2016-04-19 07:24:40.869069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c> (044703c0-c26a-475e-a094-60dd5c45e02c) [No such file or directory] >[2016-04-19 07:24:40.870586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c> (044703c0-c26a-475e-a094-60dd5c45e02c) [No such file or directory] >[2016-04-19 07:24:40.870679] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c> (044703c0-c26a-475e-a094-60dd5c45e02c) [No such file or directory] >[2016-04-19 07:24:40.870788] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.873209] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 044703c0-c26a-475e-a094-60dd5c45e02c. (Possible split-brain) >[2016-04-19 07:24:40.873974] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c> (044703c0-c26a-475e-a094-60dd5c45e02c) [No such file or directory] >[2016-04-19 07:24:40.874205] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c> (044703c0-c26a-475e-a094-60dd5c45e02c) [No such file or directory] >[2016-04-19 07:24:40.877099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c> (044703c0-c26a-475e-a094-60dd5c45e02c) [No such file or directory] >[2016-04-19 07:24:40.877294] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c> (044703c0-c26a-475e-a094-60dd5c45e02c) [No such file or directory] >[2016-04-19 07:24:40.877440] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:044703c0-c26a-475e-a094-60dd5c45e02c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.886650] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.887452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29> (1d11ed41-f4b9-4653-9ffb-9a240ce03e29) [No such file or directory] >[2016-04-19 07:24:40.887749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29> (1d11ed41-f4b9-4653-9ffb-9a240ce03e29) [No such file or directory] >[2016-04-19 07:24:40.890293] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1d11ed41-f4b9-4653-9ffb-9a240ce03e29. (Possible split-brain) >[2016-04-19 07:24:40.891188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29> (1d11ed41-f4b9-4653-9ffb-9a240ce03e29) [No such file or directory] >[2016-04-19 07:24:40.891553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29> (1d11ed41-f4b9-4653-9ffb-9a240ce03e29) [No such file or directory] >[2016-04-19 07:24:40.893232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29> (1d11ed41-f4b9-4653-9ffb-9a240ce03e29) [No such file or directory] >[2016-04-19 07:24:40.893236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29> (1d11ed41-f4b9-4653-9ffb-9a240ce03e29) [No such file or directory] >[2016-04-19 07:24:40.893435] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.896010] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1d11ed41-f4b9-4653-9ffb-9a240ce03e29. (Possible split-brain) >[2016-04-19 07:24:40.897041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29> (1d11ed41-f4b9-4653-9ffb-9a240ce03e29) [No such file or directory] >[2016-04-19 07:24:40.897424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29> (1d11ed41-f4b9-4653-9ffb-9a240ce03e29) [No such file or directory] >[2016-04-19 07:24:40.900647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29> (1d11ed41-f4b9-4653-9ffb-9a240ce03e29) [No such file or directory] >[2016-04-19 07:24:40.900707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29> (1d11ed41-f4b9-4653-9ffb-9a240ce03e29) [No such file or directory] >[2016-04-19 07:24:40.900908] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1d11ed41-f4b9-4653-9ffb-9a240ce03e29>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.910257] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.911307] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db> (86fbdacd-ba2f-4363-83fc-49d8505638db) [No such file or directory] >[2016-04-19 07:24:40.911422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db> (86fbdacd-ba2f-4363-83fc-49d8505638db) [No such file or directory] >[2016-04-19 07:24:40.914251] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 86fbdacd-ba2f-4363-83fc-49d8505638db. (Possible split-brain) >[2016-04-19 07:24:40.915214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db> (86fbdacd-ba2f-4363-83fc-49d8505638db) [No such file or directory] >[2016-04-19 07:24:40.915509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db> (86fbdacd-ba2f-4363-83fc-49d8505638db) [No such file or directory] >[2016-04-19 07:24:40.916798] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db> (86fbdacd-ba2f-4363-83fc-49d8505638db) [No such file or directory] >[2016-04-19 07:24:40.916936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db> (86fbdacd-ba2f-4363-83fc-49d8505638db) [No such file or directory] >[2016-04-19 07:24:40.917064] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.919704] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 86fbdacd-ba2f-4363-83fc-49d8505638db. (Possible split-brain) >[2016-04-19 07:24:40.920637] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db> (86fbdacd-ba2f-4363-83fc-49d8505638db) [No such file or directory] >[2016-04-19 07:24:40.920661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db> (86fbdacd-ba2f-4363-83fc-49d8505638db) [No such file or directory] >[2016-04-19 07:24:40.923765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db> (86fbdacd-ba2f-4363-83fc-49d8505638db) [No such file or directory] >[2016-04-19 07:24:40.923782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db> (86fbdacd-ba2f-4363-83fc-49d8505638db) [No such file or directory] >[2016-04-19 07:24:40.923959] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:86fbdacd-ba2f-4363-83fc-49d8505638db>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.933633] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.934654] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77> (acd758a6-07c3-4350-bcf5-b25ec3695a77) [No such file or directory] >[2016-04-19 07:24:40.934732] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77> (acd758a6-07c3-4350-bcf5-b25ec3695a77) [No such file or directory] >[2016-04-19 07:24:40.937594] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid acd758a6-07c3-4350-bcf5-b25ec3695a77. (Possible split-brain) >[2016-04-19 07:24:40.938572] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77> (acd758a6-07c3-4350-bcf5-b25ec3695a77) [No such file or directory] >[2016-04-19 07:24:40.938585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77> (acd758a6-07c3-4350-bcf5-b25ec3695a77) [No such file or directory] >[2016-04-19 07:24:40.939859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77> (acd758a6-07c3-4350-bcf5-b25ec3695a77) [No such file or directory] >[2016-04-19 07:24:40.939873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77> (acd758a6-07c3-4350-bcf5-b25ec3695a77) [No such file or directory] >[2016-04-19 07:24:40.940023] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:40.941541] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid acd758a6-07c3-4350-bcf5-b25ec3695a77. (Possible split-brain) >[2016-04-19 07:24:40.942212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77> (acd758a6-07c3-4350-bcf5-b25ec3695a77) [No such file or directory] >[2016-04-19 07:24:40.942410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77> (acd758a6-07c3-4350-bcf5-b25ec3695a77) [No such file or directory] >[2016-04-19 07:24:40.944892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77> (acd758a6-07c3-4350-bcf5-b25ec3695a77) [No such file or directory] >[2016-04-19 07:24:40.945018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77> (acd758a6-07c3-4350-bcf5-b25ec3695a77) [No such file or directory] >[2016-04-19 07:24:40.945106] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:acd758a6-07c3-4350-bcf5-b25ec3695a77>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.954456] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.955430] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c> (b8d5307e-08c2-400b-8482-b35e667cf68c) [No such file or directory] >[2016-04-19 07:24:40.955724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c> (b8d5307e-08c2-400b-8482-b35e667cf68c) [No such file or directory] >[2016-04-19 07:24:40.956686] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b8d5307e-08c2-400b-8482-b35e667cf68c. (Possible split-brain) >[2016-04-19 07:24:40.957768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c> (b8d5307e-08c2-400b-8482-b35e667cf68c) [No such file or directory] >[2016-04-19 07:24:40.958094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c> (b8d5307e-08c2-400b-8482-b35e667cf68c) [No such file or directory] >[2016-04-19 07:24:40.959309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c> (b8d5307e-08c2-400b-8482-b35e667cf68c) [No such file or directory] >[2016-04-19 07:24:40.959441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c> (b8d5307e-08c2-400b-8482-b35e667cf68c) [No such file or directory] >[2016-04-19 07:24:40.959650] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.961150] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b8d5307e-08c2-400b-8482-b35e667cf68c. (Possible split-brain) >[2016-04-19 07:24:40.962083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c> (b8d5307e-08c2-400b-8482-b35e667cf68c) [No such file or directory] >[2016-04-19 07:24:40.962125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c> (b8d5307e-08c2-400b-8482-b35e667cf68c) [No such file or directory] >[2016-04-19 07:24:40.963706] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c> (b8d5307e-08c2-400b-8482-b35e667cf68c) [No such file or directory] >[2016-04-19 07:24:40.963756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c> (b8d5307e-08c2-400b-8482-b35e667cf68c) [No such file or directory] >[2016-04-19 07:24:40.963861] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b8d5307e-08c2-400b-8482-b35e667cf68c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:40.972553] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.973629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1> (a4194e38-ca84-407c-8643-a8c84d1ac7b1) [No such file or directory] >[2016-04-19 07:24:40.973696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1> (a4194e38-ca84-407c-8643-a8c84d1ac7b1) [No such file or directory] >[2016-04-19 07:24:40.974717] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a4194e38-ca84-407c-8643-a8c84d1ac7b1. (Possible split-brain) >[2016-04-19 07:24:40.975302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1> (a4194e38-ca84-407c-8643-a8c84d1ac7b1) [No such file or directory] >[2016-04-19 07:24:40.975569] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1> (a4194e38-ca84-407c-8643-a8c84d1ac7b1) [No such file or directory] >[2016-04-19 07:24:40.976719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1> (a4194e38-ca84-407c-8643-a8c84d1ac7b1) [No such file or directory] >[2016-04-19 07:24:40.976964] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1> (a4194e38-ca84-407c-8643-a8c84d1ac7b1) [No such file or directory] >[2016-04-19 07:24:40.977097] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:40.979534] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a4194e38-ca84-407c-8643-a8c84d1ac7b1. (Possible split-brain) >[2016-04-19 07:24:40.980268] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1> (a4194e38-ca84-407c-8643-a8c84d1ac7b1) [No such file or directory] >[2016-04-19 07:24:40.980496] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1> (a4194e38-ca84-407c-8643-a8c84d1ac7b1) [No such file or directory] >[2016-04-19 07:24:40.983121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1> (a4194e38-ca84-407c-8643-a8c84d1ac7b1) [No such file or directory] >[2016-04-19 07:24:40.983347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1> (a4194e38-ca84-407c-8643-a8c84d1ac7b1) [No such file or directory] >[2016-04-19 07:24:40.983479] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a4194e38-ca84-407c-8643-a8c84d1ac7b1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:40.993138] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:40.994140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c> (427a75e0-a702-4af5-b27f-b130bbca219c) [No such file or directory] >[2016-04-19 07:24:40.994459] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c> (427a75e0-a702-4af5-b27f-b130bbca219c) [No such file or directory] >[2016-04-19 07:24:40.995389] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 427a75e0-a702-4af5-b27f-b130bbca219c. (Possible split-brain) >[2016-04-19 07:24:40.996428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c> (427a75e0-a702-4af5-b27f-b130bbca219c) [No such file or directory] >[2016-04-19 07:24:40.996710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c> (427a75e0-a702-4af5-b27f-b130bbca219c) [No such file or directory] >[2016-04-19 07:24:40.998015] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c> (427a75e0-a702-4af5-b27f-b130bbca219c) [No such file or directory] >[2016-04-19 07:24:40.998054] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c> (427a75e0-a702-4af5-b27f-b130bbca219c) [No such file or directory] >[2016-04-19 07:24:40.998276] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.000814] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 427a75e0-a702-4af5-b27f-b130bbca219c. (Possible split-brain) >[2016-04-19 07:24:41.001962] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c> (427a75e0-a702-4af5-b27f-b130bbca219c) [No such file or directory] >[2016-04-19 07:24:41.001987] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c> (427a75e0-a702-4af5-b27f-b130bbca219c) [No such file or directory] >[2016-04-19 07:24:41.004358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c> (427a75e0-a702-4af5-b27f-b130bbca219c) [No such file or directory] >[2016-04-19 07:24:41.004480] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c> (427a75e0-a702-4af5-b27f-b130bbca219c) [No such file or directory] >[2016-04-19 07:24:41.004654] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:427a75e0-a702-4af5-b27f-b130bbca219c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.014953] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.015971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8> (5898b601-1eca-4a3d-baf4-2d642f9221a8) [No such file or directory] >[2016-04-19 07:24:41.015991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8> (5898b601-1eca-4a3d-baf4-2d642f9221a8) [No such file or directory] >[2016-04-19 07:24:41.016868] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5898b601-1eca-4a3d-baf4-2d642f9221a8. (Possible split-brain) >[2016-04-19 07:24:41.017795] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8> (5898b601-1eca-4a3d-baf4-2d642f9221a8) [No such file or directory] >[2016-04-19 07:24:41.017824] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8> (5898b601-1eca-4a3d-baf4-2d642f9221a8) [No such file or directory] >[2016-04-19 07:24:41.019072] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8> (5898b601-1eca-4a3d-baf4-2d642f9221a8) [No such file or directory] >[2016-04-19 07:24:41.019111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8> (5898b601-1eca-4a3d-baf4-2d642f9221a8) [No such file or directory] >[2016-04-19 07:24:41.019252] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.021725] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5898b601-1eca-4a3d-baf4-2d642f9221a8. (Possible split-brain) >[2016-04-19 07:24:41.022635] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8> (5898b601-1eca-4a3d-baf4-2d642f9221a8) [No such file or directory] >[2016-04-19 07:24:41.022873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8> (5898b601-1eca-4a3d-baf4-2d642f9221a8) [No such file or directory] >[2016-04-19 07:24:41.025654] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8> (5898b601-1eca-4a3d-baf4-2d642f9221a8) [No such file or directory] >[2016-04-19 07:24:41.025926] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8> (5898b601-1eca-4a3d-baf4-2d642f9221a8) [No such file or directory] >[2016-04-19 07:24:41.026051] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5898b601-1eca-4a3d-baf4-2d642f9221a8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.034103] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.034885] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b> (b9a637d6-cb13-45a8-8486-5c839be8778b) [No such file or directory] >[2016-04-19 07:24:41.035130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b> (b9a637d6-cb13-45a8-8486-5c839be8778b) [No such file or directory] >[2016-04-19 07:24:41.036046] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b9a637d6-cb13-45a8-8486-5c839be8778b. (Possible split-brain) >[2016-04-19 07:24:41.036871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b> (b9a637d6-cb13-45a8-8486-5c839be8778b) [No such file or directory] >[2016-04-19 07:24:41.037115] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b> (b9a637d6-cb13-45a8-8486-5c839be8778b) [No such file or directory] >[2016-04-19 07:24:41.038393] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b> (b9a637d6-cb13-45a8-8486-5c839be8778b) [No such file or directory] >[2016-04-19 07:24:41.038473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b> (b9a637d6-cb13-45a8-8486-5c839be8778b) [No such file or directory] >[2016-04-19 07:24:41.038572] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.041153] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b9a637d6-cb13-45a8-8486-5c839be8778b. (Possible split-brain) >[2016-04-19 07:24:41.041980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b> (b9a637d6-cb13-45a8-8486-5c839be8778b) [No such file or directory] >[2016-04-19 07:24:41.042050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b> (b9a637d6-cb13-45a8-8486-5c839be8778b) [No such file or directory] >[2016-04-19 07:24:41.044801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b> (b9a637d6-cb13-45a8-8486-5c839be8778b) [No such file or directory] >[2016-04-19 07:24:41.044832] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b> (b9a637d6-cb13-45a8-8486-5c839be8778b) [No such file or directory] >[2016-04-19 07:24:41.044994] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b9a637d6-cb13-45a8-8486-5c839be8778b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.053662] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.054390] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4> (2338e443-9cb1-43df-af36-cd36ff9caba4) [No such file or directory] >[2016-04-19 07:24:41.054598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4> (2338e443-9cb1-43df-af36-cd36ff9caba4) [No such file or directory] >[2016-04-19 07:24:41.057108] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2338e443-9cb1-43df-af36-cd36ff9caba4. (Possible split-brain) >[2016-04-19 07:24:41.057889] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4> (2338e443-9cb1-43df-af36-cd36ff9caba4) [No such file or directory] >[2016-04-19 07:24:41.057946] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4> (2338e443-9cb1-43df-af36-cd36ff9caba4) [No such file or directory] >[2016-04-19 07:24:41.059068] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4> (2338e443-9cb1-43df-af36-cd36ff9caba4) [No such file or directory] >[2016-04-19 07:24:41.059351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4> (2338e443-9cb1-43df-af36-cd36ff9caba4) [No such file or directory] >[2016-04-19 07:24:41.059472] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.061976] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2338e443-9cb1-43df-af36-cd36ff9caba4. (Possible split-brain) >[2016-04-19 07:24:41.062744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4> (2338e443-9cb1-43df-af36-cd36ff9caba4) [No such file or directory] >[2016-04-19 07:24:41.062831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4> (2338e443-9cb1-43df-af36-cd36ff9caba4) [No such file or directory] >[2016-04-19 07:24:41.065698] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4> (2338e443-9cb1-43df-af36-cd36ff9caba4) [No such file or directory] >[2016-04-19 07:24:41.066075] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4> (2338e443-9cb1-43df-af36-cd36ff9caba4) [No such file or directory] >[2016-04-19 07:24:41.066230] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2338e443-9cb1-43df-af36-cd36ff9caba4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.074519] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.075716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355> (7d2d9b7d-0972-4213-a8c0-201eddd7d355) [No such file or directory] >[2016-04-19 07:24:41.075718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355> (7d2d9b7d-0972-4213-a8c0-201eddd7d355) [No such file or directory] >[2016-04-19 07:24:41.078363] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7d2d9b7d-0972-4213-a8c0-201eddd7d355. (Possible split-brain) >[2016-04-19 07:24:41.079441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355> (7d2d9b7d-0972-4213-a8c0-201eddd7d355) [No such file or directory] >[2016-04-19 07:24:41.079455] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355> (7d2d9b7d-0972-4213-a8c0-201eddd7d355) [No such file or directory] >[2016-04-19 07:24:41.080382] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355> (7d2d9b7d-0972-4213-a8c0-201eddd7d355) [No such file or directory] >[2016-04-19 07:24:41.080457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355> (7d2d9b7d-0972-4213-a8c0-201eddd7d355) [No such file or directory] >[2016-04-19 07:24:41.081190] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.083711] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7d2d9b7d-0972-4213-a8c0-201eddd7d355. (Possible split-brain) >[2016-04-19 07:24:41.084597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355> (7d2d9b7d-0972-4213-a8c0-201eddd7d355) [No such file or directory] >[2016-04-19 07:24:41.084964] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355> (7d2d9b7d-0972-4213-a8c0-201eddd7d355) [No such file or directory] >[2016-04-19 07:24:41.087627] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355> (7d2d9b7d-0972-4213-a8c0-201eddd7d355) [No such file or directory] >[2016-04-19 07:24:41.087699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355> (7d2d9b7d-0972-4213-a8c0-201eddd7d355) [No such file or directory] >[2016-04-19 07:24:41.087918] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7d2d9b7d-0972-4213-a8c0-201eddd7d355>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.097640] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.098521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1> (e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1) [No such file or directory] >[2016-04-19 07:24:41.098762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1> (e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1) [No such file or directory] >[2016-04-19 07:24:41.099629] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1. (Possible split-brain) >[2016-04-19 07:24:41.100548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1> (e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1) [No such file or directory] >[2016-04-19 07:24:41.100909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1> (e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1) [No such file or directory] >[2016-04-19 07:24:41.101976] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1> (e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1) [No such file or directory] >[2016-04-19 07:24:41.102362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1> (e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1) [No such file or directory] >[2016-04-19 07:24:41.102526] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.104899] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1. (Possible split-brain) >[2016-04-19 07:24:41.105867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1> (e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1) [No such file or directory] >[2016-04-19 07:24:41.106053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1> (e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1) [No such file or directory] >[2016-04-19 07:24:41.108381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1> (e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1) [No such file or directory] >[2016-04-19 07:24:41.108933] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1> (e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1) [No such file or directory] >[2016-04-19 07:24:41.109202] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e5c9e9f2-dd5a-4c95-af4f-1ec79d3218d1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.117516] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.118241] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c691dc72-0190-4602-8b5e-933018d873c6> (c691dc72-0190-4602-8b5e-933018d873c6) [No such file or directory] >[2016-04-19 07:24:41.118446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c691dc72-0190-4602-8b5e-933018d873c6> (c691dc72-0190-4602-8b5e-933018d873c6) [No such file or directory] >[2016-04-19 07:24:41.119284] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c691dc72-0190-4602-8b5e-933018d873c6. (Possible split-brain) >[2016-04-19 07:24:41.120084] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c691dc72-0190-4602-8b5e-933018d873c6> (c691dc72-0190-4602-8b5e-933018d873c6) [No such file or directory] >[2016-04-19 07:24:41.120411] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c691dc72-0190-4602-8b5e-933018d873c6> (c691dc72-0190-4602-8b5e-933018d873c6) [No such file or directory] >[2016-04-19 07:24:41.121726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c691dc72-0190-4602-8b5e-933018d873c6> (c691dc72-0190-4602-8b5e-933018d873c6) [No such file or directory] >[2016-04-19 07:24:41.121816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c691dc72-0190-4602-8b5e-933018d873c6> (c691dc72-0190-4602-8b5e-933018d873c6) [No such file or directory] >[2016-04-19 07:24:41.121947] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c691dc72-0190-4602-8b5e-933018d873c6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.124410] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c691dc72-0190-4602-8b5e-933018d873c6. (Possible split-brain) >[2016-04-19 07:24:41.125175] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c691dc72-0190-4602-8b5e-933018d873c6> (c691dc72-0190-4602-8b5e-933018d873c6) [No such file or directory] >[2016-04-19 07:24:41.125563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c691dc72-0190-4602-8b5e-933018d873c6> (c691dc72-0190-4602-8b5e-933018d873c6) [No such file or directory] >[2016-04-19 07:24:41.127909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c691dc72-0190-4602-8b5e-933018d873c6> (c691dc72-0190-4602-8b5e-933018d873c6) [No such file or directory] >[2016-04-19 07:24:41.128433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c691dc72-0190-4602-8b5e-933018d873c6> (c691dc72-0190-4602-8b5e-933018d873c6) [No such file or directory] >[2016-04-19 07:24:41.128586] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c691dc72-0190-4602-8b5e-933018d873c6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.137865] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.138623] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3> (4a6b484e-ffcc-4180-b84b-6c7335de6da3) [No such file or directory] >[2016-04-19 07:24:41.138880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3> (4a6b484e-ffcc-4180-b84b-6c7335de6da3) [No such file or directory] >[2016-04-19 07:24:41.141436] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4a6b484e-ffcc-4180-b84b-6c7335de6da3. (Possible split-brain) >[2016-04-19 07:24:41.142216] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3> (4a6b484e-ffcc-4180-b84b-6c7335de6da3) [No such file or directory] >[2016-04-19 07:24:41.142528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3> (4a6b484e-ffcc-4180-b84b-6c7335de6da3) [No such file or directory] >[2016-04-19 07:24:41.143642] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3> (4a6b484e-ffcc-4180-b84b-6c7335de6da3) [No such file or directory] >[2016-04-19 07:24:41.144004] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3> (4a6b484e-ffcc-4180-b84b-6c7335de6da3) [No such file or directory] >[2016-04-19 07:24:41.144204] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.146759] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4a6b484e-ffcc-4180-b84b-6c7335de6da3. (Possible split-brain) >[2016-04-19 07:24:41.147601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3> (4a6b484e-ffcc-4180-b84b-6c7335de6da3) [No such file or directory] >[2016-04-19 07:24:41.147814] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3> (4a6b484e-ffcc-4180-b84b-6c7335de6da3) [No such file or directory] >[2016-04-19 07:24:41.151173] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3> (4a6b484e-ffcc-4180-b84b-6c7335de6da3) [No such file or directory] >[2016-04-19 07:24:41.151200] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3> (4a6b484e-ffcc-4180-b84b-6c7335de6da3) [No such file or directory] >[2016-04-19 07:24:41.151435] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4a6b484e-ffcc-4180-b84b-6c7335de6da3>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.160383] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.161215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba> (658a8d41-bce2-404e-a44a-e86b131fd0ba) [No such file or directory] >[2016-04-19 07:24:41.161519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba> (658a8d41-bce2-404e-a44a-e86b131fd0ba) [No such file or directory] >[2016-04-19 07:24:41.164076] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 658a8d41-bce2-404e-a44a-e86b131fd0ba. (Possible split-brain) >[2016-04-19 07:24:41.164959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba> (658a8d41-bce2-404e-a44a-e86b131fd0ba) [No such file or directory] >[2016-04-19 07:24:41.165426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba> (658a8d41-bce2-404e-a44a-e86b131fd0ba) [No such file or directory] >[2016-04-19 07:24:41.166811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba> (658a8d41-bce2-404e-a44a-e86b131fd0ba) [No such file or directory] >[2016-04-19 07:24:41.166821] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba> (658a8d41-bce2-404e-a44a-e86b131fd0ba) [No such file or directory] >[2016-04-19 07:24:41.167020] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.169576] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 658a8d41-bce2-404e-a44a-e86b131fd0ba. (Possible split-brain) >[2016-04-19 07:24:41.170342] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba> (658a8d41-bce2-404e-a44a-e86b131fd0ba) [No such file or directory] >[2016-04-19 07:24:41.170661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba> (658a8d41-bce2-404e-a44a-e86b131fd0ba) [No such file or directory] >[2016-04-19 07:24:41.173530] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba> (658a8d41-bce2-404e-a44a-e86b131fd0ba) [No such file or directory] >[2016-04-19 07:24:41.173822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba> (658a8d41-bce2-404e-a44a-e86b131fd0ba) [No such file or directory] >[2016-04-19 07:24:41.173993] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:658a8d41-bce2-404e-a44a-e86b131fd0ba>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.185256] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.186138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d> (d3ace6ab-5212-4b9f-935e-66ec99e7950d) [No such file or directory] >[2016-04-19 07:24:41.186475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d> (d3ace6ab-5212-4b9f-935e-66ec99e7950d) [No such file or directory] >[2016-04-19 07:24:41.188949] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d3ace6ab-5212-4b9f-935e-66ec99e7950d. (Possible split-brain) >[2016-04-19 07:24:41.189914] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d> (d3ace6ab-5212-4b9f-935e-66ec99e7950d) [No such file or directory] >[2016-04-19 07:24:41.190176] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d> (d3ace6ab-5212-4b9f-935e-66ec99e7950d) [No such file or directory] >[2016-04-19 07:24:41.191251] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d> (d3ace6ab-5212-4b9f-935e-66ec99e7950d) [No such file or directory] >[2016-04-19 07:24:41.191459] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d> (d3ace6ab-5212-4b9f-935e-66ec99e7950d) [No such file or directory] >[2016-04-19 07:24:41.191875] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.194345] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d3ace6ab-5212-4b9f-935e-66ec99e7950d. (Possible split-brain) >[2016-04-19 07:24:41.195353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d> (d3ace6ab-5212-4b9f-935e-66ec99e7950d) [No such file or directory] >[2016-04-19 07:24:41.195767] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d> (d3ace6ab-5212-4b9f-935e-66ec99e7950d) [No such file or directory] >[2016-04-19 07:24:41.197980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d> (d3ace6ab-5212-4b9f-935e-66ec99e7950d) [No such file or directory] >[2016-04-19 07:24:41.198492] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d> (d3ace6ab-5212-4b9f-935e-66ec99e7950d) [No such file or directory] >[2016-04-19 07:24:41.198705] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d3ace6ab-5212-4b9f-935e-66ec99e7950d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.207755] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.208748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee> (2adb7c77-3a48-4582-a364-15b485ccf7ee) [No such file or directory] >[2016-04-19 07:24:41.209163] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee> (2adb7c77-3a48-4582-a364-15b485ccf7ee) [No such file or directory] >[2016-04-19 07:24:41.210289] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2adb7c77-3a48-4582-a364-15b485ccf7ee. (Possible split-brain) >[2016-04-19 07:24:41.211150] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee> (2adb7c77-3a48-4582-a364-15b485ccf7ee) [No such file or directory] >[2016-04-19 07:24:41.211569] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee> (2adb7c77-3a48-4582-a364-15b485ccf7ee) [No such file or directory] >[2016-04-19 07:24:41.212708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee> (2adb7c77-3a48-4582-a364-15b485ccf7ee) [No such file or directory] >[2016-04-19 07:24:41.212711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee> (2adb7c77-3a48-4582-a364-15b485ccf7ee) [No such file or directory] >[2016-04-19 07:24:41.213211] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.215644] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2adb7c77-3a48-4582-a364-15b485ccf7ee. (Possible split-brain) >[2016-04-19 07:24:41.216831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee> (2adb7c77-3a48-4582-a364-15b485ccf7ee) [No such file or directory] >[2016-04-19 07:24:41.216916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee> (2adb7c77-3a48-4582-a364-15b485ccf7ee) [No such file or directory] >[2016-04-19 07:24:41.220110] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee> (2adb7c77-3a48-4582-a364-15b485ccf7ee) [No such file or directory] >[2016-04-19 07:24:41.220170] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee> (2adb7c77-3a48-4582-a364-15b485ccf7ee) [No such file or directory] >[2016-04-19 07:24:41.220308] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2adb7c77-3a48-4582-a364-15b485ccf7ee>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.231403] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.232485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d> (46ad4ecb-7d33-43b8-926e-3415c6d6535d) [No such file or directory] >[2016-04-19 07:24:41.232514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d> (46ad4ecb-7d33-43b8-926e-3415c6d6535d) [No such file or directory] >[2016-04-19 07:24:41.233461] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 46ad4ecb-7d33-43b8-926e-3415c6d6535d. (Possible split-brain) >[2016-04-19 07:24:41.234523] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d> (46ad4ecb-7d33-43b8-926e-3415c6d6535d) [No such file or directory] >[2016-04-19 07:24:41.234527] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d> (46ad4ecb-7d33-43b8-926e-3415c6d6535d) [No such file or directory] >[2016-04-19 07:24:41.235834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d> (46ad4ecb-7d33-43b8-926e-3415c6d6535d) [No such file or directory] >[2016-04-19 07:24:41.235867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d> (46ad4ecb-7d33-43b8-926e-3415c6d6535d) [No such file or directory] >[2016-04-19 07:24:41.236219] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.238731] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 46ad4ecb-7d33-43b8-926e-3415c6d6535d. (Possible split-brain) >[2016-04-19 07:24:41.239777] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d> (46ad4ecb-7d33-43b8-926e-3415c6d6535d) [No such file or directory] >[2016-04-19 07:24:41.240034] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d> (46ad4ecb-7d33-43b8-926e-3415c6d6535d) [No such file or directory] >[2016-04-19 07:24:41.242880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d> (46ad4ecb-7d33-43b8-926e-3415c6d6535d) [No such file or directory] >[2016-04-19 07:24:41.242973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d> (46ad4ecb-7d33-43b8-926e-3415c6d6535d) [No such file or directory] >[2016-04-19 07:24:41.243181] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:46ad4ecb-7d33-43b8-926e-3415c6d6535d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.252892] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.253633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb> (edb8d9bc-9efe-484d-99b4-ed1ecb1370bb) [No such file or directory] >[2016-04-19 07:24:41.253960] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb> (edb8d9bc-9efe-484d-99b4-ed1ecb1370bb) [No such file or directory] >[2016-04-19 07:24:41.256861] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid edb8d9bc-9efe-484d-99b4-ed1ecb1370bb. (Possible split-brain) >[2016-04-19 07:24:41.257586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb> (edb8d9bc-9efe-484d-99b4-ed1ecb1370bb) [No such file or directory] >[2016-04-19 07:24:41.258114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb> (edb8d9bc-9efe-484d-99b4-ed1ecb1370bb) [No such file or directory] >[2016-04-19 07:24:41.259363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb> (edb8d9bc-9efe-484d-99b4-ed1ecb1370bb) [No such file or directory] >[2016-04-19 07:24:41.259813] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb> (edb8d9bc-9efe-484d-99b4-ed1ecb1370bb) [No such file or directory] >[2016-04-19 07:24:41.260000] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.262566] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid edb8d9bc-9efe-484d-99b4-ed1ecb1370bb. (Possible split-brain) >[2016-04-19 07:24:41.263367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb> (edb8d9bc-9efe-484d-99b4-ed1ecb1370bb) [No such file or directory] >[2016-04-19 07:24:41.263940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb> (edb8d9bc-9efe-484d-99b4-ed1ecb1370bb) [No such file or directory] >[2016-04-19 07:24:41.266909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb> (edb8d9bc-9efe-484d-99b4-ed1ecb1370bb) [No such file or directory] >[2016-04-19 07:24:41.266998] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb> (edb8d9bc-9efe-484d-99b4-ed1ecb1370bb) [No such file or directory] >[2016-04-19 07:24:41.267144] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:edb8d9bc-9efe-484d-99b4-ed1ecb1370bb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.276694] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.277069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3> (547be4ee-d5b1-4137-a67c-b8816f9d62d3) [No such file or directory] >[2016-04-19 07:24:41.277647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3> (547be4ee-d5b1-4137-a67c-b8816f9d62d3) [No such file or directory] >[2016-04-19 07:24:41.278633] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 547be4ee-d5b1-4137-a67c-b8816f9d62d3. (Possible split-brain) >[2016-04-19 07:24:41.279075] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3> (547be4ee-d5b1-4137-a67c-b8816f9d62d3) [No such file or directory] >[2016-04-19 07:24:41.279565] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3> (547be4ee-d5b1-4137-a67c-b8816f9d62d3) [No such file or directory] >[2016-04-19 07:24:41.280503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3> (547be4ee-d5b1-4137-a67c-b8816f9d62d3) [No such file or directory] >[2016-04-19 07:24:41.280804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3> (547be4ee-d5b1-4137-a67c-b8816f9d62d3) [No such file or directory] >[2016-04-19 07:24:41.280958] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.282800] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 547be4ee-d5b1-4137-a67c-b8816f9d62d3. (Possible split-brain) >[2016-04-19 07:24:41.283287] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3> (547be4ee-d5b1-4137-a67c-b8816f9d62d3) [No such file or directory] >[2016-04-19 07:24:41.283748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3> (547be4ee-d5b1-4137-a67c-b8816f9d62d3) [No such file or directory] >[2016-04-19 07:24:41.286257] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3> (547be4ee-d5b1-4137-a67c-b8816f9d62d3) [No such file or directory] >[2016-04-19 07:24:41.286740] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3> (547be4ee-d5b1-4137-a67c-b8816f9d62d3) [No such file or directory] >[2016-04-19 07:24:41.286953] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:547be4ee-d5b1-4137-a67c-b8816f9d62d3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.294570] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.295275] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd> (d88684c6-d9b5-4f43-a226-eaba71a410cd) [No such file or directory] >[2016-04-19 07:24:41.295624] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd> (d88684c6-d9b5-4f43-a226-eaba71a410cd) [No such file or directory] >[2016-04-19 07:24:41.296779] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d88684c6-d9b5-4f43-a226-eaba71a410cd. (Possible split-brain) >[2016-04-19 07:24:41.297548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd> (d88684c6-d9b5-4f43-a226-eaba71a410cd) [No such file or directory] >[2016-04-19 07:24:41.297870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd> (d88684c6-d9b5-4f43-a226-eaba71a410cd) [No such file or directory] >[2016-04-19 07:24:41.299403] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd> (d88684c6-d9b5-4f43-a226-eaba71a410cd) [No such file or directory] >[2016-04-19 07:24:41.299502] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd> (d88684c6-d9b5-4f43-a226-eaba71a410cd) [No such file or directory] >[2016-04-19 07:24:41.299613] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.302104] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d88684c6-d9b5-4f43-a226-eaba71a410cd. (Possible split-brain) >[2016-04-19 07:24:41.302953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd> (d88684c6-d9b5-4f43-a226-eaba71a410cd) [No such file or directory] >[2016-04-19 07:24:41.303177] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd> (d88684c6-d9b5-4f43-a226-eaba71a410cd) [No such file or directory] >[2016-04-19 07:24:41.306406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd> (d88684c6-d9b5-4f43-a226-eaba71a410cd) [No such file or directory] >[2016-04-19 07:24:41.306493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd> (d88684c6-d9b5-4f43-a226-eaba71a410cd) [No such file or directory] >[2016-04-19 07:24:41.306737] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d88684c6-d9b5-4f43-a226-eaba71a410cd>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.316194] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.317589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e> (56f5736e-8a5d-41b2-aed6-e1901a10ee0e) [No such file or directory] >[2016-04-19 07:24:41.317822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e> (56f5736e-8a5d-41b2-aed6-e1901a10ee0e) [No such file or directory] >[2016-04-19 07:24:41.318937] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 56f5736e-8a5d-41b2-aed6-e1901a10ee0e. (Possible split-brain) >[2016-04-19 07:24:41.319965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e> (56f5736e-8a5d-41b2-aed6-e1901a10ee0e) [No such file or directory] >[2016-04-19 07:24:41.320035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e> (56f5736e-8a5d-41b2-aed6-e1901a10ee0e) [No such file or directory] >[2016-04-19 07:24:41.321295] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e> (56f5736e-8a5d-41b2-aed6-e1901a10ee0e) [No such file or directory] >[2016-04-19 07:24:41.321418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e> (56f5736e-8a5d-41b2-aed6-e1901a10ee0e) [No such file or directory] >[2016-04-19 07:24:41.321626] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.324135] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 56f5736e-8a5d-41b2-aed6-e1901a10ee0e. (Possible split-brain) >[2016-04-19 07:24:41.325153] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e> (56f5736e-8a5d-41b2-aed6-e1901a10ee0e) [No such file or directory] >[2016-04-19 07:24:41.325259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e> (56f5736e-8a5d-41b2-aed6-e1901a10ee0e) [No such file or directory] >[2016-04-19 07:24:41.327756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e> (56f5736e-8a5d-41b2-aed6-e1901a10ee0e) [No such file or directory] >[2016-04-19 07:24:41.328120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e> (56f5736e-8a5d-41b2-aed6-e1901a10ee0e) [No such file or directory] >[2016-04-19 07:24:41.328275] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:56f5736e-8a5d-41b2-aed6-e1901a10ee0e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.338073] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.338931] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a441493c-eae3-464e-a34d-27f3e517890f> (a441493c-eae3-464e-a34d-27f3e517890f) [No such file or directory] >[2016-04-19 07:24:41.339369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a441493c-eae3-464e-a34d-27f3e517890f> (a441493c-eae3-464e-a34d-27f3e517890f) [No such file or directory] >[2016-04-19 07:24:41.340462] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a441493c-eae3-464e-a34d-27f3e517890f. (Possible split-brain) >[2016-04-19 07:24:41.341279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a441493c-eae3-464e-a34d-27f3e517890f> (a441493c-eae3-464e-a34d-27f3e517890f) [No such file or directory] >[2016-04-19 07:24:41.341602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a441493c-eae3-464e-a34d-27f3e517890f> (a441493c-eae3-464e-a34d-27f3e517890f) [No such file or directory] >[2016-04-19 07:24:41.342940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a441493c-eae3-464e-a34d-27f3e517890f> (a441493c-eae3-464e-a34d-27f3e517890f) [No such file or directory] >[2016-04-19 07:24:41.343019] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a441493c-eae3-464e-a34d-27f3e517890f> (a441493c-eae3-464e-a34d-27f3e517890f) [No such file or directory] >[2016-04-19 07:24:41.343158] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a441493c-eae3-464e-a34d-27f3e517890f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.345640] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a441493c-eae3-464e-a34d-27f3e517890f. (Possible split-brain) >[2016-04-19 07:24:41.346474] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a441493c-eae3-464e-a34d-27f3e517890f> (a441493c-eae3-464e-a34d-27f3e517890f) [No such file or directory] >[2016-04-19 07:24:41.347005] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a441493c-eae3-464e-a34d-27f3e517890f> (a441493c-eae3-464e-a34d-27f3e517890f) [No such file or directory] >[2016-04-19 07:24:41.349817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a441493c-eae3-464e-a34d-27f3e517890f> (a441493c-eae3-464e-a34d-27f3e517890f) [No such file or directory] >[2016-04-19 07:24:41.349550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a441493c-eae3-464e-a34d-27f3e517890f> (a441493c-eae3-464e-a34d-27f3e517890f) [No such file or directory] >[2016-04-19 07:24:41.350030] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a441493c-eae3-464e-a34d-27f3e517890f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.359958] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.360995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6> (2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6) [No such file or directory] >[2016-04-19 07:24:41.361080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6> (2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6) [No such file or directory] >[2016-04-19 07:24:41.362204] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6. (Possible split-brain) >[2016-04-19 07:24:41.363310] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6> (2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6) [No such file or directory] >[2016-04-19 07:24:41.363360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6> (2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6) [No such file or directory] >[2016-04-19 07:24:41.364694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6> (2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6) [No such file or directory] >[2016-04-19 07:24:41.364799] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6> (2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6) [No such file or directory] >[2016-04-19 07:24:41.364986] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.367515] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6. (Possible split-brain) >[2016-04-19 07:24:41.368688] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6> (2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6) [No such file or directory] >[2016-04-19 07:24:41.368710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6> (2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6) [No such file or directory] >[2016-04-19 07:24:41.370887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6> (2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6) [No such file or directory] >[2016-04-19 07:24:41.370939] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6> (2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6) [No such file or directory] >[2016-04-19 07:24:41.371236] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2e0506a8-3a83-42a7-b9e2-1a7a4ebd3ff6>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.378598] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.379296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7> (8326487e-ffe3-4c87-9dc3-4e9d4092c0c7) [No such file or directory] >[2016-04-19 07:24:41.379509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7> (8326487e-ffe3-4c87-9dc3-4e9d4092c0c7) [No such file or directory] >[2016-04-19 07:24:41.380408] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8326487e-ffe3-4c87-9dc3-4e9d4092c0c7. (Possible split-brain) >[2016-04-19 07:24:41.381231] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7> (8326487e-ffe3-4c87-9dc3-4e9d4092c0c7) [No such file or directory] >[2016-04-19 07:24:41.381353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7> (8326487e-ffe3-4c87-9dc3-4e9d4092c0c7) [No such file or directory] >[2016-04-19 07:24:41.382731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7> (8326487e-ffe3-4c87-9dc3-4e9d4092c0c7) [No such file or directory] >[2016-04-19 07:24:41.383044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7> (8326487e-ffe3-4c87-9dc3-4e9d4092c0c7) [No such file or directory] >[2016-04-19 07:24:41.383201] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.386265] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8326487e-ffe3-4c87-9dc3-4e9d4092c0c7. (Possible split-brain) >[2016-04-19 07:24:41.387118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7> (8326487e-ffe3-4c87-9dc3-4e9d4092c0c7) [No such file or directory] >[2016-04-19 07:24:41.387457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7> (8326487e-ffe3-4c87-9dc3-4e9d4092c0c7) [No such file or directory] >[2016-04-19 07:24:41.389966] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7> (8326487e-ffe3-4c87-9dc3-4e9d4092c0c7) [No such file or directory] >[2016-04-19 07:24:41.390106] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7> (8326487e-ffe3-4c87-9dc3-4e9d4092c0c7) [No such file or directory] >[2016-04-19 07:24:41.390265] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8326487e-ffe3-4c87-9dc3-4e9d4092c0c7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.398271] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.398737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8> (8ecf87e2-cd43-45ce-bc5b-087cbd4740b8) [No such file or directory] >[2016-04-19 07:24:41.399100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8> (8ecf87e2-cd43-45ce-bc5b-087cbd4740b8) [No such file or directory] >[2016-04-19 07:24:41.402031] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8ecf87e2-cd43-45ce-bc5b-087cbd4740b8. (Possible split-brain) >[2016-04-19 07:24:41.402500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8> (8ecf87e2-cd43-45ce-bc5b-087cbd4740b8) [No such file or directory] >[2016-04-19 07:24:41.402942] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8> (8ecf87e2-cd43-45ce-bc5b-087cbd4740b8) [No such file or directory] >[2016-04-19 07:24:41.404243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8> (8ecf87e2-cd43-45ce-bc5b-087cbd4740b8) [No such file or directory] >[2016-04-19 07:24:41.404760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8> (8ecf87e2-cd43-45ce-bc5b-087cbd4740b8) [No such file or directory] >[2016-04-19 07:24:41.404980] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.407553] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8ecf87e2-cd43-45ce-bc5b-087cbd4740b8. (Possible split-brain) >[2016-04-19 07:24:41.408256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8> (8ecf87e2-cd43-45ce-bc5b-087cbd4740b8) [No such file or directory] >[2016-04-19 07:24:41.408574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8> (8ecf87e2-cd43-45ce-bc5b-087cbd4740b8) [No such file or directory] >[2016-04-19 07:24:41.411433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8> (8ecf87e2-cd43-45ce-bc5b-087cbd4740b8) [No such file or directory] >[2016-04-19 07:24:41.411514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8> (8ecf87e2-cd43-45ce-bc5b-087cbd4740b8) [No such file or directory] >[2016-04-19 07:24:41.411697] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8ecf87e2-cd43-45ce-bc5b-087cbd4740b8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.421669] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.422555] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7> (01e5a6a9-50a0-4870-9374-815ed48065c7) [No such file or directory] >[2016-04-19 07:24:41.422586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7> (01e5a6a9-50a0-4870-9374-815ed48065c7) [No such file or directory] >[2016-04-19 07:24:41.425440] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 01e5a6a9-50a0-4870-9374-815ed48065c7. (Possible split-brain) >[2016-04-19 07:24:41.426384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7> (01e5a6a9-50a0-4870-9374-815ed48065c7) [No such file or directory] >[2016-04-19 07:24:41.426392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7> (01e5a6a9-50a0-4870-9374-815ed48065c7) [No such file or directory] >[2016-04-19 07:24:41.427835] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7> (01e5a6a9-50a0-4870-9374-815ed48065c7) [No such file or directory] >[2016-04-19 07:24:41.428107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7> (01e5a6a9-50a0-4870-9374-815ed48065c7) [No such file or directory] >[2016-04-19 07:24:41.428253] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.430887] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 01e5a6a9-50a0-4870-9374-815ed48065c7. (Possible split-brain) >[2016-04-19 07:24:41.431645] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7> (01e5a6a9-50a0-4870-9374-815ed48065c7) [No such file or directory] >[2016-04-19 07:24:41.432032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7> (01e5a6a9-50a0-4870-9374-815ed48065c7) [No such file or directory] >[2016-04-19 07:24:41.434534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7> (01e5a6a9-50a0-4870-9374-815ed48065c7) [No such file or directory] >[2016-04-19 07:24:41.434650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7> (01e5a6a9-50a0-4870-9374-815ed48065c7) [No such file or directory] >[2016-04-19 07:24:41.434868] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:01e5a6a9-50a0-4870-9374-815ed48065c7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.443726] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.444628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8> (3c3c684c-4918-4953-bb8f-6050c2a42dd8) [No such file or directory] >[2016-04-19 07:24:41.444743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8> (3c3c684c-4918-4953-bb8f-6050c2a42dd8) [No such file or directory] >[2016-04-19 07:24:41.445837] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3c3c684c-4918-4953-bb8f-6050c2a42dd8. (Possible split-brain) >[2016-04-19 07:24:41.446591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8> (3c3c684c-4918-4953-bb8f-6050c2a42dd8) [No such file or directory] >[2016-04-19 07:24:41.446865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8> (3c3c684c-4918-4953-bb8f-6050c2a42dd8) [No such file or directory] >[2016-04-19 07:24:41.447955] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8> (3c3c684c-4918-4953-bb8f-6050c2a42dd8) [No such file or directory] >[2016-04-19 07:24:41.448072] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8> (3c3c684c-4918-4953-bb8f-6050c2a42dd8) [No such file or directory] >[2016-04-19 07:24:41.448212] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.450709] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3c3c684c-4918-4953-bb8f-6050c2a42dd8. (Possible split-brain) >[2016-04-19 07:24:41.451447] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8> (3c3c684c-4918-4953-bb8f-6050c2a42dd8) [No such file or directory] >[2016-04-19 07:24:41.451628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8> (3c3c684c-4918-4953-bb8f-6050c2a42dd8) [No such file or directory] >[2016-04-19 07:24:41.454579] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8> (3c3c684c-4918-4953-bb8f-6050c2a42dd8) [No such file or directory] >[2016-04-19 07:24:41.454683] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8> (3c3c684c-4918-4953-bb8f-6050c2a42dd8) [No such file or directory] >[2016-04-19 07:24:41.454929] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3c3c684c-4918-4953-bb8f-6050c2a42dd8>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.463231] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.464085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba> (7c524c55-2708-4bf1-8ba4-0526b967b9ba) [No such file or directory] >[2016-04-19 07:24:41.464191] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba> (7c524c55-2708-4bf1-8ba4-0526b967b9ba) [No such file or directory] >[2016-04-19 07:24:41.467130] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7c524c55-2708-4bf1-8ba4-0526b967b9ba. (Possible split-brain) >[2016-04-19 07:24:41.467916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba> (7c524c55-2708-4bf1-8ba4-0526b967b9ba) [No such file or directory] >[2016-04-19 07:24:41.468012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba> (7c524c55-2708-4bf1-8ba4-0526b967b9ba) [No such file or directory] >[2016-04-19 07:24:41.469302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba> (7c524c55-2708-4bf1-8ba4-0526b967b9ba) [No such file or directory] >[2016-04-19 07:24:41.469701] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba> (7c524c55-2708-4bf1-8ba4-0526b967b9ba) [No such file or directory] >[2016-04-19 07:24:41.469876] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.472424] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7c524c55-2708-4bf1-8ba4-0526b967b9ba. (Possible split-brain) >[2016-04-19 07:24:41.473300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba> (7c524c55-2708-4bf1-8ba4-0526b967b9ba) [No such file or directory] >[2016-04-19 07:24:41.473444] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba> (7c524c55-2708-4bf1-8ba4-0526b967b9ba) [No such file or directory] >[2016-04-19 07:24:41.476396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba> (7c524c55-2708-4bf1-8ba4-0526b967b9ba) [No such file or directory] >[2016-04-19 07:24:41.476768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba> (7c524c55-2708-4bf1-8ba4-0526b967b9ba) [No such file or directory] >[2016-04-19 07:24:41.476997] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7c524c55-2708-4bf1-8ba4-0526b967b9ba>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.486383] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.487191] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844> (a80e56a5-208b-4cf1-a016-95d99a5f2844) [No such file or directory] >[2016-04-19 07:24:41.487487] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844> (a80e56a5-208b-4cf1-a016-95d99a5f2844) [No such file or directory] >[2016-04-19 07:24:41.488645] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a80e56a5-208b-4cf1-a016-95d99a5f2844. (Possible split-brain) >[2016-04-19 07:24:41.489575] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844> (a80e56a5-208b-4cf1-a016-95d99a5f2844) [No such file or directory] >[2016-04-19 07:24:41.489819] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844> (a80e56a5-208b-4cf1-a016-95d99a5f2844) [No such file or directory] >[2016-04-19 07:24:41.491064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844> (a80e56a5-208b-4cf1-a016-95d99a5f2844) [No such file or directory] >[2016-04-19 07:24:41.491112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844> (a80e56a5-208b-4cf1-a016-95d99a5f2844) [No such file or directory] >[2016-04-19 07:24:41.491268] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.492700] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a80e56a5-208b-4cf1-a016-95d99a5f2844. (Possible split-brain) >[2016-04-19 07:24:41.493083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844> (a80e56a5-208b-4cf1-a016-95d99a5f2844) [No such file or directory] >[2016-04-19 07:24:41.493467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844> (a80e56a5-208b-4cf1-a016-95d99a5f2844) [No such file or directory] >[2016-04-19 07:24:41.496380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844> (a80e56a5-208b-4cf1-a016-95d99a5f2844) [No such file or directory] >[2016-04-19 07:24:41.496463] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844> (a80e56a5-208b-4cf1-a016-95d99a5f2844) [No such file or directory] >[2016-04-19 07:24:41.496661] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a80e56a5-208b-4cf1-a016-95d99a5f2844>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.506867] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.507793] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9> (c17412d6-de15-42a0-a6c9-3a7ee7f841d9) [No such file or directory] >[2016-04-19 07:24:41.508132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9> (c17412d6-de15-42a0-a6c9-3a7ee7f841d9) [No such file or directory] >[2016-04-19 07:24:41.511141] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c17412d6-de15-42a0-a6c9-3a7ee7f841d9. (Possible split-brain) >[2016-04-19 07:24:41.512194] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9> (c17412d6-de15-42a0-a6c9-3a7ee7f841d9) [No such file or directory] >[2016-04-19 07:24:41.512481] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9> (c17412d6-de15-42a0-a6c9-3a7ee7f841d9) [No such file or directory] >[2016-04-19 07:24:41.513734] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9> (c17412d6-de15-42a0-a6c9-3a7ee7f841d9) [No such file or directory] >[2016-04-19 07:24:41.513764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9> (c17412d6-de15-42a0-a6c9-3a7ee7f841d9) [No such file or directory] >[2016-04-19 07:24:41.513978] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.516511] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c17412d6-de15-42a0-a6c9-3a7ee7f841d9. (Possible split-brain) >[2016-04-19 07:24:41.517681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9> (c17412d6-de15-42a0-a6c9-3a7ee7f841d9) [No such file or directory] >[2016-04-19 07:24:41.517780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9> (c17412d6-de15-42a0-a6c9-3a7ee7f841d9) [No such file or directory] >[2016-04-19 07:24:41.520105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9> (c17412d6-de15-42a0-a6c9-3a7ee7f841d9) [No such file or directory] >[2016-04-19 07:24:41.520300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9> (c17412d6-de15-42a0-a6c9-3a7ee7f841d9) [No such file or directory] >[2016-04-19 07:24:41.520417] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c17412d6-de15-42a0-a6c9-3a7ee7f841d9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.531173] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.532144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0> (4409c1bd-3f69-434d-9786-30538e06bfe0) [No such file or directory] >[2016-04-19 07:24:41.532456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0> (4409c1bd-3f69-434d-9786-30538e06bfe0) [No such file or directory] >[2016-04-19 07:24:41.535369] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4409c1bd-3f69-434d-9786-30538e06bfe0. (Possible split-brain) >[2016-04-19 07:24:41.536503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0> (4409c1bd-3f69-434d-9786-30538e06bfe0) [No such file or directory] >[2016-04-19 07:24:41.536523] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0> (4409c1bd-3f69-434d-9786-30538e06bfe0) [No such file or directory] >[2016-04-19 07:24:41.537707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0> (4409c1bd-3f69-434d-9786-30538e06bfe0) [No such file or directory] >[2016-04-19 07:24:41.537960] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0> (4409c1bd-3f69-434d-9786-30538e06bfe0) [No such file or directory] >[2016-04-19 07:24:41.538069] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.540680] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4409c1bd-3f69-434d-9786-30538e06bfe0. (Possible split-brain) >[2016-04-19 07:24:41.541956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0> (4409c1bd-3f69-434d-9786-30538e06bfe0) [No such file or directory] >[2016-04-19 07:24:41.542046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0> (4409c1bd-3f69-434d-9786-30538e06bfe0) [No such file or directory] >[2016-04-19 07:24:41.544485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0> (4409c1bd-3f69-434d-9786-30538e06bfe0) [No such file or directory] >[2016-04-19 07:24:41.544737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0> (4409c1bd-3f69-434d-9786-30538e06bfe0) [No such file or directory] >[2016-04-19 07:24:41.544855] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4409c1bd-3f69-434d-9786-30538e06bfe0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.553655] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.554584] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed> (f89d71fb-77b0-4f23-aba7-8884eec996ed) [No such file or directory] >[2016-04-19 07:24:41.554825] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed> (f89d71fb-77b0-4f23-aba7-8884eec996ed) [No such file or directory] >[2016-04-19 07:24:41.557792] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f89d71fb-77b0-4f23-aba7-8884eec996ed. (Possible split-brain) >[2016-04-19 07:24:41.559002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed> (f89d71fb-77b0-4f23-aba7-8884eec996ed) [No such file or directory] >[2016-04-19 07:24:41.559102] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed> (f89d71fb-77b0-4f23-aba7-8884eec996ed) [No such file or directory] >[2016-04-19 07:24:41.560162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed> (f89d71fb-77b0-4f23-aba7-8884eec996ed) [No such file or directory] >[2016-04-19 07:24:41.560512] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed> (f89d71fb-77b0-4f23-aba7-8884eec996ed) [No such file or directory] >[2016-04-19 07:24:41.560719] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.563298] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f89d71fb-77b0-4f23-aba7-8884eec996ed. (Possible split-brain) >[2016-04-19 07:24:41.564218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed> (f89d71fb-77b0-4f23-aba7-8884eec996ed) [No such file or directory] >[2016-04-19 07:24:41.564510] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed> (f89d71fb-77b0-4f23-aba7-8884eec996ed) [No such file or directory] >[2016-04-19 07:24:41.566950] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed> (f89d71fb-77b0-4f23-aba7-8884eec996ed) [No such file or directory] >[2016-04-19 07:24:41.566963] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed> (f89d71fb-77b0-4f23-aba7-8884eec996ed) [No such file or directory] >[2016-04-19 07:24:41.567182] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f89d71fb-77b0-4f23-aba7-8884eec996ed>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.578245] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.579167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a> (a50ab036-55b8-4d2f-a84f-82c907f5025a) [No such file or directory] >[2016-04-19 07:24:41.579489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a> (a50ab036-55b8-4d2f-a84f-82c907f5025a) [No such file or directory] >[2016-04-19 07:24:41.580591] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a50ab036-55b8-4d2f-a84f-82c907f5025a. (Possible split-brain) >[2016-04-19 07:24:41.581678] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a> (a50ab036-55b8-4d2f-a84f-82c907f5025a) [No such file or directory] >[2016-04-19 07:24:41.581683] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a> (a50ab036-55b8-4d2f-a84f-82c907f5025a) [No such file or directory] >[2016-04-19 07:24:41.583109] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a> (a50ab036-55b8-4d2f-a84f-82c907f5025a) [No such file or directory] >[2016-04-19 07:24:41.583145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a> (a50ab036-55b8-4d2f-a84f-82c907f5025a) [No such file or directory] >[2016-04-19 07:24:41.583716] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.586162] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a50ab036-55b8-4d2f-a84f-82c907f5025a. (Possible split-brain) >[2016-04-19 07:24:41.587584] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a> (a50ab036-55b8-4d2f-a84f-82c907f5025a) [No such file or directory] >[2016-04-19 07:24:41.587664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a> (a50ab036-55b8-4d2f-a84f-82c907f5025a) [No such file or directory] >[2016-04-19 07:24:41.589994] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a> (a50ab036-55b8-4d2f-a84f-82c907f5025a) [No such file or directory] >[2016-04-19 07:24:41.590353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a> (a50ab036-55b8-4d2f-a84f-82c907f5025a) [No such file or directory] >[2016-04-19 07:24:41.590565] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a50ab036-55b8-4d2f-a84f-82c907f5025a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.599491] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.600482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7> (e1877817-30e2-4f9a-a388-1c47f72373e7) [No such file or directory] >[2016-04-19 07:24:41.600846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7> (e1877817-30e2-4f9a-a388-1c47f72373e7) [No such file or directory] >[2016-04-19 07:24:41.603854] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e1877817-30e2-4f9a-a388-1c47f72373e7. (Possible split-brain) >[2016-04-19 07:24:41.605070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7> (e1877817-30e2-4f9a-a388-1c47f72373e7) [No such file or directory] >[2016-04-19 07:24:41.605072] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7> (e1877817-30e2-4f9a-a388-1c47f72373e7) [No such file or directory] >[2016-04-19 07:24:41.606058] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7> (e1877817-30e2-4f9a-a388-1c47f72373e7) [No such file or directory] >[2016-04-19 07:24:41.606288] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7> (e1877817-30e2-4f9a-a388-1c47f72373e7) [No such file or directory] >[2016-04-19 07:24:41.606390] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.608897] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e1877817-30e2-4f9a-a388-1c47f72373e7. (Possible split-brain) >[2016-04-19 07:24:41.609997] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7> (e1877817-30e2-4f9a-a388-1c47f72373e7) [No such file or directory] >[2016-04-19 07:24:41.610087] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7> (e1877817-30e2-4f9a-a388-1c47f72373e7) [No such file or directory] >[2016-04-19 07:24:41.612619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7> (e1877817-30e2-4f9a-a388-1c47f72373e7) [No such file or directory] >[2016-04-19 07:24:41.612748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7> (e1877817-30e2-4f9a-a388-1c47f72373e7) [No such file or directory] >[2016-04-19 07:24:41.612863] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e1877817-30e2-4f9a-a388-1c47f72373e7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.622202] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.622980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:95982333-9793-4313-91b3-93a4ac155add> (95982333-9793-4313-91b3-93a4ac155add) [No such file or directory] >[2016-04-19 07:24:41.623401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:95982333-9793-4313-91b3-93a4ac155add> (95982333-9793-4313-91b3-93a4ac155add) [No such file or directory] >[2016-04-19 07:24:41.624510] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 95982333-9793-4313-91b3-93a4ac155add. (Possible split-brain) >[2016-04-19 07:24:41.625193] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:95982333-9793-4313-91b3-93a4ac155add> (95982333-9793-4313-91b3-93a4ac155add) [No such file or directory] >[2016-04-19 07:24:41.625527] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:95982333-9793-4313-91b3-93a4ac155add> (95982333-9793-4313-91b3-93a4ac155add) [No such file or directory] >[2016-04-19 07:24:41.626711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:95982333-9793-4313-91b3-93a4ac155add> (95982333-9793-4313-91b3-93a4ac155add) [No such file or directory] >[2016-04-19 07:24:41.626908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:95982333-9793-4313-91b3-93a4ac155add> (95982333-9793-4313-91b3-93a4ac155add) [No such file or directory] >[2016-04-19 07:24:41.627010] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:95982333-9793-4313-91b3-93a4ac155add>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.629466] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 95982333-9793-4313-91b3-93a4ac155add. (Possible split-brain) >[2016-04-19 07:24:41.630226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:95982333-9793-4313-91b3-93a4ac155add> (95982333-9793-4313-91b3-93a4ac155add) [No such file or directory] >[2016-04-19 07:24:41.630349] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:95982333-9793-4313-91b3-93a4ac155add> (95982333-9793-4313-91b3-93a4ac155add) [No such file or directory] >[2016-04-19 07:24:41.633094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:95982333-9793-4313-91b3-93a4ac155add> (95982333-9793-4313-91b3-93a4ac155add) [No such file or directory] >[2016-04-19 07:24:41.633477] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:95982333-9793-4313-91b3-93a4ac155add> (95982333-9793-4313-91b3-93a4ac155add) [No such file or directory] >[2016-04-19 07:24:41.633703] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:95982333-9793-4313-91b3-93a4ac155add>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.643480] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.644568] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39> (edb09f47-cea5-4a0f-87d3-ab6012e0ba39) [No such file or directory] >[2016-04-19 07:24:41.644657] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39> (edb09f47-cea5-4a0f-87d3-ab6012e0ba39) [No such file or directory] >[2016-04-19 07:24:41.645833] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid edb09f47-cea5-4a0f-87d3-ab6012e0ba39. (Possible split-brain) >[2016-04-19 07:24:41.646884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39> (edb09f47-cea5-4a0f-87d3-ab6012e0ba39) [No such file or directory] >[2016-04-19 07:24:41.646959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39> (edb09f47-cea5-4a0f-87d3-ab6012e0ba39) [No such file or directory] >[2016-04-19 07:24:41.648214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39> (edb09f47-cea5-4a0f-87d3-ab6012e0ba39) [No such file or directory] >[2016-04-19 07:24:41.648300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39> (edb09f47-cea5-4a0f-87d3-ab6012e0ba39) [No such file or directory] >[2016-04-19 07:24:41.648484] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.650945] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid edb09f47-cea5-4a0f-87d3-ab6012e0ba39. (Possible split-brain) >[2016-04-19 07:24:41.651937] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39> (edb09f47-cea5-4a0f-87d3-ab6012e0ba39) [No such file or directory] >[2016-04-19 07:24:41.652220] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39> (edb09f47-cea5-4a0f-87d3-ab6012e0ba39) [No such file or directory] >[2016-04-19 07:24:41.655154] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39> (edb09f47-cea5-4a0f-87d3-ab6012e0ba39) [No such file or directory] >[2016-04-19 07:24:41.655219] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39> (edb09f47-cea5-4a0f-87d3-ab6012e0ba39) [No such file or directory] >[2016-04-19 07:24:41.655416] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:edb09f47-cea5-4a0f-87d3-ab6012e0ba39>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.664978] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.665711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1> (9bf09347-7868-4ca1-a379-f1f534e883c1) [No such file or directory] >[2016-04-19 07:24:41.666103] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1> (9bf09347-7868-4ca1-a379-f1f534e883c1) [No such file or directory] >[2016-04-19 07:24:41.667213] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9bf09347-7868-4ca1-a379-f1f534e883c1. (Possible split-brain) >[2016-04-19 07:24:41.667945] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1> (9bf09347-7868-4ca1-a379-f1f534e883c1) [No such file or directory] >[2016-04-19 07:24:41.668420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1> (9bf09347-7868-4ca1-a379-f1f534e883c1) [No such file or directory] >[2016-04-19 07:24:41.669743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1> (9bf09347-7868-4ca1-a379-f1f534e883c1) [No such file or directory] >[2016-04-19 07:24:41.670041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1> (9bf09347-7868-4ca1-a379-f1f534e883c1) [No such file or directory] >[2016-04-19 07:24:41.670155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.672601] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9bf09347-7868-4ca1-a379-f1f534e883c1. (Possible split-brain) >[2016-04-19 07:24:41.673246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1> (9bf09347-7868-4ca1-a379-f1f534e883c1) [No such file or directory] >[2016-04-19 07:24:41.673686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1> (9bf09347-7868-4ca1-a379-f1f534e883c1) [No such file or directory] >[2016-04-19 07:24:41.675733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1> (9bf09347-7868-4ca1-a379-f1f534e883c1) [No such file or directory] >[2016-04-19 07:24:41.676024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1> (9bf09347-7868-4ca1-a379-f1f534e883c1) [No such file or directory] >[2016-04-19 07:24:41.676169] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9bf09347-7868-4ca1-a379-f1f534e883c1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.684723] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.685434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044> (2ea9237e-3e6e-4365-a309-fae507be3044) [No such file or directory] >[2016-04-19 07:24:41.685784] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044> (2ea9237e-3e6e-4365-a309-fae507be3044) [No such file or directory] >[2016-04-19 07:24:41.686929] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2ea9237e-3e6e-4365-a309-fae507be3044. (Possible split-brain) >[2016-04-19 07:24:41.687645] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044> (2ea9237e-3e6e-4365-a309-fae507be3044) [No such file or directory] >[2016-04-19 07:24:41.687654] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044> (2ea9237e-3e6e-4365-a309-fae507be3044) [No such file or directory] >[2016-04-19 07:24:41.688787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044> (2ea9237e-3e6e-4365-a309-fae507be3044) [No such file or directory] >[2016-04-19 07:24:41.689074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044> (2ea9237e-3e6e-4365-a309-fae507be3044) [No such file or directory] >[2016-04-19 07:24:41.689258] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.691748] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2ea9237e-3e6e-4365-a309-fae507be3044. (Possible split-brain) >[2016-04-19 07:24:41.692618] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044> (2ea9237e-3e6e-4365-a309-fae507be3044) [No such file or directory] >[2016-04-19 07:24:41.692879] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044> (2ea9237e-3e6e-4365-a309-fae507be3044) [No such file or directory] >[2016-04-19 07:24:41.695722] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044> (2ea9237e-3e6e-4365-a309-fae507be3044) [No such file or directory] >[2016-04-19 07:24:41.695898] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044> (2ea9237e-3e6e-4365-a309-fae507be3044) [No such file or directory] >[2016-04-19 07:24:41.696033] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2ea9237e-3e6e-4365-a309-fae507be3044>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.706666] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.707786] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76> (8a1279a6-73fc-40d7-8ee9-5f33bff96b76) [No such file or directory] >[2016-04-19 07:24:41.707865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76> (8a1279a6-73fc-40d7-8ee9-5f33bff96b76) [No such file or directory] >[2016-04-19 07:24:41.710760] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8a1279a6-73fc-40d7-8ee9-5f33bff96b76. (Possible split-brain) >[2016-04-19 07:24:41.711936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76> (8a1279a6-73fc-40d7-8ee9-5f33bff96b76) [No such file or directory] >[2016-04-19 07:24:41.712009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76> (8a1279a6-73fc-40d7-8ee9-5f33bff96b76) [No such file or directory] >[2016-04-19 07:24:41.713265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76> (8a1279a6-73fc-40d7-8ee9-5f33bff96b76) [No such file or directory] >[2016-04-19 07:24:41.713357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76> (8a1279a6-73fc-40d7-8ee9-5f33bff96b76) [No such file or directory] >[2016-04-19 07:24:41.713511] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.715991] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8a1279a6-73fc-40d7-8ee9-5f33bff96b76. (Possible split-brain) >[2016-04-19 07:24:41.717086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76> (8a1279a6-73fc-40d7-8ee9-5f33bff96b76) [No such file or directory] >[2016-04-19 07:24:41.717162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76> (8a1279a6-73fc-40d7-8ee9-5f33bff96b76) [No such file or directory] >[2016-04-19 07:24:41.719687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76> (8a1279a6-73fc-40d7-8ee9-5f33bff96b76) [No such file or directory] >[2016-04-19 07:24:41.719757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76> (8a1279a6-73fc-40d7-8ee9-5f33bff96b76) [No such file or directory] >[2016-04-19 07:24:41.719986] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8a1279a6-73fc-40d7-8ee9-5f33bff96b76>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.728769] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.729658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1> (5dfd3db5-369c-44f8-81e7-db441c86fed1) [No such file or directory] >[2016-04-19 07:24:41.729687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1> (5dfd3db5-369c-44f8-81e7-db441c86fed1) [No such file or directory] >[2016-04-19 07:24:41.730785] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5dfd3db5-369c-44f8-81e7-db441c86fed1. (Possible split-brain) >[2016-04-19 07:24:41.731659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1> (5dfd3db5-369c-44f8-81e7-db441c86fed1) [No such file or directory] >[2016-04-19 07:24:41.731680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1> (5dfd3db5-369c-44f8-81e7-db441c86fed1) [No such file or directory] >[2016-04-19 07:24:41.733153] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1> (5dfd3db5-369c-44f8-81e7-db441c86fed1) [No such file or directory] >[2016-04-19 07:24:41.733361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1> (5dfd3db5-369c-44f8-81e7-db441c86fed1) [No such file or directory] >[2016-04-19 07:24:41.733485] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.735965] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5dfd3db5-369c-44f8-81e7-db441c86fed1. (Possible split-brain) >[2016-04-19 07:24:41.736716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1> (5dfd3db5-369c-44f8-81e7-db441c86fed1) [No such file or directory] >[2016-04-19 07:24:41.736837] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1> (5dfd3db5-369c-44f8-81e7-db441c86fed1) [No such file or directory] >[2016-04-19 07:24:41.739363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1> (5dfd3db5-369c-44f8-81e7-db441c86fed1) [No such file or directory] >[2016-04-19 07:24:41.739467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1> (5dfd3db5-369c-44f8-81e7-db441c86fed1) [No such file or directory] >[2016-04-19 07:24:41.739702] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5dfd3db5-369c-44f8-81e7-db441c86fed1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.749227] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.750403] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe> (cf7ec9ad-e740-4b8f-a406-369e31038bbe) [No such file or directory] >[2016-04-19 07:24:41.750406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe> (cf7ec9ad-e740-4b8f-a406-369e31038bbe) [No such file or directory] >[2016-04-19 07:24:41.753430] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cf7ec9ad-e740-4b8f-a406-369e31038bbe. (Possible split-brain) >[2016-04-19 07:24:41.754452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe> (cf7ec9ad-e740-4b8f-a406-369e31038bbe) [No such file or directory] >[2016-04-19 07:24:41.754586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe> (cf7ec9ad-e740-4b8f-a406-369e31038bbe) [No such file or directory] >[2016-04-19 07:24:41.755758] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe> (cf7ec9ad-e740-4b8f-a406-369e31038bbe) [No such file or directory] >[2016-04-19 07:24:41.755787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe> (cf7ec9ad-e740-4b8f-a406-369e31038bbe) [No such file or directory] >[2016-04-19 07:24:41.756068] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.758613] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cf7ec9ad-e740-4b8f-a406-369e31038bbe. (Possible split-brain) >[2016-04-19 07:24:41.759697] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe> (cf7ec9ad-e740-4b8f-a406-369e31038bbe) [No such file or directory] >[2016-04-19 07:24:41.759750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe> (cf7ec9ad-e740-4b8f-a406-369e31038bbe) [No such file or directory] >[2016-04-19 07:24:41.762467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe> (cf7ec9ad-e740-4b8f-a406-369e31038bbe) [No such file or directory] >[2016-04-19 07:24:41.762512] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe> (cf7ec9ad-e740-4b8f-a406-369e31038bbe) [No such file or directory] >[2016-04-19 07:24:41.762749] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cf7ec9ad-e740-4b8f-a406-369e31038bbe>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.772452] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.773544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c> (fe836859-6be9-433d-92f9-e1e86866e09c) [No such file or directory] >[2016-04-19 07:24:41.773822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c> (fe836859-6be9-433d-92f9-e1e86866e09c) [No such file or directory] >[2016-04-19 07:24:41.776734] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fe836859-6be9-433d-92f9-e1e86866e09c. (Possible split-brain) >[2016-04-19 07:24:41.777814] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c> (fe836859-6be9-433d-92f9-e1e86866e09c) [No such file or directory] >[2016-04-19 07:24:41.777912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c> (fe836859-6be9-433d-92f9-e1e86866e09c) [No such file or directory] >[2016-04-19 07:24:41.779020] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c> (fe836859-6be9-433d-92f9-e1e86866e09c) [No such file or directory] >[2016-04-19 07:24:41.779011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c> (fe836859-6be9-433d-92f9-e1e86866e09c) [No such file or directory] >[2016-04-19 07:24:41.779456] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.781965] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fe836859-6be9-433d-92f9-e1e86866e09c. (Possible split-brain) >[2016-04-19 07:24:41.782922] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c> (fe836859-6be9-433d-92f9-e1e86866e09c) [No such file or directory] >[2016-04-19 07:24:41.783406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c> (fe836859-6be9-433d-92f9-e1e86866e09c) [No such file or directory] >[2016-04-19 07:24:41.785664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c> (fe836859-6be9-433d-92f9-e1e86866e09c) [No such file or directory] >[2016-04-19 07:24:41.785910] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c> (fe836859-6be9-433d-92f9-e1e86866e09c) [No such file or directory] >[2016-04-19 07:24:41.786237] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fe836859-6be9-433d-92f9-e1e86866e09c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.794663] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.795472] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c> (d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c) [No such file or directory] >[2016-04-19 07:24:41.795873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c> (d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c) [No such file or directory] >[2016-04-19 07:24:41.796743] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c. (Possible split-brain) >[2016-04-19 07:24:41.797799] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c> (d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c) [No such file or directory] >[2016-04-19 07:24:41.797805] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c> (d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c) [No such file or directory] >[2016-04-19 07:24:41.799278] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c> (d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c) [No such file or directory] >[2016-04-19 07:24:41.799452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c> (d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c) [No such file or directory] >[2016-04-19 07:24:41.799619] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.802040] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c. (Possible split-brain) >[2016-04-19 07:24:41.802836] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c> (d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c) [No such file or directory] >[2016-04-19 07:24:41.803303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c> (d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c) [No such file or directory] >[2016-04-19 07:24:41.806009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c> (d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c) [No such file or directory] >[2016-04-19 07:24:41.806245] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c> (d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c) [No such file or directory] >[2016-04-19 07:24:41.806365] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d3c526ab-39d9-4dad-aeb9-57cb6d1f7e7c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.815909] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.817084] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6> (6ee63676-c489-48ed-865f-02a309ae00e6) [No such file or directory] >[2016-04-19 07:24:41.817114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6> (6ee63676-c489-48ed-865f-02a309ae00e6) [No such file or directory] >[2016-04-19 07:24:41.818270] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6ee63676-c489-48ed-865f-02a309ae00e6. (Possible split-brain) >[2016-04-19 07:24:41.819309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6> (6ee63676-c489-48ed-865f-02a309ae00e6) [No such file or directory] >[2016-04-19 07:24:41.819369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6> (6ee63676-c489-48ed-865f-02a309ae00e6) [No such file or directory] >[2016-04-19 07:24:41.820605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6> (6ee63676-c489-48ed-865f-02a309ae00e6) [No such file or directory] >[2016-04-19 07:24:41.820651] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6> (6ee63676-c489-48ed-865f-02a309ae00e6) [No such file or directory] >[2016-04-19 07:24:41.820993] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.823509] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6ee63676-c489-48ed-865f-02a309ae00e6. (Possible split-brain) >[2016-04-19 07:24:41.824454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6> (6ee63676-c489-48ed-865f-02a309ae00e6) [No such file or directory] >[2016-04-19 07:24:41.824469] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6> (6ee63676-c489-48ed-865f-02a309ae00e6) [No such file or directory] >[2016-04-19 07:24:41.826940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6> (6ee63676-c489-48ed-865f-02a309ae00e6) [No such file or directory] >[2016-04-19 07:24:41.826969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6> (6ee63676-c489-48ed-865f-02a309ae00e6) [No such file or directory] >[2016-04-19 07:24:41.827385] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6ee63676-c489-48ed-865f-02a309ae00e6>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.836635] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.837523] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d298966d-efbf-4126-b26b-33413f522cba> (d298966d-efbf-4126-b26b-33413f522cba) [No such file or directory] >[2016-04-19 07:24:41.837539] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d298966d-efbf-4126-b26b-33413f522cba> (d298966d-efbf-4126-b26b-33413f522cba) [No such file or directory] >[2016-04-19 07:24:41.840088] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d298966d-efbf-4126-b26b-33413f522cba. (Possible split-brain) >[2016-04-19 07:24:41.841003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d298966d-efbf-4126-b26b-33413f522cba> (d298966d-efbf-4126-b26b-33413f522cba) [No such file or directory] >[2016-04-19 07:24:41.841362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d298966d-efbf-4126-b26b-33413f522cba> (d298966d-efbf-4126-b26b-33413f522cba) [No such file or directory] >[2016-04-19 07:24:41.842456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d298966d-efbf-4126-b26b-33413f522cba> (d298966d-efbf-4126-b26b-33413f522cba) [No such file or directory] >[2016-04-19 07:24:41.842594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d298966d-efbf-4126-b26b-33413f522cba> (d298966d-efbf-4126-b26b-33413f522cba) [No such file or directory] >[2016-04-19 07:24:41.842741] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d298966d-efbf-4126-b26b-33413f522cba>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.845195] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d298966d-efbf-4126-b26b-33413f522cba. (Possible split-brain) >[2016-04-19 07:24:41.846378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d298966d-efbf-4126-b26b-33413f522cba> (d298966d-efbf-4126-b26b-33413f522cba) [No such file or directory] >[2016-04-19 07:24:41.846440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d298966d-efbf-4126-b26b-33413f522cba> (d298966d-efbf-4126-b26b-33413f522cba) [No such file or directory] >[2016-04-19 07:24:41.848854] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d298966d-efbf-4126-b26b-33413f522cba> (d298966d-efbf-4126-b26b-33413f522cba) [No such file or directory] >[2016-04-19 07:24:41.849177] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d298966d-efbf-4126-b26b-33413f522cba> (d298966d-efbf-4126-b26b-33413f522cba) [No such file or directory] >[2016-04-19 07:24:41.849518] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d298966d-efbf-4126-b26b-33413f522cba>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.858585] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.859414] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7> (12fb99ca-e8e9-4476-b962-bfad0d800ce7) [No such file or directory] >[2016-04-19 07:24:41.859710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7> (12fb99ca-e8e9-4476-b962-bfad0d800ce7) [No such file or directory] >[2016-04-19 07:24:41.862550] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 12fb99ca-e8e9-4476-b962-bfad0d800ce7. (Possible split-brain) >[2016-04-19 07:24:41.863415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7> (12fb99ca-e8e9-4476-b962-bfad0d800ce7) [No such file or directory] >[2016-04-19 07:24:41.863921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7> (12fb99ca-e8e9-4476-b962-bfad0d800ce7) [No such file or directory] >[2016-04-19 07:24:41.865055] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7> (12fb99ca-e8e9-4476-b962-bfad0d800ce7) [No such file or directory] >[2016-04-19 07:24:41.865134] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7> (12fb99ca-e8e9-4476-b962-bfad0d800ce7) [No such file or directory] >[2016-04-19 07:24:41.865513] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.868011] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 12fb99ca-e8e9-4476-b962-bfad0d800ce7. (Possible split-brain) >[2016-04-19 07:24:41.868983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7> (12fb99ca-e8e9-4476-b962-bfad0d800ce7) [No such file or directory] >[2016-04-19 07:24:41.869046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7> (12fb99ca-e8e9-4476-b962-bfad0d800ce7) [No such file or directory] >[2016-04-19 07:24:41.871519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7> (12fb99ca-e8e9-4476-b962-bfad0d800ce7) [No such file or directory] >[2016-04-19 07:24:41.871693] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7> (12fb99ca-e8e9-4476-b962-bfad0d800ce7) [No such file or directory] >[2016-04-19 07:24:41.871854] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:12fb99ca-e8e9-4476-b962-bfad0d800ce7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.881697] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.882783] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d> (44a5325e-e718-4f84-ae38-6ae7f848216d) [No such file or directory] >[2016-04-19 07:24:41.882813] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d> (44a5325e-e718-4f84-ae38-6ae7f848216d) [No such file or directory] >[2016-04-19 07:24:41.883976] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 44a5325e-e718-4f84-ae38-6ae7f848216d. (Possible split-brain) >[2016-04-19 07:24:41.884985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d> (44a5325e-e718-4f84-ae38-6ae7f848216d) [No such file or directory] >[2016-04-19 07:24:41.885075] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d> (44a5325e-e718-4f84-ae38-6ae7f848216d) [No such file or directory] >[2016-04-19 07:24:41.886362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d> (44a5325e-e718-4f84-ae38-6ae7f848216d) [No such file or directory] >[2016-04-19 07:24:41.886435] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d> (44a5325e-e718-4f84-ae38-6ae7f848216d) [No such file or directory] >[2016-04-19 07:24:41.886636] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.889009] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 44a5325e-e718-4f84-ae38-6ae7f848216d. (Possible split-brain) >[2016-04-19 07:24:41.890062] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d> (44a5325e-e718-4f84-ae38-6ae7f848216d) [No such file or directory] >[2016-04-19 07:24:41.890238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d> (44a5325e-e718-4f84-ae38-6ae7f848216d) [No such file or directory] >[2016-04-19 07:24:41.892790] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d> (44a5325e-e718-4f84-ae38-6ae7f848216d) [No such file or directory] >[2016-04-19 07:24:41.892883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d> (44a5325e-e718-4f84-ae38-6ae7f848216d) [No such file or directory] >[2016-04-19 07:24:41.893063] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:44a5325e-e718-4f84-ae38-6ae7f848216d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.902735] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.903737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7> (276fa72e-338f-40f7-8dbf-b4f7238ec6e7) [No such file or directory] >[2016-04-19 07:24:41.903768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7> (276fa72e-338f-40f7-8dbf-b4f7238ec6e7) [No such file or directory] >[2016-04-19 07:24:41.906640] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 276fa72e-338f-40f7-8dbf-b4f7238ec6e7. (Possible split-brain) >[2016-04-19 07:24:41.907709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7> (276fa72e-338f-40f7-8dbf-b4f7238ec6e7) [No such file or directory] >[2016-04-19 07:24:41.907800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7> (276fa72e-338f-40f7-8dbf-b4f7238ec6e7) [No such file or directory] >[2016-04-19 07:24:41.908993] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7> (276fa72e-338f-40f7-8dbf-b4f7238ec6e7) [No such file or directory] >[2016-04-19 07:24:41.909030] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7> (276fa72e-338f-40f7-8dbf-b4f7238ec6e7) [No such file or directory] >[2016-04-19 07:24:41.909465] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.912031] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 276fa72e-338f-40f7-8dbf-b4f7238ec6e7. (Possible split-brain) >[2016-04-19 07:24:41.913014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7> (276fa72e-338f-40f7-8dbf-b4f7238ec6e7) [No such file or directory] >[2016-04-19 07:24:41.913226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7> (276fa72e-338f-40f7-8dbf-b4f7238ec6e7) [No such file or directory] >[2016-04-19 07:24:41.915661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7> (276fa72e-338f-40f7-8dbf-b4f7238ec6e7) [No such file or directory] >[2016-04-19 07:24:41.915823] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7> (276fa72e-338f-40f7-8dbf-b4f7238ec6e7) [No such file or directory] >[2016-04-19 07:24:41.916207] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:276fa72e-338f-40f7-8dbf-b4f7238ec6e7>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:41.925766] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.926594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6> (e9f5111c-6c49-4168-83b6-d92f33939bf6) [No such file or directory] >[2016-04-19 07:24:41.926829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6> (e9f5111c-6c49-4168-83b6-d92f33939bf6) [No such file or directory] >[2016-04-19 07:24:41.929425] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e9f5111c-6c49-4168-83b6-d92f33939bf6. (Possible split-brain) >[2016-04-19 07:24:41.930306] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6> (e9f5111c-6c49-4168-83b6-d92f33939bf6) [No such file or directory] >[2016-04-19 07:24:41.930360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6> (e9f5111c-6c49-4168-83b6-d92f33939bf6) [No such file or directory] >[2016-04-19 07:24:41.931494] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6> (e9f5111c-6c49-4168-83b6-d92f33939bf6) [No such file or directory] >[2016-04-19 07:24:41.931607] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6> (e9f5111c-6c49-4168-83b6-d92f33939bf6) [No such file or directory] >[2016-04-19 07:24:41.931751] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.934221] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e9f5111c-6c49-4168-83b6-d92f33939bf6. (Possible split-brain) >[2016-04-19 07:24:41.934822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6> (e9f5111c-6c49-4168-83b6-d92f33939bf6) [No such file or directory] >[2016-04-19 07:24:41.935243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6> (e9f5111c-6c49-4168-83b6-d92f33939bf6) [No such file or directory] >[2016-04-19 07:24:41.937594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6> (e9f5111c-6c49-4168-83b6-d92f33939bf6) [No such file or directory] >[2016-04-19 07:24:41.937980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6> (e9f5111c-6c49-4168-83b6-d92f33939bf6) [No such file or directory] >[2016-04-19 07:24:41.938114] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e9f5111c-6c49-4168-83b6-d92f33939bf6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.945308] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.946024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f> (61c28136-7ecc-488b-9045-80a1a426a90f) [No such file or directory] >[2016-04-19 07:24:41.946410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f> (61c28136-7ecc-488b-9045-80a1a426a90f) [No such file or directory] >[2016-04-19 07:24:41.949342] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 61c28136-7ecc-488b-9045-80a1a426a90f. (Possible split-brain) >[2016-04-19 07:24:41.949977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f> (61c28136-7ecc-488b-9045-80a1a426a90f) [No such file or directory] >[2016-04-19 07:24:41.950439] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f> (61c28136-7ecc-488b-9045-80a1a426a90f) [No such file or directory] >[2016-04-19 07:24:41.951676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f> (61c28136-7ecc-488b-9045-80a1a426a90f) [No such file or directory] >[2016-04-19 07:24:41.951991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f> (61c28136-7ecc-488b-9045-80a1a426a90f) [No such file or directory] >[2016-04-19 07:24:41.952180] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.954763] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 61c28136-7ecc-488b-9045-80a1a426a90f. (Possible split-brain) >[2016-04-19 07:24:41.955756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f> (61c28136-7ecc-488b-9045-80a1a426a90f) [No such file or directory] >[2016-04-19 07:24:41.955779] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f> (61c28136-7ecc-488b-9045-80a1a426a90f) [No such file or directory] >[2016-04-19 07:24:41.958367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f> (61c28136-7ecc-488b-9045-80a1a426a90f) [No such file or directory] >[2016-04-19 07:24:41.958674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f> (61c28136-7ecc-488b-9045-80a1a426a90f) [No such file or directory] >[2016-04-19 07:24:41.958787] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:61c28136-7ecc-488b-9045-80a1a426a90f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.967989] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.969022] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:69165b06-584b-456e-9799-79e1352fdf94> (69165b06-584b-456e-9799-79e1352fdf94) [No such file or directory] >[2016-04-19 07:24:41.969133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:69165b06-584b-456e-9799-79e1352fdf94> (69165b06-584b-456e-9799-79e1352fdf94) [No such file or directory] >[2016-04-19 07:24:41.970009] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 69165b06-584b-456e-9799-79e1352fdf94. (Possible split-brain) >[2016-04-19 07:24:41.970957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:69165b06-584b-456e-9799-79e1352fdf94> (69165b06-584b-456e-9799-79e1352fdf94) [No such file or directory] >[2016-04-19 07:24:41.971056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:69165b06-584b-456e-9799-79e1352fdf94> (69165b06-584b-456e-9799-79e1352fdf94) [No such file or directory] >[2016-04-19 07:24:41.972106] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:69165b06-584b-456e-9799-79e1352fdf94> (69165b06-584b-456e-9799-79e1352fdf94) [No such file or directory] >[2016-04-19 07:24:41.972271] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:69165b06-584b-456e-9799-79e1352fdf94> (69165b06-584b-456e-9799-79e1352fdf94) [No such file or directory] >[2016-04-19 07:24:41.972424] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:69165b06-584b-456e-9799-79e1352fdf94>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:41.974891] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 69165b06-584b-456e-9799-79e1352fdf94. (Possible split-brain) >[2016-04-19 07:24:41.975855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:69165b06-584b-456e-9799-79e1352fdf94> (69165b06-584b-456e-9799-79e1352fdf94) [No such file or directory] >[2016-04-19 07:24:41.975872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:69165b06-584b-456e-9799-79e1352fdf94> (69165b06-584b-456e-9799-79e1352fdf94) [No such file or directory] >[2016-04-19 07:24:41.978147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:69165b06-584b-456e-9799-79e1352fdf94> (69165b06-584b-456e-9799-79e1352fdf94) [No such file or directory] >[2016-04-19 07:24:41.978581] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:69165b06-584b-456e-9799-79e1352fdf94> (69165b06-584b-456e-9799-79e1352fdf94) [No such file or directory] >[2016-04-19 07:24:41.978712] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:69165b06-584b-456e-9799-79e1352fdf94>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:41.987180] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:41.987879] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67b15132-0324-424a-86a3-257b81c1a0db> (67b15132-0324-424a-86a3-257b81c1a0db) [No such file or directory] >[2016-04-19 07:24:41.988127] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67b15132-0324-424a-86a3-257b81c1a0db> (67b15132-0324-424a-86a3-257b81c1a0db) [No such file or directory] >[2016-04-19 07:24:41.990997] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 67b15132-0324-424a-86a3-257b81c1a0db. (Possible split-brain) >[2016-04-19 07:24:41.991784] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67b15132-0324-424a-86a3-257b81c1a0db> (67b15132-0324-424a-86a3-257b81c1a0db) [No such file or directory] >[2016-04-19 07:24:41.992086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67b15132-0324-424a-86a3-257b81c1a0db> (67b15132-0324-424a-86a3-257b81c1a0db) [No such file or directory] >[2016-04-19 07:24:41.993301] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67b15132-0324-424a-86a3-257b81c1a0db> (67b15132-0324-424a-86a3-257b81c1a0db) [No such file or directory] >[2016-04-19 07:24:41.993674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67b15132-0324-424a-86a3-257b81c1a0db> (67b15132-0324-424a-86a3-257b81c1a0db) [No such file or directory] >[2016-04-19 07:24:41.993793] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:67b15132-0324-424a-86a3-257b81c1a0db>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:41.996247] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 67b15132-0324-424a-86a3-257b81c1a0db. (Possible split-brain) >[2016-04-19 07:24:41.997058] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67b15132-0324-424a-86a3-257b81c1a0db> (67b15132-0324-424a-86a3-257b81c1a0db) [No such file or directory] >[2016-04-19 07:24:41.997482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67b15132-0324-424a-86a3-257b81c1a0db> (67b15132-0324-424a-86a3-257b81c1a0db) [No such file or directory] >[2016-04-19 07:24:42.000374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67b15132-0324-424a-86a3-257b81c1a0db> (67b15132-0324-424a-86a3-257b81c1a0db) [No such file or directory] >[2016-04-19 07:24:42.000397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67b15132-0324-424a-86a3-257b81c1a0db> (67b15132-0324-424a-86a3-257b81c1a0db) [No such file or directory] >[2016-04-19 07:24:42.000666] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:67b15132-0324-424a-86a3-257b81c1a0db>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.009793] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.010843] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580> (70e9a4b4-5b7e-468a-a96d-9df4b1462580) [No such file or directory] >[2016-04-19 07:24:42.010848] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580> (70e9a4b4-5b7e-468a-a96d-9df4b1462580) [No such file or directory] >[2016-04-19 07:24:42.012003] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 70e9a4b4-5b7e-468a-a96d-9df4b1462580. (Possible split-brain) >[2016-04-19 07:24:42.013096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580> (70e9a4b4-5b7e-468a-a96d-9df4b1462580) [No such file or directory] >[2016-04-19 07:24:42.013107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580> (70e9a4b4-5b7e-468a-a96d-9df4b1462580) [No such file or directory] >[2016-04-19 07:24:42.014756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580> (70e9a4b4-5b7e-468a-a96d-9df4b1462580) [No such file or directory] >[2016-04-19 07:24:42.014875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580> (70e9a4b4-5b7e-468a-a96d-9df4b1462580) [No such file or directory] >[2016-04-19 07:24:42.015015] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.017397] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 70e9a4b4-5b7e-468a-a96d-9df4b1462580. (Possible split-brain) >[2016-04-19 07:24:42.018472] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580> (70e9a4b4-5b7e-468a-a96d-9df4b1462580) [No such file or directory] >[2016-04-19 07:24:42.018910] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580> (70e9a4b4-5b7e-468a-a96d-9df4b1462580) [No such file or directory] >[2016-04-19 07:24:42.021622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580> (70e9a4b4-5b7e-468a-a96d-9df4b1462580) [No such file or directory] >[2016-04-19 07:24:42.021667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580> (70e9a4b4-5b7e-468a-a96d-9df4b1462580) [No such file or directory] >[2016-04-19 07:24:42.021864] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:70e9a4b4-5b7e-468a-a96d-9df4b1462580>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.029723] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.030670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1> (d924927e-3d2d-4707-8b9a-27e95df135a1) [No such file or directory] >[2016-04-19 07:24:42.030906] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1> (d924927e-3d2d-4707-8b9a-27e95df135a1) [No such file or directory] >[2016-04-19 07:24:42.033433] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d924927e-3d2d-4707-8b9a-27e95df135a1. (Possible split-brain) >[2016-04-19 07:24:42.034383] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1> (d924927e-3d2d-4707-8b9a-27e95df135a1) [No such file or directory] >[2016-04-19 07:24:42.034471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1> (d924927e-3d2d-4707-8b9a-27e95df135a1) [No such file or directory] >[2016-04-19 07:24:42.035517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1> (d924927e-3d2d-4707-8b9a-27e95df135a1) [No such file or directory] >[2016-04-19 07:24:42.035805] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1> (d924927e-3d2d-4707-8b9a-27e95df135a1) [No such file or directory] >[2016-04-19 07:24:42.035930] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.038425] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d924927e-3d2d-4707-8b9a-27e95df135a1. (Possible split-brain) >[2016-04-19 07:24:42.039612] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1> (d924927e-3d2d-4707-8b9a-27e95df135a1) [No such file or directory] >[2016-04-19 07:24:42.039639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1> (d924927e-3d2d-4707-8b9a-27e95df135a1) [No such file or directory] >[2016-04-19 07:24:42.041992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1> (d924927e-3d2d-4707-8b9a-27e95df135a1) [No such file or directory] >[2016-04-19 07:24:42.042358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1> (d924927e-3d2d-4707-8b9a-27e95df135a1) [No such file or directory] >[2016-04-19 07:24:42.042511] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d924927e-3d2d-4707-8b9a-27e95df135a1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.052366] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.053406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08366d64-bf33-47e6-8127-33428f386c7b> (08366d64-bf33-47e6-8127-33428f386c7b) [No such file or directory] >[2016-04-19 07:24:42.053602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08366d64-bf33-47e6-8127-33428f386c7b> (08366d64-bf33-47e6-8127-33428f386c7b) [No such file or directory] >[2016-04-19 07:24:42.056135] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 08366d64-bf33-47e6-8127-33428f386c7b. (Possible split-brain) >[2016-04-19 07:24:42.057243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08366d64-bf33-47e6-8127-33428f386c7b> (08366d64-bf33-47e6-8127-33428f386c7b) [No such file or directory] >[2016-04-19 07:24:42.057263] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08366d64-bf33-47e6-8127-33428f386c7b> (08366d64-bf33-47e6-8127-33428f386c7b) [No such file or directory] >[2016-04-19 07:24:42.058420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08366d64-bf33-47e6-8127-33428f386c7b> (08366d64-bf33-47e6-8127-33428f386c7b) [No such file or directory] >[2016-04-19 07:24:42.058478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08366d64-bf33-47e6-8127-33428f386c7b> (08366d64-bf33-47e6-8127-33428f386c7b) [No such file or directory] >[2016-04-19 07:24:42.058710] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:08366d64-bf33-47e6-8127-33428f386c7b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.061170] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 08366d64-bf33-47e6-8127-33428f386c7b. (Possible split-brain) >[2016-04-19 07:24:42.062179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08366d64-bf33-47e6-8127-33428f386c7b> (08366d64-bf33-47e6-8127-33428f386c7b) [No such file or directory] >[2016-04-19 07:24:42.062392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08366d64-bf33-47e6-8127-33428f386c7b> (08366d64-bf33-47e6-8127-33428f386c7b) [No such file or directory] >[2016-04-19 07:24:42.064673] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08366d64-bf33-47e6-8127-33428f386c7b> (08366d64-bf33-47e6-8127-33428f386c7b) [No such file or directory] >[2016-04-19 07:24:42.064851] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08366d64-bf33-47e6-8127-33428f386c7b> (08366d64-bf33-47e6-8127-33428f386c7b) [No such file or directory] >[2016-04-19 07:24:42.065075] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:08366d64-bf33-47e6-8127-33428f386c7b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.073864] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.074854] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6de3b598-12fe-43ef-9eea-817caf611630> (6de3b598-12fe-43ef-9eea-817caf611630) [No such file or directory] >[2016-04-19 07:24:42.074905] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6de3b598-12fe-43ef-9eea-817caf611630> (6de3b598-12fe-43ef-9eea-817caf611630) [No such file or directory] >[2016-04-19 07:24:42.076067] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6de3b598-12fe-43ef-9eea-817caf611630. (Possible split-brain) >[2016-04-19 07:24:42.077166] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6de3b598-12fe-43ef-9eea-817caf611630> (6de3b598-12fe-43ef-9eea-817caf611630) [No such file or directory] >[2016-04-19 07:24:42.077256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6de3b598-12fe-43ef-9eea-817caf611630> (6de3b598-12fe-43ef-9eea-817caf611630) [No such file or directory] >[2016-04-19 07:24:42.078358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6de3b598-12fe-43ef-9eea-817caf611630> (6de3b598-12fe-43ef-9eea-817caf611630) [No such file or directory] >[2016-04-19 07:24:42.078385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6de3b598-12fe-43ef-9eea-817caf611630> (6de3b598-12fe-43ef-9eea-817caf611630) [No such file or directory] >[2016-04-19 07:24:42.078762] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6de3b598-12fe-43ef-9eea-817caf611630>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.081252] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6de3b598-12fe-43ef-9eea-817caf611630. (Possible split-brain) >[2016-04-19 07:24:42.082371] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6de3b598-12fe-43ef-9eea-817caf611630> (6de3b598-12fe-43ef-9eea-817caf611630) [No such file or directory] >[2016-04-19 07:24:42.082440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6de3b598-12fe-43ef-9eea-817caf611630> (6de3b598-12fe-43ef-9eea-817caf611630) [No such file or directory] >[2016-04-19 07:24:42.085099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6de3b598-12fe-43ef-9eea-817caf611630> (6de3b598-12fe-43ef-9eea-817caf611630) [No such file or directory] >[2016-04-19 07:24:42.085211] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6de3b598-12fe-43ef-9eea-817caf611630> (6de3b598-12fe-43ef-9eea-817caf611630) [No such file or directory] >[2016-04-19 07:24:42.085497] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6de3b598-12fe-43ef-9eea-817caf611630>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.094774] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.095698] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f> (fa549fc5-ff4a-4795-bd20-07b83b9e7e2f) [No such file or directory] >[2016-04-19 07:24:42.095959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f> (fa549fc5-ff4a-4795-bd20-07b83b9e7e2f) [No such file or directory] >[2016-04-19 07:24:42.098827] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fa549fc5-ff4a-4795-bd20-07b83b9e7e2f. (Possible split-brain) >[2016-04-19 07:24:42.099947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f> (fa549fc5-ff4a-4795-bd20-07b83b9e7e2f) [No such file or directory] >[2016-04-19 07:24:42.099973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f> (fa549fc5-ff4a-4795-bd20-07b83b9e7e2f) [No such file or directory] >[2016-04-19 07:24:42.100977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f> (fa549fc5-ff4a-4795-bd20-07b83b9e7e2f) [No such file or directory] >[2016-04-19 07:24:42.101108] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f> (fa549fc5-ff4a-4795-bd20-07b83b9e7e2f) [No such file or directory] >[2016-04-19 07:24:42.101533] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.103995] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fa549fc5-ff4a-4795-bd20-07b83b9e7e2f. (Possible split-brain) >[2016-04-19 07:24:42.105061] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f> (fa549fc5-ff4a-4795-bd20-07b83b9e7e2f) [No such file or directory] >[2016-04-19 07:24:42.105171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f> (fa549fc5-ff4a-4795-bd20-07b83b9e7e2f) [No such file or directory] >[2016-04-19 07:24:42.107640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f> (fa549fc5-ff4a-4795-bd20-07b83b9e7e2f) [No such file or directory] >[2016-04-19 07:24:42.108002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f> (fa549fc5-ff4a-4795-bd20-07b83b9e7e2f) [No such file or directory] >[2016-04-19 07:24:42.108165] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fa549fc5-ff4a-4795-bd20-07b83b9e7e2f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.117847] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.118739] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16> (a987b105-964b-4f68-ac7b-5163cf9e0d16) [No such file or directory] >[2016-04-19 07:24:42.119030] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16> (a987b105-964b-4f68-ac7b-5163cf9e0d16) [No such file or directory] >[2016-04-19 07:24:42.120132] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a987b105-964b-4f68-ac7b-5163cf9e0d16. (Possible split-brain) >[2016-04-19 07:24:42.121131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16> (a987b105-964b-4f68-ac7b-5163cf9e0d16) [No such file or directory] >[2016-04-19 07:24:42.121387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16> (a987b105-964b-4f68-ac7b-5163cf9e0d16) [No such file or directory] >[2016-04-19 07:24:42.122422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16> (a987b105-964b-4f68-ac7b-5163cf9e0d16) [No such file or directory] >[2016-04-19 07:24:42.122675] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16> (a987b105-964b-4f68-ac7b-5163cf9e0d16) [No such file or directory] >[2016-04-19 07:24:42.122951] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.125367] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a987b105-964b-4f68-ac7b-5163cf9e0d16. (Possible split-brain) >[2016-04-19 07:24:42.126430] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16> (a987b105-964b-4f68-ac7b-5163cf9e0d16) [No such file or directory] >[2016-04-19 07:24:42.126531] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16> (a987b105-964b-4f68-ac7b-5163cf9e0d16) [No such file or directory] >[2016-04-19 07:24:42.128910] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16> (a987b105-964b-4f68-ac7b-5163cf9e0d16) [No such file or directory] >[2016-04-19 07:24:42.128990] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16> (a987b105-964b-4f68-ac7b-5163cf9e0d16) [No such file or directory] >[2016-04-19 07:24:42.129219] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a987b105-964b-4f68-ac7b-5163cf9e0d16>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.138439] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.139180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a> (f86db808-97ff-47b3-bc64-c52b249fea4a) [No such file or directory] >[2016-04-19 07:24:42.139474] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a> (f86db808-97ff-47b3-bc64-c52b249fea4a) [No such file or directory] >[2016-04-19 07:24:42.140308] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f86db808-97ff-47b3-bc64-c52b249fea4a. (Possible split-brain) >[2016-04-19 07:24:42.141013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a> (f86db808-97ff-47b3-bc64-c52b249fea4a) [No such file or directory] >[2016-04-19 07:24:42.141128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a> (f86db808-97ff-47b3-bc64-c52b249fea4a) [No such file or directory] >[2016-04-19 07:24:42.142350] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a> (f86db808-97ff-47b3-bc64-c52b249fea4a) [No such file or directory] >[2016-04-19 07:24:42.142615] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a> (f86db808-97ff-47b3-bc64-c52b249fea4a) [No such file or directory] >[2016-04-19 07:24:42.142725] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.145210] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f86db808-97ff-47b3-bc64-c52b249fea4a. (Possible split-brain) >[2016-04-19 07:24:42.145945] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a> (f86db808-97ff-47b3-bc64-c52b249fea4a) [No such file or directory] >[2016-04-19 07:24:42.146381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a> (f86db808-97ff-47b3-bc64-c52b249fea4a) [No such file or directory] >[2016-04-19 07:24:42.148991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a> (f86db808-97ff-47b3-bc64-c52b249fea4a) [No such file or directory] >[2016-04-19 07:24:42.149444] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a> (f86db808-97ff-47b3-bc64-c52b249fea4a) [No such file or directory] >[2016-04-19 07:24:42.149689] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f86db808-97ff-47b3-bc64-c52b249fea4a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.158862] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.159971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b> (1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b) [No such file or directory] >[2016-04-19 07:24:42.160046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b> (1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b) [No such file or directory] >[2016-04-19 07:24:42.160923] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b. (Possible split-brain) >[2016-04-19 07:24:42.162123] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b> (1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b) [No such file or directory] >[2016-04-19 07:24:42.162124] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b> (1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b) [No such file or directory] >[2016-04-19 07:24:42.163428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b> (1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b) [No such file or directory] >[2016-04-19 07:24:42.163553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b> (1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b) [No such file or directory] >[2016-04-19 07:24:42.163686] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.166061] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b. (Possible split-brain) >[2016-04-19 07:24:42.167210] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b> (1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b) [No such file or directory] >[2016-04-19 07:24:42.167216] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b> (1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b) [No such file or directory] >[2016-04-19 07:24:42.169620] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b> (1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b) [No such file or directory] >[2016-04-19 07:24:42.169923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b> (1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b) [No such file or directory] >[2016-04-19 07:24:42.170039] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1dbe9ea9-0c71-41a4-8a94-8fd47c6b474b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.179480] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.180257] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52> (ecf61afe-8afd-4a9d-bfb5-b47a74f73f52) [No such file or directory] >[2016-04-19 07:24:42.180509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52> (ecf61afe-8afd-4a9d-bfb5-b47a74f73f52) [No such file or directory] >[2016-04-19 07:24:42.181364] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ecf61afe-8afd-4a9d-bfb5-b47a74f73f52. (Possible split-brain) >[2016-04-19 07:24:42.182140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52> (ecf61afe-8afd-4a9d-bfb5-b47a74f73f52) [No such file or directory] >[2016-04-19 07:24:42.182351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52> (ecf61afe-8afd-4a9d-bfb5-b47a74f73f52) [No such file or directory] >[2016-04-19 07:24:42.183579] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52> (ecf61afe-8afd-4a9d-bfb5-b47a74f73f52) [No such file or directory] >[2016-04-19 07:24:42.183972] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52> (ecf61afe-8afd-4a9d-bfb5-b47a74f73f52) [No such file or directory] >[2016-04-19 07:24:42.184117] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.186611] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ecf61afe-8afd-4a9d-bfb5-b47a74f73f52. (Possible split-brain) >[2016-04-19 07:24:42.187376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52> (ecf61afe-8afd-4a9d-bfb5-b47a74f73f52) [No such file or directory] >[2016-04-19 07:24:42.187490] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52> (ecf61afe-8afd-4a9d-bfb5-b47a74f73f52) [No such file or directory] >[2016-04-19 07:24:42.190018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52> (ecf61afe-8afd-4a9d-bfb5-b47a74f73f52) [No such file or directory] >[2016-04-19 07:24:42.190112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52> (ecf61afe-8afd-4a9d-bfb5-b47a74f73f52) [No such file or directory] >[2016-04-19 07:24:42.190224] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ecf61afe-8afd-4a9d-bfb5-b47a74f73f52>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.198709] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.199519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2608a691-e16b-4b2c-b988-55845595192b> (2608a691-e16b-4b2c-b988-55845595192b) [No such file or directory] >[2016-04-19 07:24:42.199820] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2608a691-e16b-4b2c-b988-55845595192b> (2608a691-e16b-4b2c-b988-55845595192b) [No such file or directory] >[2016-04-19 07:24:42.200897] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2608a691-e16b-4b2c-b988-55845595192b. (Possible split-brain) >[2016-04-19 07:24:42.201712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2608a691-e16b-4b2c-b988-55845595192b> (2608a691-e16b-4b2c-b988-55845595192b) [No such file or directory] >[2016-04-19 07:24:42.201808] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2608a691-e16b-4b2c-b988-55845595192b> (2608a691-e16b-4b2c-b988-55845595192b) [No such file or directory] >[2016-04-19 07:24:42.202901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2608a691-e16b-4b2c-b988-55845595192b> (2608a691-e16b-4b2c-b988-55845595192b) [No such file or directory] >[2016-04-19 07:24:42.203167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2608a691-e16b-4b2c-b988-55845595192b> (2608a691-e16b-4b2c-b988-55845595192b) [No such file or directory] >[2016-04-19 07:24:42.203363] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2608a691-e16b-4b2c-b988-55845595192b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.205799] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2608a691-e16b-4b2c-b988-55845595192b. (Possible split-brain) >[2016-04-19 07:24:42.206694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2608a691-e16b-4b2c-b988-55845595192b> (2608a691-e16b-4b2c-b988-55845595192b) [No such file or directory] >[2016-04-19 07:24:42.206720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2608a691-e16b-4b2c-b988-55845595192b> (2608a691-e16b-4b2c-b988-55845595192b) [No such file or directory] >[2016-04-19 07:24:42.208909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2608a691-e16b-4b2c-b988-55845595192b> (2608a691-e16b-4b2c-b988-55845595192b) [No such file or directory] >[2016-04-19 07:24:42.209298] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2608a691-e16b-4b2c-b988-55845595192b> (2608a691-e16b-4b2c-b988-55845595192b) [No such file or directory] >[2016-04-19 07:24:42.209471] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2608a691-e16b-4b2c-b988-55845595192b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.219358] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.220392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803> (46d74f5e-8236-47eb-bb07-eafc2ead3803) [No such file or directory] >[2016-04-19 07:24:42.220469] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803> (46d74f5e-8236-47eb-bb07-eafc2ead3803) [No such file or directory] >[2016-04-19 07:24:42.223389] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 46d74f5e-8236-47eb-bb07-eafc2ead3803. (Possible split-brain) >[2016-04-19 07:24:42.224384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803> (46d74f5e-8236-47eb-bb07-eafc2ead3803) [No such file or directory] >[2016-04-19 07:24:42.224395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803> (46d74f5e-8236-47eb-bb07-eafc2ead3803) [No such file or directory] >[2016-04-19 07:24:42.225677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803> (46d74f5e-8236-47eb-bb07-eafc2ead3803) [No such file or directory] >[2016-04-19 07:24:42.225765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803> (46d74f5e-8236-47eb-bb07-eafc2ead3803) [No such file or directory] >[2016-04-19 07:24:42.225877] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.228381] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 46d74f5e-8236-47eb-bb07-eafc2ead3803. (Possible split-brain) >[2016-04-19 07:24:42.229193] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803> (46d74f5e-8236-47eb-bb07-eafc2ead3803) [No such file or directory] >[2016-04-19 07:24:42.229422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803> (46d74f5e-8236-47eb-bb07-eafc2ead3803) [No such file or directory] >[2016-04-19 07:24:42.231987] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803> (46d74f5e-8236-47eb-bb07-eafc2ead3803) [No such file or directory] >[2016-04-19 07:24:42.232387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803> (46d74f5e-8236-47eb-bb07-eafc2ead3803) [No such file or directory] >[2016-04-19 07:24:42.232554] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:46d74f5e-8236-47eb-bb07-eafc2ead3803>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.241450] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.242280] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985> (cdf6f4c1-f32d-41a6-8809-04f41aece985) [No such file or directory] >[2016-04-19 07:24:42.242652] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985> (cdf6f4c1-f32d-41a6-8809-04f41aece985) [No such file or directory] >[2016-04-19 07:24:42.243577] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cdf6f4c1-f32d-41a6-8809-04f41aece985. (Possible split-brain) >[2016-04-19 07:24:42.244300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985> (cdf6f4c1-f32d-41a6-8809-04f41aece985) [No such file or directory] >[2016-04-19 07:24:42.244688] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985> (cdf6f4c1-f32d-41a6-8809-04f41aece985) [No such file or directory] >[2016-04-19 07:24:42.246256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985> (cdf6f4c1-f32d-41a6-8809-04f41aece985) [No such file or directory] >[2016-04-19 07:24:42.246370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985> (cdf6f4c1-f32d-41a6-8809-04f41aece985) [No such file or directory] >[2016-04-19 07:24:42.246604] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.249072] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cdf6f4c1-f32d-41a6-8809-04f41aece985. (Possible split-brain) >[2016-04-19 07:24:42.249811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985> (cdf6f4c1-f32d-41a6-8809-04f41aece985) [No such file or directory] >[2016-04-19 07:24:42.250201] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985> (cdf6f4c1-f32d-41a6-8809-04f41aece985) [No such file or directory] >[2016-04-19 07:24:42.252945] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985> (cdf6f4c1-f32d-41a6-8809-04f41aece985) [No such file or directory] >[2016-04-19 07:24:42.253544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985> (cdf6f4c1-f32d-41a6-8809-04f41aece985) [No such file or directory] >[2016-04-19 07:24:42.253720] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cdf6f4c1-f32d-41a6-8809-04f41aece985>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.262637] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.263346] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1> (bb67855d-575a-4e3e-a63b-cbc46b167db1) [No such file or directory] >[2016-04-19 07:24:42.263677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1> (bb67855d-575a-4e3e-a63b-cbc46b167db1) [No such file or directory] >[2016-04-19 07:24:42.264779] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bb67855d-575a-4e3e-a63b-cbc46b167db1. (Possible split-brain) >[2016-04-19 07:24:42.265748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1> (bb67855d-575a-4e3e-a63b-cbc46b167db1) [No such file or directory] >[2016-04-19 07:24:42.265903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1> (bb67855d-575a-4e3e-a63b-cbc46b167db1) [No such file or directory] >[2016-04-19 07:24:42.267463] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1> (bb67855d-575a-4e3e-a63b-cbc46b167db1) [No such file or directory] >[2016-04-19 07:24:42.267534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1> (bb67855d-575a-4e3e-a63b-cbc46b167db1) [No such file or directory] >[2016-04-19 07:24:42.267754] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.270214] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bb67855d-575a-4e3e-a63b-cbc46b167db1. (Possible split-brain) >[2016-04-19 07:24:42.270981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1> (bb67855d-575a-4e3e-a63b-cbc46b167db1) [No such file or directory] >[2016-04-19 07:24:42.271313] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1> (bb67855d-575a-4e3e-a63b-cbc46b167db1) [No such file or directory] >[2016-04-19 07:24:42.274007] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1> (bb67855d-575a-4e3e-a63b-cbc46b167db1) [No such file or directory] >[2016-04-19 07:24:42.274353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1> (bb67855d-575a-4e3e-a63b-cbc46b167db1) [No such file or directory] >[2016-04-19 07:24:42.274502] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bb67855d-575a-4e3e-a63b-cbc46b167db1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.283034] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.284206] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec> (cdc209a7-4808-442e-a8f9-35b1883fb5ec) [No such file or directory] >[2016-04-19 07:24:42.284282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec> (cdc209a7-4808-442e-a8f9-35b1883fb5ec) [No such file or directory] >[2016-04-19 07:24:42.285255] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cdc209a7-4808-442e-a8f9-35b1883fb5ec. (Possible split-brain) >[2016-04-19 07:24:42.286379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec> (cdc209a7-4808-442e-a8f9-35b1883fb5ec) [No such file or directory] >[2016-04-19 07:24:42.286448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec> (cdc209a7-4808-442e-a8f9-35b1883fb5ec) [No such file or directory] >[2016-04-19 07:24:42.287856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec> (cdc209a7-4808-442e-a8f9-35b1883fb5ec) [No such file or directory] >[2016-04-19 07:24:42.287888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec> (cdc209a7-4808-442e-a8f9-35b1883fb5ec) [No such file or directory] >[2016-04-19 07:24:42.288070] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.290888] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cdc209a7-4808-442e-a8f9-35b1883fb5ec. (Possible split-brain) >[2016-04-19 07:24:42.292008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec> (cdc209a7-4808-442e-a8f9-35b1883fb5ec) [No such file or directory] >[2016-04-19 07:24:42.292027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec> (cdc209a7-4808-442e-a8f9-35b1883fb5ec) [No such file or directory] >[2016-04-19 07:24:42.294540] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec> (cdc209a7-4808-442e-a8f9-35b1883fb5ec) [No such file or directory] >[2016-04-19 07:24:42.294832] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec> (cdc209a7-4808-442e-a8f9-35b1883fb5ec) [No such file or directory] >[2016-04-19 07:24:42.294983] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cdc209a7-4808-442e-a8f9-35b1883fb5ec>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.304006] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.304753] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1> (1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1) [No such file or directory] >[2016-04-19 07:24:42.305052] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1> (1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1) [No such file or directory] >[2016-04-19 07:24:42.307890] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1. (Possible split-brain) >[2016-04-19 07:24:42.308661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1> (1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1) [No such file or directory] >[2016-04-19 07:24:42.308925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1> (1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1) [No such file or directory] >[2016-04-19 07:24:42.310139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1> (1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1) [No such file or directory] >[2016-04-19 07:24:42.310528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1> (1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1) [No such file or directory] >[2016-04-19 07:24:42.310685] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.313350] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1. (Possible split-brain) >[2016-04-19 07:24:42.314063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1> (1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1) [No such file or directory] >[2016-04-19 07:24:42.314563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1> (1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1) [No such file or directory] >[2016-04-19 07:24:42.317065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1> (1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1) [No such file or directory] >[2016-04-19 07:24:42.317287] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1> (1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1) [No such file or directory] >[2016-04-19 07:24:42.317459] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1ea4dab0-27fa-4d2a-93aa-0e6a6ad949d1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.327157] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.328220] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0> (b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0) [No such file or directory] >[2016-04-19 07:24:42.328249] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0> (b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0) [No such file or directory] >[2016-04-19 07:24:42.329378] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0. (Possible split-brain) >[2016-04-19 07:24:42.330378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0> (b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0) [No such file or directory] >[2016-04-19 07:24:42.330389] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0> (b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0) [No such file or directory] >[2016-04-19 07:24:42.331806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0> (b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0) [No such file or directory] >[2016-04-19 07:24:42.331833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0> (b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0) [No such file or directory] >[2016-04-19 07:24:42.331986] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.334483] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0. (Possible split-brain) >[2016-04-19 07:24:42.335582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0> (b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0) [No such file or directory] >[2016-04-19 07:24:42.335618] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0> (b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0) [No such file or directory] >[2016-04-19 07:24:42.338712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0> (b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0) [No such file or directory] >[2016-04-19 07:24:42.338742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0> (b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0) [No such file or directory] >[2016-04-19 07:24:42.338900] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b60b2bfb-7d72-4a1d-8231-9e9e1cba82c0>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.349220] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.350396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f> (92fc7902-2204-465c-abc5-a3089a2f4e4f) [No such file or directory] >[2016-04-19 07:24:42.350496] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f> (92fc7902-2204-465c-abc5-a3089a2f4e4f) [No such file or directory] >[2016-04-19 07:24:42.353294] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 92fc7902-2204-465c-abc5-a3089a2f4e4f. (Possible split-brain) >[2016-04-19 07:24:42.354399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f> (92fc7902-2204-465c-abc5-a3089a2f4e4f) [No such file or directory] >[2016-04-19 07:24:42.354414] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f> (92fc7902-2204-465c-abc5-a3089a2f4e4f) [No such file or directory] >[2016-04-19 07:24:42.355663] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f> (92fc7902-2204-465c-abc5-a3089a2f4e4f) [No such file or directory] >[2016-04-19 07:24:42.355720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f> (92fc7902-2204-465c-abc5-a3089a2f4e4f) [No such file or directory] >[2016-04-19 07:24:42.355886] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.358678] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 92fc7902-2204-465c-abc5-a3089a2f4e4f. (Possible split-brain) >[2016-04-19 07:24:42.359894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f> (92fc7902-2204-465c-abc5-a3089a2f4e4f) [No such file or directory] >[2016-04-19 07:24:42.359921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f> (92fc7902-2204-465c-abc5-a3089a2f4e4f) [No such file or directory] >[2016-04-19 07:24:42.362857] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f> (92fc7902-2204-465c-abc5-a3089a2f4e4f) [No such file or directory] >[2016-04-19 07:24:42.363149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f> (92fc7902-2204-465c-abc5-a3089a2f4e4f) [No such file or directory] >[2016-04-19 07:24:42.363428] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:92fc7902-2204-465c-abc5-a3089a2f4e4f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.372484] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.373448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40> (263bbc61-e94c-4dca-90ab-71713ba21d40) [No such file or directory] >[2016-04-19 07:24:42.373487] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40> (263bbc61-e94c-4dca-90ab-71713ba21d40) [No such file or directory] >[2016-04-19 07:24:42.376395] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 263bbc61-e94c-4dca-90ab-71713ba21d40. (Possible split-brain) >[2016-04-19 07:24:42.377442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40> (263bbc61-e94c-4dca-90ab-71713ba21d40) [No such file or directory] >[2016-04-19 07:24:42.377474] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40> (263bbc61-e94c-4dca-90ab-71713ba21d40) [No such file or directory] >[2016-04-19 07:24:42.378632] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40> (263bbc61-e94c-4dca-90ab-71713ba21d40) [No such file or directory] >[2016-04-19 07:24:42.379001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40> (263bbc61-e94c-4dca-90ab-71713ba21d40) [No such file or directory] >[2016-04-19 07:24:42.379190] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.382011] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 263bbc61-e94c-4dca-90ab-71713ba21d40. (Possible split-brain) >[2016-04-19 07:24:42.382897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40> (263bbc61-e94c-4dca-90ab-71713ba21d40) [No such file or directory] >[2016-04-19 07:24:42.383179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40> (263bbc61-e94c-4dca-90ab-71713ba21d40) [No such file or directory] >[2016-04-19 07:24:42.385663] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40> (263bbc61-e94c-4dca-90ab-71713ba21d40) [No such file or directory] >[2016-04-19 07:24:42.385698] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40> (263bbc61-e94c-4dca-90ab-71713ba21d40) [No such file or directory] >[2016-04-19 07:24:42.385929] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:263bbc61-e94c-4dca-90ab-71713ba21d40>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.395643] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.396658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c> (67cc1b1d-8d0f-48c2-827c-906bbbb61e3c) [No such file or directory] >[2016-04-19 07:24:42.396741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c> (67cc1b1d-8d0f-48c2-827c-906bbbb61e3c) [No such file or directory] >[2016-04-19 07:24:42.399586] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 67cc1b1d-8d0f-48c2-827c-906bbbb61e3c. (Possible split-brain) >[2016-04-19 07:24:42.400592] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c> (67cc1b1d-8d0f-48c2-827c-906bbbb61e3c) [No such file or directory] >[2016-04-19 07:24:42.400678] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c> (67cc1b1d-8d0f-48c2-827c-906bbbb61e3c) [No such file or directory] >[2016-04-19 07:24:42.402232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c> (67cc1b1d-8d0f-48c2-827c-906bbbb61e3c) [No such file or directory] >[2016-04-19 07:24:42.402387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c> (67cc1b1d-8d0f-48c2-827c-906bbbb61e3c) [No such file or directory] >[2016-04-19 07:24:42.402568] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.405289] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 67cc1b1d-8d0f-48c2-827c-906bbbb61e3c. (Possible split-brain) >[2016-04-19 07:24:42.406130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c> (67cc1b1d-8d0f-48c2-827c-906bbbb61e3c) [No such file or directory] >[2016-04-19 07:24:42.406619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c> (67cc1b1d-8d0f-48c2-827c-906bbbb61e3c) [No such file or directory] >[2016-04-19 07:24:42.409076] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c> (67cc1b1d-8d0f-48c2-827c-906bbbb61e3c) [No such file or directory] >[2016-04-19 07:24:42.409658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c> (67cc1b1d-8d0f-48c2-827c-906bbbb61e3c) [No such file or directory] >[2016-04-19 07:24:42.409801] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:67cc1b1d-8d0f-48c2-827c-906bbbb61e3c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.418561] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.419573] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2> (cb87012d-d256-404f-b59b-2a81aaa0cbb2) [No such file or directory] >[2016-04-19 07:24:42.419596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2> (cb87012d-d256-404f-b59b-2a81aaa0cbb2) [No such file or directory] >[2016-04-19 07:24:42.422542] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cb87012d-d256-404f-b59b-2a81aaa0cbb2. (Possible split-brain) >[2016-04-19 07:24:42.423301] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2> (cb87012d-d256-404f-b59b-2a81aaa0cbb2) [No such file or directory] >[2016-04-19 07:24:42.423711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2> (cb87012d-d256-404f-b59b-2a81aaa0cbb2) [No such file or directory] >[2016-04-19 07:24:42.424880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2> (cb87012d-d256-404f-b59b-2a81aaa0cbb2) [No such file or directory] >[2016-04-19 07:24:42.425220] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2> (cb87012d-d256-404f-b59b-2a81aaa0cbb2) [No such file or directory] >[2016-04-19 07:24:42.425392] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.428235] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cb87012d-d256-404f-b59b-2a81aaa0cbb2. (Possible split-brain) >[2016-04-19 07:24:42.429203] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2> (cb87012d-d256-404f-b59b-2a81aaa0cbb2) [No such file or directory] >[2016-04-19 07:24:42.429218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2> (cb87012d-d256-404f-b59b-2a81aaa0cbb2) [No such file or directory] >[2016-04-19 07:24:42.432247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2> (cb87012d-d256-404f-b59b-2a81aaa0cbb2) [No such file or directory] >[2016-04-19 07:24:42.432400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2> (cb87012d-d256-404f-b59b-2a81aaa0cbb2) [No such file or directory] >[2016-04-19 07:24:42.432613] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cb87012d-d256-404f-b59b-2a81aaa0cbb2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.442507] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.443346] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489> (728400ce-9d42-4e62-a2eb-3425627ef489) [No such file or directory] >[2016-04-19 07:24:42.443506] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489> (728400ce-9d42-4e62-a2eb-3425627ef489) [No such file or directory] >[2016-04-19 07:24:42.446096] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 728400ce-9d42-4e62-a2eb-3425627ef489. (Possible split-brain) >[2016-04-19 07:24:42.446845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489> (728400ce-9d42-4e62-a2eb-3425627ef489) [No such file or directory] >[2016-04-19 07:24:42.447116] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489> (728400ce-9d42-4e62-a2eb-3425627ef489) [No such file or directory] >[2016-04-19 07:24:42.448289] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489> (728400ce-9d42-4e62-a2eb-3425627ef489) [No such file or directory] >[2016-04-19 07:24:42.448692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489> (728400ce-9d42-4e62-a2eb-3425627ef489) [No such file or directory] >[2016-04-19 07:24:42.448838] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.451578] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 728400ce-9d42-4e62-a2eb-3425627ef489. (Possible split-brain) >[2016-04-19 07:24:42.452417] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489> (728400ce-9d42-4e62-a2eb-3425627ef489) [No such file or directory] >[2016-04-19 07:24:42.452737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489> (728400ce-9d42-4e62-a2eb-3425627ef489) [No such file or directory] >[2016-04-19 07:24:42.455162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489> (728400ce-9d42-4e62-a2eb-3425627ef489) [No such file or directory] >[2016-04-19 07:24:42.455604] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489> (728400ce-9d42-4e62-a2eb-3425627ef489) [No such file or directory] >[2016-04-19 07:24:42.455742] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:728400ce-9d42-4e62-a2eb-3425627ef489>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.465786] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.466830] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece> (1b015849-fe3c-4055-a60b-0d9f3c2c4ece) [No such file or directory] >[2016-04-19 07:24:42.466860] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece> (1b015849-fe3c-4055-a60b-0d9f3c2c4ece) [No such file or directory] >[2016-04-19 07:24:42.469783] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1b015849-fe3c-4055-a60b-0d9f3c2c4ece. (Possible split-brain) >[2016-04-19 07:24:42.470807] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece> (1b015849-fe3c-4055-a60b-0d9f3c2c4ece) [No such file or directory] >[2016-04-19 07:24:42.471109] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece> (1b015849-fe3c-4055-a60b-0d9f3c2c4ece) [No such file or directory] >[2016-04-19 07:24:42.472598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece> (1b015849-fe3c-4055-a60b-0d9f3c2c4ece) [No such file or directory] >[2016-04-19 07:24:42.472658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece> (1b015849-fe3c-4055-a60b-0d9f3c2c4ece) [No such file or directory] >[2016-04-19 07:24:42.472854] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.475704] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1b015849-fe3c-4055-a60b-0d9f3c2c4ece. (Possible split-brain) >[2016-04-19 07:24:42.476791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece> (1b015849-fe3c-4055-a60b-0d9f3c2c4ece) [No such file or directory] >[2016-04-19 07:24:42.476876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece> (1b015849-fe3c-4055-a60b-0d9f3c2c4ece) [No such file or directory] >[2016-04-19 07:24:42.479513] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece> (1b015849-fe3c-4055-a60b-0d9f3c2c4ece) [No such file or directory] >[2016-04-19 07:24:42.479563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece> (1b015849-fe3c-4055-a60b-0d9f3c2c4ece) [No such file or directory] >[2016-04-19 07:24:42.479800] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1b015849-fe3c-4055-a60b-0d9f3c2c4ece>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.489523] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.490413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4> (92fa7df7-b072-401f-a8b0-a2e8c6c43ef4) [No such file or directory] >[2016-04-19 07:24:42.490514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4> (92fa7df7-b072-401f-a8b0-a2e8c6c43ef4) [No such file or directory] >[2016-04-19 07:24:42.491610] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 92fa7df7-b072-401f-a8b0-a2e8c6c43ef4. (Possible split-brain) >[2016-04-19 07:24:42.492633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4> (92fa7df7-b072-401f-a8b0-a2e8c6c43ef4) [No such file or directory] >[2016-04-19 07:24:42.492662] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4> (92fa7df7-b072-401f-a8b0-a2e8c6c43ef4) [No such file or directory] >[2016-04-19 07:24:42.494102] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4> (92fa7df7-b072-401f-a8b0-a2e8c6c43ef4) [No such file or directory] >[2016-04-19 07:24:42.494109] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4> (92fa7df7-b072-401f-a8b0-a2e8c6c43ef4) [No such file or directory] >[2016-04-19 07:24:42.494305] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.497029] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 92fa7df7-b072-401f-a8b0-a2e8c6c43ef4. (Possible split-brain) >[2016-04-19 07:24:42.497753] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4> (92fa7df7-b072-401f-a8b0-a2e8c6c43ef4) [No such file or directory] >[2016-04-19 07:24:42.498057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4> (92fa7df7-b072-401f-a8b0-a2e8c6c43ef4) [No such file or directory] >[2016-04-19 07:24:42.500595] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4> (92fa7df7-b072-401f-a8b0-a2e8c6c43ef4) [No such file or directory] >[2016-04-19 07:24:42.500737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4> (92fa7df7-b072-401f-a8b0-a2e8c6c43ef4) [No such file or directory] >[2016-04-19 07:24:42.500853] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:92fa7df7-b072-401f-a8b0-a2e8c6c43ef4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.508606] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.509509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:af596d5d-68ff-440f-bd35-30b88d554159> (af596d5d-68ff-440f-bd35-30b88d554159) [No such file or directory] >[2016-04-19 07:24:42.509591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:af596d5d-68ff-440f-bd35-30b88d554159> (af596d5d-68ff-440f-bd35-30b88d554159) [No such file or directory] >[2016-04-19 07:24:42.510690] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid af596d5d-68ff-440f-bd35-30b88d554159. (Possible split-brain) >[2016-04-19 07:24:42.511633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:af596d5d-68ff-440f-bd35-30b88d554159> (af596d5d-68ff-440f-bd35-30b88d554159) [No such file or directory] >[2016-04-19 07:24:42.511975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:af596d5d-68ff-440f-bd35-30b88d554159> (af596d5d-68ff-440f-bd35-30b88d554159) [No such file or directory] >[2016-04-19 07:24:42.513207] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:af596d5d-68ff-440f-bd35-30b88d554159> (af596d5d-68ff-440f-bd35-30b88d554159) [No such file or directory] >[2016-04-19 07:24:42.513398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:af596d5d-68ff-440f-bd35-30b88d554159> (af596d5d-68ff-440f-bd35-30b88d554159) [No such file or directory] >[2016-04-19 07:24:42.513568] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:af596d5d-68ff-440f-bd35-30b88d554159>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.516120] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid af596d5d-68ff-440f-bd35-30b88d554159. (Possible split-brain) >[2016-04-19 07:24:42.516888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:af596d5d-68ff-440f-bd35-30b88d554159> (af596d5d-68ff-440f-bd35-30b88d554159) [No such file or directory] >[2016-04-19 07:24:42.517131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:af596d5d-68ff-440f-bd35-30b88d554159> (af596d5d-68ff-440f-bd35-30b88d554159) [No such file or directory] >[2016-04-19 07:24:42.519832] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:af596d5d-68ff-440f-bd35-30b88d554159> (af596d5d-68ff-440f-bd35-30b88d554159) [No such file or directory] >[2016-04-19 07:24:42.519910] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:af596d5d-68ff-440f-bd35-30b88d554159> (af596d5d-68ff-440f-bd35-30b88d554159) [No such file or directory] >[2016-04-19 07:24:42.520096] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:af596d5d-68ff-440f-bd35-30b88d554159>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.529236] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.530308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6> (dd59665b-7e98-48e0-b49c-5d7f4477e3a6) [No such file or directory] >[2016-04-19 07:24:42.530391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6> (dd59665b-7e98-48e0-b49c-5d7f4477e3a6) [No such file or directory] >[2016-04-19 07:24:42.531277] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dd59665b-7e98-48e0-b49c-5d7f4477e3a6. (Possible split-brain) >[2016-04-19 07:24:42.532313] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6> (dd59665b-7e98-48e0-b49c-5d7f4477e3a6) [No such file or directory] >[2016-04-19 07:24:42.532450] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6> (dd59665b-7e98-48e0-b49c-5d7f4477e3a6) [No such file or directory] >[2016-04-19 07:24:42.533595] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6> (dd59665b-7e98-48e0-b49c-5d7f4477e3a6) [No such file or directory] >[2016-04-19 07:24:42.533675] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6> (dd59665b-7e98-48e0-b49c-5d7f4477e3a6) [No such file or directory] >[2016-04-19 07:24:42.533868] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.536545] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dd59665b-7e98-48e0-b49c-5d7f4477e3a6. (Possible split-brain) >[2016-04-19 07:24:42.537655] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6> (dd59665b-7e98-48e0-b49c-5d7f4477e3a6) [No such file or directory] >[2016-04-19 07:24:42.537734] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6> (dd59665b-7e98-48e0-b49c-5d7f4477e3a6) [No such file or directory] >[2016-04-19 07:24:42.540391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6> (dd59665b-7e98-48e0-b49c-5d7f4477e3a6) [No such file or directory] >[2016-04-19 07:24:42.540422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6> (dd59665b-7e98-48e0-b49c-5d7f4477e3a6) [No such file or directory] >[2016-04-19 07:24:42.540685] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:dd59665b-7e98-48e0-b49c-5d7f4477e3a6>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.550416] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.551425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b152416-9060-4c73-8aba-30f8292b2824> (8b152416-9060-4c73-8aba-30f8292b2824) [No such file or directory] >[2016-04-19 07:24:42.551527] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b152416-9060-4c73-8aba-30f8292b2824> (8b152416-9060-4c73-8aba-30f8292b2824) [No such file or directory] >[2016-04-19 07:24:42.552639] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8b152416-9060-4c73-8aba-30f8292b2824. (Possible split-brain) >[2016-04-19 07:24:42.553713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b152416-9060-4c73-8aba-30f8292b2824> (8b152416-9060-4c73-8aba-30f8292b2824) [No such file or directory] >[2016-04-19 07:24:42.553804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b152416-9060-4c73-8aba-30f8292b2824> (8b152416-9060-4c73-8aba-30f8292b2824) [No such file or directory] >[2016-04-19 07:24:42.554817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b152416-9060-4c73-8aba-30f8292b2824> (8b152416-9060-4c73-8aba-30f8292b2824) [No such file or directory] >[2016-04-19 07:24:42.555074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b152416-9060-4c73-8aba-30f8292b2824> (8b152416-9060-4c73-8aba-30f8292b2824) [No such file or directory] >[2016-04-19 07:24:42.555189] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8b152416-9060-4c73-8aba-30f8292b2824>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.556795] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8b152416-9060-4c73-8aba-30f8292b2824. (Possible split-brain) >[2016-04-19 07:24:42.557423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b152416-9060-4c73-8aba-30f8292b2824> (8b152416-9060-4c73-8aba-30f8292b2824) [No such file or directory] >[2016-04-19 07:24:42.557742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b152416-9060-4c73-8aba-30f8292b2824> (8b152416-9060-4c73-8aba-30f8292b2824) [No such file or directory] >[2016-04-19 07:24:42.560228] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b152416-9060-4c73-8aba-30f8292b2824> (8b152416-9060-4c73-8aba-30f8292b2824) [No such file or directory] >[2016-04-19 07:24:42.560270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b152416-9060-4c73-8aba-30f8292b2824> (8b152416-9060-4c73-8aba-30f8292b2824) [No such file or directory] >[2016-04-19 07:24:42.560447] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8b152416-9060-4c73-8aba-30f8292b2824>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.569747] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.570706] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda> (9b746052-bcf5-4a99-b19b-5879e0d5dfda) [No such file or directory] >[2016-04-19 07:24:42.570724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda> (9b746052-bcf5-4a99-b19b-5879e0d5dfda) [No such file or directory] >[2016-04-19 07:24:42.573704] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9b746052-bcf5-4a99-b19b-5879e0d5dfda. (Possible split-brain) >[2016-04-19 07:24:42.574502] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda> (9b746052-bcf5-4a99-b19b-5879e0d5dfda) [No such file or directory] >[2016-04-19 07:24:42.574814] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda> (9b746052-bcf5-4a99-b19b-5879e0d5dfda) [No such file or directory] >[2016-04-19 07:24:42.575940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda> (9b746052-bcf5-4a99-b19b-5879e0d5dfda) [No such file or directory] >[2016-04-19 07:24:42.575946] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda> (9b746052-bcf5-4a99-b19b-5879e0d5dfda) [No such file or directory] >[2016-04-19 07:24:42.576709] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.579440] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9b746052-bcf5-4a99-b19b-5879e0d5dfda. (Possible split-brain) >[2016-04-19 07:24:42.580536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda> (9b746052-bcf5-4a99-b19b-5879e0d5dfda) [No such file or directory] >[2016-04-19 07:24:42.580620] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda> (9b746052-bcf5-4a99-b19b-5879e0d5dfda) [No such file or directory] >[2016-04-19 07:24:42.583171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda> (9b746052-bcf5-4a99-b19b-5879e0d5dfda) [No such file or directory] >[2016-04-19 07:24:42.583256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda> (9b746052-bcf5-4a99-b19b-5879e0d5dfda) [No such file or directory] >[2016-04-19 07:24:42.583462] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9b746052-bcf5-4a99-b19b-5879e0d5dfda>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.591901] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.592741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21> (7b74c6fc-124f-4fe9-bc37-4f1f3c947c21) [No such file or directory] >[2016-04-19 07:24:42.592835] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21> (7b74c6fc-124f-4fe9-bc37-4f1f3c947c21) [No such file or directory] >[2016-04-19 07:24:42.593783] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7b74c6fc-124f-4fe9-bc37-4f1f3c947c21. (Possible split-brain) >[2016-04-19 07:24:42.594721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21> (7b74c6fc-124f-4fe9-bc37-4f1f3c947c21) [No such file or directory] >[2016-04-19 07:24:42.594828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21> (7b74c6fc-124f-4fe9-bc37-4f1f3c947c21) [No such file or directory] >[2016-04-19 07:24:42.595947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21> (7b74c6fc-124f-4fe9-bc37-4f1f3c947c21) [No such file or directory] >[2016-04-19 07:24:42.596447] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21> (7b74c6fc-124f-4fe9-bc37-4f1f3c947c21) [No such file or directory] >[2016-04-19 07:24:42.596586] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.599506] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7b74c6fc-124f-4fe9-bc37-4f1f3c947c21. (Possible split-brain) >[2016-04-19 07:24:42.600444] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21> (7b74c6fc-124f-4fe9-bc37-4f1f3c947c21) [No such file or directory] >[2016-04-19 07:24:42.600952] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21> (7b74c6fc-124f-4fe9-bc37-4f1f3c947c21) [No such file or directory] >[2016-04-19 07:24:42.602732] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21> (7b74c6fc-124f-4fe9-bc37-4f1f3c947c21) [No such file or directory] >[2016-04-19 07:24:42.602810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21> (7b74c6fc-124f-4fe9-bc37-4f1f3c947c21) [No such file or directory] >[2016-04-19 07:24:42.602993] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7b74c6fc-124f-4fe9-bc37-4f1f3c947c21>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.613263] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.614576] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc> (49822622-0f44-44d0-b632-5bcbf233e5bc) [No such file or directory] >[2016-04-19 07:24:42.614724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc> (49822622-0f44-44d0-b632-5bcbf233e5bc) [No such file or directory] >[2016-04-19 07:24:42.617577] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 49822622-0f44-44d0-b632-5bcbf233e5bc. (Possible split-brain) >[2016-04-19 07:24:42.618652] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc> (49822622-0f44-44d0-b632-5bcbf233e5bc) [No such file or directory] >[2016-04-19 07:24:42.618768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc> (49822622-0f44-44d0-b632-5bcbf233e5bc) [No such file or directory] >[2016-04-19 07:24:42.620003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc> (49822622-0f44-44d0-b632-5bcbf233e5bc) [No such file or directory] >[2016-04-19 07:24:42.620083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc> (49822622-0f44-44d0-b632-5bcbf233e5bc) [No such file or directory] >[2016-04-19 07:24:42.620251] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.622918] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 49822622-0f44-44d0-b632-5bcbf233e5bc. (Possible split-brain) >[2016-04-19 07:24:42.624103] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc> (49822622-0f44-44d0-b632-5bcbf233e5bc) [No such file or directory] >[2016-04-19 07:24:42.624117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc> (49822622-0f44-44d0-b632-5bcbf233e5bc) [No such file or directory] >[2016-04-19 07:24:42.626785] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc> (49822622-0f44-44d0-b632-5bcbf233e5bc) [No such file or directory] >[2016-04-19 07:24:42.626924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc> (49822622-0f44-44d0-b632-5bcbf233e5bc) [No such file or directory] >[2016-04-19 07:24:42.627439] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:49822622-0f44-44d0-b632-5bcbf233e5bc>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.636544] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.637706] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392> (c475c4ac-8d75-4a87-9836-d9e083acf392) [No such file or directory] >[2016-04-19 07:24:42.637724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392> (c475c4ac-8d75-4a87-9836-d9e083acf392) [No such file or directory] >[2016-04-19 07:24:42.640306] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c475c4ac-8d75-4a87-9836-d9e083acf392. (Possible split-brain) >[2016-04-19 07:24:42.641407] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392> (c475c4ac-8d75-4a87-9836-d9e083acf392) [No such file or directory] >[2016-04-19 07:24:42.641534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392> (c475c4ac-8d75-4a87-9836-d9e083acf392) [No such file or directory] >[2016-04-19 07:24:42.642775] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392> (c475c4ac-8d75-4a87-9836-d9e083acf392) [No such file or directory] >[2016-04-19 07:24:42.642801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392> (c475c4ac-8d75-4a87-9836-d9e083acf392) [No such file or directory] >[2016-04-19 07:24:42.643018] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.645636] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c475c4ac-8d75-4a87-9836-d9e083acf392. (Possible split-brain) >[2016-04-19 07:24:42.646831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392> (c475c4ac-8d75-4a87-9836-d9e083acf392) [No such file or directory] >[2016-04-19 07:24:42.646913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392> (c475c4ac-8d75-4a87-9836-d9e083acf392) [No such file or directory] >[2016-04-19 07:24:42.649475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392> (c475c4ac-8d75-4a87-9836-d9e083acf392) [No such file or directory] >[2016-04-19 07:24:42.649573] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392> (c475c4ac-8d75-4a87-9836-d9e083acf392) [No such file or directory] >[2016-04-19 07:24:42.649691] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c475c4ac-8d75-4a87-9836-d9e083acf392>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.662561] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.663656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32> (6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32) [No such file or directory] >[2016-04-19 07:24:42.663675] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32> (6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32) [No such file or directory] >[2016-04-19 07:24:42.667488] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32. (Possible split-brain) >[2016-04-19 07:24:42.668380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32> (6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32) [No such file or directory] >[2016-04-19 07:24:42.668397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32> (6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32) [No such file or directory] >[2016-04-19 07:24:42.669464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32> (6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32) [No such file or directory] >[2016-04-19 07:24:42.669612] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32> (6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32) [No such file or directory] >[2016-04-19 07:24:42.669755] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.672590] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32. (Possible split-brain) >[2016-04-19 07:24:42.673525] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32> (6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32) [No such file or directory] >[2016-04-19 07:24:42.673783] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32> (6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32) [No such file or directory] >[2016-04-19 07:24:42.676432] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32> (6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32) [No such file or directory] >[2016-04-19 07:24:42.676501] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32> (6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32) [No such file or directory] >[2016-04-19 07:24:42.676653] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6c4bc35c-ba2f-4116-90f6-bf77dcc2ef32>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.685039] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.685835] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd> (f3388389-3d6a-4b97-955a-8c1fed1141bd) [No such file or directory] >[2016-04-19 07:24:42.685887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd> (f3388389-3d6a-4b97-955a-8c1fed1141bd) [No such file or directory] >[2016-04-19 07:24:42.686956] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f3388389-3d6a-4b97-955a-8c1fed1141bd. (Possible split-brain) >[2016-04-19 07:24:42.687838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd> (f3388389-3d6a-4b97-955a-8c1fed1141bd) [No such file or directory] >[2016-04-19 07:24:42.688035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd> (f3388389-3d6a-4b97-955a-8c1fed1141bd) [No such file or directory] >[2016-04-19 07:24:42.689604] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd> (f3388389-3d6a-4b97-955a-8c1fed1141bd) [No such file or directory] >[2016-04-19 07:24:42.689733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd> (f3388389-3d6a-4b97-955a-8c1fed1141bd) [No such file or directory] >[2016-04-19 07:24:42.690415] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.693130] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f3388389-3d6a-4b97-955a-8c1fed1141bd. (Possible split-brain) >[2016-04-19 07:24:42.693966] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd> (f3388389-3d6a-4b97-955a-8c1fed1141bd) [No such file or directory] >[2016-04-19 07:24:42.694085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd> (f3388389-3d6a-4b97-955a-8c1fed1141bd) [No such file or directory] >[2016-04-19 07:24:42.697643] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd> (f3388389-3d6a-4b97-955a-8c1fed1141bd) [No such file or directory] >[2016-04-19 07:24:42.697854] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd> (f3388389-3d6a-4b97-955a-8c1fed1141bd) [No such file or directory] >[2016-04-19 07:24:42.698169] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f3388389-3d6a-4b97-955a-8c1fed1141bd>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.710705] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.711184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d> (1eda7182-d3a4-43df-9ac4-daf89865952d) [No such file or directory] >[2016-04-19 07:24:42.711622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d> (1eda7182-d3a4-43df-9ac4-daf89865952d) [No such file or directory] >[2016-04-19 07:24:42.716395] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1eda7182-d3a4-43df-9ac4-daf89865952d. (Possible split-brain) >[2016-04-19 07:24:42.716838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d> (1eda7182-d3a4-43df-9ac4-daf89865952d) [No such file or directory] >[2016-04-19 07:24:42.716943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d> (1eda7182-d3a4-43df-9ac4-daf89865952d) [No such file or directory] >[2016-04-19 07:24:42.718057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d> (1eda7182-d3a4-43df-9ac4-daf89865952d) [No such file or directory] >[2016-04-19 07:24:42.718206] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d> (1eda7182-d3a4-43df-9ac4-daf89865952d) [No such file or directory] >[2016-04-19 07:24:42.718307] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.721038] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1eda7182-d3a4-43df-9ac4-daf89865952d. (Possible split-brain) >[2016-04-19 07:24:42.721625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d> (1eda7182-d3a4-43df-9ac4-daf89865952d) [No such file or directory] >[2016-04-19 07:24:42.722086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d> (1eda7182-d3a4-43df-9ac4-daf89865952d) [No such file or directory] >[2016-04-19 07:24:42.724751] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d> (1eda7182-d3a4-43df-9ac4-daf89865952d) [No such file or directory] >[2016-04-19 07:24:42.724999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d> (1eda7182-d3a4-43df-9ac4-daf89865952d) [No such file or directory] >[2016-04-19 07:24:42.725075] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1eda7182-d3a4-43df-9ac4-daf89865952d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.731497] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.732140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7> (b605047c-4ad4-4afb-b9bc-5e0a228c86a7) [No such file or directory] >[2016-04-19 07:24:42.732173] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7> (b605047c-4ad4-4afb-b9bc-5e0a228c86a7) [No such file or directory] >[2016-04-19 07:24:42.735023] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b605047c-4ad4-4afb-b9bc-5e0a228c86a7. (Possible split-brain) >[2016-04-19 07:24:42.735778] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7> (b605047c-4ad4-4afb-b9bc-5e0a228c86a7) [No such file or directory] >[2016-04-19 07:24:42.735830] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7> (b605047c-4ad4-4afb-b9bc-5e0a228c86a7) [No such file or directory] >[2016-04-19 07:24:42.736678] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7> (b605047c-4ad4-4afb-b9bc-5e0a228c86a7) [No such file or directory] >[2016-04-19 07:24:42.736736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7> (b605047c-4ad4-4afb-b9bc-5e0a228c86a7) [No such file or directory] >[2016-04-19 07:24:42.737187] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.738936] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b605047c-4ad4-4afb-b9bc-5e0a228c86a7. (Possible split-brain) >[2016-04-19 07:24:42.739649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7> (b605047c-4ad4-4afb-b9bc-5e0a228c86a7) [No such file or directory] >[2016-04-19 07:24:42.739831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7> (b605047c-4ad4-4afb-b9bc-5e0a228c86a7) [No such file or directory] >[2016-04-19 07:24:42.742472] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7> (b605047c-4ad4-4afb-b9bc-5e0a228c86a7) [No such file or directory] >[2016-04-19 07:24:42.742918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7> (b605047c-4ad4-4afb-b9bc-5e0a228c86a7) [No such file or directory] >[2016-04-19 07:24:42.743635] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b605047c-4ad4-4afb-b9bc-5e0a228c86a7>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.752252] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.753264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:02804a8b-8899-4060-8649-8da29bdf815b> (02804a8b-8899-4060-8649-8da29bdf815b) [No such file or directory] >[2016-04-19 07:24:42.753283] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:02804a8b-8899-4060-8649-8da29bdf815b> (02804a8b-8899-4060-8649-8da29bdf815b) [No such file or directory] >[2016-04-19 07:24:42.756041] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 02804a8b-8899-4060-8649-8da29bdf815b. (Possible split-brain) >[2016-04-19 07:24:42.756929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:02804a8b-8899-4060-8649-8da29bdf815b> (02804a8b-8899-4060-8649-8da29bdf815b) [No such file or directory] >[2016-04-19 07:24:42.757177] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:02804a8b-8899-4060-8649-8da29bdf815b> (02804a8b-8899-4060-8649-8da29bdf815b) [No such file or directory] >[2016-04-19 07:24:42.758279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:02804a8b-8899-4060-8649-8da29bdf815b> (02804a8b-8899-4060-8649-8da29bdf815b) [No such file or directory] >[2016-04-19 07:24:42.758572] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:02804a8b-8899-4060-8649-8da29bdf815b> (02804a8b-8899-4060-8649-8da29bdf815b) [No such file or directory] >[2016-04-19 07:24:42.758873] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:02804a8b-8899-4060-8649-8da29bdf815b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.761619] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 02804a8b-8899-4060-8649-8da29bdf815b. (Possible split-brain) >[2016-04-19 07:24:42.762721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:02804a8b-8899-4060-8649-8da29bdf815b> (02804a8b-8899-4060-8649-8da29bdf815b) [No such file or directory] >[2016-04-19 07:24:42.762742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:02804a8b-8899-4060-8649-8da29bdf815b> (02804a8b-8899-4060-8649-8da29bdf815b) [No such file or directory] >[2016-04-19 07:24:42.766303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:02804a8b-8899-4060-8649-8da29bdf815b> (02804a8b-8899-4060-8649-8da29bdf815b) [No such file or directory] >[2016-04-19 07:24:42.766627] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:02804a8b-8899-4060-8649-8da29bdf815b> (02804a8b-8899-4060-8649-8da29bdf815b) [No such file or directory] >[2016-04-19 07:24:42.766999] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:02804a8b-8899-4060-8649-8da29bdf815b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.774649] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.775469] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29d19082-ab91-43f8-bb29-35177b730992> (29d19082-ab91-43f8-bb29-35177b730992) [No such file or directory] >[2016-04-19 07:24:42.775682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29d19082-ab91-43f8-bb29-35177b730992> (29d19082-ab91-43f8-bb29-35177b730992) [No such file or directory] >[2016-04-19 07:24:42.778483] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 29d19082-ab91-43f8-bb29-35177b730992. (Possible split-brain) >[2016-04-19 07:24:42.779491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29d19082-ab91-43f8-bb29-35177b730992> (29d19082-ab91-43f8-bb29-35177b730992) [No such file or directory] >[2016-04-19 07:24:42.779774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29d19082-ab91-43f8-bb29-35177b730992> (29d19082-ab91-43f8-bb29-35177b730992) [No such file or directory] >[2016-04-19 07:24:42.781145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29d19082-ab91-43f8-bb29-35177b730992> (29d19082-ab91-43f8-bb29-35177b730992) [No such file or directory] >[2016-04-19 07:24:42.781266] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29d19082-ab91-43f8-bb29-35177b730992> (29d19082-ab91-43f8-bb29-35177b730992) [No such file or directory] >[2016-04-19 07:24:42.781444] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:29d19082-ab91-43f8-bb29-35177b730992>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.784157] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 29d19082-ab91-43f8-bb29-35177b730992. (Possible split-brain) >[2016-04-19 07:24:42.785120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29d19082-ab91-43f8-bb29-35177b730992> (29d19082-ab91-43f8-bb29-35177b730992) [No such file or directory] >[2016-04-19 07:24:42.785290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29d19082-ab91-43f8-bb29-35177b730992> (29d19082-ab91-43f8-bb29-35177b730992) [No such file or directory] >[2016-04-19 07:24:42.789585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29d19082-ab91-43f8-bb29-35177b730992> (29d19082-ab91-43f8-bb29-35177b730992) [No such file or directory] >[2016-04-19 07:24:42.789655] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29d19082-ab91-43f8-bb29-35177b730992> (29d19082-ab91-43f8-bb29-35177b730992) [No such file or directory] >[2016-04-19 07:24:42.789797] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:29d19082-ab91-43f8-bb29-35177b730992>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.799918] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.801050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c> (fff78b49-f026-45f4-bada-7b28c64d6c9c) [No such file or directory] >[2016-04-19 07:24:42.801438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c> (fff78b49-f026-45f4-bada-7b28c64d6c9c) [No such file or directory] >[2016-04-19 07:24:42.804123] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fff78b49-f026-45f4-bada-7b28c64d6c9c. (Possible split-brain) >[2016-04-19 07:24:42.805182] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c> (fff78b49-f026-45f4-bada-7b28c64d6c9c) [No such file or directory] >[2016-04-19 07:24:42.805471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c> (fff78b49-f026-45f4-bada-7b28c64d6c9c) [No such file or directory] >[2016-04-19 07:24:42.806706] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c> (fff78b49-f026-45f4-bada-7b28c64d6c9c) [No such file or directory] >[2016-04-19 07:24:42.806757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c> (fff78b49-f026-45f4-bada-7b28c64d6c9c) [No such file or directory] >[2016-04-19 07:24:42.807048] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.809784] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fff78b49-f026-45f4-bada-7b28c64d6c9c. (Possible split-brain) >[2016-04-19 07:24:42.811094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c> (fff78b49-f026-45f4-bada-7b28c64d6c9c) [No such file or directory] >[2016-04-19 07:24:42.811117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c> (fff78b49-f026-45f4-bada-7b28c64d6c9c) [No such file or directory] >[2016-04-19 07:24:42.814939] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c> (fff78b49-f026-45f4-bada-7b28c64d6c9c) [No such file or directory] >[2016-04-19 07:24:42.815216] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c> (fff78b49-f026-45f4-bada-7b28c64d6c9c) [No such file or directory] >[2016-04-19 07:24:42.815414] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fff78b49-f026-45f4-bada-7b28c64d6c9c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.823702] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.824488] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1> (5d2320f1-7ebc-435f-97b4-b3ab871190a1) [No such file or directory] >[2016-04-19 07:24:42.824739] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1> (5d2320f1-7ebc-435f-97b4-b3ab871190a1) [No such file or directory] >[2016-04-19 07:24:42.825847] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5d2320f1-7ebc-435f-97b4-b3ab871190a1. (Possible split-brain) >[2016-04-19 07:24:42.826622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1> (5d2320f1-7ebc-435f-97b4-b3ab871190a1) [No such file or directory] >[2016-04-19 07:24:42.826891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1> (5d2320f1-7ebc-435f-97b4-b3ab871190a1) [No such file or directory] >[2016-04-19 07:24:42.828348] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1> (5d2320f1-7ebc-435f-97b4-b3ab871190a1) [No such file or directory] >[2016-04-19 07:24:42.828409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1> (5d2320f1-7ebc-435f-97b4-b3ab871190a1) [No such file or directory] >[2016-04-19 07:24:42.828601] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.831312] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5d2320f1-7ebc-435f-97b4-b3ab871190a1. (Possible split-brain) >[2016-04-19 07:24:42.832222] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1> (5d2320f1-7ebc-435f-97b4-b3ab871190a1) [No such file or directory] >[2016-04-19 07:24:42.832310] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1> (5d2320f1-7ebc-435f-97b4-b3ab871190a1) [No such file or directory] >[2016-04-19 07:24:42.834923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1> (5d2320f1-7ebc-435f-97b4-b3ab871190a1) [No such file or directory] >[2016-04-19 07:24:42.835135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1> (5d2320f1-7ebc-435f-97b4-b3ab871190a1) [No such file or directory] >[2016-04-19 07:24:42.835289] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5d2320f1-7ebc-435f-97b4-b3ab871190a1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.845293] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.846269] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0> (f7e4f085-2205-4b37-9ff4-75cd82028db0) [No such file or directory] >[2016-04-19 07:24:42.846558] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0> (f7e4f085-2205-4b37-9ff4-75cd82028db0) [No such file or directory] >[2016-04-19 07:24:42.847464] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f7e4f085-2205-4b37-9ff4-75cd82028db0. (Possible split-brain) >[2016-04-19 07:24:42.848343] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0> (f7e4f085-2205-4b37-9ff4-75cd82028db0) [No such file or directory] >[2016-04-19 07:24:42.848727] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0> (f7e4f085-2205-4b37-9ff4-75cd82028db0) [No such file or directory] >[2016-04-19 07:24:42.849650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0> (f7e4f085-2205-4b37-9ff4-75cd82028db0) [No such file or directory] >[2016-04-19 07:24:42.850086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0> (f7e4f085-2205-4b37-9ff4-75cd82028db0) [No such file or directory] >[2016-04-19 07:24:42.850413] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.853112] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f7e4f085-2205-4b37-9ff4-75cd82028db0. (Possible split-brain) >[2016-04-19 07:24:42.854181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0> (f7e4f085-2205-4b37-9ff4-75cd82028db0) [No such file or directory] >[2016-04-19 07:24:42.854517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0> (f7e4f085-2205-4b37-9ff4-75cd82028db0) [No such file or directory] >[2016-04-19 07:24:42.857183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0> (f7e4f085-2205-4b37-9ff4-75cd82028db0) [No such file or directory] >[2016-04-19 07:24:42.857236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0> (f7e4f085-2205-4b37-9ff4-75cd82028db0) [No such file or directory] >[2016-04-19 07:24:42.857395] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f7e4f085-2205-4b37-9ff4-75cd82028db0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.866584] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.868152] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c> (fd3e00e1-80c8-46c6-b51f-8d307804f04c) [No such file or directory] >[2016-04-19 07:24:42.881516] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c> (fd3e00e1-80c8-46c6-b51f-8d307804f04c) [No such file or directory] >[2016-04-19 07:24:42.884286] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fd3e00e1-80c8-46c6-b51f-8d307804f04c. (Possible split-brain) >[2016-04-19 07:24:42.885378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c> (fd3e00e1-80c8-46c6-b51f-8d307804f04c) [No such file or directory] >[2016-04-19 07:24:42.885576] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c> (fd3e00e1-80c8-46c6-b51f-8d307804f04c) [No such file or directory] >[2016-04-19 07:24:42.886897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c> (fd3e00e1-80c8-46c6-b51f-8d307804f04c) [No such file or directory] >[2016-04-19 07:24:42.886983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c> (fd3e00e1-80c8-46c6-b51f-8d307804f04c) [No such file or directory] >[2016-04-19 07:24:42.887127] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.889705] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fd3e00e1-80c8-46c6-b51f-8d307804f04c. (Possible split-brain) >[2016-04-19 07:24:42.890854] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c> (fd3e00e1-80c8-46c6-b51f-8d307804f04c) [No such file or directory] >[2016-04-19 07:24:42.890867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c> (fd3e00e1-80c8-46c6-b51f-8d307804f04c) [No such file or directory] >[2016-04-19 07:24:42.895474] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c> (fd3e00e1-80c8-46c6-b51f-8d307804f04c) [No such file or directory] >[2016-04-19 07:24:42.895555] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c> (fd3e00e1-80c8-46c6-b51f-8d307804f04c) [No such file or directory] >[2016-04-19 07:24:42.895817] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fd3e00e1-80c8-46c6-b51f-8d307804f04c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.907218] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.908441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8> (a240a487-58b5-4e24-bb84-1c8b35a9fdc8) [No such file or directory] >[2016-04-19 07:24:42.908571] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8> (a240a487-58b5-4e24-bb84-1c8b35a9fdc8) [No such file or directory] >[2016-04-19 07:24:42.909701] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a240a487-58b5-4e24-bb84-1c8b35a9fdc8. (Possible split-brain) >[2016-04-19 07:24:42.910946] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8> (a240a487-58b5-4e24-bb84-1c8b35a9fdc8) [No such file or directory] >[2016-04-19 07:24:42.910948] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8> (a240a487-58b5-4e24-bb84-1c8b35a9fdc8) [No such file or directory] >[2016-04-19 07:24:42.912486] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8> (a240a487-58b5-4e24-bb84-1c8b35a9fdc8) [No such file or directory] >[2016-04-19 07:24:42.912513] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8> (a240a487-58b5-4e24-bb84-1c8b35a9fdc8) [No such file or directory] >[2016-04-19 07:24:42.912749] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.915450] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a240a487-58b5-4e24-bb84-1c8b35a9fdc8. (Possible split-brain) >[2016-04-19 07:24:42.916733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8> (a240a487-58b5-4e24-bb84-1c8b35a9fdc8) [No such file or directory] >[2016-04-19 07:24:42.916740] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8> (a240a487-58b5-4e24-bb84-1c8b35a9fdc8) [No such file or directory] >[2016-04-19 07:24:42.919765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8> (a240a487-58b5-4e24-bb84-1c8b35a9fdc8) [No such file or directory] >[2016-04-19 07:24:42.919875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8> (a240a487-58b5-4e24-bb84-1c8b35a9fdc8) [No such file or directory] >[2016-04-19 07:24:42.920013] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a240a487-58b5-4e24-bb84-1c8b35a9fdc8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.930038] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.931091] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f176d5f-67cc-444e-84a6-b88114023767> (2f176d5f-67cc-444e-84a6-b88114023767) [No such file or directory] >[2016-04-19 07:24:42.931196] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f176d5f-67cc-444e-84a6-b88114023767> (2f176d5f-67cc-444e-84a6-b88114023767) [No such file or directory] >[2016-04-19 07:24:42.932268] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2f176d5f-67cc-444e-84a6-b88114023767. (Possible split-brain) >[2016-04-19 07:24:42.933251] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f176d5f-67cc-444e-84a6-b88114023767> (2f176d5f-67cc-444e-84a6-b88114023767) [No such file or directory] >[2016-04-19 07:24:42.933424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f176d5f-67cc-444e-84a6-b88114023767> (2f176d5f-67cc-444e-84a6-b88114023767) [No such file or directory] >[2016-04-19 07:24:42.934763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f176d5f-67cc-444e-84a6-b88114023767> (2f176d5f-67cc-444e-84a6-b88114023767) [No such file or directory] >[2016-04-19 07:24:42.934946] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f176d5f-67cc-444e-84a6-b88114023767> (2f176d5f-67cc-444e-84a6-b88114023767) [No such file or directory] >[2016-04-19 07:24:42.935374] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2f176d5f-67cc-444e-84a6-b88114023767>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.938072] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2f176d5f-67cc-444e-84a6-b88114023767. (Possible split-brain) >[2016-04-19 07:24:42.939056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f176d5f-67cc-444e-84a6-b88114023767> (2f176d5f-67cc-444e-84a6-b88114023767) [No such file or directory] >[2016-04-19 07:24:42.939347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f176d5f-67cc-444e-84a6-b88114023767> (2f176d5f-67cc-444e-84a6-b88114023767) [No such file or directory] >[2016-04-19 07:24:42.941977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f176d5f-67cc-444e-84a6-b88114023767> (2f176d5f-67cc-444e-84a6-b88114023767) [No such file or directory] >[2016-04-19 07:24:42.942065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f176d5f-67cc-444e-84a6-b88114023767> (2f176d5f-67cc-444e-84a6-b88114023767) [No such file or directory] >[2016-04-19 07:24:42.942183] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2f176d5f-67cc-444e-84a6-b88114023767>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.951348] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.952126] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9823898-6569-433f-90ac-b975ff1db56e> (b9823898-6569-433f-90ac-b975ff1db56e) [No such file or directory] >[2016-04-19 07:24:42.952303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9823898-6569-433f-90ac-b975ff1db56e> (b9823898-6569-433f-90ac-b975ff1db56e) [No such file or directory] >[2016-04-19 07:24:42.955054] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b9823898-6569-433f-90ac-b975ff1db56e. (Possible split-brain) >[2016-04-19 07:24:42.956103] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9823898-6569-433f-90ac-b975ff1db56e> (b9823898-6569-433f-90ac-b975ff1db56e) [No such file or directory] >[2016-04-19 07:24:42.956224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9823898-6569-433f-90ac-b975ff1db56e> (b9823898-6569-433f-90ac-b975ff1db56e) [No such file or directory] >[2016-04-19 07:24:42.957577] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9823898-6569-433f-90ac-b975ff1db56e> (b9823898-6569-433f-90ac-b975ff1db56e) [No such file or directory] >[2016-04-19 07:24:42.957719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9823898-6569-433f-90ac-b975ff1db56e> (b9823898-6569-433f-90ac-b975ff1db56e) [No such file or directory] >[2016-04-19 07:24:42.957987] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b9823898-6569-433f-90ac-b975ff1db56e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:42.960739] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b9823898-6569-433f-90ac-b975ff1db56e. (Possible split-brain) >[2016-04-19 07:24:42.961633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9823898-6569-433f-90ac-b975ff1db56e> (b9823898-6569-433f-90ac-b975ff1db56e) [No such file or directory] >[2016-04-19 07:24:42.961646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9823898-6569-433f-90ac-b975ff1db56e> (b9823898-6569-433f-90ac-b975ff1db56e) [No such file or directory] >[2016-04-19 07:24:42.965712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9823898-6569-433f-90ac-b975ff1db56e> (b9823898-6569-433f-90ac-b975ff1db56e) [No such file or directory] >[2016-04-19 07:24:42.965805] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9823898-6569-433f-90ac-b975ff1db56e> (b9823898-6569-433f-90ac-b975ff1db56e) [No such file or directory] >[2016-04-19 07:24:42.966104] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b9823898-6569-433f-90ac-b975ff1db56e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:42.975683] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.976687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565> (7e30fc1d-74c5-449e-b59e-a0dcee8eb565) [No such file or directory] >[2016-04-19 07:24:42.976760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565> (7e30fc1d-74c5-449e-b59e-a0dcee8eb565) [No such file or directory] >[2016-04-19 07:24:42.977641] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7e30fc1d-74c5-449e-b59e-a0dcee8eb565. (Possible split-brain) >[2016-04-19 07:24:42.978490] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565> (7e30fc1d-74c5-449e-b59e-a0dcee8eb565) [No such file or directory] >[2016-04-19 07:24:42.978696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565> (7e30fc1d-74c5-449e-b59e-a0dcee8eb565) [No such file or directory] >[2016-04-19 07:24:42.980003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565> (7e30fc1d-74c5-449e-b59e-a0dcee8eb565) [No such file or directory] >[2016-04-19 07:24:42.980107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565> (7e30fc1d-74c5-449e-b59e-a0dcee8eb565) [No such file or directory] >[2016-04-19 07:24:42.980656] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:42.983356] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7e30fc1d-74c5-449e-b59e-a0dcee8eb565. (Possible split-brain) >[2016-04-19 07:24:42.984397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565> (7e30fc1d-74c5-449e-b59e-a0dcee8eb565) [No such file or directory] >[2016-04-19 07:24:42.984471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565> (7e30fc1d-74c5-449e-b59e-a0dcee8eb565) [No such file or directory] >[2016-04-19 07:24:42.987412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565> (7e30fc1d-74c5-449e-b59e-a0dcee8eb565) [No such file or directory] >[2016-04-19 07:24:42.987442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565> (7e30fc1d-74c5-449e-b59e-a0dcee8eb565) [No such file or directory] >[2016-04-19 07:24:42.987673] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7e30fc1d-74c5-449e-b59e-a0dcee8eb565>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:42.996361] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:42.997147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7404c096-775b-436b-91db-4947b6b23d8f> (7404c096-775b-436b-91db-4947b6b23d8f) [No such file or directory] >[2016-04-19 07:24:42.997234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7404c096-775b-436b-91db-4947b6b23d8f> (7404c096-775b-436b-91db-4947b6b23d8f) [No such file or directory] >[2016-04-19 07:24:42.998084] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7404c096-775b-436b-91db-4947b6b23d8f. (Possible split-brain) >[2016-04-19 07:24:42.998935] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7404c096-775b-436b-91db-4947b6b23d8f> (7404c096-775b-436b-91db-4947b6b23d8f) [No such file or directory] >[2016-04-19 07:24:42.998957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7404c096-775b-436b-91db-4947b6b23d8f> (7404c096-775b-436b-91db-4947b6b23d8f) [No such file or directory] >[2016-04-19 07:24:43.000359] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7404c096-775b-436b-91db-4947b6b23d8f> (7404c096-775b-436b-91db-4947b6b23d8f) [No such file or directory] >[2016-04-19 07:24:43.000580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7404c096-775b-436b-91db-4947b6b23d8f> (7404c096-775b-436b-91db-4947b6b23d8f) [No such file or directory] >[2016-04-19 07:24:43.000852] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7404c096-775b-436b-91db-4947b6b23d8f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.003566] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7404c096-775b-436b-91db-4947b6b23d8f. (Possible split-brain) >[2016-04-19 07:24:43.004276] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7404c096-775b-436b-91db-4947b6b23d8f> (7404c096-775b-436b-91db-4947b6b23d8f) [No such file or directory] >[2016-04-19 07:24:43.004632] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7404c096-775b-436b-91db-4947b6b23d8f> (7404c096-775b-436b-91db-4947b6b23d8f) [No such file or directory] >[2016-04-19 07:24:43.007521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7404c096-775b-436b-91db-4947b6b23d8f> (7404c096-775b-436b-91db-4947b6b23d8f) [No such file or directory] >[2016-04-19 07:24:43.007674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7404c096-775b-436b-91db-4947b6b23d8f> (7404c096-775b-436b-91db-4947b6b23d8f) [No such file or directory] >[2016-04-19 07:24:43.007821] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7404c096-775b-436b-91db-4947b6b23d8f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.015426] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.016111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d781d808-5725-4278-b333-798e39f9f981> (d781d808-5725-4278-b333-798e39f9f981) [No such file or directory] >[2016-04-19 07:24:43.016240] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d781d808-5725-4278-b333-798e39f9f981> (d781d808-5725-4278-b333-798e39f9f981) [No such file or directory] >[2016-04-19 07:24:43.017095] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d781d808-5725-4278-b333-798e39f9f981. (Possible split-brain) >[2016-04-19 07:24:43.017897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d781d808-5725-4278-b333-798e39f9f981> (d781d808-5725-4278-b333-798e39f9f981) [No such file or directory] >[2016-04-19 07:24:43.018093] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d781d808-5725-4278-b333-798e39f9f981> (d781d808-5725-4278-b333-798e39f9f981) [No such file or directory] >[2016-04-19 07:24:43.019294] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d781d808-5725-4278-b333-798e39f9f981> (d781d808-5725-4278-b333-798e39f9f981) [No such file or directory] >[2016-04-19 07:24:43.019551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d781d808-5725-4278-b333-798e39f9f981> (d781d808-5725-4278-b333-798e39f9f981) [No such file or directory] >[2016-04-19 07:24:43.019842] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d781d808-5725-4278-b333-798e39f9f981>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.022575] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d781d808-5725-4278-b333-798e39f9f981. (Possible split-brain) >[2016-04-19 07:24:43.023356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d781d808-5725-4278-b333-798e39f9f981> (d781d808-5725-4278-b333-798e39f9f981) [No such file or directory] >[2016-04-19 07:24:43.023667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d781d808-5725-4278-b333-798e39f9f981> (d781d808-5725-4278-b333-798e39f9f981) [No such file or directory] >[2016-04-19 07:24:43.026707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d781d808-5725-4278-b333-798e39f9f981> (d781d808-5725-4278-b333-798e39f9f981) [No such file or directory] >[2016-04-19 07:24:43.026849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d781d808-5725-4278-b333-798e39f9f981> (d781d808-5725-4278-b333-798e39f9f981) [No such file or directory] >[2016-04-19 07:24:43.026989] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d781d808-5725-4278-b333-798e39f9f981>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.035793] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.036930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f4562baa-a347-4722-beed-6a3242f26626> (f4562baa-a347-4722-beed-6a3242f26626) [No such file or directory] >[2016-04-19 07:24:43.036949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f4562baa-a347-4722-beed-6a3242f26626> (f4562baa-a347-4722-beed-6a3242f26626) [No such file or directory] >[2016-04-19 07:24:43.039795] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f4562baa-a347-4722-beed-6a3242f26626. (Possible split-brain) >[2016-04-19 07:24:43.040791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f4562baa-a347-4722-beed-6a3242f26626> (f4562baa-a347-4722-beed-6a3242f26626) [No such file or directory] >[2016-04-19 07:24:43.040891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f4562baa-a347-4722-beed-6a3242f26626> (f4562baa-a347-4722-beed-6a3242f26626) [No such file or directory] >[2016-04-19 07:24:43.041947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f4562baa-a347-4722-beed-6a3242f26626> (f4562baa-a347-4722-beed-6a3242f26626) [No such file or directory] >[2016-04-19 07:24:43.041971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f4562baa-a347-4722-beed-6a3242f26626> (f4562baa-a347-4722-beed-6a3242f26626) [No such file or directory] >[2016-04-19 07:24:43.042663] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f4562baa-a347-4722-beed-6a3242f26626>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:43.045391] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f4562baa-a347-4722-beed-6a3242f26626. (Possible split-brain) >[2016-04-19 07:24:43.046374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f4562baa-a347-4722-beed-6a3242f26626> (f4562baa-a347-4722-beed-6a3242f26626) [No such file or directory] >[2016-04-19 07:24:43.046496] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f4562baa-a347-4722-beed-6a3242f26626> (f4562baa-a347-4722-beed-6a3242f26626) [No such file or directory] >[2016-04-19 07:24:43.050309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f4562baa-a347-4722-beed-6a3242f26626> (f4562baa-a347-4722-beed-6a3242f26626) [No such file or directory] >[2016-04-19 07:24:43.050364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f4562baa-a347-4722-beed-6a3242f26626> (f4562baa-a347-4722-beed-6a3242f26626) [No such file or directory] >[2016-04-19 07:24:43.050954] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f4562baa-a347-4722-beed-6a3242f26626>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.060513] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.061674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396> (4a1d5bcc-686e-4a74-844c-2f060bff2396) [No such file or directory] >[2016-04-19 07:24:43.061905] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396> (4a1d5bcc-686e-4a74-844c-2f060bff2396) [No such file or directory] >[2016-04-19 07:24:43.062788] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4a1d5bcc-686e-4a74-844c-2f060bff2396. (Possible split-brain) >[2016-04-19 07:24:43.063865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396> (4a1d5bcc-686e-4a74-844c-2f060bff2396) [No such file or directory] >[2016-04-19 07:24:43.063946] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396> (4a1d5bcc-686e-4a74-844c-2f060bff2396) [No such file or directory] >[2016-04-19 07:24:43.065181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396> (4a1d5bcc-686e-4a74-844c-2f060bff2396) [No such file or directory] >[2016-04-19 07:24:43.065214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396> (4a1d5bcc-686e-4a74-844c-2f060bff2396) [No such file or directory] >[2016-04-19 07:24:43.065714] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:43.068655] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4a1d5bcc-686e-4a74-844c-2f060bff2396. (Possible split-brain) >[2016-04-19 07:24:43.069664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396> (4a1d5bcc-686e-4a74-844c-2f060bff2396) [No such file or directory] >[2016-04-19 07:24:43.069660] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396> (4a1d5bcc-686e-4a74-844c-2f060bff2396) [No such file or directory] >[2016-04-19 07:24:43.071844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396> (4a1d5bcc-686e-4a74-844c-2f060bff2396) [No such file or directory] >[2016-04-19 07:24:43.072312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396> (4a1d5bcc-686e-4a74-844c-2f060bff2396) [No such file or directory] >[2016-04-19 07:24:43.072397] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4a1d5bcc-686e-4a74-844c-2f060bff2396>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.082095] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.083184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:500edc74-e5b6-44f1-820a-125b852c478d> (500edc74-e5b6-44f1-820a-125b852c478d) [No such file or directory] >[2016-04-19 07:24:43.083273] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:500edc74-e5b6-44f1-820a-125b852c478d> (500edc74-e5b6-44f1-820a-125b852c478d) [No such file or directory] >[2016-04-19 07:24:43.085957] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 500edc74-e5b6-44f1-820a-125b852c478d. (Possible split-brain) >[2016-04-19 07:24:43.087025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:500edc74-e5b6-44f1-820a-125b852c478d> (500edc74-e5b6-44f1-820a-125b852c478d) [No such file or directory] >[2016-04-19 07:24:43.087037] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:500edc74-e5b6-44f1-820a-125b852c478d> (500edc74-e5b6-44f1-820a-125b852c478d) [No such file or directory] >[2016-04-19 07:24:43.088293] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:500edc74-e5b6-44f1-820a-125b852c478d> (500edc74-e5b6-44f1-820a-125b852c478d) [No such file or directory] >[2016-04-19 07:24:43.088635] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:500edc74-e5b6-44f1-820a-125b852c478d> (500edc74-e5b6-44f1-820a-125b852c478d) [No such file or directory] >[2016-04-19 07:24:43.089382] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:500edc74-e5b6-44f1-820a-125b852c478d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:43.092003] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 500edc74-e5b6-44f1-820a-125b852c478d. (Possible split-brain) >[2016-04-19 07:24:43.093185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:500edc74-e5b6-44f1-820a-125b852c478d> (500edc74-e5b6-44f1-820a-125b852c478d) [No such file or directory] >[2016-04-19 07:24:43.093204] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:500edc74-e5b6-44f1-820a-125b852c478d> (500edc74-e5b6-44f1-820a-125b852c478d) [No such file or directory] >[2016-04-19 07:24:43.097627] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:500edc74-e5b6-44f1-820a-125b852c478d> (500edc74-e5b6-44f1-820a-125b852c478d) [No such file or directory] >[2016-04-19 07:24:43.098050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:500edc74-e5b6-44f1-820a-125b852c478d> (500edc74-e5b6-44f1-820a-125b852c478d) [No such file or directory] >[2016-04-19 07:24:43.098928] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:500edc74-e5b6-44f1-820a-125b852c478d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.107279] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.108189] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92> (348d2be3-3222-4774-9e99-6c72aaa29d92) [No such file or directory] >[2016-04-19 07:24:43.108384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92> (348d2be3-3222-4774-9e99-6c72aaa29d92) [No such file or directory] >[2016-04-19 07:24:43.109514] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 348d2be3-3222-4774-9e99-6c72aaa29d92. (Possible split-brain) >[2016-04-19 07:24:43.110485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92> (348d2be3-3222-4774-9e99-6c72aaa29d92) [No such file or directory] >[2016-04-19 07:24:43.110610] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92> (348d2be3-3222-4774-9e99-6c72aaa29d92) [No such file or directory] >[2016-04-19 07:24:43.112080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92> (348d2be3-3222-4774-9e99-6c72aaa29d92) [No such file or directory] >[2016-04-19 07:24:43.112253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92> (348d2be3-3222-4774-9e99-6c72aaa29d92) [No such file or directory] >[2016-04-19 07:24:43.112570] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.115069] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 348d2be3-3222-4774-9e99-6c72aaa29d92. (Possible split-brain) >[2016-04-19 07:24:43.115977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92> (348d2be3-3222-4774-9e99-6c72aaa29d92) [No such file or directory] >[2016-04-19 07:24:43.116020] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92> (348d2be3-3222-4774-9e99-6c72aaa29d92) [No such file or directory] >[2016-04-19 07:24:43.120720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92> (348d2be3-3222-4774-9e99-6c72aaa29d92) [No such file or directory] >[2016-04-19 07:24:43.120883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92> (348d2be3-3222-4774-9e99-6c72aaa29d92) [No such file or directory] >[2016-04-19 07:24:43.121021] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:348d2be3-3222-4774-9e99-6c72aaa29d92>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.130259] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.131404] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d893a62d-989a-4960-9270-0cd4d92126df> (d893a62d-989a-4960-9270-0cd4d92126df) [No such file or directory] >[2016-04-19 07:24:43.131483] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d893a62d-989a-4960-9270-0cd4d92126df> (d893a62d-989a-4960-9270-0cd4d92126df) [No such file or directory] >[2016-04-19 07:24:43.132615] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d893a62d-989a-4960-9270-0cd4d92126df. (Possible split-brain) >[2016-04-19 07:24:43.133635] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d893a62d-989a-4960-9270-0cd4d92126df> (d893a62d-989a-4960-9270-0cd4d92126df) [No such file or directory] >[2016-04-19 07:24:43.133877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d893a62d-989a-4960-9270-0cd4d92126df> (d893a62d-989a-4960-9270-0cd4d92126df) [No such file or directory] >[2016-04-19 07:24:43.135266] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d893a62d-989a-4960-9270-0cd4d92126df> (d893a62d-989a-4960-9270-0cd4d92126df) [No such file or directory] >[2016-04-19 07:24:43.135430] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d893a62d-989a-4960-9270-0cd4d92126df> (d893a62d-989a-4960-9270-0cd4d92126df) [No such file or directory] >[2016-04-19 07:24:43.135951] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d893a62d-989a-4960-9270-0cd4d92126df>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:43.138629] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d893a62d-989a-4960-9270-0cd4d92126df. (Possible split-brain) >[2016-04-19 07:24:43.139773] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d893a62d-989a-4960-9270-0cd4d92126df> (d893a62d-989a-4960-9270-0cd4d92126df) [No such file or directory] >[2016-04-19 07:24:43.139992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d893a62d-989a-4960-9270-0cd4d92126df> (d893a62d-989a-4960-9270-0cd4d92126df) [No such file or directory] >[2016-04-19 07:24:43.143218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d893a62d-989a-4960-9270-0cd4d92126df> (d893a62d-989a-4960-9270-0cd4d92126df) [No such file or directory] >[2016-04-19 07:24:43.143356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d893a62d-989a-4960-9270-0cd4d92126df> (d893a62d-989a-4960-9270-0cd4d92126df) [No such file or directory] >[2016-04-19 07:24:43.143491] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d893a62d-989a-4960-9270-0cd4d92126df>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.151668] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.152509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb> (8521f314-b623-46fe-937d-ff4119ac2ebb) [No such file or directory] >[2016-04-19 07:24:43.152598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb> (8521f314-b623-46fe-937d-ff4119ac2ebb) [No such file or directory] >[2016-04-19 07:24:43.155201] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8521f314-b623-46fe-937d-ff4119ac2ebb. (Possible split-brain) >[2016-04-19 07:24:43.156052] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb> (8521f314-b623-46fe-937d-ff4119ac2ebb) [No such file or directory] >[2016-04-19 07:24:43.156291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb> (8521f314-b623-46fe-937d-ff4119ac2ebb) [No such file or directory] >[2016-04-19 07:24:43.157726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb> (8521f314-b623-46fe-937d-ff4119ac2ebb) [No such file or directory] >[2016-04-19 07:24:43.157793] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb> (8521f314-b623-46fe-937d-ff4119ac2ebb) [No such file or directory] >[2016-04-19 07:24:43.158202] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.160796] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8521f314-b623-46fe-937d-ff4119ac2ebb. (Possible split-brain) >[2016-04-19 07:24:43.161644] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb> (8521f314-b623-46fe-937d-ff4119ac2ebb) [No such file or directory] >[2016-04-19 07:24:43.161665] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb> (8521f314-b623-46fe-937d-ff4119ac2ebb) [No such file or directory] >[2016-04-19 07:24:43.164903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb> (8521f314-b623-46fe-937d-ff4119ac2ebb) [No such file or directory] >[2016-04-19 07:24:43.164983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb> (8521f314-b623-46fe-937d-ff4119ac2ebb) [No such file or directory] >[2016-04-19 07:24:43.165158] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8521f314-b623-46fe-937d-ff4119ac2ebb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.173950] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.174702] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d> (e41b3ee8-572a-41d5-948e-7a6835f9c29d) [No such file or directory] >[2016-04-19 07:24:43.174796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d> (e41b3ee8-572a-41d5-948e-7a6835f9c29d) [No such file or directory] >[2016-04-19 07:24:43.177729] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e41b3ee8-572a-41d5-948e-7a6835f9c29d. (Possible split-brain) >[2016-04-19 07:24:43.178900] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d> (e41b3ee8-572a-41d5-948e-7a6835f9c29d) [No such file or directory] >[2016-04-19 07:24:43.179475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d> (e41b3ee8-572a-41d5-948e-7a6835f9c29d) [No such file or directory] >[2016-04-19 07:24:43.181221] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d> (e41b3ee8-572a-41d5-948e-7a6835f9c29d) [No such file or directory] >[2016-04-19 07:24:43.181778] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d> (e41b3ee8-572a-41d5-948e-7a6835f9c29d) [No such file or directory] >[2016-04-19 07:24:43.182028] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.184810] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e41b3ee8-572a-41d5-948e-7a6835f9c29d. (Possible split-brain) >[2016-04-19 07:24:43.185665] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d> (e41b3ee8-572a-41d5-948e-7a6835f9c29d) [No such file or directory] >[2016-04-19 07:24:43.185744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d> (e41b3ee8-572a-41d5-948e-7a6835f9c29d) [No such file or directory] >[2016-04-19 07:24:43.191128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d> (e41b3ee8-572a-41d5-948e-7a6835f9c29d) [No such file or directory] >[2016-04-19 07:24:43.191226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d> (e41b3ee8-572a-41d5-948e-7a6835f9c29d) [No such file or directory] >[2016-04-19 07:24:43.191419] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e41b3ee8-572a-41d5-948e-7a6835f9c29d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.200148] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.201102] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc> (2f36d0d6-e2cc-4e89-8822-721aa86928fc) [No such file or directory] >[2016-04-19 07:24:43.201125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc> (2f36d0d6-e2cc-4e89-8822-721aa86928fc) [No such file or directory] >[2016-04-19 07:24:43.202041] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2f36d0d6-e2cc-4e89-8822-721aa86928fc. (Possible split-brain) >[2016-04-19 07:24:43.202966] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc> (2f36d0d6-e2cc-4e89-8822-721aa86928fc) [No such file or directory] >[2016-04-19 07:24:43.202985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc> (2f36d0d6-e2cc-4e89-8822-721aa86928fc) [No such file or directory] >[2016-04-19 07:24:43.204446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc> (2f36d0d6-e2cc-4e89-8822-721aa86928fc) [No such file or directory] >[2016-04-19 07:24:43.204729] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc> (2f36d0d6-e2cc-4e89-8822-721aa86928fc) [No such file or directory] >[2016-04-19 07:24:43.204960] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.207503] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2f36d0d6-e2cc-4e89-8822-721aa86928fc. (Possible split-brain) >[2016-04-19 07:24:43.208305] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc> (2f36d0d6-e2cc-4e89-8822-721aa86928fc) [No such file or directory] >[2016-04-19 07:24:43.208446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc> (2f36d0d6-e2cc-4e89-8822-721aa86928fc) [No such file or directory] >[2016-04-19 07:24:43.213648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc> (2f36d0d6-e2cc-4e89-8822-721aa86928fc) [No such file or directory] >[2016-04-19 07:24:43.213681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc> (2f36d0d6-e2cc-4e89-8822-721aa86928fc) [No such file or directory] >[2016-04-19 07:24:43.213899] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2f36d0d6-e2cc-4e89-8822-721aa86928fc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.225242] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.226445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f> (5a6722fc-ffba-4499-a4ec-db81ad533e8f) [No such file or directory] >[2016-04-19 07:24:43.226752] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f> (5a6722fc-ffba-4499-a4ec-db81ad533e8f) [No such file or directory] >[2016-04-19 07:24:43.227631] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5a6722fc-ffba-4499-a4ec-db81ad533e8f. (Possible split-brain) >[2016-04-19 07:24:43.228769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f> (5a6722fc-ffba-4499-a4ec-db81ad533e8f) [No such file or directory] >[2016-04-19 07:24:43.229047] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f> (5a6722fc-ffba-4499-a4ec-db81ad533e8f) [No such file or directory] >[2016-04-19 07:24:43.230458] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f> (5a6722fc-ffba-4499-a4ec-db81ad533e8f) [No such file or directory] >[2016-04-19 07:24:43.230563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f> (5a6722fc-ffba-4499-a4ec-db81ad533e8f) [No such file or directory] >[2016-04-19 07:24:43.230963] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:43.233423] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5a6722fc-ffba-4499-a4ec-db81ad533e8f. (Possible split-brain) >[2016-04-19 07:24:43.234655] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f> (5a6722fc-ffba-4499-a4ec-db81ad533e8f) [No such file or directory] >[2016-04-19 07:24:43.234822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f> (5a6722fc-ffba-4499-a4ec-db81ad533e8f) [No such file or directory] >[2016-04-19 07:24:43.238155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f> (5a6722fc-ffba-4499-a4ec-db81ad533e8f) [No such file or directory] >[2016-04-19 07:24:43.238168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f> (5a6722fc-ffba-4499-a4ec-db81ad533e8f) [No such file or directory] >[2016-04-19 07:24:43.238362] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5a6722fc-ffba-4499-a4ec-db81ad533e8f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.247079] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.247809] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd> (f256e60a-b38b-4ee2-9b1e-cc44d7998edd) [No such file or directory] >[2016-04-19 07:24:43.248050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd> (f256e60a-b38b-4ee2-9b1e-cc44d7998edd) [No such file or directory] >[2016-04-19 07:24:43.248931] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f256e60a-b38b-4ee2-9b1e-cc44d7998edd. (Possible split-brain) >[2016-04-19 07:24:43.249738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd> (f256e60a-b38b-4ee2-9b1e-cc44d7998edd) [No such file or directory] >[2016-04-19 07:24:43.249977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd> (f256e60a-b38b-4ee2-9b1e-cc44d7998edd) [No such file or directory] >[2016-04-19 07:24:43.251302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd> (f256e60a-b38b-4ee2-9b1e-cc44d7998edd) [No such file or directory] >[2016-04-19 07:24:43.251479] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd> (f256e60a-b38b-4ee2-9b1e-cc44d7998edd) [No such file or directory] >[2016-04-19 07:24:43.251712] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.254154] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f256e60a-b38b-4ee2-9b1e-cc44d7998edd. (Possible split-brain) >[2016-04-19 07:24:43.255112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd> (f256e60a-b38b-4ee2-9b1e-cc44d7998edd) [No such file or directory] >[2016-04-19 07:24:43.255117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd> (f256e60a-b38b-4ee2-9b1e-cc44d7998edd) [No such file or directory] >[2016-04-19 07:24:43.259580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd> (f256e60a-b38b-4ee2-9b1e-cc44d7998edd) [No such file or directory] >[2016-04-19 07:24:43.259648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd> (f256e60a-b38b-4ee2-9b1e-cc44d7998edd) [No such file or directory] >[2016-04-19 07:24:43.259872] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f256e60a-b38b-4ee2-9b1e-cc44d7998edd>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.269504] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.270559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd> (413fcd11-08c0-4bc6-b641-8192c07e33fd) [No such file or directory] >[2016-04-19 07:24:43.270829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd> (413fcd11-08c0-4bc6-b641-8192c07e33fd) [No such file or directory] >[2016-04-19 07:24:43.271729] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 413fcd11-08c0-4bc6-b641-8192c07e33fd. (Possible split-brain) >[2016-04-19 07:24:43.272917] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd> (413fcd11-08c0-4bc6-b641-8192c07e33fd) [No such file or directory] >[2016-04-19 07:24:43.272925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd> (413fcd11-08c0-4bc6-b641-8192c07e33fd) [No such file or directory] >[2016-04-19 07:24:43.274149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd> (413fcd11-08c0-4bc6-b641-8192c07e33fd) [No such file or directory] >[2016-04-19 07:24:43.274225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd> (413fcd11-08c0-4bc6-b641-8192c07e33fd) [No such file or directory] >[2016-04-19 07:24:43.274595] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.277087] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 413fcd11-08c0-4bc6-b641-8192c07e33fd. (Possible split-brain) >[2016-04-19 07:24:43.278011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd> (413fcd11-08c0-4bc6-b641-8192c07e33fd) [No such file or directory] >[2016-04-19 07:24:43.278130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd> (413fcd11-08c0-4bc6-b641-8192c07e33fd) [No such file or directory] >[2016-04-19 07:24:43.281833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd> (413fcd11-08c0-4bc6-b641-8192c07e33fd) [No such file or directory] >[2016-04-19 07:24:43.282164] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd> (413fcd11-08c0-4bc6-b641-8192c07e33fd) [No such file or directory] >[2016-04-19 07:24:43.282661] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:413fcd11-08c0-4bc6-b641-8192c07e33fd>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.290419] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.291359] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad> (d03bcbe6-3b1d-4ef3-af50-83fac6d132ad) [No such file or directory] >[2016-04-19 07:24:43.291379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad> (d03bcbe6-3b1d-4ef3-af50-83fac6d132ad) [No such file or directory] >[2016-04-19 07:24:43.293994] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d03bcbe6-3b1d-4ef3-af50-83fac6d132ad. (Possible split-brain) >[2016-04-19 07:24:43.295046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad> (d03bcbe6-3b1d-4ef3-af50-83fac6d132ad) [No such file or directory] >[2016-04-19 07:24:43.295124] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad> (d03bcbe6-3b1d-4ef3-af50-83fac6d132ad) [No such file or directory] >[2016-04-19 07:24:43.296391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad> (d03bcbe6-3b1d-4ef3-af50-83fac6d132ad) [No such file or directory] >[2016-04-19 07:24:43.296560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad> (d03bcbe6-3b1d-4ef3-af50-83fac6d132ad) [No such file or directory] >[2016-04-19 07:24:43.296897] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.299445] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d03bcbe6-3b1d-4ef3-af50-83fac6d132ad. (Possible split-brain) >[2016-04-19 07:24:43.300303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad> (d03bcbe6-3b1d-4ef3-af50-83fac6d132ad) [No such file or directory] >[2016-04-19 07:24:43.300433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad> (d03bcbe6-3b1d-4ef3-af50-83fac6d132ad) [No such file or directory] >[2016-04-19 07:24:43.304658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad> (d03bcbe6-3b1d-4ef3-af50-83fac6d132ad) [No such file or directory] >[2016-04-19 07:24:43.304763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad> (d03bcbe6-3b1d-4ef3-af50-83fac6d132ad) [No such file or directory] >[2016-04-19 07:24:43.305125] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d03bcbe6-3b1d-4ef3-af50-83fac6d132ad>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.314416] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.315213] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407> (a3f23cf8-35d3-435d-800f-cd0b8c809407) [No such file or directory] >[2016-04-19 07:24:43.315616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407> (a3f23cf8-35d3-435d-800f-cd0b8c809407) [No such file or directory] >[2016-04-19 07:24:43.318168] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a3f23cf8-35d3-435d-800f-cd0b8c809407. (Possible split-brain) >[2016-04-19 07:24:43.319158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407> (a3f23cf8-35d3-435d-800f-cd0b8c809407) [No such file or directory] >[2016-04-19 07:24:43.319462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407> (a3f23cf8-35d3-435d-800f-cd0b8c809407) [No such file or directory] >[2016-04-19 07:24:43.320877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407> (a3f23cf8-35d3-435d-800f-cd0b8c809407) [No such file or directory] >[2016-04-19 07:24:43.320911] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407> (a3f23cf8-35d3-435d-800f-cd0b8c809407) [No such file or directory] >[2016-04-19 07:24:43.321246] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.323866] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a3f23cf8-35d3-435d-800f-cd0b8c809407. (Possible split-brain) >[2016-04-19 07:24:43.324927] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407> (a3f23cf8-35d3-435d-800f-cd0b8c809407) [No such file or directory] >[2016-04-19 07:24:43.325018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407> (a3f23cf8-35d3-435d-800f-cd0b8c809407) [No such file or directory] >[2016-04-19 07:24:43.329741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407> (a3f23cf8-35d3-435d-800f-cd0b8c809407) [No such file or directory] >[2016-04-19 07:24:43.329753] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407> (a3f23cf8-35d3-435d-800f-cd0b8c809407) [No such file or directory] >[2016-04-19 07:24:43.330013] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a3f23cf8-35d3-435d-800f-cd0b8c809407>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.339931] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.341020] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:522858e2-193b-4d2d-8838-774755026e14> (522858e2-193b-4d2d-8838-774755026e14) [No such file or directory] >[2016-04-19 07:24:43.341792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:522858e2-193b-4d2d-8838-774755026e14> (522858e2-193b-4d2d-8838-774755026e14) [No such file or directory] >[2016-04-19 07:24:43.342669] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 522858e2-193b-4d2d-8838-774755026e14. (Possible split-brain) >[2016-04-19 07:24:43.343767] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:522858e2-193b-4d2d-8838-774755026e14> (522858e2-193b-4d2d-8838-774755026e14) [No such file or directory] >[2016-04-19 07:24:43.343792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:522858e2-193b-4d2d-8838-774755026e14> (522858e2-193b-4d2d-8838-774755026e14) [No such file or directory] >[2016-04-19 07:24:43.345126] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:522858e2-193b-4d2d-8838-774755026e14> (522858e2-193b-4d2d-8838-774755026e14) [No such file or directory] >[2016-04-19 07:24:43.345422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:522858e2-193b-4d2d-8838-774755026e14> (522858e2-193b-4d2d-8838-774755026e14) [No such file or directory] >[2016-04-19 07:24:43.345712] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:522858e2-193b-4d2d-8838-774755026e14>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.348134] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 522858e2-193b-4d2d-8838-774755026e14. (Possible split-brain) >[2016-04-19 07:24:43.349504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:522858e2-193b-4d2d-8838-774755026e14> (522858e2-193b-4d2d-8838-774755026e14) [No such file or directory] >[2016-04-19 07:24:43.349505] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:522858e2-193b-4d2d-8838-774755026e14> (522858e2-193b-4d2d-8838-774755026e14) [No such file or directory] >[2016-04-19 07:24:43.352616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:522858e2-193b-4d2d-8838-774755026e14> (522858e2-193b-4d2d-8838-774755026e14) [No such file or directory] >[2016-04-19 07:24:43.352659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:522858e2-193b-4d2d-8838-774755026e14> (522858e2-193b-4d2d-8838-774755026e14) [No such file or directory] >[2016-04-19 07:24:43.352787] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:522858e2-193b-4d2d-8838-774755026e14>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.363839] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.364858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a> (0c805350-4ab1-480f-b28f-997ff2268c8a) [No such file or directory] >[2016-04-19 07:24:43.365128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a> (0c805350-4ab1-480f-b28f-997ff2268c8a) [No such file or directory] >[2016-04-19 07:24:43.365959] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0c805350-4ab1-480f-b28f-997ff2268c8a. (Possible split-brain) >[2016-04-19 07:24:43.367120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a> (0c805350-4ab1-480f-b28f-997ff2268c8a) [No such file or directory] >[2016-04-19 07:24:43.367150] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a> (0c805350-4ab1-480f-b28f-997ff2268c8a) [No such file or directory] >[2016-04-19 07:24:43.368501] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a> (0c805350-4ab1-480f-b28f-997ff2268c8a) [No such file or directory] >[2016-04-19 07:24:43.368515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a> (0c805350-4ab1-480f-b28f-997ff2268c8a) [No such file or directory] >[2016-04-19 07:24:43.368714] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.371306] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0c805350-4ab1-480f-b28f-997ff2268c8a. (Possible split-brain) >[2016-04-19 07:24:43.372504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a> (0c805350-4ab1-480f-b28f-997ff2268c8a) [No such file or directory] >[2016-04-19 07:24:43.372616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a> (0c805350-4ab1-480f-b28f-997ff2268c8a) [No such file or directory] >[2016-04-19 07:24:43.375484] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a> (0c805350-4ab1-480f-b28f-997ff2268c8a) [No such file or directory] >[2016-04-19 07:24:43.375641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a> (0c805350-4ab1-480f-b28f-997ff2268c8a) [No such file or directory] >[2016-04-19 07:24:43.375850] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0c805350-4ab1-480f-b28f-997ff2268c8a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.384556] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.385480] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88> (2e1e7115-0a9d-485b-85cf-d51c10f10f88) [No such file or directory] >[2016-04-19 07:24:43.385499] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88> (2e1e7115-0a9d-485b-85cf-d51c10f10f88) [No such file or directory] >[2016-04-19 07:24:43.386482] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e1e7115-0a9d-485b-85cf-d51c10f10f88. (Possible split-brain) >[2016-04-19 07:24:43.387420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88> (2e1e7115-0a9d-485b-85cf-d51c10f10f88) [No such file or directory] >[2016-04-19 07:24:43.387503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88> (2e1e7115-0a9d-485b-85cf-d51c10f10f88) [No such file or directory] >[2016-04-19 07:24:43.388646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88> (2e1e7115-0a9d-485b-85cf-d51c10f10f88) [No such file or directory] >[2016-04-19 07:24:43.389081] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88> (2e1e7115-0a9d-485b-85cf-d51c10f10f88) [No such file or directory] >[2016-04-19 07:24:43.389234] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.391979] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e1e7115-0a9d-485b-85cf-d51c10f10f88. (Possible split-brain) >[2016-04-19 07:24:43.392949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88> (2e1e7115-0a9d-485b-85cf-d51c10f10f88) [No such file or directory] >[2016-04-19 07:24:43.393034] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88> (2e1e7115-0a9d-485b-85cf-d51c10f10f88) [No such file or directory] >[2016-04-19 07:24:43.397476] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88> (2e1e7115-0a9d-485b-85cf-d51c10f10f88) [No such file or directory] >[2016-04-19 07:24:43.397586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88> (2e1e7115-0a9d-485b-85cf-d51c10f10f88) [No such file or directory] >[2016-04-19 07:24:43.397776] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2e1e7115-0a9d-485b-85cf-d51c10f10f88>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.407369] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.408152] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4> (a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4) [No such file or directory] >[2016-04-19 07:24:43.408369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4> (a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4) [No such file or directory] >[2016-04-19 07:24:43.410933] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4. (Possible split-brain) >[2016-04-19 07:24:43.411762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4> (a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4) [No such file or directory] >[2016-04-19 07:24:43.411969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4> (a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4) [No such file or directory] >[2016-04-19 07:24:43.413237] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4> (a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4) [No such file or directory] >[2016-04-19 07:24:43.413264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4> (a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4) [No such file or directory] >[2016-04-19 07:24:43.413463] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.416102] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4. (Possible split-brain) >[2016-04-19 07:24:43.417049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4> (a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4) [No such file or directory] >[2016-04-19 07:24:43.417133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4> (a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4) [No such file or directory] >[2016-04-19 07:24:43.421392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4> (a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4) [No such file or directory] >[2016-04-19 07:24:43.421504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4> (a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4) [No such file or directory] >[2016-04-19 07:24:43.421842] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a11a7ed2-3cbf-4cbc-94bb-a6bb9b37d0a4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.430546] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.431394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334> (6936b46e-d861-4c20-9330-ab8befb3e334) [No such file or directory] >[2016-04-19 07:24:43.431493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334> (6936b46e-d861-4c20-9330-ab8befb3e334) [No such file or directory] >[2016-04-19 07:24:43.432385] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6936b46e-d861-4c20-9330-ab8befb3e334. (Possible split-brain) >[2016-04-19 07:24:43.433353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334> (6936b46e-d861-4c20-9330-ab8befb3e334) [No such file or directory] >[2016-04-19 07:24:43.433725] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334> (6936b46e-d861-4c20-9330-ab8befb3e334) [No such file or directory] >[2016-04-19 07:24:43.434997] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334> (6936b46e-d861-4c20-9330-ab8befb3e334) [No such file or directory] >[2016-04-19 07:24:43.435032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334> (6936b46e-d861-4c20-9330-ab8befb3e334) [No such file or directory] >[2016-04-19 07:24:43.435479] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.437914] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6936b46e-d861-4c20-9330-ab8befb3e334. (Possible split-brain) >[2016-04-19 07:24:43.438828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334> (6936b46e-d861-4c20-9330-ab8befb3e334) [No such file or directory] >[2016-04-19 07:24:43.439052] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334> (6936b46e-d861-4c20-9330-ab8befb3e334) [No such file or directory] >[2016-04-19 07:24:43.442137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334> (6936b46e-d861-4c20-9330-ab8befb3e334) [No such file or directory] >[2016-04-19 07:24:43.442361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334> (6936b46e-d861-4c20-9330-ab8befb3e334) [No such file or directory] >[2016-04-19 07:24:43.442530] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6936b46e-d861-4c20-9330-ab8befb3e334>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.453304] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.454384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719> (f5c1b0b7-1cd0-4d17-bb10-ef41c722c719) [No such file or directory] >[2016-04-19 07:24:43.454388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719> (f5c1b0b7-1cd0-4d17-bb10-ef41c722c719) [No such file or directory] >[2016-04-19 07:24:43.455348] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f5c1b0b7-1cd0-4d17-bb10-ef41c722c719. (Possible split-brain) >[2016-04-19 07:24:43.456366] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719> (f5c1b0b7-1cd0-4d17-bb10-ef41c722c719) [No such file or directory] >[2016-04-19 07:24:43.456385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719> (f5c1b0b7-1cd0-4d17-bb10-ef41c722c719) [No such file or directory] >[2016-04-19 07:24:43.457697] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719> (f5c1b0b7-1cd0-4d17-bb10-ef41c722c719) [No such file or directory] >[2016-04-19 07:24:43.457841] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719> (f5c1b0b7-1cd0-4d17-bb10-ef41c722c719) [No such file or directory] >[2016-04-19 07:24:43.458172] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.460648] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f5c1b0b7-1cd0-4d17-bb10-ef41c722c719. (Possible split-brain) >[2016-04-19 07:24:43.461556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719> (f5c1b0b7-1cd0-4d17-bb10-ef41c722c719) [No such file or directory] >[2016-04-19 07:24:43.461789] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719> (f5c1b0b7-1cd0-4d17-bb10-ef41c722c719) [No such file or directory] >[2016-04-19 07:24:43.465782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719> (f5c1b0b7-1cd0-4d17-bb10-ef41c722c719) [No such file or directory] >[2016-04-19 07:24:43.465883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719> (f5c1b0b7-1cd0-4d17-bb10-ef41c722c719) [No such file or directory] >[2016-04-19 07:24:43.466510] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f5c1b0b7-1cd0-4d17-bb10-ef41c722c719>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.476520] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.477395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b> (07a1def7-6085-4ee3-8b11-b48f1d54f00b) [No such file or directory] >[2016-04-19 07:24:43.477661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b> (07a1def7-6085-4ee3-8b11-b48f1d54f00b) [No such file or directory] >[2016-04-19 07:24:43.478525] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 07a1def7-6085-4ee3-8b11-b48f1d54f00b. (Possible split-brain) >[2016-04-19 07:24:43.479543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b> (07a1def7-6085-4ee3-8b11-b48f1d54f00b) [No such file or directory] >[2016-04-19 07:24:43.479556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b> (07a1def7-6085-4ee3-8b11-b48f1d54f00b) [No such file or directory] >[2016-04-19 07:24:43.480710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b> (07a1def7-6085-4ee3-8b11-b48f1d54f00b) [No such file or directory] >[2016-04-19 07:24:43.480788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b> (07a1def7-6085-4ee3-8b11-b48f1d54f00b) [No such file or directory] >[2016-04-19 07:24:43.481093] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.483527] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 07a1def7-6085-4ee3-8b11-b48f1d54f00b. (Possible split-brain) >[2016-04-19 07:24:43.484718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b> (07a1def7-6085-4ee3-8b11-b48f1d54f00b) [No such file or directory] >[2016-04-19 07:24:43.484745] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b> (07a1def7-6085-4ee3-8b11-b48f1d54f00b) [No such file or directory] >[2016-04-19 07:24:43.487723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b> (07a1def7-6085-4ee3-8b11-b48f1d54f00b) [No such file or directory] >[2016-04-19 07:24:43.487932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b> (07a1def7-6085-4ee3-8b11-b48f1d54f00b) [No such file or directory] >[2016-04-19 07:24:43.488096] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:07a1def7-6085-4ee3-8b11-b48f1d54f00b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.497751] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.498688] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c> (6d607900-1256-45fc-81ac-1f46f8fec35c) [No such file or directory] >[2016-04-19 07:24:43.498711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c> (6d607900-1256-45fc-81ac-1f46f8fec35c) [No such file or directory] >[2016-04-19 07:24:43.499622] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6d607900-1256-45fc-81ac-1f46f8fec35c. (Possible split-brain) >[2016-04-19 07:24:43.500749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c> (6d607900-1256-45fc-81ac-1f46f8fec35c) [No such file or directory] >[2016-04-19 07:24:43.500776] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c> (6d607900-1256-45fc-81ac-1f46f8fec35c) [No such file or directory] >[2016-04-19 07:24:43.502032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c> (6d607900-1256-45fc-81ac-1f46f8fec35c) [No such file or directory] >[2016-04-19 07:24:43.502262] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c> (6d607900-1256-45fc-81ac-1f46f8fec35c) [No such file or directory] >[2016-04-19 07:24:43.502565] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.505022] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6d607900-1256-45fc-81ac-1f46f8fec35c. (Possible split-brain) >[2016-04-19 07:24:43.505839] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c> (6d607900-1256-45fc-81ac-1f46f8fec35c) [No such file or directory] >[2016-04-19 07:24:43.506067] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c> (6d607900-1256-45fc-81ac-1f46f8fec35c) [No such file or directory] >[2016-04-19 07:24:43.509056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c> (6d607900-1256-45fc-81ac-1f46f8fec35c) [No such file or directory] >[2016-04-19 07:24:43.509195] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c> (6d607900-1256-45fc-81ac-1f46f8fec35c) [No such file or directory] >[2016-04-19 07:24:43.509366] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6d607900-1256-45fc-81ac-1f46f8fec35c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.518602] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.519560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af> (fbbe1721-3aad-4bde-b93f-5e4377ff66af) [No such file or directory] >[2016-04-19 07:24:43.519649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af> (fbbe1721-3aad-4bde-b93f-5e4377ff66af) [No such file or directory] >[2016-04-19 07:24:43.522231] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fbbe1721-3aad-4bde-b93f-5e4377ff66af. (Possible split-brain) >[2016-04-19 07:24:43.523185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af> (fbbe1721-3aad-4bde-b93f-5e4377ff66af) [No such file or directory] >[2016-04-19 07:24:43.523257] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af> (fbbe1721-3aad-4bde-b93f-5e4377ff66af) [No such file or directory] >[2016-04-19 07:24:43.524630] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af> (fbbe1721-3aad-4bde-b93f-5e4377ff66af) [No such file or directory] >[2016-04-19 07:24:43.524680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af> (fbbe1721-3aad-4bde-b93f-5e4377ff66af) [No such file or directory] >[2016-04-19 07:24:43.525049] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.527601] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fbbe1721-3aad-4bde-b93f-5e4377ff66af. (Possible split-brain) >[2016-04-19 07:24:43.528542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af> (fbbe1721-3aad-4bde-b93f-5e4377ff66af) [No such file or directory] >[2016-04-19 07:24:43.528654] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af> (fbbe1721-3aad-4bde-b93f-5e4377ff66af) [No such file or directory] >[2016-04-19 07:24:43.533015] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af> (fbbe1721-3aad-4bde-b93f-5e4377ff66af) [No such file or directory] >[2016-04-19 07:24:43.533111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af> (fbbe1721-3aad-4bde-b93f-5e4377ff66af) [No such file or directory] >[2016-04-19 07:24:43.533239] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fbbe1721-3aad-4bde-b93f-5e4377ff66af>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.543337] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.544406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d> (13d2f11b-50d8-4d17-86fc-3438382d998d) [No such file or directory] >[2016-04-19 07:24:43.544486] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d> (13d2f11b-50d8-4d17-86fc-3438382d998d) [No such file or directory] >[2016-04-19 07:24:43.547015] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 13d2f11b-50d8-4d17-86fc-3438382d998d. (Possible split-brain) >[2016-04-19 07:24:43.548232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d> (13d2f11b-50d8-4d17-86fc-3438382d998d) [No such file or directory] >[2016-04-19 07:24:43.548261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d> (13d2f11b-50d8-4d17-86fc-3438382d998d) [No such file or directory] >[2016-04-19 07:24:43.549664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d> (13d2f11b-50d8-4d17-86fc-3438382d998d) [No such file or directory] >[2016-04-19 07:24:43.549649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d> (13d2f11b-50d8-4d17-86fc-3438382d998d) [No such file or directory] >[2016-04-19 07:24:43.549859] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.552426] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 13d2f11b-50d8-4d17-86fc-3438382d998d. (Possible split-brain) >[2016-04-19 07:24:43.553709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d> (13d2f11b-50d8-4d17-86fc-3438382d998d) [No such file or directory] >[2016-04-19 07:24:43.553796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d> (13d2f11b-50d8-4d17-86fc-3438382d998d) [No such file or directory] >[2016-04-19 07:24:43.557401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d> (13d2f11b-50d8-4d17-86fc-3438382d998d) [No such file or directory] >[2016-04-19 07:24:43.557726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d> (13d2f11b-50d8-4d17-86fc-3438382d998d) [No such file or directory] >[2016-04-19 07:24:43.558146] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:13d2f11b-50d8-4d17-86fc-3438382d998d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.568115] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.569242] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f> (651374b3-030f-4034-91fc-7be9d4b7b17f) [No such file or directory] >[2016-04-19 07:24:43.569313] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f> (651374b3-030f-4034-91fc-7be9d4b7b17f) [No such file or directory] >[2016-04-19 07:24:43.571917] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 651374b3-030f-4034-91fc-7be9d4b7b17f. (Possible split-brain) >[2016-04-19 07:24:43.572940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f> (651374b3-030f-4034-91fc-7be9d4b7b17f) [No such file or directory] >[2016-04-19 07:24:43.572955] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f> (651374b3-030f-4034-91fc-7be9d4b7b17f) [No such file or directory] >[2016-04-19 07:24:43.574227] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f> (651374b3-030f-4034-91fc-7be9d4b7b17f) [No such file or directory] >[2016-04-19 07:24:43.574379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f> (651374b3-030f-4034-91fc-7be9d4b7b17f) [No such file or directory] >[2016-04-19 07:24:43.574711] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.577353] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 651374b3-030f-4034-91fc-7be9d4b7b17f. (Possible split-brain) >[2016-04-19 07:24:43.578600] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f> (651374b3-030f-4034-91fc-7be9d4b7b17f) [No such file or directory] >[2016-04-19 07:24:43.578609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f> (651374b3-030f-4034-91fc-7be9d4b7b17f) [No such file or directory] >[2016-04-19 07:24:43.582161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f> (651374b3-030f-4034-91fc-7be9d4b7b17f) [No such file or directory] >[2016-04-19 07:24:43.582559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f> (651374b3-030f-4034-91fc-7be9d4b7b17f) [No such file or directory] >[2016-04-19 07:24:43.583258] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:651374b3-030f-4034-91fc-7be9d4b7b17f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.593526] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.594269] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab> (02e1b68b-d787-4309-a4a1-1400087e6bab) [No such file or directory] >[2016-04-19 07:24:43.594614] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab> (02e1b68b-d787-4309-a4a1-1400087e6bab) [No such file or directory] >[2016-04-19 07:24:43.597130] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 02e1b68b-d787-4309-a4a1-1400087e6bab. (Possible split-brain) >[2016-04-19 07:24:43.598172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab> (02e1b68b-d787-4309-a4a1-1400087e6bab) [No such file or directory] >[2016-04-19 07:24:43.598201] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab> (02e1b68b-d787-4309-a4a1-1400087e6bab) [No such file or directory] >[2016-04-19 07:24:43.599462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab> (02e1b68b-d787-4309-a4a1-1400087e6bab) [No such file or directory] >[2016-04-19 07:24:43.599586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab> (02e1b68b-d787-4309-a4a1-1400087e6bab) [No such file or directory] >[2016-04-19 07:24:43.600036] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.602823] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 02e1b68b-d787-4309-a4a1-1400087e6bab. (Possible split-brain) >[2016-04-19 07:24:43.603814] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab> (02e1b68b-d787-4309-a4a1-1400087e6bab) [No such file or directory] >[2016-04-19 07:24:43.603906] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab> (02e1b68b-d787-4309-a4a1-1400087e6bab) [No such file or directory] >[2016-04-19 07:24:43.608895] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab> (02e1b68b-d787-4309-a4a1-1400087e6bab) [No such file or directory] >[2016-04-19 07:24:43.608998] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab> (02e1b68b-d787-4309-a4a1-1400087e6bab) [No such file or directory] >[2016-04-19 07:24:43.609118] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:02e1b68b-d787-4309-a4a1-1400087e6bab>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.619042] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.620117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4> (2949b1ae-777d-437f-b063-9b5673544ec4) [No such file or directory] >[2016-04-19 07:24:43.620217] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4> (2949b1ae-777d-437f-b063-9b5673544ec4) [No such file or directory] >[2016-04-19 07:24:43.622863] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2949b1ae-777d-437f-b063-9b5673544ec4. (Possible split-brain) >[2016-04-19 07:24:43.624078] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4> (2949b1ae-777d-437f-b063-9b5673544ec4) [No such file or directory] >[2016-04-19 07:24:43.624188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4> (2949b1ae-777d-437f-b063-9b5673544ec4) [No such file or directory] >[2016-04-19 07:24:43.625269] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4> (2949b1ae-777d-437f-b063-9b5673544ec4) [No such file or directory] >[2016-04-19 07:24:43.625269] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4> (2949b1ae-777d-437f-b063-9b5673544ec4) [No such file or directory] >[2016-04-19 07:24:43.625537] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:43.628049] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2949b1ae-777d-437f-b063-9b5673544ec4. (Possible split-brain) >[2016-04-19 07:24:43.629069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4> (2949b1ae-777d-437f-b063-9b5673544ec4) [No such file or directory] >[2016-04-19 07:24:43.629408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4> (2949b1ae-777d-437f-b063-9b5673544ec4) [No such file or directory] >[2016-04-19 07:24:43.633469] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4> (2949b1ae-777d-437f-b063-9b5673544ec4) [No such file or directory] >[2016-04-19 07:24:43.633510] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4> (2949b1ae-777d-437f-b063-9b5673544ec4) [No such file or directory] >[2016-04-19 07:24:43.634024] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2949b1ae-777d-437f-b063-9b5673544ec4>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.643837] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.644849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4b323a74-0706-4433-81ac-f484685d50e2> (4b323a74-0706-4433-81ac-f484685d50e2) [No such file or directory] >[2016-04-19 07:24:43.644931] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4b323a74-0706-4433-81ac-f484685d50e2> (4b323a74-0706-4433-81ac-f484685d50e2) [No such file or directory] >[2016-04-19 07:24:43.645805] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4b323a74-0706-4433-81ac-f484685d50e2. (Possible split-brain) >[2016-04-19 07:24:43.646845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4b323a74-0706-4433-81ac-f484685d50e2> (4b323a74-0706-4433-81ac-f484685d50e2) [No such file or directory] >[2016-04-19 07:24:43.646867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4b323a74-0706-4433-81ac-f484685d50e2> (4b323a74-0706-4433-81ac-f484685d50e2) [No such file or directory] >[2016-04-19 07:24:43.648264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4b323a74-0706-4433-81ac-f484685d50e2> (4b323a74-0706-4433-81ac-f484685d50e2) [No such file or directory] >[2016-04-19 07:24:43.648422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4b323a74-0706-4433-81ac-f484685d50e2> (4b323a74-0706-4433-81ac-f484685d50e2) [No such file or directory] >[2016-04-19 07:24:43.648618] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4b323a74-0706-4433-81ac-f484685d50e2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.651062] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4b323a74-0706-4433-81ac-f484685d50e2. (Possible split-brain) >[2016-04-19 07:24:43.652063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4b323a74-0706-4433-81ac-f484685d50e2> (4b323a74-0706-4433-81ac-f484685d50e2) [No such file or directory] >[2016-04-19 07:24:43.652083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4b323a74-0706-4433-81ac-f484685d50e2> (4b323a74-0706-4433-81ac-f484685d50e2) [No such file or directory] >[2016-04-19 07:24:43.654650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4b323a74-0706-4433-81ac-f484685d50e2> (4b323a74-0706-4433-81ac-f484685d50e2) [No such file or directory] >[2016-04-19 07:24:43.654896] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4b323a74-0706-4433-81ac-f484685d50e2> (4b323a74-0706-4433-81ac-f484685d50e2) [No such file or directory] >[2016-04-19 07:24:43.655104] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4b323a74-0706-4433-81ac-f484685d50e2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.664266] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.665151] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36> (4f943da8-c799-4b77-97f9-c90da4cf2e36) [No such file or directory] >[2016-04-19 07:24:43.665449] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36> (4f943da8-c799-4b77-97f9-c90da4cf2e36) [No such file or directory] >[2016-04-19 07:24:43.666552] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4f943da8-c799-4b77-97f9-c90da4cf2e36. (Possible split-brain) >[2016-04-19 07:24:43.667508] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36> (4f943da8-c799-4b77-97f9-c90da4cf2e36) [No such file or directory] >[2016-04-19 07:24:43.667624] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36> (4f943da8-c799-4b77-97f9-c90da4cf2e36) [No such file or directory] >[2016-04-19 07:24:43.669409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36> (4f943da8-c799-4b77-97f9-c90da4cf2e36) [No such file or directory] >[2016-04-19 07:24:43.669413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36> (4f943da8-c799-4b77-97f9-c90da4cf2e36) [No such file or directory] >[2016-04-19 07:24:43.669561] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.672292] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4f943da8-c799-4b77-97f9-c90da4cf2e36. (Possible split-brain) >[2016-04-19 07:24:43.673570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36> (4f943da8-c799-4b77-97f9-c90da4cf2e36) [No such file or directory] >[2016-04-19 07:24:43.673720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36> (4f943da8-c799-4b77-97f9-c90da4cf2e36) [No such file or directory] >[2016-04-19 07:24:43.676558] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36> (4f943da8-c799-4b77-97f9-c90da4cf2e36) [No such file or directory] >[2016-04-19 07:24:43.676663] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36> (4f943da8-c799-4b77-97f9-c90da4cf2e36) [No such file or directory] >[2016-04-19 07:24:43.676893] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4f943da8-c799-4b77-97f9-c90da4cf2e36>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.687447] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.688245] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325> (af6d79e4-4a1d-4960-8541-a6ba8a737325) [No such file or directory] >[2016-04-19 07:24:43.688553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325> (af6d79e4-4a1d-4960-8541-a6ba8a737325) [No such file or directory] >[2016-04-19 07:24:43.691142] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid af6d79e4-4a1d-4960-8541-a6ba8a737325. (Possible split-brain) >[2016-04-19 07:24:43.692363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325> (af6d79e4-4a1d-4960-8541-a6ba8a737325) [No such file or directory] >[2016-04-19 07:24:43.692366] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325> (af6d79e4-4a1d-4960-8541-a6ba8a737325) [No such file or directory] >[2016-04-19 07:24:43.693825] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325> (af6d79e4-4a1d-4960-8541-a6ba8a737325) [No such file or directory] >[2016-04-19 07:24:43.693916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325> (af6d79e4-4a1d-4960-8541-a6ba8a737325) [No such file or directory] >[2016-04-19 07:24:43.694031] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.696580] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid af6d79e4-4a1d-4960-8541-a6ba8a737325. (Possible split-brain) >[2016-04-19 07:24:43.697471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325> (af6d79e4-4a1d-4960-8541-a6ba8a737325) [No such file or directory] >[2016-04-19 07:24:43.697564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325> (af6d79e4-4a1d-4960-8541-a6ba8a737325) [No such file or directory] >[2016-04-19 07:24:43.700237] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325> (af6d79e4-4a1d-4960-8541-a6ba8a737325) [No such file or directory] >[2016-04-19 07:24:43.700429] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325> (af6d79e4-4a1d-4960-8541-a6ba8a737325) [No such file or directory] >[2016-04-19 07:24:43.700566] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:af6d79e4-4a1d-4960-8541-a6ba8a737325>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.709865] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.710844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28> (d3213f28-5939-4bbd-9681-0450421a8f28) [No such file or directory] >[2016-04-19 07:24:43.711098] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28> (d3213f28-5939-4bbd-9681-0450421a8f28) [No such file or directory] >[2016-04-19 07:24:43.711969] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d3213f28-5939-4bbd-9681-0450421a8f28. (Possible split-brain) >[2016-04-19 07:24:43.712797] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28> (d3213f28-5939-4bbd-9681-0450421a8f28) [No such file or directory] >[2016-04-19 07:24:43.713080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28> (d3213f28-5939-4bbd-9681-0450421a8f28) [No such file or directory] >[2016-04-19 07:24:43.714413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28> (d3213f28-5939-4bbd-9681-0450421a8f28) [No such file or directory] >[2016-04-19 07:24:43.714425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28> (d3213f28-5939-4bbd-9681-0450421a8f28) [No such file or directory] >[2016-04-19 07:24:43.714888] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:43.717450] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d3213f28-5939-4bbd-9681-0450421a8f28. (Possible split-brain) >[2016-04-19 07:24:43.718496] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28> (d3213f28-5939-4bbd-9681-0450421a8f28) [No such file or directory] >[2016-04-19 07:24:43.718614] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28> (d3213f28-5939-4bbd-9681-0450421a8f28) [No such file or directory] >[2016-04-19 07:24:43.721446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28> (d3213f28-5939-4bbd-9681-0450421a8f28) [No such file or directory] >[2016-04-19 07:24:43.721597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28> (d3213f28-5939-4bbd-9681-0450421a8f28) [No such file or directory] >[2016-04-19 07:24:43.721775] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d3213f28-5939-4bbd-9681-0450421a8f28>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.731609] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.732576] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f> (c76115b6-789f-4846-ad04-74fa15a82e6f) [No such file or directory] >[2016-04-19 07:24:43.732601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f> (c76115b6-789f-4846-ad04-74fa15a82e6f) [No such file or directory] >[2016-04-19 07:24:43.733600] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c76115b6-789f-4846-ad04-74fa15a82e6f. (Possible split-brain) >[2016-04-19 07:24:43.734730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f> (c76115b6-789f-4846-ad04-74fa15a82e6f) [No such file or directory] >[2016-04-19 07:24:43.734748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f> (c76115b6-789f-4846-ad04-74fa15a82e6f) [No such file or directory] >[2016-04-19 07:24:43.736294] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f> (c76115b6-789f-4846-ad04-74fa15a82e6f) [No such file or directory] >[2016-04-19 07:24:43.736528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f> (c76115b6-789f-4846-ad04-74fa15a82e6f) [No such file or directory] >[2016-04-19 07:24:43.736738] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.739471] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c76115b6-789f-4846-ad04-74fa15a82e6f. (Possible split-brain) >[2016-04-19 07:24:43.740452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f> (c76115b6-789f-4846-ad04-74fa15a82e6f) [No such file or directory] >[2016-04-19 07:24:43.740473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f> (c76115b6-789f-4846-ad04-74fa15a82e6f) [No such file or directory] >[2016-04-19 07:24:43.743513] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f> (c76115b6-789f-4846-ad04-74fa15a82e6f) [No such file or directory] >[2016-04-19 07:24:43.743609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f> (c76115b6-789f-4846-ad04-74fa15a82e6f) [No such file or directory] >[2016-04-19 07:24:43.743777] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c76115b6-789f-4846-ad04-74fa15a82e6f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.753678] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.754526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c> (938ff2e2-4eaa-475f-82b3-0f11430a698c) [No such file or directory] >[2016-04-19 07:24:43.754888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c> (938ff2e2-4eaa-475f-82b3-0f11430a698c) [No such file or directory] >[2016-04-19 07:24:43.755989] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 938ff2e2-4eaa-475f-82b3-0f11430a698c. (Possible split-brain) >[2016-04-19 07:24:43.756916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c> (938ff2e2-4eaa-475f-82b3-0f11430a698c) [No such file or directory] >[2016-04-19 07:24:43.756984] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c> (938ff2e2-4eaa-475f-82b3-0f11430a698c) [No such file or directory] >[2016-04-19 07:24:43.758277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c> (938ff2e2-4eaa-475f-82b3-0f11430a698c) [No such file or directory] >[2016-04-19 07:24:43.758378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c> (938ff2e2-4eaa-475f-82b3-0f11430a698c) [No such file or directory] >[2016-04-19 07:24:43.758536] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.761136] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 938ff2e2-4eaa-475f-82b3-0f11430a698c. (Possible split-brain) >[2016-04-19 07:24:43.761977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c> (938ff2e2-4eaa-475f-82b3-0f11430a698c) [No such file or directory] >[2016-04-19 07:24:43.762242] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c> (938ff2e2-4eaa-475f-82b3-0f11430a698c) [No such file or directory] >[2016-04-19 07:24:43.764864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c> (938ff2e2-4eaa-475f-82b3-0f11430a698c) [No such file or directory] >[2016-04-19 07:24:43.765027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c> (938ff2e2-4eaa-475f-82b3-0f11430a698c) [No such file or directory] >[2016-04-19 07:24:43.765190] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:938ff2e2-4eaa-475f-82b3-0f11430a698c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.775306] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.776452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:56694a79-7f35-45ca-bc56-db073266fca6> (56694a79-7f35-45ca-bc56-db073266fca6) [No such file or directory] >[2016-04-19 07:24:43.776467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:56694a79-7f35-45ca-bc56-db073266fca6> (56694a79-7f35-45ca-bc56-db073266fca6) [No such file or directory] >[2016-04-19 07:24:43.779006] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 56694a79-7f35-45ca-bc56-db073266fca6. (Possible split-brain) >[2016-04-19 07:24:43.780055] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:56694a79-7f35-45ca-bc56-db073266fca6> (56694a79-7f35-45ca-bc56-db073266fca6) [No such file or directory] >[2016-04-19 07:24:43.780066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:56694a79-7f35-45ca-bc56-db073266fca6> (56694a79-7f35-45ca-bc56-db073266fca6) [No such file or directory] >[2016-04-19 07:24:43.781699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:56694a79-7f35-45ca-bc56-db073266fca6> (56694a79-7f35-45ca-bc56-db073266fca6) [No such file or directory] >[2016-04-19 07:24:43.781780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:56694a79-7f35-45ca-bc56-db073266fca6> (56694a79-7f35-45ca-bc56-db073266fca6) [No such file or directory] >[2016-04-19 07:24:43.781893] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:56694a79-7f35-45ca-bc56-db073266fca6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.784633] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 56694a79-7f35-45ca-bc56-db073266fca6. (Possible split-brain) >[2016-04-19 07:24:43.785471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:56694a79-7f35-45ca-bc56-db073266fca6> (56694a79-7f35-45ca-bc56-db073266fca6) [No such file or directory] >[2016-04-19 07:24:43.785848] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:56694a79-7f35-45ca-bc56-db073266fca6> (56694a79-7f35-45ca-bc56-db073266fca6) [No such file or directory] >[2016-04-19 07:24:43.788825] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:56694a79-7f35-45ca-bc56-db073266fca6> (56694a79-7f35-45ca-bc56-db073266fca6) [No such file or directory] >[2016-04-19 07:24:43.788830] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:56694a79-7f35-45ca-bc56-db073266fca6> (56694a79-7f35-45ca-bc56-db073266fca6) [No such file or directory] >[2016-04-19 07:24:43.789008] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:56694a79-7f35-45ca-bc56-db073266fca6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.797167] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.798197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37> (5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37) [No such file or directory] >[2016-04-19 07:24:43.798229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37> (5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37) [No such file or directory] >[2016-04-19 07:24:43.800850] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37. (Possible split-brain) >[2016-04-19 07:24:43.801892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37> (5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37) [No such file or directory] >[2016-04-19 07:24:43.801949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37> (5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37) [No such file or directory] >[2016-04-19 07:24:43.803207] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37> (5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37) [No such file or directory] >[2016-04-19 07:24:43.803682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37> (5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37) [No such file or directory] >[2016-04-19 07:24:43.803836] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.806558] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37. (Possible split-brain) >[2016-04-19 07:24:43.807745] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37> (5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37) [No such file or directory] >[2016-04-19 07:24:43.807822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37> (5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37) [No such file or directory] >[2016-04-19 07:24:43.811057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37> (5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37) [No such file or directory] >[2016-04-19 07:24:43.811076] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37> (5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37) [No such file or directory] >[2016-04-19 07:24:43.811241] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5caa6e4c-0d3e-41ab-bd83-f29dea5d2f37>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.822634] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.823765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b> (e9ef0187-b128-4266-bdc5-79c545b11e6b) [No such file or directory] >[2016-04-19 07:24:43.824111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b> (e9ef0187-b128-4266-bdc5-79c545b11e6b) [No such file or directory] >[2016-04-19 07:24:43.825229] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e9ef0187-b128-4266-bdc5-79c545b11e6b. (Possible split-brain) >[2016-04-19 07:24:43.826409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b> (e9ef0187-b128-4266-bdc5-79c545b11e6b) [No such file or directory] >[2016-04-19 07:24:43.826428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b> (e9ef0187-b128-4266-bdc5-79c545b11e6b) [No such file or directory] >[2016-04-19 07:24:43.827713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b> (e9ef0187-b128-4266-bdc5-79c545b11e6b) [No such file or directory] >[2016-04-19 07:24:43.827763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b> (e9ef0187-b128-4266-bdc5-79c545b11e6b) [No such file or directory] >[2016-04-19 07:24:43.827931] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.830712] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e9ef0187-b128-4266-bdc5-79c545b11e6b. (Possible split-brain) >[2016-04-19 07:24:43.831806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b> (e9ef0187-b128-4266-bdc5-79c545b11e6b) [No such file or directory] >[2016-04-19 07:24:43.831862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b> (e9ef0187-b128-4266-bdc5-79c545b11e6b) [No such file or directory] >[2016-04-19 07:24:43.835048] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b> (e9ef0187-b128-4266-bdc5-79c545b11e6b) [No such file or directory] >[2016-04-19 07:24:43.835070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b> (e9ef0187-b128-4266-bdc5-79c545b11e6b) [No such file or directory] >[2016-04-19 07:24:43.835266] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e9ef0187-b128-4266-bdc5-79c545b11e6b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.844631] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.845478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003> (41b794dd-134c-4d3a-affc-d1553d5b7003) [No such file or directory] >[2016-04-19 07:24:43.845774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003> (41b794dd-134c-4d3a-affc-d1553d5b7003) [No such file or directory] >[2016-04-19 07:24:43.846961] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 41b794dd-134c-4d3a-affc-d1553d5b7003. (Possible split-brain) >[2016-04-19 07:24:43.847755] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003> (41b794dd-134c-4d3a-affc-d1553d5b7003) [No such file or directory] >[2016-04-19 07:24:43.847871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003> (41b794dd-134c-4d3a-affc-d1553d5b7003) [No such file or directory] >[2016-04-19 07:24:43.849147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003> (41b794dd-134c-4d3a-affc-d1553d5b7003) [No such file or directory] >[2016-04-19 07:24:43.849736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003> (41b794dd-134c-4d3a-affc-d1553d5b7003) [No such file or directory] >[2016-04-19 07:24:43.849916] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.852465] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 41b794dd-134c-4d3a-affc-d1553d5b7003. (Possible split-brain) >[2016-04-19 07:24:43.853233] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003> (41b794dd-134c-4d3a-affc-d1553d5b7003) [No such file or directory] >[2016-04-19 07:24:43.853491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003> (41b794dd-134c-4d3a-affc-d1553d5b7003) [No such file or directory] >[2016-04-19 07:24:43.856532] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003> (41b794dd-134c-4d3a-affc-d1553d5b7003) [No such file or directory] >[2016-04-19 07:24:43.856556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003> (41b794dd-134c-4d3a-affc-d1553d5b7003) [No such file or directory] >[2016-04-19 07:24:43.857137] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:41b794dd-134c-4d3a-affc-d1553d5b7003>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.866726] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.867664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19> (62cfba69-c941-42a6-a2cf-92b8f132df19) [No such file or directory] >[2016-04-19 07:24:43.868003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19> (62cfba69-c941-42a6-a2cf-92b8f132df19) [No such file or directory] >[2016-04-19 07:24:43.871051] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 62cfba69-c941-42a6-a2cf-92b8f132df19. (Possible split-brain) >[2016-04-19 07:24:43.871933] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19> (62cfba69-c941-42a6-a2cf-92b8f132df19) [No such file or directory] >[2016-04-19 07:24:43.872156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19> (62cfba69-c941-42a6-a2cf-92b8f132df19) [No such file or directory] >[2016-04-19 07:24:43.873491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19> (62cfba69-c941-42a6-a2cf-92b8f132df19) [No such file or directory] >[2016-04-19 07:24:43.873580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19> (62cfba69-c941-42a6-a2cf-92b8f132df19) [No such file or directory] >[2016-04-19 07:24:43.873699] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.876405] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 62cfba69-c941-42a6-a2cf-92b8f132df19. (Possible split-brain) >[2016-04-19 07:24:43.877219] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19> (62cfba69-c941-42a6-a2cf-92b8f132df19) [No such file or directory] >[2016-04-19 07:24:43.877466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19> (62cfba69-c941-42a6-a2cf-92b8f132df19) [No such file or directory] >[2016-04-19 07:24:43.880840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19> (62cfba69-c941-42a6-a2cf-92b8f132df19) [No such file or directory] >[2016-04-19 07:24:43.880862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19> (62cfba69-c941-42a6-a2cf-92b8f132df19) [No such file or directory] >[2016-04-19 07:24:43.881016] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:62cfba69-c941-42a6-a2cf-92b8f132df19>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.889928] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.890812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a> (4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a) [No such file or directory] >[2016-04-19 07:24:43.891011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a> (4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a) [No such file or directory] >[2016-04-19 07:24:43.893546] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a. (Possible split-brain) >[2016-04-19 07:24:43.894370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a> (4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a) [No such file or directory] >[2016-04-19 07:24:43.894589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a> (4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a) [No such file or directory] >[2016-04-19 07:24:43.895832] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a> (4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a) [No such file or directory] >[2016-04-19 07:24:43.895957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a> (4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a) [No such file or directory] >[2016-04-19 07:24:43.896156] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.898903] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a. (Possible split-brain) >[2016-04-19 07:24:43.899657] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a> (4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a) [No such file or directory] >[2016-04-19 07:24:43.899888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a> (4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a) [No such file or directory] >[2016-04-19 07:24:43.903280] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a> (4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a) [No such file or directory] >[2016-04-19 07:24:43.903432] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a> (4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a) [No such file or directory] >[2016-04-19 07:24:43.903638] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4e9d95c1-7d4e-417e-bcce-eec0be9aaa4a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.913215] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.913929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156> (fc4a11b1-e879-4584-9ccc-8db62a07a156) [No such file or directory] >[2016-04-19 07:24:43.914286] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156> (fc4a11b1-e879-4584-9ccc-8db62a07a156) [No such file or directory] >[2016-04-19 07:24:43.916972] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fc4a11b1-e879-4584-9ccc-8db62a07a156. (Possible split-brain) >[2016-04-19 07:24:43.917827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156> (fc4a11b1-e879-4584-9ccc-8db62a07a156) [No such file or directory] >[2016-04-19 07:24:43.918147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156> (fc4a11b1-e879-4584-9ccc-8db62a07a156) [No such file or directory] >[2016-04-19 07:24:43.919446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156> (fc4a11b1-e879-4584-9ccc-8db62a07a156) [No such file or directory] >[2016-04-19 07:24:43.919555] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156> (fc4a11b1-e879-4584-9ccc-8db62a07a156) [No such file or directory] >[2016-04-19 07:24:43.919723] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.922441] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fc4a11b1-e879-4584-9ccc-8db62a07a156. (Possible split-brain) >[2016-04-19 07:24:43.923301] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156> (fc4a11b1-e879-4584-9ccc-8db62a07a156) [No such file or directory] >[2016-04-19 07:24:43.923601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156> (fc4a11b1-e879-4584-9ccc-8db62a07a156) [No such file or directory] >[2016-04-19 07:24:43.926817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156> (fc4a11b1-e879-4584-9ccc-8db62a07a156) [No such file or directory] >[2016-04-19 07:24:43.927001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156> (fc4a11b1-e879-4584-9ccc-8db62a07a156) [No such file or directory] >[2016-04-19 07:24:43.927192] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fc4a11b1-e879-4584-9ccc-8db62a07a156>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.937478] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.938460] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c> (2cdac86a-b122-400f-9ec6-f9bb55f3979c) [No such file or directory] >[2016-04-19 07:24:43.938554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c> (2cdac86a-b122-400f-9ec6-f9bb55f3979c) [No such file or directory] >[2016-04-19 07:24:43.941396] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2cdac86a-b122-400f-9ec6-f9bb55f3979c. (Possible split-brain) >[2016-04-19 07:24:43.942497] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c> (2cdac86a-b122-400f-9ec6-f9bb55f3979c) [No such file or directory] >[2016-04-19 07:24:43.942701] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c> (2cdac86a-b122-400f-9ec6-f9bb55f3979c) [No such file or directory] >[2016-04-19 07:24:43.943916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c> (2cdac86a-b122-400f-9ec6-f9bb55f3979c) [No such file or directory] >[2016-04-19 07:24:43.943947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c> (2cdac86a-b122-400f-9ec6-f9bb55f3979c) [No such file or directory] >[2016-04-19 07:24:43.944118] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.946868] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2cdac86a-b122-400f-9ec6-f9bb55f3979c. (Possible split-brain) >[2016-04-19 07:24:43.948002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c> (2cdac86a-b122-400f-9ec6-f9bb55f3979c) [No such file or directory] >[2016-04-19 07:24:43.948023] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c> (2cdac86a-b122-400f-9ec6-f9bb55f3979c) [No such file or directory] >[2016-04-19 07:24:43.951131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c> (2cdac86a-b122-400f-9ec6-f9bb55f3979c) [No such file or directory] >[2016-04-19 07:24:43.951236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c> (2cdac86a-b122-400f-9ec6-f9bb55f3979c) [No such file or directory] >[2016-04-19 07:24:43.951381] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2cdac86a-b122-400f-9ec6-f9bb55f3979c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:43.962131] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.962713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:06415445-da26-477f-b48e-5b54776937f0> (06415445-da26-477f-b48e-5b54776937f0) [No such file or directory] >[2016-04-19 07:24:43.963138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:06415445-da26-477f-b48e-5b54776937f0> (06415445-da26-477f-b48e-5b54776937f0) [No such file or directory] >[2016-04-19 07:24:43.965842] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 06415445-da26-477f-b48e-5b54776937f0. (Possible split-brain) >[2016-04-19 07:24:43.966477] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:06415445-da26-477f-b48e-5b54776937f0> (06415445-da26-477f-b48e-5b54776937f0) [No such file or directory] >[2016-04-19 07:24:43.966980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:06415445-da26-477f-b48e-5b54776937f0> (06415445-da26-477f-b48e-5b54776937f0) [No such file or directory] >[2016-04-19 07:24:43.967851] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:06415445-da26-477f-b48e-5b54776937f0> (06415445-da26-477f-b48e-5b54776937f0) [No such file or directory] >[2016-04-19 07:24:43.967947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:06415445-da26-477f-b48e-5b54776937f0> (06415445-da26-477f-b48e-5b54776937f0) [No such file or directory] >[2016-04-19 07:24:43.968055] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:06415445-da26-477f-b48e-5b54776937f0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.970608] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 06415445-da26-477f-b48e-5b54776937f0. (Possible split-brain) >[2016-04-19 07:24:43.971355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:06415445-da26-477f-b48e-5b54776937f0> (06415445-da26-477f-b48e-5b54776937f0) [No such file or directory] >[2016-04-19 07:24:43.971536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:06415445-da26-477f-b48e-5b54776937f0> (06415445-da26-477f-b48e-5b54776937f0) [No such file or directory] >[2016-04-19 07:24:43.973453] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:06415445-da26-477f-b48e-5b54776937f0> (06415445-da26-477f-b48e-5b54776937f0) [No such file or directory] >[2016-04-19 07:24:43.973622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:06415445-da26-477f-b48e-5b54776937f0> (06415445-da26-477f-b48e-5b54776937f0) [No such file or directory] >[2016-04-19 07:24:43.973892] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:06415445-da26-477f-b48e-5b54776937f0>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:43.982207] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:43.983126] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6> (2041803d-c4f2-4cfa-be4e-e67dd101e3e6) [No such file or directory] >[2016-04-19 07:24:43.983194] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6> (2041803d-c4f2-4cfa-be4e-e67dd101e3e6) [No such file or directory] >[2016-04-19 07:24:43.984131] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2041803d-c4f2-4cfa-be4e-e67dd101e3e6. (Possible split-brain) >[2016-04-19 07:24:43.984976] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6> (2041803d-c4f2-4cfa-be4e-e67dd101e3e6) [No such file or directory] >[2016-04-19 07:24:43.984986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6> (2041803d-c4f2-4cfa-be4e-e67dd101e3e6) [No such file or directory] >[2016-04-19 07:24:43.986140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6> (2041803d-c4f2-4cfa-be4e-e67dd101e3e6) [No such file or directory] >[2016-04-19 07:24:43.986414] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6> (2041803d-c4f2-4cfa-be4e-e67dd101e3e6) [No such file or directory] >[2016-04-19 07:24:43.986528] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:43.987977] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2041803d-c4f2-4cfa-be4e-e67dd101e3e6. (Possible split-brain) >[2016-04-19 07:24:43.989041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6> (2041803d-c4f2-4cfa-be4e-e67dd101e3e6) [No such file or directory] >[2016-04-19 07:24:43.989065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6> (2041803d-c4f2-4cfa-be4e-e67dd101e3e6) [No such file or directory] >[2016-04-19 07:24:43.991535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6> (2041803d-c4f2-4cfa-be4e-e67dd101e3e6) [No such file or directory] >[2016-04-19 07:24:43.992008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6> (2041803d-c4f2-4cfa-be4e-e67dd101e3e6) [No such file or directory] >[2016-04-19 07:24:43.993120] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2041803d-c4f2-4cfa-be4e-e67dd101e3e6>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.003285] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.004144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739> (14fa7e42-adbb-4c09-a6e3-68773aeb9739) [No such file or directory] >[2016-04-19 07:24:44.004473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739> (14fa7e42-adbb-4c09-a6e3-68773aeb9739) [No such file or directory] >[2016-04-19 07:24:44.007205] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 14fa7e42-adbb-4c09-a6e3-68773aeb9739. (Possible split-brain) >[2016-04-19 07:24:44.007868] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739> (14fa7e42-adbb-4c09-a6e3-68773aeb9739) [No such file or directory] >[2016-04-19 07:24:44.008239] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739> (14fa7e42-adbb-4c09-a6e3-68773aeb9739) [No such file or directory] >[2016-04-19 07:24:44.009974] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739> (14fa7e42-adbb-4c09-a6e3-68773aeb9739) [No such file or directory] >[2016-04-19 07:24:44.009981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739> (14fa7e42-adbb-4c09-a6e3-68773aeb9739) [No such file or directory] >[2016-04-19 07:24:44.010153] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.012934] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 14fa7e42-adbb-4c09-a6e3-68773aeb9739. (Possible split-brain) >[2016-04-19 07:24:44.014017] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739> (14fa7e42-adbb-4c09-a6e3-68773aeb9739) [No such file or directory] >[2016-04-19 07:24:44.014129] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739> (14fa7e42-adbb-4c09-a6e3-68773aeb9739) [No such file or directory] >[2016-04-19 07:24:44.017283] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739> (14fa7e42-adbb-4c09-a6e3-68773aeb9739) [No such file or directory] >[2016-04-19 07:24:44.017438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739> (14fa7e42-adbb-4c09-a6e3-68773aeb9739) [No such file or directory] >[2016-04-19 07:24:44.017562] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:14fa7e42-adbb-4c09-a6e3-68773aeb9739>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.025904] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.026776] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872> (996a2f7e-5dcb-4d57-b0fe-9089f97cd872) [No such file or directory] >[2016-04-19 07:24:44.026870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872> (996a2f7e-5dcb-4d57-b0fe-9089f97cd872) [No such file or directory] >[2016-04-19 07:24:44.027825] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 996a2f7e-5dcb-4d57-b0fe-9089f97cd872. (Possible split-brain) >[2016-04-19 07:24:44.028720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872> (996a2f7e-5dcb-4d57-b0fe-9089f97cd872) [No such file or directory] >[2016-04-19 07:24:44.028937] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872> (996a2f7e-5dcb-4d57-b0fe-9089f97cd872) [No such file or directory] >[2016-04-19 07:24:44.030209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872> (996a2f7e-5dcb-4d57-b0fe-9089f97cd872) [No such file or directory] >[2016-04-19 07:24:44.030233] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872> (996a2f7e-5dcb-4d57-b0fe-9089f97cd872) [No such file or directory] >[2016-04-19 07:24:44.030401] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.033237] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 996a2f7e-5dcb-4d57-b0fe-9089f97cd872. (Possible split-brain) >[2016-04-19 07:24:44.034046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872> (996a2f7e-5dcb-4d57-b0fe-9089f97cd872) [No such file or directory] >[2016-04-19 07:24:44.034103] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872> (996a2f7e-5dcb-4d57-b0fe-9089f97cd872) [No such file or directory] >[2016-04-19 07:24:44.036930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872> (996a2f7e-5dcb-4d57-b0fe-9089f97cd872) [No such file or directory] >[2016-04-19 07:24:44.036972] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872> (996a2f7e-5dcb-4d57-b0fe-9089f97cd872) [No such file or directory] >[2016-04-19 07:24:44.037371] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:996a2f7e-5dcb-4d57-b0fe-9089f97cd872>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.047246] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.048264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23> (becdbe4b-7f61-4c97-9797-da272dd09c23) [No such file or directory] >[2016-04-19 07:24:44.048282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23> (becdbe4b-7f61-4c97-9797-da272dd09c23) [No such file or directory] >[2016-04-19 07:24:44.050987] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid becdbe4b-7f61-4c97-9797-da272dd09c23. (Possible split-brain) >[2016-04-19 07:24:44.052055] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23> (becdbe4b-7f61-4c97-9797-da272dd09c23) [No such file or directory] >[2016-04-19 07:24:44.052111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23> (becdbe4b-7f61-4c97-9797-da272dd09c23) [No such file or directory] >[2016-04-19 07:24:44.053259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23> (becdbe4b-7f61-4c97-9797-da272dd09c23) [No such file or directory] >[2016-04-19 07:24:44.053422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23> (becdbe4b-7f61-4c97-9797-da272dd09c23) [No such file or directory] >[2016-04-19 07:24:44.053647] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.056103] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid becdbe4b-7f61-4c97-9797-da272dd09c23. (Possible split-brain) >[2016-04-19 07:24:44.057190] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23> (becdbe4b-7f61-4c97-9797-da272dd09c23) [No such file or directory] >[2016-04-19 07:24:44.057407] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23> (becdbe4b-7f61-4c97-9797-da272dd09c23) [No such file or directory] >[2016-04-19 07:24:44.060146] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23> (becdbe4b-7f61-4c97-9797-da272dd09c23) [No such file or directory] >[2016-04-19 07:24:44.060180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23> (becdbe4b-7f61-4c97-9797-da272dd09c23) [No such file or directory] >[2016-04-19 07:24:44.060478] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:becdbe4b-7f61-4c97-9797-da272dd09c23>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.070377] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.071385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d> (c7a26338-6c4c-47a7-90ee-824c80df0d6d) [No such file or directory] >[2016-04-19 07:24:44.071391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d> (c7a26338-6c4c-47a7-90ee-824c80df0d6d) [No such file or directory] >[2016-04-19 07:24:44.072529] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c7a26338-6c4c-47a7-90ee-824c80df0d6d. (Possible split-brain) >[2016-04-19 07:24:44.073596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d> (c7a26338-6c4c-47a7-90ee-824c80df0d6d) [No such file or directory] >[2016-04-19 07:24:44.073621] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d> (c7a26338-6c4c-47a7-90ee-824c80df0d6d) [No such file or directory] >[2016-04-19 07:24:44.074916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d> (c7a26338-6c4c-47a7-90ee-824c80df0d6d) [No such file or directory] >[2016-04-19 07:24:44.075025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d> (c7a26338-6c4c-47a7-90ee-824c80df0d6d) [No such file or directory] >[2016-04-19 07:24:44.075147] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.077701] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c7a26338-6c4c-47a7-90ee-824c80df0d6d. (Possible split-brain) >[2016-04-19 07:24:44.078704] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d> (c7a26338-6c4c-47a7-90ee-824c80df0d6d) [No such file or directory] >[2016-04-19 07:24:44.078696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d> (c7a26338-6c4c-47a7-90ee-824c80df0d6d) [No such file or directory] >[2016-04-19 07:24:44.081959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d> (c7a26338-6c4c-47a7-90ee-824c80df0d6d) [No such file or directory] >[2016-04-19 07:24:44.082003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d> (c7a26338-6c4c-47a7-90ee-824c80df0d6d) [No such file or directory] >[2016-04-19 07:24:44.082426] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c7a26338-6c4c-47a7-90ee-824c80df0d6d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.091608] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.092674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1> (9b9394b8-a649-4f9d-909e-99caa010aac1) [No such file or directory] >[2016-04-19 07:24:44.092681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1> (9b9394b8-a649-4f9d-909e-99caa010aac1) [No such file or directory] >[2016-04-19 07:24:44.093906] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9b9394b8-a649-4f9d-909e-99caa010aac1. (Possible split-brain) >[2016-04-19 07:24:44.094901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1> (9b9394b8-a649-4f9d-909e-99caa010aac1) [No such file or directory] >[2016-04-19 07:24:44.095210] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1> (9b9394b8-a649-4f9d-909e-99caa010aac1) [No such file or directory] >[2016-04-19 07:24:44.096366] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1> (9b9394b8-a649-4f9d-909e-99caa010aac1) [No such file or directory] >[2016-04-19 07:24:44.096747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1> (9b9394b8-a649-4f9d-909e-99caa010aac1) [No such file or directory] >[2016-04-19 07:24:44.096901] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.099810] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9b9394b8-a649-4f9d-909e-99caa010aac1. (Possible split-brain) >[2016-04-19 07:24:44.100702] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1> (9b9394b8-a649-4f9d-909e-99caa010aac1) [No such file or directory] >[2016-04-19 07:24:44.100790] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1> (9b9394b8-a649-4f9d-909e-99caa010aac1) [No such file or directory] >[2016-04-19 07:24:44.103423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1> (9b9394b8-a649-4f9d-909e-99caa010aac1) [No such file or directory] >[2016-04-19 07:24:44.103708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1> (9b9394b8-a649-4f9d-909e-99caa010aac1) [No such file or directory] >[2016-04-19 07:24:44.103836] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9b9394b8-a649-4f9d-909e-99caa010aac1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.112830] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.113856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e> (a02e9c46-008e-46ef-b88a-70746b9cba4e) [No such file or directory] >[2016-04-19 07:24:44.113882] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e> (a02e9c46-008e-46ef-b88a-70746b9cba4e) [No such file or directory] >[2016-04-19 07:24:44.116532] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a02e9c46-008e-46ef-b88a-70746b9cba4e. (Possible split-brain) >[2016-04-19 07:24:44.117388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e> (a02e9c46-008e-46ef-b88a-70746b9cba4e) [No such file or directory] >[2016-04-19 07:24:44.117596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e> (a02e9c46-008e-46ef-b88a-70746b9cba4e) [No such file or directory] >[2016-04-19 07:24:44.118900] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e> (a02e9c46-008e-46ef-b88a-70746b9cba4e) [No such file or directory] >[2016-04-19 07:24:44.119024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e> (a02e9c46-008e-46ef-b88a-70746b9cba4e) [No such file or directory] >[2016-04-19 07:24:44.119144] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.121798] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a02e9c46-008e-46ef-b88a-70746b9cba4e. (Possible split-brain) >[2016-04-19 07:24:44.122858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e> (a02e9c46-008e-46ef-b88a-70746b9cba4e) [No such file or directory] >[2016-04-19 07:24:44.123139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e> (a02e9c46-008e-46ef-b88a-70746b9cba4e) [No such file or directory] >[2016-04-19 07:24:44.125756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e> (a02e9c46-008e-46ef-b88a-70746b9cba4e) [No such file or directory] >[2016-04-19 07:24:44.125841] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e> (a02e9c46-008e-46ef-b88a-70746b9cba4e) [No such file or directory] >[2016-04-19 07:24:44.126003] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a02e9c46-008e-46ef-b88a-70746b9cba4e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.135342] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.136413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304> (cc5fae90-a561-4886-820d-d715d1cc0304) [No such file or directory] >[2016-04-19 07:24:44.136426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304> (cc5fae90-a561-4886-820d-d715d1cc0304) [No such file or directory] >[2016-04-19 07:24:44.137589] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cc5fae90-a561-4886-820d-d715d1cc0304. (Possible split-brain) >[2016-04-19 07:24:44.138565] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304> (cc5fae90-a561-4886-820d-d715d1cc0304) [No such file or directory] >[2016-04-19 07:24:44.138686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304> (cc5fae90-a561-4886-820d-d715d1cc0304) [No such file or directory] >[2016-04-19 07:24:44.139844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304> (cc5fae90-a561-4886-820d-d715d1cc0304) [No such file or directory] >[2016-04-19 07:24:44.140192] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304> (cc5fae90-a561-4886-820d-d715d1cc0304) [No such file or directory] >[2016-04-19 07:24:44.140416] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.142883] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cc5fae90-a561-4886-820d-d715d1cc0304. (Possible split-brain) >[2016-04-19 07:24:44.143784] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304> (cc5fae90-a561-4886-820d-d715d1cc0304) [No such file or directory] >[2016-04-19 07:24:44.144094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304> (cc5fae90-a561-4886-820d-d715d1cc0304) [No such file or directory] >[2016-04-19 07:24:44.147232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304> (cc5fae90-a561-4886-820d-d715d1cc0304) [No such file or directory] >[2016-04-19 07:24:44.147369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304> (cc5fae90-a561-4886-820d-d715d1cc0304) [No such file or directory] >[2016-04-19 07:24:44.147511] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cc5fae90-a561-4886-820d-d715d1cc0304>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.157091] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.158051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4> (d4115ae4-d7ef-4bc0-ad64-f23ea72989a4) [No such file or directory] >[2016-04-19 07:24:44.158118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4> (d4115ae4-d7ef-4bc0-ad64-f23ea72989a4) [No such file or directory] >[2016-04-19 07:24:44.160986] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d4115ae4-d7ef-4bc0-ad64-f23ea72989a4. (Possible split-brain) >[2016-04-19 07:24:44.162038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4> (d4115ae4-d7ef-4bc0-ad64-f23ea72989a4) [No such file or directory] >[2016-04-19 07:24:44.162297] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4> (d4115ae4-d7ef-4bc0-ad64-f23ea72989a4) [No such file or directory] >[2016-04-19 07:24:44.163491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4> (d4115ae4-d7ef-4bc0-ad64-f23ea72989a4) [No such file or directory] >[2016-04-19 07:24:44.163728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4> (d4115ae4-d7ef-4bc0-ad64-f23ea72989a4) [No such file or directory] >[2016-04-19 07:24:44.163909] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.166677] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d4115ae4-d7ef-4bc0-ad64-f23ea72989a4. (Possible split-brain) >[2016-04-19 07:24:44.167680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4> (d4115ae4-d7ef-4bc0-ad64-f23ea72989a4) [No such file or directory] >[2016-04-19 07:24:44.167804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4> (d4115ae4-d7ef-4bc0-ad64-f23ea72989a4) [No such file or directory] >[2016-04-19 07:24:44.170803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4> (d4115ae4-d7ef-4bc0-ad64-f23ea72989a4) [No such file or directory] >[2016-04-19 07:24:44.170907] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4> (d4115ae4-d7ef-4bc0-ad64-f23ea72989a4) [No such file or directory] >[2016-04-19 07:24:44.171069] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d4115ae4-d7ef-4bc0-ad64-f23ea72989a4>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.181874] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.182945] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161> (3fb574cf-866f-4dfc-9a06-32d6cdfae161) [No such file or directory] >[2016-04-19 07:24:44.183027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161> (3fb574cf-866f-4dfc-9a06-32d6cdfae161) [No such file or directory] >[2016-04-19 07:24:44.184179] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3fb574cf-866f-4dfc-9a06-32d6cdfae161. (Possible split-brain) >[2016-04-19 07:24:44.185285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161> (3fb574cf-866f-4dfc-9a06-32d6cdfae161) [No such file or directory] >[2016-04-19 07:24:44.185418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161> (3fb574cf-866f-4dfc-9a06-32d6cdfae161) [No such file or directory] >[2016-04-19 07:24:44.186623] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161> (3fb574cf-866f-4dfc-9a06-32d6cdfae161) [No such file or directory] >[2016-04-19 07:24:44.186840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161> (3fb574cf-866f-4dfc-9a06-32d6cdfae161) [No such file or directory] >[2016-04-19 07:24:44.186972] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.189726] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3fb574cf-866f-4dfc-9a06-32d6cdfae161. (Possible split-brain) >[2016-04-19 07:24:44.190605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161> (3fb574cf-866f-4dfc-9a06-32d6cdfae161) [No such file or directory] >[2016-04-19 07:24:44.191050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161> (3fb574cf-866f-4dfc-9a06-32d6cdfae161) [No such file or directory] >[2016-04-19 07:24:44.193834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161> (3fb574cf-866f-4dfc-9a06-32d6cdfae161) [No such file or directory] >[2016-04-19 07:24:44.194038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161> (3fb574cf-866f-4dfc-9a06-32d6cdfae161) [No such file or directory] >[2016-04-19 07:24:44.194261] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3fb574cf-866f-4dfc-9a06-32d6cdfae161>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.204259] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.205383] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d> (b94e3f14-e122-4bce-b742-73a4772ced5d) [No such file or directory] >[2016-04-19 07:24:44.205409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d> (b94e3f14-e122-4bce-b742-73a4772ced5d) [No such file or directory] >[2016-04-19 07:24:44.206535] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b94e3f14-e122-4bce-b742-73a4772ced5d. (Possible split-brain) >[2016-04-19 07:24:44.207513] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d> (b94e3f14-e122-4bce-b742-73a4772ced5d) [No such file or directory] >[2016-04-19 07:24:44.207791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d> (b94e3f14-e122-4bce-b742-73a4772ced5d) [No such file or directory] >[2016-04-19 07:24:44.209197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d> (b94e3f14-e122-4bce-b742-73a4772ced5d) [No such file or directory] >[2016-04-19 07:24:44.209303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d> (b94e3f14-e122-4bce-b742-73a4772ced5d) [No such file or directory] >[2016-04-19 07:24:44.209488] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.211976] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b94e3f14-e122-4bce-b742-73a4772ced5d. (Possible split-brain) >[2016-04-19 07:24:44.212949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d> (b94e3f14-e122-4bce-b742-73a4772ced5d) [No such file or directory] >[2016-04-19 07:24:44.212974] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d> (b94e3f14-e122-4bce-b742-73a4772ced5d) [No such file or directory] >[2016-04-19 07:24:44.216221] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d> (b94e3f14-e122-4bce-b742-73a4772ced5d) [No such file or directory] >[2016-04-19 07:24:44.216418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d> (b94e3f14-e122-4bce-b742-73a4772ced5d) [No such file or directory] >[2016-04-19 07:24:44.216558] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b94e3f14-e122-4bce-b742-73a4772ced5d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.227158] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.228265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0> (7ba0c25f-13f0-4889-809f-a952166fe1f0) [No such file or directory] >[2016-04-19 07:24:44.228408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0> (7ba0c25f-13f0-4889-809f-a952166fe1f0) [No such file or directory] >[2016-04-19 07:24:44.229379] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7ba0c25f-13f0-4889-809f-a952166fe1f0. (Possible split-brain) >[2016-04-19 07:24:44.230637] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0> (7ba0c25f-13f0-4889-809f-a952166fe1f0) [No such file or directory] >[2016-04-19 07:24:44.231431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0> (7ba0c25f-13f0-4889-809f-a952166fe1f0) [No such file or directory] >[2016-04-19 07:24:44.232927] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0> (7ba0c25f-13f0-4889-809f-a952166fe1f0) [No such file or directory] >[2016-04-19 07:24:44.232965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0> (7ba0c25f-13f0-4889-809f-a952166fe1f0) [No such file or directory] >[2016-04-19 07:24:44.233638] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.236148] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7ba0c25f-13f0-4889-809f-a952166fe1f0. (Possible split-brain) >[2016-04-19 07:24:44.237269] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0> (7ba0c25f-13f0-4889-809f-a952166fe1f0) [No such file or directory] >[2016-04-19 07:24:44.237529] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0> (7ba0c25f-13f0-4889-809f-a952166fe1f0) [No such file or directory] >[2016-04-19 07:24:44.242178] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0> (7ba0c25f-13f0-4889-809f-a952166fe1f0) [No such file or directory] >[2016-04-19 07:24:44.242214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0> (7ba0c25f-13f0-4889-809f-a952166fe1f0) [No such file or directory] >[2016-04-19 07:24:44.242752] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7ba0c25f-13f0-4889-809f-a952166fe1f0>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.252987] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.254156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840> (74a463f0-06f7-40c5-83ce-2efbd46b0840) [No such file or directory] >[2016-04-19 07:24:44.254245] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840> (74a463f0-06f7-40c5-83ce-2efbd46b0840) [No such file or directory] >[2016-04-19 07:24:44.255143] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 74a463f0-06f7-40c5-83ce-2efbd46b0840. (Possible split-brain) >[2016-04-19 07:24:44.256360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840> (74a463f0-06f7-40c5-83ce-2efbd46b0840) [No such file or directory] >[2016-04-19 07:24:44.256497] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840> (74a463f0-06f7-40c5-83ce-2efbd46b0840) [No such file or directory] >[2016-04-19 07:24:44.257994] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840> (74a463f0-06f7-40c5-83ce-2efbd46b0840) [No such file or directory] >[2016-04-19 07:24:44.258099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840> (74a463f0-06f7-40c5-83ce-2efbd46b0840) [No such file or directory] >[2016-04-19 07:24:44.258304] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.261100] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 74a463f0-06f7-40c5-83ce-2efbd46b0840. (Possible split-brain) >[2016-04-19 07:24:44.262290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840> (74a463f0-06f7-40c5-83ce-2efbd46b0840) [No such file or directory] >[2016-04-19 07:24:44.262423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840> (74a463f0-06f7-40c5-83ce-2efbd46b0840) [No such file or directory] >[2016-04-19 07:24:44.266148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840> (74a463f0-06f7-40c5-83ce-2efbd46b0840) [No such file or directory] >[2016-04-19 07:24:44.266712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840> (74a463f0-06f7-40c5-83ce-2efbd46b0840) [No such file or directory] >[2016-04-19 07:24:44.267008] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:74a463f0-06f7-40c5-83ce-2efbd46b0840>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.276658] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.277501] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b7902075-c979-4352-8976-86f6ff871503> (b7902075-c979-4352-8976-86f6ff871503) [No such file or directory] >[2016-04-19 07:24:44.277721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b7902075-c979-4352-8976-86f6ff871503> (b7902075-c979-4352-8976-86f6ff871503) [No such file or directory] >[2016-04-19 07:24:44.280261] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b7902075-c979-4352-8976-86f6ff871503. (Possible split-brain) >[2016-04-19 07:24:44.281527] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b7902075-c979-4352-8976-86f6ff871503> (b7902075-c979-4352-8976-86f6ff871503) [No such file or directory] >[2016-04-19 07:24:44.281637] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b7902075-c979-4352-8976-86f6ff871503> (b7902075-c979-4352-8976-86f6ff871503) [No such file or directory] >[2016-04-19 07:24:44.282938] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b7902075-c979-4352-8976-86f6ff871503> (b7902075-c979-4352-8976-86f6ff871503) [No such file or directory] >[2016-04-19 07:24:44.283270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b7902075-c979-4352-8976-86f6ff871503> (b7902075-c979-4352-8976-86f6ff871503) [No such file or directory] >[2016-04-19 07:24:44.283454] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b7902075-c979-4352-8976-86f6ff871503>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.286219] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b7902075-c979-4352-8976-86f6ff871503. (Possible split-brain) >[2016-04-19 07:24:44.287215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b7902075-c979-4352-8976-86f6ff871503> (b7902075-c979-4352-8976-86f6ff871503) [No such file or directory] >[2016-04-19 07:24:44.287528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b7902075-c979-4352-8976-86f6ff871503> (b7902075-c979-4352-8976-86f6ff871503) [No such file or directory] >[2016-04-19 07:24:44.291162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b7902075-c979-4352-8976-86f6ff871503> (b7902075-c979-4352-8976-86f6ff871503) [No such file or directory] >[2016-04-19 07:24:44.291193] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b7902075-c979-4352-8976-86f6ff871503> (b7902075-c979-4352-8976-86f6ff871503) [No such file or directory] >[2016-04-19 07:24:44.291424] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b7902075-c979-4352-8976-86f6ff871503>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.299858] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.301091] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8> (e277b9b6-3c48-4e5c-91f5-773d0d1768f8) [No such file or directory] >[2016-04-19 07:24:44.301102] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8> (e277b9b6-3c48-4e5c-91f5-773d0d1768f8) [No such file or directory] >[2016-04-19 07:24:44.303881] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e277b9b6-3c48-4e5c-91f5-773d0d1768f8. (Possible split-brain) >[2016-04-19 07:24:44.304783] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8> (e277b9b6-3c48-4e5c-91f5-773d0d1768f8) [No such file or directory] >[2016-04-19 07:24:44.305011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8> (e277b9b6-3c48-4e5c-91f5-773d0d1768f8) [No such file or directory] >[2016-04-19 07:24:44.306485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8> (e277b9b6-3c48-4e5c-91f5-773d0d1768f8) [No such file or directory] >[2016-04-19 07:24:44.306656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8> (e277b9b6-3c48-4e5c-91f5-773d0d1768f8) [No such file or directory] >[2016-04-19 07:24:44.306840] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.309616] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e277b9b6-3c48-4e5c-91f5-773d0d1768f8. (Possible split-brain) >[2016-04-19 07:24:44.310666] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8> (e277b9b6-3c48-4e5c-91f5-773d0d1768f8) [No such file or directory] >[2016-04-19 07:24:44.310932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8> (e277b9b6-3c48-4e5c-91f5-773d0d1768f8) [No such file or directory] >[2016-04-19 07:24:44.314291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8> (e277b9b6-3c48-4e5c-91f5-773d0d1768f8) [No such file or directory] >[2016-04-19 07:24:44.314716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8> (e277b9b6-3c48-4e5c-91f5-773d0d1768f8) [No such file or directory] >[2016-04-19 07:24:44.314843] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e277b9b6-3c48-4e5c-91f5-773d0d1768f8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.325034] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.326186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc> (cf1f0360-e431-4f77-a67a-e07c546a54fc) [No such file or directory] >[2016-04-19 07:24:44.326483] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc> (cf1f0360-e431-4f77-a67a-e07c546a54fc) [No such file or directory] >[2016-04-19 07:24:44.329122] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cf1f0360-e431-4f77-a67a-e07c546a54fc. (Possible split-brain) >[2016-04-19 07:24:44.330465] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc> (cf1f0360-e431-4f77-a67a-e07c546a54fc) [No such file or directory] >[2016-04-19 07:24:44.330621] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc> (cf1f0360-e431-4f77-a67a-e07c546a54fc) [No such file or directory] >[2016-04-19 07:24:44.331980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc> (cf1f0360-e431-4f77-a67a-e07c546a54fc) [No such file or directory] >[2016-04-19 07:24:44.332197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc> (cf1f0360-e431-4f77-a67a-e07c546a54fc) [No such file or directory] >[2016-04-19 07:24:44.332367] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.335049] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cf1f0360-e431-4f77-a67a-e07c546a54fc. (Possible split-brain) >[2016-04-19 07:24:44.336050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc> (cf1f0360-e431-4f77-a67a-e07c546a54fc) [No such file or directory] >[2016-04-19 07:24:44.336060] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc> (cf1f0360-e431-4f77-a67a-e07c546a54fc) [No such file or directory] >[2016-04-19 07:24:44.339376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc> (cf1f0360-e431-4f77-a67a-e07c546a54fc) [No such file or directory] >[2016-04-19 07:24:44.339631] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc> (cf1f0360-e431-4f77-a67a-e07c546a54fc) [No such file or directory] >[2016-04-19 07:24:44.339780] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cf1f0360-e431-4f77-a67a-e07c546a54fc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.349576] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.350693] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b> (426be06b-98d3-492f-a078-5dc54702ba1b) [No such file or directory] >[2016-04-19 07:24:44.350793] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b> (426be06b-98d3-492f-a078-5dc54702ba1b) [No such file or directory] >[2016-04-19 07:24:44.351759] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 426be06b-98d3-492f-a078-5dc54702ba1b. (Possible split-brain) >[2016-04-19 07:24:44.352733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b> (426be06b-98d3-492f-a078-5dc54702ba1b) [No such file or directory] >[2016-04-19 07:24:44.353032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b> (426be06b-98d3-492f-a078-5dc54702ba1b) [No such file or directory] >[2016-04-19 07:24:44.354401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b> (426be06b-98d3-492f-a078-5dc54702ba1b) [No such file or directory] >[2016-04-19 07:24:44.354492] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b> (426be06b-98d3-492f-a078-5dc54702ba1b) [No such file or directory] >[2016-04-19 07:24:44.354724] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.357427] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 426be06b-98d3-492f-a078-5dc54702ba1b. (Possible split-brain) >[2016-04-19 07:24:44.358672] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b> (426be06b-98d3-492f-a078-5dc54702ba1b) [No such file or directory] >[2016-04-19 07:24:44.358731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b> (426be06b-98d3-492f-a078-5dc54702ba1b) [No such file or directory] >[2016-04-19 07:24:44.361392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b> (426be06b-98d3-492f-a078-5dc54702ba1b) [No such file or directory] >[2016-04-19 07:24:44.361436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b> (426be06b-98d3-492f-a078-5dc54702ba1b) [No such file or directory] >[2016-04-19 07:24:44.361651] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:426be06b-98d3-492f-a078-5dc54702ba1b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.372740] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.373568] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66> (f6de1e98-664d-4759-9d4b-426ab9573f66) [No such file or directory] >[2016-04-19 07:24:44.373842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66> (f6de1e98-664d-4759-9d4b-426ab9573f66) [No such file or directory] >[2016-04-19 07:24:44.376540] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f6de1e98-664d-4759-9d4b-426ab9573f66. (Possible split-brain) >[2016-04-19 07:24:44.377504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66> (f6de1e98-664d-4759-9d4b-426ab9573f66) [No such file or directory] >[2016-04-19 07:24:44.377627] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66> (f6de1e98-664d-4759-9d4b-426ab9573f66) [No such file or directory] >[2016-04-19 07:24:44.378582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66> (f6de1e98-664d-4759-9d4b-426ab9573f66) [No such file or directory] >[2016-04-19 07:24:44.379143] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66> (f6de1e98-664d-4759-9d4b-426ab9573f66) [No such file or directory] >[2016-04-19 07:24:44.379290] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.382088] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f6de1e98-664d-4759-9d4b-426ab9573f66. (Possible split-brain) >[2016-04-19 07:24:44.382898] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66> (f6de1e98-664d-4759-9d4b-426ab9573f66) [No such file or directory] >[2016-04-19 07:24:44.383282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66> (f6de1e98-664d-4759-9d4b-426ab9573f66) [No such file or directory] >[2016-04-19 07:24:44.385736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66> (f6de1e98-664d-4759-9d4b-426ab9573f66) [No such file or directory] >[2016-04-19 07:24:44.385876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66> (f6de1e98-664d-4759-9d4b-426ab9573f66) [No such file or directory] >[2016-04-19 07:24:44.386508] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f6de1e98-664d-4759-9d4b-426ab9573f66>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.395371] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.396219] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a> (10e41e0b-64d6-47b7-a2d4-470ffb9ade9a) [No such file or directory] >[2016-04-19 07:24:44.396523] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a> (10e41e0b-64d6-47b7-a2d4-470ffb9ade9a) [No such file or directory] >[2016-04-19 07:24:44.397375] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 10e41e0b-64d6-47b7-a2d4-470ffb9ade9a. (Possible split-brain) >[2016-04-19 07:24:44.398446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a> (10e41e0b-64d6-47b7-a2d4-470ffb9ade9a) [No such file or directory] >[2016-04-19 07:24:44.398470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a> (10e41e0b-64d6-47b7-a2d4-470ffb9ade9a) [No such file or directory] >[2016-04-19 07:24:44.400024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a> (10e41e0b-64d6-47b7-a2d4-470ffb9ade9a) [No such file or directory] >[2016-04-19 07:24:44.400339] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a> (10e41e0b-64d6-47b7-a2d4-470ffb9ade9a) [No such file or directory] >[2016-04-19 07:24:44.400459] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.403161] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 10e41e0b-64d6-47b7-a2d4-470ffb9ade9a. (Possible split-brain) >[2016-04-19 07:24:44.404121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a> (10e41e0b-64d6-47b7-a2d4-470ffb9ade9a) [No such file or directory] >[2016-04-19 07:24:44.404145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a> (10e41e0b-64d6-47b7-a2d4-470ffb9ade9a) [No such file or directory] >[2016-04-19 07:24:44.406304] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a> (10e41e0b-64d6-47b7-a2d4-470ffb9ade9a) [No such file or directory] >[2016-04-19 07:24:44.406596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a> (10e41e0b-64d6-47b7-a2d4-470ffb9ade9a) [No such file or directory] >[2016-04-19 07:24:44.406782] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:10e41e0b-64d6-47b7-a2d4-470ffb9ade9a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.416391] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.417268] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164> (afb33991-8a12-46d3-a686-6fa2e6632164) [No such file or directory] >[2016-04-19 07:24:44.417370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164> (afb33991-8a12-46d3-a686-6fa2e6632164) [No such file or directory] >[2016-04-19 07:24:44.420063] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid afb33991-8a12-46d3-a686-6fa2e6632164. (Possible split-brain) >[2016-04-19 07:24:44.420945] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164> (afb33991-8a12-46d3-a686-6fa2e6632164) [No such file or directory] >[2016-04-19 07:24:44.420965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164> (afb33991-8a12-46d3-a686-6fa2e6632164) [No such file or directory] >[2016-04-19 07:24:44.422357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164> (afb33991-8a12-46d3-a686-6fa2e6632164) [No such file or directory] >[2016-04-19 07:24:44.422013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164> (afb33991-8a12-46d3-a686-6fa2e6632164) [No such file or directory] >[2016-04-19 07:24:44.422593] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.425303] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid afb33991-8a12-46d3-a686-6fa2e6632164. (Possible split-brain) >[2016-04-19 07:24:44.426226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164> (afb33991-8a12-46d3-a686-6fa2e6632164) [No such file or directory] >[2016-04-19 07:24:44.426509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164> (afb33991-8a12-46d3-a686-6fa2e6632164) [No such file or directory] >[2016-04-19 07:24:44.429352] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164> (afb33991-8a12-46d3-a686-6fa2e6632164) [No such file or directory] >[2016-04-19 07:24:44.429446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164> (afb33991-8a12-46d3-a686-6fa2e6632164) [No such file or directory] >[2016-04-19 07:24:44.429642] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:afb33991-8a12-46d3-a686-6fa2e6632164>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.438248] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.439064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89> (98a246aa-fde0-438b-8222-58bcce22ef89) [No such file or directory] >[2016-04-19 07:24:44.439369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89> (98a246aa-fde0-438b-8222-58bcce22ef89) [No such file or directory] >[2016-04-19 07:24:44.442067] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 98a246aa-fde0-438b-8222-58bcce22ef89. (Possible split-brain) >[2016-04-19 07:24:44.442856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89> (98a246aa-fde0-438b-8222-58bcce22ef89) [No such file or directory] >[2016-04-19 07:24:44.443127] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89> (98a246aa-fde0-438b-8222-58bcce22ef89) [No such file or directory] >[2016-04-19 07:24:44.444727] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89> (98a246aa-fde0-438b-8222-58bcce22ef89) [No such file or directory] >[2016-04-19 07:24:44.444757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89> (98a246aa-fde0-438b-8222-58bcce22ef89) [No such file or directory] >[2016-04-19 07:24:44.444899] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.447724] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 98a246aa-fde0-438b-8222-58bcce22ef89. (Possible split-brain) >[2016-04-19 07:24:44.448657] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89> (98a246aa-fde0-438b-8222-58bcce22ef89) [No such file or directory] >[2016-04-19 07:24:44.448701] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89> (98a246aa-fde0-438b-8222-58bcce22ef89) [No such file or directory] >[2016-04-19 07:24:44.451581] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89> (98a246aa-fde0-438b-8222-58bcce22ef89) [No such file or directory] >[2016-04-19 07:24:44.451664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89> (98a246aa-fde0-438b-8222-58bcce22ef89) [No such file or directory] >[2016-04-19 07:24:44.451802] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:98a246aa-fde0-438b-8222-58bcce22ef89>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.462224] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.463292] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246> (1f5a0fd5-8c67-425e-961b-f34423172246) [No such file or directory] >[2016-04-19 07:24:44.463403] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246> (1f5a0fd5-8c67-425e-961b-f34423172246) [No such file or directory] >[2016-04-19 07:24:44.464293] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1f5a0fd5-8c67-425e-961b-f34423172246. (Possible split-brain) >[2016-04-19 07:24:44.465375] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246> (1f5a0fd5-8c67-425e-961b-f34423172246) [No such file or directory] >[2016-04-19 07:24:44.465451] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246> (1f5a0fd5-8c67-425e-961b-f34423172246) [No such file or directory] >[2016-04-19 07:24:44.466842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246> (1f5a0fd5-8c67-425e-961b-f34423172246) [No such file or directory] >[2016-04-19 07:24:44.466879] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246> (1f5a0fd5-8c67-425e-961b-f34423172246) [No such file or directory] >[2016-04-19 07:24:44.467047] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.469771] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1f5a0fd5-8c67-425e-961b-f34423172246. (Possible split-brain) >[2016-04-19 07:24:44.470676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246> (1f5a0fd5-8c67-425e-961b-f34423172246) [No such file or directory] >[2016-04-19 07:24:44.470798] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246> (1f5a0fd5-8c67-425e-961b-f34423172246) [No such file or directory] >[2016-04-19 07:24:44.473901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246> (1f5a0fd5-8c67-425e-961b-f34423172246) [No such file or directory] >[2016-04-19 07:24:44.474005] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246> (1f5a0fd5-8c67-425e-961b-f34423172246) [No such file or directory] >[2016-04-19 07:24:44.474169] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1f5a0fd5-8c67-425e-961b-f34423172246>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.483518] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.484372] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05> (5ea9e551-0902-4b30-9336-8151703b5e05) [No such file or directory] >[2016-04-19 07:24:44.484798] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05> (5ea9e551-0902-4b30-9336-8151703b5e05) [No such file or directory] >[2016-04-19 07:24:44.485741] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5ea9e551-0902-4b30-9336-8151703b5e05. (Possible split-brain) >[2016-04-19 07:24:44.486615] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05> (5ea9e551-0902-4b30-9336-8151703b5e05) [No such file or directory] >[2016-04-19 07:24:44.486964] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05> (5ea9e551-0902-4b30-9336-8151703b5e05) [No such file or directory] >[2016-04-19 07:24:44.487962] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05> (5ea9e551-0902-4b30-9336-8151703b5e05) [No such file or directory] >[2016-04-19 07:24:44.488240] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05> (5ea9e551-0902-4b30-9336-8151703b5e05) [No such file or directory] >[2016-04-19 07:24:44.488367] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.491073] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5ea9e551-0902-4b30-9336-8151703b5e05. (Possible split-brain) >[2016-04-19 07:24:44.492191] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05> (5ea9e551-0902-4b30-9336-8151703b5e05) [No such file or directory] >[2016-04-19 07:24:44.492206] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05> (5ea9e551-0902-4b30-9336-8151703b5e05) [No such file or directory] >[2016-04-19 07:24:44.495115] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05> (5ea9e551-0902-4b30-9336-8151703b5e05) [No such file or directory] >[2016-04-19 07:24:44.495193] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05> (5ea9e551-0902-4b30-9336-8151703b5e05) [No such file or directory] >[2016-04-19 07:24:44.495397] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5ea9e551-0902-4b30-9336-8151703b5e05>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.504990] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.505725] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:55e17bd2-e87b-47e3-9188-face56220752> (55e17bd2-e87b-47e3-9188-face56220752) [No such file or directory] >[2016-04-19 07:24:44.506053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:55e17bd2-e87b-47e3-9188-face56220752> (55e17bd2-e87b-47e3-9188-face56220752) [No such file or directory] >[2016-04-19 07:24:44.508685] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 55e17bd2-e87b-47e3-9188-face56220752. (Possible split-brain) >[2016-04-19 07:24:44.509740] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:55e17bd2-e87b-47e3-9188-face56220752> (55e17bd2-e87b-47e3-9188-face56220752) [No such file or directory] >[2016-04-19 07:24:44.509814] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:55e17bd2-e87b-47e3-9188-face56220752> (55e17bd2-e87b-47e3-9188-face56220752) [No such file or directory] >[2016-04-19 07:24:44.511144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:55e17bd2-e87b-47e3-9188-face56220752> (55e17bd2-e87b-47e3-9188-face56220752) [No such file or directory] >[2016-04-19 07:24:44.511382] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:55e17bd2-e87b-47e3-9188-face56220752> (55e17bd2-e87b-47e3-9188-face56220752) [No such file or directory] >[2016-04-19 07:24:44.511510] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:55e17bd2-e87b-47e3-9188-face56220752>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.514281] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 55e17bd2-e87b-47e3-9188-face56220752. (Possible split-brain) >[2016-04-19 07:24:44.515112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:55e17bd2-e87b-47e3-9188-face56220752> (55e17bd2-e87b-47e3-9188-face56220752) [No such file or directory] >[2016-04-19 07:24:44.515405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:55e17bd2-e87b-47e3-9188-face56220752> (55e17bd2-e87b-47e3-9188-face56220752) [No such file or directory] >[2016-04-19 07:24:44.518099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:55e17bd2-e87b-47e3-9188-face56220752> (55e17bd2-e87b-47e3-9188-face56220752) [No such file or directory] >[2016-04-19 07:24:44.518216] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:55e17bd2-e87b-47e3-9188-face56220752> (55e17bd2-e87b-47e3-9188-face56220752) [No such file or directory] >[2016-04-19 07:24:44.518417] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:55e17bd2-e87b-47e3-9188-face56220752>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.528999] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.529876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3> (c6ffb514-529a-4a6b-a752-ceb6c45a0fa3) [No such file or directory] >[2016-04-19 07:24:44.530215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3> (c6ffb514-529a-4a6b-a752-ceb6c45a0fa3) [No such file or directory] >[2016-04-19 07:24:44.531070] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c6ffb514-529a-4a6b-a752-ceb6c45a0fa3. (Possible split-brain) >[2016-04-19 07:24:44.532069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3> (c6ffb514-529a-4a6b-a752-ceb6c45a0fa3) [No such file or directory] >[2016-04-19 07:24:44.532162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3> (c6ffb514-529a-4a6b-a752-ceb6c45a0fa3) [No such file or directory] >[2016-04-19 07:24:44.533234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3> (c6ffb514-529a-4a6b-a752-ceb6c45a0fa3) [No such file or directory] >[2016-04-19 07:24:44.533551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3> (c6ffb514-529a-4a6b-a752-ceb6c45a0fa3) [No such file or directory] >[2016-04-19 07:24:44.533723] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.536410] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c6ffb514-529a-4a6b-a752-ceb6c45a0fa3. (Possible split-brain) >[2016-04-19 07:24:44.537262] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3> (c6ffb514-529a-4a6b-a752-ceb6c45a0fa3) [No such file or directory] >[2016-04-19 07:24:44.537635] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3> (c6ffb514-529a-4a6b-a752-ceb6c45a0fa3) [No such file or directory] >[2016-04-19 07:24:44.540114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3> (c6ffb514-529a-4a6b-a752-ceb6c45a0fa3) [No such file or directory] >[2016-04-19 07:24:44.540445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3> (c6ffb514-529a-4a6b-a752-ceb6c45a0fa3) [No such file or directory] >[2016-04-19 07:24:44.540654] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c6ffb514-529a-4a6b-a752-ceb6c45a0fa3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.549615] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.550356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd> (09b02aed-7035-4ef6-b3fe-844fdbe0b1cd) [No such file or directory] >[2016-04-19 07:24:44.550723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd> (09b02aed-7035-4ef6-b3fe-844fdbe0b1cd) [No such file or directory] >[2016-04-19 07:24:44.553415] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 09b02aed-7035-4ef6-b3fe-844fdbe0b1cd. (Possible split-brain) >[2016-04-19 07:24:44.554049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd> (09b02aed-7035-4ef6-b3fe-844fdbe0b1cd) [No such file or directory] >[2016-04-19 07:24:44.554517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd> (09b02aed-7035-4ef6-b3fe-844fdbe0b1cd) [No such file or directory] >[2016-04-19 07:24:44.555795] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd> (09b02aed-7035-4ef6-b3fe-844fdbe0b1cd) [No such file or directory] >[2016-04-19 07:24:44.556381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd> (09b02aed-7035-4ef6-b3fe-844fdbe0b1cd) [No such file or directory] >[2016-04-19 07:24:44.556507] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.559210] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 09b02aed-7035-4ef6-b3fe-844fdbe0b1cd. (Possible split-brain) >[2016-04-19 07:24:44.560039] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd> (09b02aed-7035-4ef6-b3fe-844fdbe0b1cd) [No such file or directory] >[2016-04-19 07:24:44.560440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd> (09b02aed-7035-4ef6-b3fe-844fdbe0b1cd) [No such file or directory] >[2016-04-19 07:24:44.563198] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd> (09b02aed-7035-4ef6-b3fe-844fdbe0b1cd) [No such file or directory] >[2016-04-19 07:24:44.563264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd> (09b02aed-7035-4ef6-b3fe-844fdbe0b1cd) [No such file or directory] >[2016-04-19 07:24:44.563435] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:09b02aed-7035-4ef6-b3fe-844fdbe0b1cd>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.572429] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.573265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc> (3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc) [No such file or directory] >[2016-04-19 07:24:44.573548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc> (3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc) [No such file or directory] >[2016-04-19 07:24:44.576346] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc. (Possible split-brain) >[2016-04-19 07:24:44.577366] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc> (3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc) [No such file or directory] >[2016-04-19 07:24:44.577380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc> (3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc) [No such file or directory] >[2016-04-19 07:24:44.579011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc> (3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc) [No such file or directory] >[2016-04-19 07:24:44.579021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc> (3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc) [No such file or directory] >[2016-04-19 07:24:44.579212] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.582049] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc. (Possible split-brain) >[2016-04-19 07:24:44.583033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc> (3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc) [No such file or directory] >[2016-04-19 07:24:44.583450] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc> (3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc) [No such file or directory] >[2016-04-19 07:24:44.586093] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc> (3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc) [No such file or directory] >[2016-04-19 07:24:44.586482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc> (3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc) [No such file or directory] >[2016-04-19 07:24:44.586677] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3aee4889-c79d-4c5c-bf70-1bb6ef59bcfc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.597480] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.598367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb> (50d051a9-ec4d-421b-b219-6fe97512facb) [No such file or directory] >[2016-04-19 07:24:44.598746] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb> (50d051a9-ec4d-421b-b219-6fe97512facb) [No such file or directory] >[2016-04-19 07:24:44.601391] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 50d051a9-ec4d-421b-b219-6fe97512facb. (Possible split-brain) >[2016-04-19 07:24:44.602339] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb> (50d051a9-ec4d-421b-b219-6fe97512facb) [No such file or directory] >[2016-04-19 07:24:44.602702] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb> (50d051a9-ec4d-421b-b219-6fe97512facb) [No such file or directory] >[2016-04-19 07:24:44.603674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb> (50d051a9-ec4d-421b-b219-6fe97512facb) [No such file or directory] >[2016-04-19 07:24:44.604171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb> (50d051a9-ec4d-421b-b219-6fe97512facb) [No such file or directory] >[2016-04-19 07:24:44.604288] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.607066] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 50d051a9-ec4d-421b-b219-6fe97512facb. (Possible split-brain) >[2016-04-19 07:24:44.607908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb> (50d051a9-ec4d-421b-b219-6fe97512facb) [No such file or directory] >[2016-04-19 07:24:44.608382] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb> (50d051a9-ec4d-421b-b219-6fe97512facb) [No such file or directory] >[2016-04-19 07:24:44.610867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb> (50d051a9-ec4d-421b-b219-6fe97512facb) [No such file or directory] >[2016-04-19 07:24:44.611198] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb> (50d051a9-ec4d-421b-b219-6fe97512facb) [No such file or directory] >[2016-04-19 07:24:44.611410] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:50d051a9-ec4d-421b-b219-6fe97512facb>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.621946] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.623139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071> (6d32a73f-8843-4d79-86c8-4a9247c0f071) [No such file or directory] >[2016-04-19 07:24:44.623147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071> (6d32a73f-8843-4d79-86c8-4a9247c0f071) [No such file or directory] >[2016-04-19 07:24:44.624066] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6d32a73f-8843-4d79-86c8-4a9247c0f071. (Possible split-brain) >[2016-04-19 07:24:44.625060] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071> (6d32a73f-8843-4d79-86c8-4a9247c0f071) [No such file or directory] >[2016-04-19 07:24:44.625078] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071> (6d32a73f-8843-4d79-86c8-4a9247c0f071) [No such file or directory] >[2016-04-19 07:24:44.626148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071> (6d32a73f-8843-4d79-86c8-4a9247c0f071) [No such file or directory] >[2016-04-19 07:24:44.626597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071> (6d32a73f-8843-4d79-86c8-4a9247c0f071) [No such file or directory] >[2016-04-19 07:24:44.626738] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.629417] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6d32a73f-8843-4d79-86c8-4a9247c0f071. (Possible split-brain) >[2016-04-19 07:24:44.630284] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071> (6d32a73f-8843-4d79-86c8-4a9247c0f071) [No such file or directory] >[2016-04-19 07:24:44.630394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071> (6d32a73f-8843-4d79-86c8-4a9247c0f071) [No such file or directory] >[2016-04-19 07:24:44.632796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071> (6d32a73f-8843-4d79-86c8-4a9247c0f071) [No such file or directory] >[2016-04-19 07:24:44.632881] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071> (6d32a73f-8843-4d79-86c8-4a9247c0f071) [No such file or directory] >[2016-04-19 07:24:44.633024] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6d32a73f-8843-4d79-86c8-4a9247c0f071>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.642635] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.643652] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad> (5bc24b62-2215-4e08-a333-0d261b2122ad) [No such file or directory] >[2016-04-19 07:24:44.643675] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad> (5bc24b62-2215-4e08-a333-0d261b2122ad) [No such file or directory] >[2016-04-19 07:24:44.646341] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5bc24b62-2215-4e08-a333-0d261b2122ad. (Possible split-brain) >[2016-04-19 07:24:44.647347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad> (5bc24b62-2215-4e08-a333-0d261b2122ad) [No such file or directory] >[2016-04-19 07:24:44.647372] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad> (5bc24b62-2215-4e08-a333-0d261b2122ad) [No such file or directory] >[2016-04-19 07:24:44.648360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad> (5bc24b62-2215-4e08-a333-0d261b2122ad) [No such file or directory] >[2016-04-19 07:24:44.648630] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad> (5bc24b62-2215-4e08-a333-0d261b2122ad) [No such file or directory] >[2016-04-19 07:24:44.648779] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.650857] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5bc24b62-2215-4e08-a333-0d261b2122ad. (Possible split-brain) >[2016-04-19 07:24:44.651648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad> (5bc24b62-2215-4e08-a333-0d261b2122ad) [No such file or directory] >[2016-04-19 07:24:44.651657] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad> (5bc24b62-2215-4e08-a333-0d261b2122ad) [No such file or directory] >[2016-04-19 07:24:44.653864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad> (5bc24b62-2215-4e08-a333-0d261b2122ad) [No such file or directory] >[2016-04-19 07:24:44.654112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad> (5bc24b62-2215-4e08-a333-0d261b2122ad) [No such file or directory] >[2016-04-19 07:24:44.654267] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5bc24b62-2215-4e08-a333-0d261b2122ad>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.662138] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.662865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:06ad9ca8-f572-4235-b16f-8887302141de> (06ad9ca8-f572-4235-b16f-8887302141de) [No such file or directory] >[2016-04-19 07:24:44.663291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:06ad9ca8-f572-4235-b16f-8887302141de> (06ad9ca8-f572-4235-b16f-8887302141de) [No such file or directory] >[2016-04-19 07:24:44.664155] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 06ad9ca8-f572-4235-b16f-8887302141de. (Possible split-brain) >[2016-04-19 07:24:44.664852] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:06ad9ca8-f572-4235-b16f-8887302141de> (06ad9ca8-f572-4235-b16f-8887302141de) [No such file or directory] >[2016-04-19 07:24:44.664875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:06ad9ca8-f572-4235-b16f-8887302141de> (06ad9ca8-f572-4235-b16f-8887302141de) [No such file or directory] >[2016-04-19 07:24:44.665965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:06ad9ca8-f572-4235-b16f-8887302141de> (06ad9ca8-f572-4235-b16f-8887302141de) [No such file or directory] >[2016-04-19 07:24:44.666237] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:06ad9ca8-f572-4235-b16f-8887302141de> (06ad9ca8-f572-4235-b16f-8887302141de) [No such file or directory] >[2016-04-19 07:24:44.666404] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:06ad9ca8-f572-4235-b16f-8887302141de>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.669076] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 06ad9ca8-f572-4235-b16f-8887302141de. (Possible split-brain) >[2016-04-19 07:24:44.670107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:06ad9ca8-f572-4235-b16f-8887302141de> (06ad9ca8-f572-4235-b16f-8887302141de) [No such file or directory] >[2016-04-19 07:24:44.670116] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:06ad9ca8-f572-4235-b16f-8887302141de> (06ad9ca8-f572-4235-b16f-8887302141de) [No such file or directory] >[2016-04-19 07:24:44.673079] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:06ad9ca8-f572-4235-b16f-8887302141de> (06ad9ca8-f572-4235-b16f-8887302141de) [No such file or directory] >[2016-04-19 07:24:44.673435] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:06ad9ca8-f572-4235-b16f-8887302141de> (06ad9ca8-f572-4235-b16f-8887302141de) [No such file or directory] >[2016-04-19 07:24:44.673660] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:06ad9ca8-f572-4235-b16f-8887302141de>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.682911] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.683797] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8157be10-4d3a-402c-8c64-def963819104> (8157be10-4d3a-402c-8c64-def963819104) [No such file or directory] >[2016-04-19 07:24:44.684013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8157be10-4d3a-402c-8c64-def963819104> (8157be10-4d3a-402c-8c64-def963819104) [No such file or directory] >[2016-04-19 07:24:44.686779] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8157be10-4d3a-402c-8c64-def963819104. (Possible split-brain) >[2016-04-19 07:24:44.687574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8157be10-4d3a-402c-8c64-def963819104> (8157be10-4d3a-402c-8c64-def963819104) [No such file or directory] >[2016-04-19 07:24:44.687753] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8157be10-4d3a-402c-8c64-def963819104> (8157be10-4d3a-402c-8c64-def963819104) [No such file or directory] >[2016-04-19 07:24:44.688853] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8157be10-4d3a-402c-8c64-def963819104> (8157be10-4d3a-402c-8c64-def963819104) [No such file or directory] >[2016-04-19 07:24:44.689013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8157be10-4d3a-402c-8c64-def963819104> (8157be10-4d3a-402c-8c64-def963819104) [No such file or directory] >[2016-04-19 07:24:44.689132] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8157be10-4d3a-402c-8c64-def963819104>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.691913] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8157be10-4d3a-402c-8c64-def963819104. (Possible split-brain) >[2016-04-19 07:24:44.692851] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8157be10-4d3a-402c-8c64-def963819104> (8157be10-4d3a-402c-8c64-def963819104) [No such file or directory] >[2016-04-19 07:24:44.692873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8157be10-4d3a-402c-8c64-def963819104> (8157be10-4d3a-402c-8c64-def963819104) [No such file or directory] >[2016-04-19 07:24:44.695849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8157be10-4d3a-402c-8c64-def963819104> (8157be10-4d3a-402c-8c64-def963819104) [No such file or directory] >[2016-04-19 07:24:44.696133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8157be10-4d3a-402c-8c64-def963819104> (8157be10-4d3a-402c-8c64-def963819104) [No such file or directory] >[2016-04-19 07:24:44.696268] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8157be10-4d3a-402c-8c64-def963819104>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.704862] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.705540] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5> (5ac241b0-504a-4004-b4ef-c24c326f2ed5) [No such file or directory] >[2016-04-19 07:24:44.705856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5> (5ac241b0-504a-4004-b4ef-c24c326f2ed5) [No such file or directory] >[2016-04-19 07:24:44.708543] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5ac241b0-504a-4004-b4ef-c24c326f2ed5. (Possible split-brain) >[2016-04-19 07:24:44.709291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5> (5ac241b0-504a-4004-b4ef-c24c326f2ed5) [No such file or directory] >[2016-04-19 07:24:44.709624] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5> (5ac241b0-504a-4004-b4ef-c24c326f2ed5) [No such file or directory] >[2016-04-19 07:24:44.710821] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5> (5ac241b0-504a-4004-b4ef-c24c326f2ed5) [No such file or directory] >[2016-04-19 07:24:44.710990] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5> (5ac241b0-504a-4004-b4ef-c24c326f2ed5) [No such file or directory] >[2016-04-19 07:24:44.711127] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.713871] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5ac241b0-504a-4004-b4ef-c24c326f2ed5. (Possible split-brain) >[2016-04-19 07:24:44.714607] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5> (5ac241b0-504a-4004-b4ef-c24c326f2ed5) [No such file or directory] >[2016-04-19 07:24:44.715010] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5> (5ac241b0-504a-4004-b4ef-c24c326f2ed5) [No such file or directory] >[2016-04-19 07:24:44.717999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5> (5ac241b0-504a-4004-b4ef-c24c326f2ed5) [No such file or directory] >[2016-04-19 07:24:44.718521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5> (5ac241b0-504a-4004-b4ef-c24c326f2ed5) [No such file or directory] >[2016-04-19 07:24:44.718725] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5ac241b0-504a-4004-b4ef-c24c326f2ed5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.728648] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.729646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9> (fa292fbb-aa77-41c3-aa53-2176fd7cddc9) [No such file or directory] >[2016-04-19 07:24:44.729667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9> (fa292fbb-aa77-41c3-aa53-2176fd7cddc9) [No such file or directory] >[2016-04-19 07:24:44.730655] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fa292fbb-aa77-41c3-aa53-2176fd7cddc9. (Possible split-brain) >[2016-04-19 07:24:44.731699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9> (fa292fbb-aa77-41c3-aa53-2176fd7cddc9) [No such file or directory] >[2016-04-19 07:24:44.731718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9> (fa292fbb-aa77-41c3-aa53-2176fd7cddc9) [No such file or directory] >[2016-04-19 07:24:44.732670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9> (fa292fbb-aa77-41c3-aa53-2176fd7cddc9) [No such file or directory] >[2016-04-19 07:24:44.733073] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9> (fa292fbb-aa77-41c3-aa53-2176fd7cddc9) [No such file or directory] >[2016-04-19 07:24:44.733288] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.736068] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fa292fbb-aa77-41c3-aa53-2176fd7cddc9. (Possible split-brain) >[2016-04-19 07:24:44.736871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9> (fa292fbb-aa77-41c3-aa53-2176fd7cddc9) [No such file or directory] >[2016-04-19 07:24:44.737212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9> (fa292fbb-aa77-41c3-aa53-2176fd7cddc9) [No such file or directory] >[2016-04-19 07:24:44.739950] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9> (fa292fbb-aa77-41c3-aa53-2176fd7cddc9) [No such file or directory] >[2016-04-19 07:24:44.740210] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9> (fa292fbb-aa77-41c3-aa53-2176fd7cddc9) [No such file or directory] >[2016-04-19 07:24:44.740643] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fa292fbb-aa77-41c3-aa53-2176fd7cddc9>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.749124] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.750080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff> (35a0dea2-c152-4b5d-862d-13ebbd7921ff) [No such file or directory] >[2016-04-19 07:24:44.750113] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff> (35a0dea2-c152-4b5d-862d-13ebbd7921ff) [No such file or directory] >[2016-04-19 07:24:44.750999] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 35a0dea2-c152-4b5d-862d-13ebbd7921ff. (Possible split-brain) >[2016-04-19 07:24:44.751757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff> (35a0dea2-c152-4b5d-862d-13ebbd7921ff) [No such file or directory] >[2016-04-19 07:24:44.752066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff> (35a0dea2-c152-4b5d-862d-13ebbd7921ff) [No such file or directory] >[2016-04-19 07:24:44.753370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff> (35a0dea2-c152-4b5d-862d-13ebbd7921ff) [No such file or directory] >[2016-04-19 07:24:44.753393] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff> (35a0dea2-c152-4b5d-862d-13ebbd7921ff) [No such file or directory] >[2016-04-19 07:24:44.753544] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.756301] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 35a0dea2-c152-4b5d-862d-13ebbd7921ff. (Possible split-brain) >[2016-04-19 07:24:44.757148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff> (35a0dea2-c152-4b5d-862d-13ebbd7921ff) [No such file or directory] >[2016-04-19 07:24:44.757446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff> (35a0dea2-c152-4b5d-862d-13ebbd7921ff) [No such file or directory] >[2016-04-19 07:24:44.760186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff> (35a0dea2-c152-4b5d-862d-13ebbd7921ff) [No such file or directory] >[2016-04-19 07:24:44.760274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff> (35a0dea2-c152-4b5d-862d-13ebbd7921ff) [No such file or directory] >[2016-04-19 07:24:44.760514] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:35a0dea2-c152-4b5d-862d-13ebbd7921ff>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.770062] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.770882] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5> (0e8ccb3f-dddd-413e-b71e-78765930f1e5) [No such file or directory] >[2016-04-19 07:24:44.771167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5> (0e8ccb3f-dddd-413e-b71e-78765930f1e5) [No such file or directory] >[2016-04-19 07:24:44.774004] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0e8ccb3f-dddd-413e-b71e-78765930f1e5. (Possible split-brain) >[2016-04-19 07:24:44.774787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5> (0e8ccb3f-dddd-413e-b71e-78765930f1e5) [No such file or directory] >[2016-04-19 07:24:44.775086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5> (0e8ccb3f-dddd-413e-b71e-78765930f1e5) [No such file or directory] >[2016-04-19 07:24:44.776255] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5> (0e8ccb3f-dddd-413e-b71e-78765930f1e5) [No such file or directory] >[2016-04-19 07:24:44.776797] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5> (0e8ccb3f-dddd-413e-b71e-78765930f1e5) [No such file or directory] >[2016-04-19 07:24:44.776925] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.779639] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0e8ccb3f-dddd-413e-b71e-78765930f1e5. (Possible split-brain) >[2016-04-19 07:24:44.780439] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5> (0e8ccb3f-dddd-413e-b71e-78765930f1e5) [No such file or directory] >[2016-04-19 07:24:44.780940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5> (0e8ccb3f-dddd-413e-b71e-78765930f1e5) [No such file or directory] >[2016-04-19 07:24:44.783503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5> (0e8ccb3f-dddd-413e-b71e-78765930f1e5) [No such file or directory] >[2016-04-19 07:24:44.783674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5> (0e8ccb3f-dddd-413e-b71e-78765930f1e5) [No such file or directory] >[2016-04-19 07:24:44.784127] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0e8ccb3f-dddd-413e-b71e-78765930f1e5>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.793016] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.793900] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7> (235095ae-b45b-42e6-9f3a-ab91f4c795c7) [No such file or directory] >[2016-04-19 07:24:44.794274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7> (235095ae-b45b-42e6-9f3a-ab91f4c795c7) [No such file or directory] >[2016-04-19 07:24:44.795145] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 235095ae-b45b-42e6-9f3a-ab91f4c795c7. (Possible split-brain) >[2016-04-19 07:24:44.796310] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7> (235095ae-b45b-42e6-9f3a-ab91f4c795c7) [No such file or directory] >[2016-04-19 07:24:44.796361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7> (235095ae-b45b-42e6-9f3a-ab91f4c795c7) [No such file or directory] >[2016-04-19 07:24:44.797464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7> (235095ae-b45b-42e6-9f3a-ab91f4c795c7) [No such file or directory] >[2016-04-19 07:24:44.797770] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7> (235095ae-b45b-42e6-9f3a-ab91f4c795c7) [No such file or directory] >[2016-04-19 07:24:44.797903] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.800629] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 235095ae-b45b-42e6-9f3a-ab91f4c795c7. (Possible split-brain) >[2016-04-19 07:24:44.801650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7> (235095ae-b45b-42e6-9f3a-ab91f4c795c7) [No such file or directory] >[2016-04-19 07:24:44.801991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7> (235095ae-b45b-42e6-9f3a-ab91f4c795c7) [No such file or directory] >[2016-04-19 07:24:44.804548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7> (235095ae-b45b-42e6-9f3a-ab91f4c795c7) [No such file or directory] >[2016-04-19 07:24:44.804943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7> (235095ae-b45b-42e6-9f3a-ab91f4c795c7) [No such file or directory] >[2016-04-19 07:24:44.805084] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:235095ae-b45b-42e6-9f3a-ab91f4c795c7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.814743] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.815605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64> (b209af3a-49c2-43ff-9639-8001c9689e64) [No such file or directory] >[2016-04-19 07:24:44.815849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64> (b209af3a-49c2-43ff-9639-8001c9689e64) [No such file or directory] >[2016-04-19 07:24:44.818525] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b209af3a-49c2-43ff-9639-8001c9689e64. (Possible split-brain) >[2016-04-19 07:24:44.819397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64> (b209af3a-49c2-43ff-9639-8001c9689e64) [No such file or directory] >[2016-04-19 07:24:44.819745] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64> (b209af3a-49c2-43ff-9639-8001c9689e64) [No such file or directory] >[2016-04-19 07:24:44.820895] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64> (b209af3a-49c2-43ff-9639-8001c9689e64) [No such file or directory] >[2016-04-19 07:24:44.821082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64> (b209af3a-49c2-43ff-9639-8001c9689e64) [No such file or directory] >[2016-04-19 07:24:44.821202] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.823960] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b209af3a-49c2-43ff-9639-8001c9689e64. (Possible split-brain) >[2016-04-19 07:24:44.825056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64> (b209af3a-49c2-43ff-9639-8001c9689e64) [No such file or directory] >[2016-04-19 07:24:44.825132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64> (b209af3a-49c2-43ff-9639-8001c9689e64) [No such file or directory] >[2016-04-19 07:24:44.827707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64> (b209af3a-49c2-43ff-9639-8001c9689e64) [No such file or directory] >[2016-04-19 07:24:44.827765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64> (b209af3a-49c2-43ff-9639-8001c9689e64) [No such file or directory] >[2016-04-19 07:24:44.827939] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b209af3a-49c2-43ff-9639-8001c9689e64>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.837016] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.837874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2> (410e4880-3da9-43e0-ae5a-033b315f33c2) [No such file or directory] >[2016-04-19 07:24:44.837897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2> (410e4880-3da9-43e0-ae5a-033b315f33c2) [No such file or directory] >[2016-04-19 07:24:44.838772] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 410e4880-3da9-43e0-ae5a-033b315f33c2. (Possible split-brain) >[2016-04-19 07:24:44.839717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2> (410e4880-3da9-43e0-ae5a-033b315f33c2) [No such file or directory] >[2016-04-19 07:24:44.839744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2> (410e4880-3da9-43e0-ae5a-033b315f33c2) [No such file or directory] >[2016-04-19 07:24:44.840988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2> (410e4880-3da9-43e0-ae5a-033b315f33c2) [No such file or directory] >[2016-04-19 07:24:44.841223] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2> (410e4880-3da9-43e0-ae5a-033b315f33c2) [No such file or directory] >[2016-04-19 07:24:44.841432] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.844165] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 410e4880-3da9-43e0-ae5a-033b315f33c2. (Possible split-brain) >[2016-04-19 07:24:44.845213] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2> (410e4880-3da9-43e0-ae5a-033b315f33c2) [No such file or directory] >[2016-04-19 07:24:44.845616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2> (410e4880-3da9-43e0-ae5a-033b315f33c2) [No such file or directory] >[2016-04-19 07:24:44.848778] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2> (410e4880-3da9-43e0-ae5a-033b315f33c2) [No such file or directory] >[2016-04-19 07:24:44.849026] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2> (410e4880-3da9-43e0-ae5a-033b315f33c2) [No such file or directory] >[2016-04-19 07:24:44.849482] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:410e4880-3da9-43e0-ae5a-033b315f33c2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.859969] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.860883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b> (dde88e56-5ec5-4f3a-af0e-0a77464eac9b) [No such file or directory] >[2016-04-19 07:24:44.861161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b> (dde88e56-5ec5-4f3a-af0e-0a77464eac9b) [No such file or directory] >[2016-04-19 07:24:44.863931] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dde88e56-5ec5-4f3a-af0e-0a77464eac9b. (Possible split-brain) >[2016-04-19 07:24:44.864943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b> (dde88e56-5ec5-4f3a-af0e-0a77464eac9b) [No such file or directory] >[2016-04-19 07:24:44.865195] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b> (dde88e56-5ec5-4f3a-af0e-0a77464eac9b) [No such file or directory] >[2016-04-19 07:24:44.866278] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b> (dde88e56-5ec5-4f3a-af0e-0a77464eac9b) [No such file or directory] >[2016-04-19 07:24:44.866289] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b> (dde88e56-5ec5-4f3a-af0e-0a77464eac9b) [No such file or directory] >[2016-04-19 07:24:44.866696] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.869804] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dde88e56-5ec5-4f3a-af0e-0a77464eac9b. (Possible split-brain) >[2016-04-19 07:24:44.871260] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b> (dde88e56-5ec5-4f3a-af0e-0a77464eac9b) [No such file or directory] >[2016-04-19 07:24:44.871300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b> (dde88e56-5ec5-4f3a-af0e-0a77464eac9b) [No such file or directory] >[2016-04-19 07:24:44.874596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b> (dde88e56-5ec5-4f3a-af0e-0a77464eac9b) [No such file or directory] >[2016-04-19 07:24:44.874646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b> (dde88e56-5ec5-4f3a-af0e-0a77464eac9b) [No such file or directory] >[2016-04-19 07:24:44.874973] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:dde88e56-5ec5-4f3a-af0e-0a77464eac9b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.885373] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.886478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f> (7d5f766b-6080-40bd-8657-3c17e86a315f) [No such file or directory] >[2016-04-19 07:24:44.886815] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f> (7d5f766b-6080-40bd-8657-3c17e86a315f) [No such file or directory] >[2016-04-19 07:24:44.887921] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7d5f766b-6080-40bd-8657-3c17e86a315f. (Possible split-brain) >[2016-04-19 07:24:44.889261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f> (7d5f766b-6080-40bd-8657-3c17e86a315f) [No such file or directory] >[2016-04-19 07:24:44.889380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f> (7d5f766b-6080-40bd-8657-3c17e86a315f) [No such file or directory] >[2016-04-19 07:24:44.890757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f> (7d5f766b-6080-40bd-8657-3c17e86a315f) [No such file or directory] >[2016-04-19 07:24:44.890868] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f> (7d5f766b-6080-40bd-8657-3c17e86a315f) [No such file or directory] >[2016-04-19 07:24:44.891023] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.893751] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7d5f766b-6080-40bd-8657-3c17e86a315f. (Possible split-brain) >[2016-04-19 07:24:44.895161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f> (7d5f766b-6080-40bd-8657-3c17e86a315f) [No such file or directory] >[2016-04-19 07:24:44.895248] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f> (7d5f766b-6080-40bd-8657-3c17e86a315f) [No such file or directory] >[2016-04-19 07:24:44.897929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f> (7d5f766b-6080-40bd-8657-3c17e86a315f) [No such file or directory] >[2016-04-19 07:24:44.898401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f> (7d5f766b-6080-40bd-8657-3c17e86a315f) [No such file or directory] >[2016-04-19 07:24:44.898621] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7d5f766b-6080-40bd-8657-3c17e86a315f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.908229] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.909011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2> (c91d215d-f55c-43cb-a754-3a1813b9f1c2) [No such file or directory] >[2016-04-19 07:24:44.909298] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2> (c91d215d-f55c-43cb-a754-3a1813b9f1c2) [No such file or directory] >[2016-04-19 07:24:44.912071] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c91d215d-f55c-43cb-a754-3a1813b9f1c2. (Possible split-brain) >[2016-04-19 07:24:44.913089] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2> (c91d215d-f55c-43cb-a754-3a1813b9f1c2) [No such file or directory] >[2016-04-19 07:24:44.913098] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2> (c91d215d-f55c-43cb-a754-3a1813b9f1c2) [No such file or directory] >[2016-04-19 07:24:44.914844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2> (c91d215d-f55c-43cb-a754-3a1813b9f1c2) [No such file or directory] >[2016-04-19 07:24:44.914881] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2> (c91d215d-f55c-43cb-a754-3a1813b9f1c2) [No such file or directory] >[2016-04-19 07:24:44.915055] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.917908] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c91d215d-f55c-43cb-a754-3a1813b9f1c2. (Possible split-brain) >[2016-04-19 07:24:44.919082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2> (c91d215d-f55c-43cb-a754-3a1813b9f1c2) [No such file or directory] >[2016-04-19 07:24:44.919102] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2> (c91d215d-f55c-43cb-a754-3a1813b9f1c2) [No such file or directory] >[2016-04-19 07:24:44.922557] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2> (c91d215d-f55c-43cb-a754-3a1813b9f1c2) [No such file or directory] >[2016-04-19 07:24:44.922818] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2> (c91d215d-f55c-43cb-a754-3a1813b9f1c2) [No such file or directory] >[2016-04-19 07:24:44.922991] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c91d215d-f55c-43cb-a754-3a1813b9f1c2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:44.932577] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.933499] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28> (32c9c234-1540-43df-a4b9-c653c0ca9c28) [No such file or directory] >[2016-04-19 07:24:44.933641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28> (32c9c234-1540-43df-a4b9-c653c0ca9c28) [No such file or directory] >[2016-04-19 07:24:44.934753] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 32c9c234-1540-43df-a4b9-c653c0ca9c28. (Possible split-brain) >[2016-04-19 07:24:44.935833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28> (32c9c234-1540-43df-a4b9-c653c0ca9c28) [No such file or directory] >[2016-04-19 07:24:44.936160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28> (32c9c234-1540-43df-a4b9-c653c0ca9c28) [No such file or directory] >[2016-04-19 07:24:44.937546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28> (32c9c234-1540-43df-a4b9-c653c0ca9c28) [No such file or directory] >[2016-04-19 07:24:44.937589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28> (32c9c234-1540-43df-a4b9-c653c0ca9c28) [No such file or directory] >[2016-04-19 07:24:44.937763] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:44.940504] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 32c9c234-1540-43df-a4b9-c653c0ca9c28. (Possible split-brain) >[2016-04-19 07:24:44.941833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28> (32c9c234-1540-43df-a4b9-c653c0ca9c28) [No such file or directory] >[2016-04-19 07:24:44.941965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28> (32c9c234-1540-43df-a4b9-c653c0ca9c28) [No such file or directory] >[2016-04-19 07:24:44.944898] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28> (32c9c234-1540-43df-a4b9-c653c0ca9c28) [No such file or directory] >[2016-04-19 07:24:44.944994] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28> (32c9c234-1540-43df-a4b9-c653c0ca9c28) [No such file or directory] >[2016-04-19 07:24:44.945237] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:32c9c234-1540-43df-a4b9-c653c0ca9c28>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.954854] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.955661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f8847671-2393-4245-bd6d-a26ab821db43> (f8847671-2393-4245-bd6d-a26ab821db43) [No such file or directory] >[2016-04-19 07:24:44.955938] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f8847671-2393-4245-bd6d-a26ab821db43> (f8847671-2393-4245-bd6d-a26ab821db43) [No such file or directory] >[2016-04-19 07:24:44.958749] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f8847671-2393-4245-bd6d-a26ab821db43. (Possible split-brain) >[2016-04-19 07:24:44.959588] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f8847671-2393-4245-bd6d-a26ab821db43> (f8847671-2393-4245-bd6d-a26ab821db43) [No such file or directory] >[2016-04-19 07:24:44.959938] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f8847671-2393-4245-bd6d-a26ab821db43> (f8847671-2393-4245-bd6d-a26ab821db43) [No such file or directory] >[2016-04-19 07:24:44.961252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f8847671-2393-4245-bd6d-a26ab821db43> (f8847671-2393-4245-bd6d-a26ab821db43) [No such file or directory] >[2016-04-19 07:24:44.961296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f8847671-2393-4245-bd6d-a26ab821db43> (f8847671-2393-4245-bd6d-a26ab821db43) [No such file or directory] >[2016-04-19 07:24:44.961897] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f8847671-2393-4245-bd6d-a26ab821db43>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.964708] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f8847671-2393-4245-bd6d-a26ab821db43. (Possible split-brain) >[2016-04-19 07:24:44.965781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f8847671-2393-4245-bd6d-a26ab821db43> (f8847671-2393-4245-bd6d-a26ab821db43) [No such file or directory] >[2016-04-19 07:24:44.966115] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f8847671-2393-4245-bd6d-a26ab821db43> (f8847671-2393-4245-bd6d-a26ab821db43) [No such file or directory] >[2016-04-19 07:24:44.968867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f8847671-2393-4245-bd6d-a26ab821db43> (f8847671-2393-4245-bd6d-a26ab821db43) [No such file or directory] >[2016-04-19 07:24:44.969007] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f8847671-2393-4245-bd6d-a26ab821db43> (f8847671-2393-4245-bd6d-a26ab821db43) [No such file or directory] >[2016-04-19 07:24:44.969294] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f8847671-2393-4245-bd6d-a26ab821db43>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:44.978727] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:44.979721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b> (eef75827-fb1b-4527-bac6-2949b39d193b) [No such file or directory] >[2016-04-19 07:24:44.979820] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b> (eef75827-fb1b-4527-bac6-2949b39d193b) [No such file or directory] >[2016-04-19 07:24:44.982476] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid eef75827-fb1b-4527-bac6-2949b39d193b. (Possible split-brain) >[2016-04-19 07:24:44.983269] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b> (eef75827-fb1b-4527-bac6-2949b39d193b) [No such file or directory] >[2016-04-19 07:24:44.983538] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b> (eef75827-fb1b-4527-bac6-2949b39d193b) [No such file or directory] >[2016-04-19 07:24:44.984663] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b> (eef75827-fb1b-4527-bac6-2949b39d193b) [No such file or directory] >[2016-04-19 07:24:44.984771] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b> (eef75827-fb1b-4527-bac6-2949b39d193b) [No such file or directory] >[2016-04-19 07:24:44.985153] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:44.987895] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid eef75827-fb1b-4527-bac6-2949b39d193b. (Possible split-brain) >[2016-04-19 07:24:44.988954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b> (eef75827-fb1b-4527-bac6-2949b39d193b) [No such file or directory] >[2016-04-19 07:24:44.988980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b> (eef75827-fb1b-4527-bac6-2949b39d193b) [No such file or directory] >[2016-04-19 07:24:44.991563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b> (eef75827-fb1b-4527-bac6-2949b39d193b) [No such file or directory] >[2016-04-19 07:24:44.991674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b> (eef75827-fb1b-4527-bac6-2949b39d193b) [No such file or directory] >[2016-04-19 07:24:44.992170] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:eef75827-fb1b-4527-bac6-2949b39d193b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.002079] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.003034] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c> (f3bf6d06-da4f-4c3a-a36c-797b40476e3c) [No such file or directory] >[2016-04-19 07:24:45.003056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c> (f3bf6d06-da4f-4c3a-a36c-797b40476e3c) [No such file or directory] >[2016-04-19 07:24:45.005666] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f3bf6d06-da4f-4c3a-a36c-797b40476e3c. (Possible split-brain) >[2016-04-19 07:24:45.006515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c> (f3bf6d06-da4f-4c3a-a36c-797b40476e3c) [No such file or directory] >[2016-04-19 07:24:45.006769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c> (f3bf6d06-da4f-4c3a-a36c-797b40476e3c) [No such file or directory] >[2016-04-19 07:24:45.007862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c> (f3bf6d06-da4f-4c3a-a36c-797b40476e3c) [No such file or directory] >[2016-04-19 07:24:45.008243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c> (f3bf6d06-da4f-4c3a-a36c-797b40476e3c) [No such file or directory] >[2016-04-19 07:24:45.008689] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.011429] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f3bf6d06-da4f-4c3a-a36c-797b40476e3c. (Possible split-brain) >[2016-04-19 07:24:45.012432] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c> (f3bf6d06-da4f-4c3a-a36c-797b40476e3c) [No such file or directory] >[2016-04-19 07:24:45.012756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c> (f3bf6d06-da4f-4c3a-a36c-797b40476e3c) [No such file or directory] >[2016-04-19 07:24:45.016422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c> (f3bf6d06-da4f-4c3a-a36c-797b40476e3c) [No such file or directory] >[2016-04-19 07:24:45.016543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c> (f3bf6d06-da4f-4c3a-a36c-797b40476e3c) [No such file or directory] >[2016-04-19 07:24:45.017232] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f3bf6d06-da4f-4c3a-a36c-797b40476e3c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.025950] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.026793] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca> (f718ee69-9cef-47cf-bc85-efe76b65c4ca) [No such file or directory] >[2016-04-19 07:24:45.026884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca> (f718ee69-9cef-47cf-bc85-efe76b65c4ca) [No such file or directory] >[2016-04-19 07:24:45.029551] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f718ee69-9cef-47cf-bc85-efe76b65c4ca. (Possible split-brain) >[2016-04-19 07:24:45.030461] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca> (f718ee69-9cef-47cf-bc85-efe76b65c4ca) [No such file or directory] >[2016-04-19 07:24:45.030669] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca> (f718ee69-9cef-47cf-bc85-efe76b65c4ca) [No such file or directory] >[2016-04-19 07:24:45.031861] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca> (f718ee69-9cef-47cf-bc85-efe76b65c4ca) [No such file or directory] >[2016-04-19 07:24:45.031940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca> (f718ee69-9cef-47cf-bc85-efe76b65c4ca) [No such file or directory] >[2016-04-19 07:24:45.032539] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.035291] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f718ee69-9cef-47cf-bc85-efe76b65c4ca. (Possible split-brain) >[2016-04-19 07:24:45.036412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca> (f718ee69-9cef-47cf-bc85-efe76b65c4ca) [No such file or directory] >[2016-04-19 07:24:45.036512] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca> (f718ee69-9cef-47cf-bc85-efe76b65c4ca) [No such file or directory] >[2016-04-19 07:24:45.040201] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca> (f718ee69-9cef-47cf-bc85-efe76b65c4ca) [No such file or directory] >[2016-04-19 07:24:45.040300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca> (f718ee69-9cef-47cf-bc85-efe76b65c4ca) [No such file or directory] >[2016-04-19 07:24:45.040934] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f718ee69-9cef-47cf-bc85-efe76b65c4ca>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.049807] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.050524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d> (fbf4177d-3703-481f-861f-5481eaf21a5d) [No such file or directory] >[2016-04-19 07:24:45.050856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d> (fbf4177d-3703-481f-861f-5481eaf21a5d) [No such file or directory] >[2016-04-19 07:24:45.053534] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fbf4177d-3703-481f-861f-5481eaf21a5d. (Possible split-brain) >[2016-04-19 07:24:45.054279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d> (fbf4177d-3703-481f-861f-5481eaf21a5d) [No such file or directory] >[2016-04-19 07:24:45.054512] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d> (fbf4177d-3703-481f-861f-5481eaf21a5d) [No such file or directory] >[2016-04-19 07:24:45.055756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d> (fbf4177d-3703-481f-861f-5481eaf21a5d) [No such file or directory] >[2016-04-19 07:24:45.056019] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d> (fbf4177d-3703-481f-861f-5481eaf21a5d) [No such file or directory] >[2016-04-19 07:24:45.056363] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.059104] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fbf4177d-3703-481f-861f-5481eaf21a5d. (Possible split-brain) >[2016-04-19 07:24:45.059923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d> (fbf4177d-3703-481f-861f-5481eaf21a5d) [No such file or directory] >[2016-04-19 07:24:45.060265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d> (fbf4177d-3703-481f-861f-5481eaf21a5d) [No such file or directory] >[2016-04-19 07:24:45.062473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d> (fbf4177d-3703-481f-861f-5481eaf21a5d) [No such file or directory] >[2016-04-19 07:24:45.062601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d> (fbf4177d-3703-481f-861f-5481eaf21a5d) [No such file or directory] >[2016-04-19 07:24:45.062664] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fbf4177d-3703-481f-861f-5481eaf21a5d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.069510] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.070383] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:168addec-1ab8-4721-9707-1908750fa3a2> (168addec-1ab8-4721-9707-1908750fa3a2) [No such file or directory] >[2016-04-19 07:24:45.070685] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:168addec-1ab8-4721-9707-1908750fa3a2> (168addec-1ab8-4721-9707-1908750fa3a2) [No such file or directory] >[2016-04-19 07:24:45.073258] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 168addec-1ab8-4721-9707-1908750fa3a2. (Possible split-brain) >[2016-04-19 07:24:45.074259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:168addec-1ab8-4721-9707-1908750fa3a2> (168addec-1ab8-4721-9707-1908750fa3a2) [No such file or directory] >[2016-04-19 07:24:45.074393] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:168addec-1ab8-4721-9707-1908750fa3a2> (168addec-1ab8-4721-9707-1908750fa3a2) [No such file or directory] >[2016-04-19 07:24:45.075509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:168addec-1ab8-4721-9707-1908750fa3a2> (168addec-1ab8-4721-9707-1908750fa3a2) [No such file or directory] >[2016-04-19 07:24:45.075747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:168addec-1ab8-4721-9707-1908750fa3a2> (168addec-1ab8-4721-9707-1908750fa3a2) [No such file or directory] >[2016-04-19 07:24:45.076110] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:168addec-1ab8-4721-9707-1908750fa3a2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.078845] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 168addec-1ab8-4721-9707-1908750fa3a2. (Possible split-brain) >[2016-04-19 07:24:45.079819] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:168addec-1ab8-4721-9707-1908750fa3a2> (168addec-1ab8-4721-9707-1908750fa3a2) [No such file or directory] >[2016-04-19 07:24:45.079976] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:168addec-1ab8-4721-9707-1908750fa3a2> (168addec-1ab8-4721-9707-1908750fa3a2) [No such file or directory] >[2016-04-19 07:24:45.083564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:168addec-1ab8-4721-9707-1908750fa3a2> (168addec-1ab8-4721-9707-1908750fa3a2) [No such file or directory] >[2016-04-19 07:24:45.084052] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:168addec-1ab8-4721-9707-1908750fa3a2> (168addec-1ab8-4721-9707-1908750fa3a2) [No such file or directory] >[2016-04-19 07:24:45.084542] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:168addec-1ab8-4721-9707-1908750fa3a2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.094406] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.095415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a8966528-9474-46f0-aff3-02636a394373> (a8966528-9474-46f0-aff3-02636a394373) [No such file or directory] >[2016-04-19 07:24:45.095416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a8966528-9474-46f0-aff3-02636a394373> (a8966528-9474-46f0-aff3-02636a394373) [No such file or directory] >[2016-04-19 07:24:45.096622] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a8966528-9474-46f0-aff3-02636a394373. (Possible split-brain) >[2016-04-19 07:24:45.097518] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a8966528-9474-46f0-aff3-02636a394373> (a8966528-9474-46f0-aff3-02636a394373) [No such file or directory] >[2016-04-19 07:24:45.097665] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a8966528-9474-46f0-aff3-02636a394373> (a8966528-9474-46f0-aff3-02636a394373) [No such file or directory] >[2016-04-19 07:24:45.098715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a8966528-9474-46f0-aff3-02636a394373> (a8966528-9474-46f0-aff3-02636a394373) [No such file or directory] >[2016-04-19 07:24:45.098827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a8966528-9474-46f0-aff3-02636a394373> (a8966528-9474-46f0-aff3-02636a394373) [No such file or directory] >[2016-04-19 07:24:45.099365] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a8966528-9474-46f0-aff3-02636a394373>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.102072] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a8966528-9474-46f0-aff3-02636a394373. (Possible split-brain) >[2016-04-19 07:24:45.103057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a8966528-9474-46f0-aff3-02636a394373> (a8966528-9474-46f0-aff3-02636a394373) [No such file or directory] >[2016-04-19 07:24:45.103259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a8966528-9474-46f0-aff3-02636a394373> (a8966528-9474-46f0-aff3-02636a394373) [No such file or directory] >[2016-04-19 07:24:45.106992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a8966528-9474-46f0-aff3-02636a394373> (a8966528-9474-46f0-aff3-02636a394373) [No such file or directory] >[2016-04-19 07:24:45.107021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a8966528-9474-46f0-aff3-02636a394373> (a8966528-9474-46f0-aff3-02636a394373) [No such file or directory] >[2016-04-19 07:24:45.107632] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a8966528-9474-46f0-aff3-02636a394373>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.115570] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.116279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516> (d52bd6bd-a78b-47d9-9b8a-f5266a8c1516) [No such file or directory] >[2016-04-19 07:24:45.116609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516> (d52bd6bd-a78b-47d9-9b8a-f5266a8c1516) [No such file or directory] >[2016-04-19 07:24:45.119226] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d52bd6bd-a78b-47d9-9b8a-f5266a8c1516. (Possible split-brain) >[2016-04-19 07:24:45.120009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516> (d52bd6bd-a78b-47d9-9b8a-f5266a8c1516) [No such file or directory] >[2016-04-19 07:24:45.120389] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516> (d52bd6bd-a78b-47d9-9b8a-f5266a8c1516) [No such file or directory] >[2016-04-19 07:24:45.121757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516> (d52bd6bd-a78b-47d9-9b8a-f5266a8c1516) [No such file or directory] >[2016-04-19 07:24:45.121861] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516> (d52bd6bd-a78b-47d9-9b8a-f5266a8c1516) [No such file or directory] >[2016-04-19 07:24:45.122042] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.124762] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d52bd6bd-a78b-47d9-9b8a-f5266a8c1516. (Possible split-brain) >[2016-04-19 07:24:45.125577] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516> (d52bd6bd-a78b-47d9-9b8a-f5266a8c1516) [No such file or directory] >[2016-04-19 07:24:45.125739] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516> (d52bd6bd-a78b-47d9-9b8a-f5266a8c1516) [No such file or directory] >[2016-04-19 07:24:45.129931] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516> (d52bd6bd-a78b-47d9-9b8a-f5266a8c1516) [No such file or directory] >[2016-04-19 07:24:45.130026] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516> (d52bd6bd-a78b-47d9-9b8a-f5266a8c1516) [No such file or directory] >[2016-04-19 07:24:45.130387] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d52bd6bd-a78b-47d9-9b8a-f5266a8c1516>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.140680] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.141463] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d> (bbc22484-515a-4dc8-bc5c-e52c7594988d) [No such file or directory] >[2016-04-19 07:24:45.141764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d> (bbc22484-515a-4dc8-bc5c-e52c7594988d) [No such file or directory] >[2016-04-19 07:24:45.144409] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bbc22484-515a-4dc8-bc5c-e52c7594988d. (Possible split-brain) >[2016-04-19 07:24:45.145389] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d> (bbc22484-515a-4dc8-bc5c-e52c7594988d) [No such file or directory] >[2016-04-19 07:24:45.145691] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d> (bbc22484-515a-4dc8-bc5c-e52c7594988d) [No such file or directory] >[2016-04-19 07:24:45.146567] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d> (bbc22484-515a-4dc8-bc5c-e52c7594988d) [No such file or directory] >[2016-04-19 07:24:45.147023] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d> (bbc22484-515a-4dc8-bc5c-e52c7594988d) [No such file or directory] >[2016-04-19 07:24:45.147543] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.150267] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bbc22484-515a-4dc8-bc5c-e52c7594988d. (Possible split-brain) >[2016-04-19 07:24:45.151222] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d> (bbc22484-515a-4dc8-bc5c-e52c7594988d) [No such file or directory] >[2016-04-19 07:24:45.151380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d> (bbc22484-515a-4dc8-bc5c-e52c7594988d) [No such file or directory] >[2016-04-19 07:24:45.154954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d> (bbc22484-515a-4dc8-bc5c-e52c7594988d) [No such file or directory] >[2016-04-19 07:24:45.155037] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d> (bbc22484-515a-4dc8-bc5c-e52c7594988d) [No such file or directory] >[2016-04-19 07:24:45.155666] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bbc22484-515a-4dc8-bc5c-e52c7594988d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.164044] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.164971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c38bfb5-1514-4305-b605-4879691afcae> (5c38bfb5-1514-4305-b605-4879691afcae) [No such file or directory] >[2016-04-19 07:24:45.164992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c38bfb5-1514-4305-b605-4879691afcae> (5c38bfb5-1514-4305-b605-4879691afcae) [No such file or directory] >[2016-04-19 07:24:45.167802] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5c38bfb5-1514-4305-b605-4879691afcae. (Possible split-brain) >[2016-04-19 07:24:45.168708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c38bfb5-1514-4305-b605-4879691afcae> (5c38bfb5-1514-4305-b605-4879691afcae) [No such file or directory] >[2016-04-19 07:24:45.168898] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c38bfb5-1514-4305-b605-4879691afcae> (5c38bfb5-1514-4305-b605-4879691afcae) [No such file or directory] >[2016-04-19 07:24:45.170115] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c38bfb5-1514-4305-b605-4879691afcae> (5c38bfb5-1514-4305-b605-4879691afcae) [No such file or directory] >[2016-04-19 07:24:45.170162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c38bfb5-1514-4305-b605-4879691afcae> (5c38bfb5-1514-4305-b605-4879691afcae) [No such file or directory] >[2016-04-19 07:24:45.170592] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5c38bfb5-1514-4305-b605-4879691afcae>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.173294] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5c38bfb5-1514-4305-b605-4879691afcae. (Possible split-brain) >[2016-04-19 07:24:45.174354] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c38bfb5-1514-4305-b605-4879691afcae> (5c38bfb5-1514-4305-b605-4879691afcae) [No such file or directory] >[2016-04-19 07:24:45.174464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c38bfb5-1514-4305-b605-4879691afcae> (5c38bfb5-1514-4305-b605-4879691afcae) [No such file or directory] >[2016-04-19 07:24:45.177899] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c38bfb5-1514-4305-b605-4879691afcae> (5c38bfb5-1514-4305-b605-4879691afcae) [No such file or directory] >[2016-04-19 07:24:45.178340] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c38bfb5-1514-4305-b605-4879691afcae> (5c38bfb5-1514-4305-b605-4879691afcae) [No such file or directory] >[2016-04-19 07:24:45.178868] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5c38bfb5-1514-4305-b605-4879691afcae>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.188705] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.189580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be> (6cd133ad-71e5-4d95-a7f1-d2dbed2f86be) [No such file or directory] >[2016-04-19 07:24:45.189765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be> (6cd133ad-71e5-4d95-a7f1-d2dbed2f86be) [No such file or directory] >[2016-04-19 07:24:45.192588] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6cd133ad-71e5-4d95-a7f1-d2dbed2f86be. (Possible split-brain) >[2016-04-19 07:24:45.193494] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be> (6cd133ad-71e5-4d95-a7f1-d2dbed2f86be) [No such file or directory] >[2016-04-19 07:24:45.193680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be> (6cd133ad-71e5-4d95-a7f1-d2dbed2f86be) [No such file or directory] >[2016-04-19 07:24:45.194551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be> (6cd133ad-71e5-4d95-a7f1-d2dbed2f86be) [No such file or directory] >[2016-04-19 07:24:45.194905] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be> (6cd133ad-71e5-4d95-a7f1-d2dbed2f86be) [No such file or directory] >[2016-04-19 07:24:45.195555] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.198309] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6cd133ad-71e5-4d95-a7f1-d2dbed2f86be. (Possible split-brain) >[2016-04-19 07:24:45.199681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be> (6cd133ad-71e5-4d95-a7f1-d2dbed2f86be) [No such file or directory] >[2016-04-19 07:24:45.199653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be> (6cd133ad-71e5-4d95-a7f1-d2dbed2f86be) [No such file or directory] >[2016-04-19 07:24:45.203755] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be> (6cd133ad-71e5-4d95-a7f1-d2dbed2f86be) [No such file or directory] >[2016-04-19 07:24:45.203851] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be> (6cd133ad-71e5-4d95-a7f1-d2dbed2f86be) [No such file or directory] >[2016-04-19 07:24:45.204551] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6cd133ad-71e5-4d95-a7f1-d2dbed2f86be>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.213371] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.214425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b> (90b5de89-b0fe-4b8c-a149-be609741102b) [No such file or directory] >[2016-04-19 07:24:45.214524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b> (90b5de89-b0fe-4b8c-a149-be609741102b) [No such file or directory] >[2016-04-19 07:24:45.215589] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 90b5de89-b0fe-4b8c-a149-be609741102b. (Possible split-brain) >[2016-04-19 07:24:45.216554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b> (90b5de89-b0fe-4b8c-a149-be609741102b) [No such file or directory] >[2016-04-19 07:24:45.216562] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b> (90b5de89-b0fe-4b8c-a149-be609741102b) [No such file or directory] >[2016-04-19 07:24:45.217740] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b> (90b5de89-b0fe-4b8c-a149-be609741102b) [No such file or directory] >[2016-04-19 07:24:45.218223] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b> (90b5de89-b0fe-4b8c-a149-be609741102b) [No such file or directory] >[2016-04-19 07:24:45.218399] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.221071] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 90b5de89-b0fe-4b8c-a149-be609741102b. (Possible split-brain) >[2016-04-19 07:24:45.222350] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b> (90b5de89-b0fe-4b8c-a149-be609741102b) [No such file or directory] >[2016-04-19 07:24:45.222436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b> (90b5de89-b0fe-4b8c-a149-be609741102b) [No such file or directory] >[2016-04-19 07:24:45.224824] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b> (90b5de89-b0fe-4b8c-a149-be609741102b) [No such file or directory] >[2016-04-19 07:24:45.225243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b> (90b5de89-b0fe-4b8c-a149-be609741102b) [No such file or directory] >[2016-04-19 07:24:45.225423] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:90b5de89-b0fe-4b8c-a149-be609741102b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.234876] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.235686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39> (f1bfec4e-7ead-46c1-bd55-df1bfef2dd39) [No such file or directory] >[2016-04-19 07:24:45.235978] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39> (f1bfec4e-7ead-46c1-bd55-df1bfef2dd39) [No such file or directory] >[2016-04-19 07:24:45.238761] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f1bfec4e-7ead-46c1-bd55-df1bfef2dd39. (Possible split-brain) >[2016-04-19 07:24:45.239614] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39> (f1bfec4e-7ead-46c1-bd55-df1bfef2dd39) [No such file or directory] >[2016-04-19 07:24:45.239876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39> (f1bfec4e-7ead-46c1-bd55-df1bfef2dd39) [No such file or directory] >[2016-04-19 07:24:45.241182] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39> (f1bfec4e-7ead-46c1-bd55-df1bfef2dd39) [No such file or directory] >[2016-04-19 07:24:45.241453] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39> (f1bfec4e-7ead-46c1-bd55-df1bfef2dd39) [No such file or directory] >[2016-04-19 07:24:45.241824] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.244540] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f1bfec4e-7ead-46c1-bd55-df1bfef2dd39. (Possible split-brain) >[2016-04-19 07:24:45.245559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39> (f1bfec4e-7ead-46c1-bd55-df1bfef2dd39) [No such file or directory] >[2016-04-19 07:24:45.245844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39> (f1bfec4e-7ead-46c1-bd55-df1bfef2dd39) [No such file or directory] >[2016-04-19 07:24:45.248594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39> (f1bfec4e-7ead-46c1-bd55-df1bfef2dd39) [No such file or directory] >[2016-04-19 07:24:45.248617] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39> (f1bfec4e-7ead-46c1-bd55-df1bfef2dd39) [No such file or directory] >[2016-04-19 07:24:45.248893] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f1bfec4e-7ead-46c1-bd55-df1bfef2dd39>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.258928] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.259753] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:37e59788-67a1-4056-a02a-15af1455864b> (37e59788-67a1-4056-a02a-15af1455864b) [No such file or directory] >[2016-04-19 07:24:45.260207] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:37e59788-67a1-4056-a02a-15af1455864b> (37e59788-67a1-4056-a02a-15af1455864b) [No such file or directory] >[2016-04-19 07:24:45.261399] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 37e59788-67a1-4056-a02a-15af1455864b. (Possible split-brain) >[2016-04-19 07:24:45.262434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:37e59788-67a1-4056-a02a-15af1455864b> (37e59788-67a1-4056-a02a-15af1455864b) [No such file or directory] >[2016-04-19 07:24:45.262692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:37e59788-67a1-4056-a02a-15af1455864b> (37e59788-67a1-4056-a02a-15af1455864b) [No such file or directory] >[2016-04-19 07:24:45.263952] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:37e59788-67a1-4056-a02a-15af1455864b> (37e59788-67a1-4056-a02a-15af1455864b) [No such file or directory] >[2016-04-19 07:24:45.264065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:37e59788-67a1-4056-a02a-15af1455864b> (37e59788-67a1-4056-a02a-15af1455864b) [No such file or directory] >[2016-04-19 07:24:45.264219] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:37e59788-67a1-4056-a02a-15af1455864b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.266809] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 37e59788-67a1-4056-a02a-15af1455864b. (Possible split-brain) >[2016-04-19 07:24:45.267952] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:37e59788-67a1-4056-a02a-15af1455864b> (37e59788-67a1-4056-a02a-15af1455864b) [No such file or directory] >[2016-04-19 07:24:45.268041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:37e59788-67a1-4056-a02a-15af1455864b> (37e59788-67a1-4056-a02a-15af1455864b) [No such file or directory] >[2016-04-19 07:24:45.270956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:37e59788-67a1-4056-a02a-15af1455864b> (37e59788-67a1-4056-a02a-15af1455864b) [No such file or directory] >[2016-04-19 07:24:45.271163] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:37e59788-67a1-4056-a02a-15af1455864b> (37e59788-67a1-4056-a02a-15af1455864b) [No such file or directory] >[2016-04-19 07:24:45.271494] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:37e59788-67a1-4056-a02a-15af1455864b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.281493] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.282656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd> (9e1762d1-8b6a-4361-9740-b684994baebd) [No such file or directory] >[2016-04-19 07:24:45.282761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd> (9e1762d1-8b6a-4361-9740-b684994baebd) [No such file or directory] >[2016-04-19 07:24:45.283827] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9e1762d1-8b6a-4361-9740-b684994baebd. (Possible split-brain) >[2016-04-19 07:24:45.284825] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd> (9e1762d1-8b6a-4361-9740-b684994baebd) [No such file or directory] >[2016-04-19 07:24:45.284897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd> (9e1762d1-8b6a-4361-9740-b684994baebd) [No such file or directory] >[2016-04-19 07:24:45.286254] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd> (9e1762d1-8b6a-4361-9740-b684994baebd) [No such file or directory] >[2016-04-19 07:24:45.286282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd> (9e1762d1-8b6a-4361-9740-b684994baebd) [No such file or directory] >[2016-04-19 07:24:45.286558] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.289225] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9e1762d1-8b6a-4361-9740-b684994baebd. (Possible split-brain) >[2016-04-19 07:24:45.290294] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd> (9e1762d1-8b6a-4361-9740-b684994baebd) [No such file or directory] >[2016-04-19 07:24:45.290347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd> (9e1762d1-8b6a-4361-9740-b684994baebd) [No such file or directory] >[2016-04-19 07:24:45.292810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd> (9e1762d1-8b6a-4361-9740-b684994baebd) [No such file or directory] >[2016-04-19 07:24:45.293061] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd> (9e1762d1-8b6a-4361-9740-b684994baebd) [No such file or directory] >[2016-04-19 07:24:45.293358] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9e1762d1-8b6a-4361-9740-b684994baebd>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.302777] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.303589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117> (fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117) [No such file or directory] >[2016-04-19 07:24:45.304066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117> (fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117) [No such file or directory] >[2016-04-19 07:24:45.306890] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117. (Possible split-brain) >[2016-04-19 07:24:45.307953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117> (fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117) [No such file or directory] >[2016-04-19 07:24:45.307964] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117> (fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117) [No such file or directory] >[2016-04-19 07:24:45.309232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117> (fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117) [No such file or directory] >[2016-04-19 07:24:45.309498] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117> (fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117) [No such file or directory] >[2016-04-19 07:24:45.309687] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.312216] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117. (Possible split-brain) >[2016-04-19 07:24:45.313418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117> (fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117) [No such file or directory] >[2016-04-19 07:24:45.313464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117> (fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117) [No such file or directory] >[2016-04-19 07:24:45.315867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117> (fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117) [No such file or directory] >[2016-04-19 07:24:45.315875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117> (fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117) [No such file or directory] >[2016-04-19 07:24:45.316065] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fee28e2f-dbc0-46e0-9f6d-88f2d7ec2117>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.324262] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.325023] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1> (2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1) [No such file or directory] >[2016-04-19 07:24:45.325291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1> (2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1) [No such file or directory] >[2016-04-19 07:24:45.327949] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1. (Possible split-brain) >[2016-04-19 07:24:45.328670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1> (2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1) [No such file or directory] >[2016-04-19 07:24:45.328972] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1> (2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1) [No such file or directory] >[2016-04-19 07:24:45.330558] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1> (2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1) [No such file or directory] >[2016-04-19 07:24:45.330673] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1> (2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1) [No such file or directory] >[2016-04-19 07:24:45.330851] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.333514] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1. (Possible split-brain) >[2016-04-19 07:24:45.334582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1> (2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1) [No such file or directory] >[2016-04-19 07:24:45.334597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1> (2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1) [No such file or directory] >[2016-04-19 07:24:45.337422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1> (2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1) [No such file or directory] >[2016-04-19 07:24:45.337484] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1> (2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1) [No such file or directory] >[2016-04-19 07:24:45.337609] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2a9dcc6b-69a0-4e7b-b99a-d25c3d6b04c1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.347034] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.348098] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd> (03fef328-dcb9-4fb6-beae-7228cb6a7ecd) [No such file or directory] >[2016-04-19 07:24:45.348125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd> (03fef328-dcb9-4fb6-beae-7228cb6a7ecd) [No such file or directory] >[2016-04-19 07:24:45.349277] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 03fef328-dcb9-4fb6-beae-7228cb6a7ecd. (Possible split-brain) >[2016-04-19 07:24:45.350498] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd> (03fef328-dcb9-4fb6-beae-7228cb6a7ecd) [No such file or directory] >[2016-04-19 07:24:45.350502] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd> (03fef328-dcb9-4fb6-beae-7228cb6a7ecd) [No such file or directory] >[2016-04-19 07:24:45.351715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd> (03fef328-dcb9-4fb6-beae-7228cb6a7ecd) [No such file or directory] >[2016-04-19 07:24:45.351851] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd> (03fef328-dcb9-4fb6-beae-7228cb6a7ecd) [No such file or directory] >[2016-04-19 07:24:45.351980] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.354527] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 03fef328-dcb9-4fb6-beae-7228cb6a7ecd. (Possible split-brain) >[2016-04-19 07:24:45.355659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd> (03fef328-dcb9-4fb6-beae-7228cb6a7ecd) [No such file or directory] >[2016-04-19 07:24:45.355688] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd> (03fef328-dcb9-4fb6-beae-7228cb6a7ecd) [No such file or directory] >[2016-04-19 07:24:45.358771] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd> (03fef328-dcb9-4fb6-beae-7228cb6a7ecd) [No such file or directory] >[2016-04-19 07:24:45.359107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd> (03fef328-dcb9-4fb6-beae-7228cb6a7ecd) [No such file or directory] >[2016-04-19 07:24:45.359294] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:03fef328-dcb9-4fb6-beae-7228cb6a7ecd>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.367955] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.368892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:47fb045b-845c-42a6-9772-6302e04589ee> (47fb045b-845c-42a6-9772-6302e04589ee) [No such file or directory] >[2016-04-19 07:24:45.368969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:47fb045b-845c-42a6-9772-6302e04589ee> (47fb045b-845c-42a6-9772-6302e04589ee) [No such file or directory] >[2016-04-19 07:24:45.371960] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 47fb045b-845c-42a6-9772-6302e04589ee. (Possible split-brain) >[2016-04-19 07:24:45.372972] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:47fb045b-845c-42a6-9772-6302e04589ee> (47fb045b-845c-42a6-9772-6302e04589ee) [No such file or directory] >[2016-04-19 07:24:45.373226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:47fb045b-845c-42a6-9772-6302e04589ee> (47fb045b-845c-42a6-9772-6302e04589ee) [No such file or directory] >[2016-04-19 07:24:45.374700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:47fb045b-845c-42a6-9772-6302e04589ee> (47fb045b-845c-42a6-9772-6302e04589ee) [No such file or directory] >[2016-04-19 07:24:45.374744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:47fb045b-845c-42a6-9772-6302e04589ee> (47fb045b-845c-42a6-9772-6302e04589ee) [No such file or directory] >[2016-04-19 07:24:45.374968] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:47fb045b-845c-42a6-9772-6302e04589ee>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.377876] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 47fb045b-845c-42a6-9772-6302e04589ee. (Possible split-brain) >[2016-04-19 07:24:45.378687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:47fb045b-845c-42a6-9772-6302e04589ee> (47fb045b-845c-42a6-9772-6302e04589ee) [No such file or directory] >[2016-04-19 07:24:45.378987] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:47fb045b-845c-42a6-9772-6302e04589ee> (47fb045b-845c-42a6-9772-6302e04589ee) [No such file or directory] >[2016-04-19 07:24:45.382009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:47fb045b-845c-42a6-9772-6302e04589ee> (47fb045b-845c-42a6-9772-6302e04589ee) [No such file or directory] >[2016-04-19 07:24:45.382164] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:47fb045b-845c-42a6-9772-6302e04589ee> (47fb045b-845c-42a6-9772-6302e04589ee) [No such file or directory] >[2016-04-19 07:24:45.382339] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:47fb045b-845c-42a6-9772-6302e04589ee>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.391437] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.392459] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4> (1699c5a7-60b6-47c6-95ed-0e543d85d0b4) [No such file or directory] >[2016-04-19 07:24:45.392480] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4> (1699c5a7-60b6-47c6-95ed-0e543d85d0b4) [No such file or directory] >[2016-04-19 07:24:45.393401] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1699c5a7-60b6-47c6-95ed-0e543d85d0b4. (Possible split-brain) >[2016-04-19 07:24:45.394137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4> (1699c5a7-60b6-47c6-95ed-0e543d85d0b4) [No such file or directory] >[2016-04-19 07:24:45.394402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4> (1699c5a7-60b6-47c6-95ed-0e543d85d0b4) [No such file or directory] >[2016-04-19 07:24:45.395803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4> (1699c5a7-60b6-47c6-95ed-0e543d85d0b4) [No such file or directory] >[2016-04-19 07:24:45.396046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4> (1699c5a7-60b6-47c6-95ed-0e543d85d0b4) [No such file or directory] >[2016-04-19 07:24:45.396194] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.398987] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1699c5a7-60b6-47c6-95ed-0e543d85d0b4. (Possible split-brain) >[2016-04-19 07:24:45.399913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4> (1699c5a7-60b6-47c6-95ed-0e543d85d0b4) [No such file or directory] >[2016-04-19 07:24:45.400173] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4> (1699c5a7-60b6-47c6-95ed-0e543d85d0b4) [No such file or directory] >[2016-04-19 07:24:45.402918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4> (1699c5a7-60b6-47c6-95ed-0e543d85d0b4) [No such file or directory] >[2016-04-19 07:24:45.403019] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4> (1699c5a7-60b6-47c6-95ed-0e543d85d0b4) [No such file or directory] >[2016-04-19 07:24:45.403168] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1699c5a7-60b6-47c6-95ed-0e543d85d0b4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.413590] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.414462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7> (dc95538f-7cb0-46a8-8ec7-ec70a83920c7) [No such file or directory] >[2016-04-19 07:24:45.414828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7> (dc95538f-7cb0-46a8-8ec7-ec70a83920c7) [No such file or directory] >[2016-04-19 07:24:45.415937] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dc95538f-7cb0-46a8-8ec7-ec70a83920c7. (Possible split-brain) >[2016-04-19 07:24:45.416845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7> (dc95538f-7cb0-46a8-8ec7-ec70a83920c7) [No such file or directory] >[2016-04-19 07:24:45.417101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7> (dc95538f-7cb0-46a8-8ec7-ec70a83920c7) [No such file or directory] >[2016-04-19 07:24:45.418492] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7> (dc95538f-7cb0-46a8-8ec7-ec70a83920c7) [No such file or directory] >[2016-04-19 07:24:45.418517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7> (dc95538f-7cb0-46a8-8ec7-ec70a83920c7) [No such file or directory] >[2016-04-19 07:24:45.418688] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.421250] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dc95538f-7cb0-46a8-8ec7-ec70a83920c7. (Possible split-brain) >[2016-04-19 07:24:45.422471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7> (dc95538f-7cb0-46a8-8ec7-ec70a83920c7) [No such file or directory] >[2016-04-19 07:24:45.422494] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7> (dc95538f-7cb0-46a8-8ec7-ec70a83920c7) [No such file or directory] >[2016-04-19 07:24:45.425851] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7> (dc95538f-7cb0-46a8-8ec7-ec70a83920c7) [No such file or directory] >[2016-04-19 07:24:45.425940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7> (dc95538f-7cb0-46a8-8ec7-ec70a83920c7) [No such file or directory] >[2016-04-19 07:24:45.426116] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:dc95538f-7cb0-46a8-8ec7-ec70a83920c7>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.435774] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.436846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5> (5fbe2b0f-9630-4152-b783-47efd0220fe5) [No such file or directory] >[2016-04-19 07:24:45.436909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5> (5fbe2b0f-9630-4152-b783-47efd0220fe5) [No such file or directory] >[2016-04-19 07:24:45.437887] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5fbe2b0f-9630-4152-b783-47efd0220fe5. (Possible split-brain) >[2016-04-19 07:24:45.438956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5> (5fbe2b0f-9630-4152-b783-47efd0220fe5) [No such file or directory] >[2016-04-19 07:24:45.439046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5> (5fbe2b0f-9630-4152-b783-47efd0220fe5) [No such file or directory] >[2016-04-19 07:24:45.440519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5> (5fbe2b0f-9630-4152-b783-47efd0220fe5) [No such file or directory] >[2016-04-19 07:24:45.440529] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5> (5fbe2b0f-9630-4152-b783-47efd0220fe5) [No such file or directory] >[2016-04-19 07:24:45.440813] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.443385] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5fbe2b0f-9630-4152-b783-47efd0220fe5. (Possible split-brain) >[2016-04-19 07:24:45.444624] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5> (5fbe2b0f-9630-4152-b783-47efd0220fe5) [No such file or directory] >[2016-04-19 07:24:45.444637] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5> (5fbe2b0f-9630-4152-b783-47efd0220fe5) [No such file or directory] >[2016-04-19 07:24:45.447367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5> (5fbe2b0f-9630-4152-b783-47efd0220fe5) [No such file or directory] >[2016-04-19 07:24:45.447684] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5> (5fbe2b0f-9630-4152-b783-47efd0220fe5) [No such file or directory] >[2016-04-19 07:24:45.447899] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5fbe2b0f-9630-4152-b783-47efd0220fe5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.458388] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.459495] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd> (2b860b2d-61af-40c5-9092-87b2843e4fdd) [No such file or directory] >[2016-04-19 07:24:45.459794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd> (2b860b2d-61af-40c5-9092-87b2843e4fdd) [No such file or directory] >[2016-04-19 07:24:45.462721] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2b860b2d-61af-40c5-9092-87b2843e4fdd. (Possible split-brain) >[2016-04-19 07:24:45.463703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd> (2b860b2d-61af-40c5-9092-87b2843e4fdd) [No such file or directory] >[2016-04-19 07:24:45.464095] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd> (2b860b2d-61af-40c5-9092-87b2843e4fdd) [No such file or directory] >[2016-04-19 07:24:45.465396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd> (2b860b2d-61af-40c5-9092-87b2843e4fdd) [No such file or directory] >[2016-04-19 07:24:45.465489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd> (2b860b2d-61af-40c5-9092-87b2843e4fdd) [No such file or directory] >[2016-04-19 07:24:45.465593] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.468124] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2b860b2d-61af-40c5-9092-87b2843e4fdd. (Possible split-brain) >[2016-04-19 07:24:45.468990] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd> (2b860b2d-61af-40c5-9092-87b2843e4fdd) [No such file or directory] >[2016-04-19 07:24:45.469310] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd> (2b860b2d-61af-40c5-9092-87b2843e4fdd) [No such file or directory] >[2016-04-19 07:24:45.472074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd> (2b860b2d-61af-40c5-9092-87b2843e4fdd) [No such file or directory] >[2016-04-19 07:24:45.472192] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd> (2b860b2d-61af-40c5-9092-87b2843e4fdd) [No such file or directory] >[2016-04-19 07:24:45.472414] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2b860b2d-61af-40c5-9092-87b2843e4fdd>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.481544] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.482311] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0> (6e7ff1f3-3814-4018-ba1e-1f79162cf1e0) [No such file or directory] >[2016-04-19 07:24:45.482623] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0> (6e7ff1f3-3814-4018-ba1e-1f79162cf1e0) [No such file or directory] >[2016-04-19 07:24:45.485554] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6e7ff1f3-3814-4018-ba1e-1f79162cf1e0. (Possible split-brain) >[2016-04-19 07:24:45.486312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0> (6e7ff1f3-3814-4018-ba1e-1f79162cf1e0) [No such file or directory] >[2016-04-19 07:24:45.486748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0> (6e7ff1f3-3814-4018-ba1e-1f79162cf1e0) [No such file or directory] >[2016-04-19 07:24:45.488408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0> (6e7ff1f3-3814-4018-ba1e-1f79162cf1e0) [No such file or directory] >[2016-04-19 07:24:45.488615] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0> (6e7ff1f3-3814-4018-ba1e-1f79162cf1e0) [No such file or directory] >[2016-04-19 07:24:45.488773] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.491292] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6e7ff1f3-3814-4018-ba1e-1f79162cf1e0. (Possible split-brain) >[2016-04-19 07:24:45.492224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0> (6e7ff1f3-3814-4018-ba1e-1f79162cf1e0) [No such file or directory] >[2016-04-19 07:24:45.492247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0> (6e7ff1f3-3814-4018-ba1e-1f79162cf1e0) [No such file or directory] >[2016-04-19 07:24:45.494886] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0> (6e7ff1f3-3814-4018-ba1e-1f79162cf1e0) [No such file or directory] >[2016-04-19 07:24:45.495120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0> (6e7ff1f3-3814-4018-ba1e-1f79162cf1e0) [No such file or directory] >[2016-04-19 07:24:45.495237] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6e7ff1f3-3814-4018-ba1e-1f79162cf1e0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.506624] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.507743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834> (2ad894dc-fa06-4e2c-936d-c107489da834) [No such file or directory] >[2016-04-19 07:24:45.507840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834> (2ad894dc-fa06-4e2c-936d-c107489da834) [No such file or directory] >[2016-04-19 07:24:45.508977] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2ad894dc-fa06-4e2c-936d-c107489da834. (Possible split-brain) >[2016-04-19 07:24:45.509806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834> (2ad894dc-fa06-4e2c-936d-c107489da834) [No such file or directory] >[2016-04-19 07:24:45.510158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834> (2ad894dc-fa06-4e2c-936d-c107489da834) [No such file or directory] >[2016-04-19 07:24:45.511709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834> (2ad894dc-fa06-4e2c-936d-c107489da834) [No such file or directory] >[2016-04-19 07:24:45.511784] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834> (2ad894dc-fa06-4e2c-936d-c107489da834) [No such file or directory] >[2016-04-19 07:24:45.511949] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.514427] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2ad894dc-fa06-4e2c-936d-c107489da834. (Possible split-brain) >[2016-04-19 07:24:45.515703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834> (2ad894dc-fa06-4e2c-936d-c107489da834) [No such file or directory] >[2016-04-19 07:24:45.515789] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834> (2ad894dc-fa06-4e2c-936d-c107489da834) [No such file or directory] >[2016-04-19 07:24:45.518657] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834> (2ad894dc-fa06-4e2c-936d-c107489da834) [No such file or directory] >[2016-04-19 07:24:45.518800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834> (2ad894dc-fa06-4e2c-936d-c107489da834) [No such file or directory] >[2016-04-19 07:24:45.518944] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2ad894dc-fa06-4e2c-936d-c107489da834>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.528101] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.529194] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133> (3813f0a5-caf9-439a-9d78-13c75bd01133) [No such file or directory] >[2016-04-19 07:24:45.529206] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133> (3813f0a5-caf9-439a-9d78-13c75bd01133) [No such file or directory] >[2016-04-19 07:24:45.532157] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3813f0a5-caf9-439a-9d78-13c75bd01133. (Possible split-brain) >[2016-04-19 07:24:45.533017] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133> (3813f0a5-caf9-439a-9d78-13c75bd01133) [No such file or directory] >[2016-04-19 07:24:45.533490] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133> (3813f0a5-caf9-439a-9d78-13c75bd01133) [No such file or directory] >[2016-04-19 07:24:45.534844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133> (3813f0a5-caf9-439a-9d78-13c75bd01133) [No such file or directory] >[2016-04-19 07:24:45.535010] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133> (3813f0a5-caf9-439a-9d78-13c75bd01133) [No such file or directory] >[2016-04-19 07:24:45.535217] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.537801] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3813f0a5-caf9-439a-9d78-13c75bd01133. (Possible split-brain) >[2016-04-19 07:24:45.538582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133> (3813f0a5-caf9-439a-9d78-13c75bd01133) [No such file or directory] >[2016-04-19 07:24:45.539004] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133> (3813f0a5-caf9-439a-9d78-13c75bd01133) [No such file or directory] >[2016-04-19 07:24:45.542196] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133> (3813f0a5-caf9-439a-9d78-13c75bd01133) [No such file or directory] >[2016-04-19 07:24:45.542276] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133> (3813f0a5-caf9-439a-9d78-13c75bd01133) [No such file or directory] >[2016-04-19 07:24:45.542424] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3813f0a5-caf9-439a-9d78-13c75bd01133>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.553433] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.554441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934> (bd89c5e9-4624-4918-9fac-16634c7cd934) [No such file or directory] >[2016-04-19 07:24:45.554466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934> (bd89c5e9-4624-4918-9fac-16634c7cd934) [No such file or directory] >[2016-04-19 07:24:45.557371] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bd89c5e9-4624-4918-9fac-16634c7cd934. (Possible split-brain) >[2016-04-19 07:24:45.558620] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934> (bd89c5e9-4624-4918-9fac-16634c7cd934) [No such file or directory] >[2016-04-19 07:24:45.558707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934> (bd89c5e9-4624-4918-9fac-16634c7cd934) [No such file or directory] >[2016-04-19 07:24:45.560099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934> (bd89c5e9-4624-4918-9fac-16634c7cd934) [No such file or directory] >[2016-04-19 07:24:45.560225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934> (bd89c5e9-4624-4918-9fac-16634c7cd934) [No such file or directory] >[2016-04-19 07:24:45.560391] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.562505] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bd89c5e9-4624-4918-9fac-16634c7cd934. (Possible split-brain) >[2016-04-19 07:24:45.563771] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934> (bd89c5e9-4624-4918-9fac-16634c7cd934) [No such file or directory] >[2016-04-19 07:24:45.563869] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934> (bd89c5e9-4624-4918-9fac-16634c7cd934) [No such file or directory] >[2016-04-19 07:24:45.566660] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934> (bd89c5e9-4624-4918-9fac-16634c7cd934) [No such file or directory] >[2016-04-19 07:24:45.566842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934> (bd89c5e9-4624-4918-9fac-16634c7cd934) [No such file or directory] >[2016-04-19 07:24:45.567033] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bd89c5e9-4624-4918-9fac-16634c7cd934>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.575548] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.576483] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d> (91eb4593-edcb-49fc-98ac-9a046f73e57d) [No such file or directory] >[2016-04-19 07:24:45.576915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d> (91eb4593-edcb-49fc-98ac-9a046f73e57d) [No such file or directory] >[2016-04-19 07:24:45.578046] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 91eb4593-edcb-49fc-98ac-9a046f73e57d. (Possible split-brain) >[2016-04-19 07:24:45.579001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d> (91eb4593-edcb-49fc-98ac-9a046f73e57d) [No such file or directory] >[2016-04-19 07:24:45.579385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d> (91eb4593-edcb-49fc-98ac-9a046f73e57d) [No such file or directory] >[2016-04-19 07:24:45.580486] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d> (91eb4593-edcb-49fc-98ac-9a046f73e57d) [No such file or directory] >[2016-04-19 07:24:45.580632] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d> (91eb4593-edcb-49fc-98ac-9a046f73e57d) [No such file or directory] >[2016-04-19 07:24:45.580921] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.583440] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 91eb4593-edcb-49fc-98ac-9a046f73e57d. (Possible split-brain) >[2016-04-19 07:24:45.584414] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d> (91eb4593-edcb-49fc-98ac-9a046f73e57d) [No such file or directory] >[2016-04-19 07:24:45.584700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d> (91eb4593-edcb-49fc-98ac-9a046f73e57d) [No such file or directory] >[2016-04-19 07:24:45.587676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d> (91eb4593-edcb-49fc-98ac-9a046f73e57d) [No such file or directory] >[2016-04-19 07:24:45.587817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d> (91eb4593-edcb-49fc-98ac-9a046f73e57d) [No such file or directory] >[2016-04-19 07:24:45.587956] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:91eb4593-edcb-49fc-98ac-9a046f73e57d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.597147] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.598132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f594611-6583-498d-b3ae-411244b8923d> (2f594611-6583-498d-b3ae-411244b8923d) [No such file or directory] >[2016-04-19 07:24:45.598133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f594611-6583-498d-b3ae-411244b8923d> (2f594611-6583-498d-b3ae-411244b8923d) [No such file or directory] >[2016-04-19 07:24:45.600640] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2f594611-6583-498d-b3ae-411244b8923d. (Possible split-brain) >[2016-04-19 07:24:45.601465] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f594611-6583-498d-b3ae-411244b8923d> (2f594611-6583-498d-b3ae-411244b8923d) [No such file or directory] >[2016-04-19 07:24:45.601526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f594611-6583-498d-b3ae-411244b8923d> (2f594611-6583-498d-b3ae-411244b8923d) [No such file or directory] >[2016-04-19 07:24:45.602598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f594611-6583-498d-b3ae-411244b8923d> (2f594611-6583-498d-b3ae-411244b8923d) [No such file or directory] >[2016-04-19 07:24:45.603145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f594611-6583-498d-b3ae-411244b8923d> (2f594611-6583-498d-b3ae-411244b8923d) [No such file or directory] >[2016-04-19 07:24:45.603236] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2f594611-6583-498d-b3ae-411244b8923d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.605677] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2f594611-6583-498d-b3ae-411244b8923d. (Possible split-brain) >[2016-04-19 07:24:45.606567] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f594611-6583-498d-b3ae-411244b8923d> (2f594611-6583-498d-b3ae-411244b8923d) [No such file or directory] >[2016-04-19 07:24:45.606908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f594611-6583-498d-b3ae-411244b8923d> (2f594611-6583-498d-b3ae-411244b8923d) [No such file or directory] >[2016-04-19 07:24:45.609704] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2f594611-6583-498d-b3ae-411244b8923d> (2f594611-6583-498d-b3ae-411244b8923d) [No such file or directory] >[2016-04-19 07:24:45.609717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2f594611-6583-498d-b3ae-411244b8923d> (2f594611-6583-498d-b3ae-411244b8923d) [No such file or directory] >[2016-04-19 07:24:45.609859] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2f594611-6583-498d-b3ae-411244b8923d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.617310] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.618111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25> (067ec850-6c67-4f8d-b557-c4684622ef25) [No such file or directory] >[2016-04-19 07:24:45.618183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25> (067ec850-6c67-4f8d-b557-c4684622ef25) [No such file or directory] >[2016-04-19 07:24:45.621051] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 067ec850-6c67-4f8d-b557-c4684622ef25. (Possible split-brain) >[2016-04-19 07:24:45.622169] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25> (067ec850-6c67-4f8d-b557-c4684622ef25) [No such file or directory] >[2016-04-19 07:24:45.622199] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25> (067ec850-6c67-4f8d-b557-c4684622ef25) [No such file or directory] >[2016-04-19 07:24:45.623629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25> (067ec850-6c67-4f8d-b557-c4684622ef25) [No such file or directory] >[2016-04-19 07:24:45.623717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25> (067ec850-6c67-4f8d-b557-c4684622ef25) [No such file or directory] >[2016-04-19 07:24:45.624125] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.626696] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 067ec850-6c67-4f8d-b557-c4684622ef25. (Possible split-brain) >[2016-04-19 07:24:45.627670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25> (067ec850-6c67-4f8d-b557-c4684622ef25) [No such file or directory] >[2016-04-19 07:24:45.627937] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25> (067ec850-6c67-4f8d-b557-c4684622ef25) [No such file or directory] >[2016-04-19 07:24:45.630506] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25> (067ec850-6c67-4f8d-b557-c4684622ef25) [No such file or directory] >[2016-04-19 07:24:45.630569] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25> (067ec850-6c67-4f8d-b557-c4684622ef25) [No such file or directory] >[2016-04-19 07:24:45.630852] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:067ec850-6c67-4f8d-b557-c4684622ef25>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.640251] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.641185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466> (792040f2-8e65-47ae-81dd-0cfa64bee466) [No such file or directory] >[2016-04-19 07:24:45.641484] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466> (792040f2-8e65-47ae-81dd-0cfa64bee466) [No such file or directory] >[2016-04-19 07:24:45.642409] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 792040f2-8e65-47ae-81dd-0cfa64bee466. (Possible split-brain) >[2016-04-19 07:24:45.643478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466> (792040f2-8e65-47ae-81dd-0cfa64bee466) [No such file or directory] >[2016-04-19 07:24:45.643575] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466> (792040f2-8e65-47ae-81dd-0cfa64bee466) [No such file or directory] >[2016-04-19 07:24:45.644868] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466> (792040f2-8e65-47ae-81dd-0cfa64bee466) [No such file or directory] >[2016-04-19 07:24:45.644948] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466> (792040f2-8e65-47ae-81dd-0cfa64bee466) [No such file or directory] >[2016-04-19 07:24:45.645256] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.647701] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 792040f2-8e65-47ae-81dd-0cfa64bee466. (Possible split-brain) >[2016-04-19 07:24:45.648818] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466> (792040f2-8e65-47ae-81dd-0cfa64bee466) [No such file or directory] >[2016-04-19 07:24:45.648917] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466> (792040f2-8e65-47ae-81dd-0cfa64bee466) [No such file or directory] >[2016-04-19 07:24:45.651432] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466> (792040f2-8e65-47ae-81dd-0cfa64bee466) [No such file or directory] >[2016-04-19 07:24:45.651646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466> (792040f2-8e65-47ae-81dd-0cfa64bee466) [No such file or directory] >[2016-04-19 07:24:45.652174] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:792040f2-8e65-47ae-81dd-0cfa64bee466>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.661996] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.663021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6> (bcbb710a-ca77-4c22-bfff-69f2d34e52b6) [No such file or directory] >[2016-04-19 07:24:45.663039] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6> (bcbb710a-ca77-4c22-bfff-69f2d34e52b6) [No such file or directory] >[2016-04-19 07:24:45.665561] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bcbb710a-ca77-4c22-bfff-69f2d34e52b6. (Possible split-brain) >[2016-04-19 07:24:45.666424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6> (bcbb710a-ca77-4c22-bfff-69f2d34e52b6) [No such file or directory] >[2016-04-19 07:24:45.666801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6> (bcbb710a-ca77-4c22-bfff-69f2d34e52b6) [No such file or directory] >[2016-04-19 07:24:45.668110] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6> (bcbb710a-ca77-4c22-bfff-69f2d34e52b6) [No such file or directory] >[2016-04-19 07:24:45.668120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6> (bcbb710a-ca77-4c22-bfff-69f2d34e52b6) [No such file or directory] >[2016-04-19 07:24:45.668364] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.670911] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bcbb710a-ca77-4c22-bfff-69f2d34e52b6. (Possible split-brain) >[2016-04-19 07:24:45.672018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6> (bcbb710a-ca77-4c22-bfff-69f2d34e52b6) [No such file or directory] >[2016-04-19 07:24:45.672108] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6> (bcbb710a-ca77-4c22-bfff-69f2d34e52b6) [No such file or directory] >[2016-04-19 07:24:45.674819] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6> (bcbb710a-ca77-4c22-bfff-69f2d34e52b6) [No such file or directory] >[2016-04-19 07:24:45.674982] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6> (bcbb710a-ca77-4c22-bfff-69f2d34e52b6) [No such file or directory] >[2016-04-19 07:24:45.675135] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bcbb710a-ca77-4c22-bfff-69f2d34e52b6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.685155] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.686023] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3> (18c8559c-7a62-41ed-8712-27bedd4ac9d3) [No such file or directory] >[2016-04-19 07:24:45.686363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3> (18c8559c-7a62-41ed-8712-27bedd4ac9d3) [No such file or directory] >[2016-04-19 07:24:45.687541] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 18c8559c-7a62-41ed-8712-27bedd4ac9d3. (Possible split-brain) >[2016-04-19 07:24:45.688766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3> (18c8559c-7a62-41ed-8712-27bedd4ac9d3) [No such file or directory] >[2016-04-19 07:24:45.688854] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3> (18c8559c-7a62-41ed-8712-27bedd4ac9d3) [No such file or directory] >[2016-04-19 07:24:45.690139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3> (18c8559c-7a62-41ed-8712-27bedd4ac9d3) [No such file or directory] >[2016-04-19 07:24:45.690225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3> (18c8559c-7a62-41ed-8712-27bedd4ac9d3) [No such file or directory] >[2016-04-19 07:24:45.690616] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.693152] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 18c8559c-7a62-41ed-8712-27bedd4ac9d3. (Possible split-brain) >[2016-04-19 07:24:45.694131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3> (18c8559c-7a62-41ed-8712-27bedd4ac9d3) [No such file or directory] >[2016-04-19 07:24:45.694478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3> (18c8559c-7a62-41ed-8712-27bedd4ac9d3) [No such file or directory] >[2016-04-19 07:24:45.697419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3> (18c8559c-7a62-41ed-8712-27bedd4ac9d3) [No such file or directory] >[2016-04-19 07:24:45.697537] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3> (18c8559c-7a62-41ed-8712-27bedd4ac9d3) [No such file or directory] >[2016-04-19 07:24:45.697777] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:18c8559c-7a62-41ed-8712-27bedd4ac9d3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.706654] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.707516] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee> (1a0bd468-a233-4a54-9bc9-07070fb18dee) [No such file or directory] >[2016-04-19 07:24:45.707746] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee> (1a0bd468-a233-4a54-9bc9-07070fb18dee) [No such file or directory] >[2016-04-19 07:24:45.710694] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1a0bd468-a233-4a54-9bc9-07070fb18dee. (Possible split-brain) >[2016-04-19 07:24:45.711722] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee> (1a0bd468-a233-4a54-9bc9-07070fb18dee) [No such file or directory] >[2016-04-19 07:24:45.711818] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee> (1a0bd468-a233-4a54-9bc9-07070fb18dee) [No such file or directory] >[2016-04-19 07:24:45.713126] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee> (1a0bd468-a233-4a54-9bc9-07070fb18dee) [No such file or directory] >[2016-04-19 07:24:45.713215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee> (1a0bd468-a233-4a54-9bc9-07070fb18dee) [No such file or directory] >[2016-04-19 07:24:45.713337] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.715842] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1a0bd468-a233-4a54-9bc9-07070fb18dee. (Possible split-brain) >[2016-04-19 07:24:45.716633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee> (1a0bd468-a233-4a54-9bc9-07070fb18dee) [No such file or directory] >[2016-04-19 07:24:45.717067] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee> (1a0bd468-a233-4a54-9bc9-07070fb18dee) [No such file or directory] >[2016-04-19 07:24:45.719720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee> (1a0bd468-a233-4a54-9bc9-07070fb18dee) [No such file or directory] >[2016-04-19 07:24:45.719894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee> (1a0bd468-a233-4a54-9bc9-07070fb18dee) [No such file or directory] >[2016-04-19 07:24:45.720069] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1a0bd468-a233-4a54-9bc9-07070fb18dee>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.729700] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.730665] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12f4e251-643e-425a-8cae-acf9d513f972> (12f4e251-643e-425a-8cae-acf9d513f972) [No such file or directory] >[2016-04-19 07:24:45.730925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12f4e251-643e-425a-8cae-acf9d513f972> (12f4e251-643e-425a-8cae-acf9d513f972) [No such file or directory] >[2016-04-19 07:24:45.733846] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 12f4e251-643e-425a-8cae-acf9d513f972. (Possible split-brain) >[2016-04-19 07:24:45.734859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12f4e251-643e-425a-8cae-acf9d513f972> (12f4e251-643e-425a-8cae-acf9d513f972) [No such file or directory] >[2016-04-19 07:24:45.734888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12f4e251-643e-425a-8cae-acf9d513f972> (12f4e251-643e-425a-8cae-acf9d513f972) [No such file or directory] >[2016-04-19 07:24:45.736364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12f4e251-643e-425a-8cae-acf9d513f972> (12f4e251-643e-425a-8cae-acf9d513f972) [No such file or directory] >[2016-04-19 07:24:45.736496] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12f4e251-643e-425a-8cae-acf9d513f972> (12f4e251-643e-425a-8cae-acf9d513f972) [No such file or directory] >[2016-04-19 07:24:45.736615] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:12f4e251-643e-425a-8cae-acf9d513f972>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.739079] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 12f4e251-643e-425a-8cae-acf9d513f972. (Possible split-brain) >[2016-04-19 07:24:45.740243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12f4e251-643e-425a-8cae-acf9d513f972> (12f4e251-643e-425a-8cae-acf9d513f972) [No such file or directory] >[2016-04-19 07:24:45.740357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12f4e251-643e-425a-8cae-acf9d513f972> (12f4e251-643e-425a-8cae-acf9d513f972) [No such file or directory] >[2016-04-19 07:24:45.742994] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12f4e251-643e-425a-8cae-acf9d513f972> (12f4e251-643e-425a-8cae-acf9d513f972) [No such file or directory] >[2016-04-19 07:24:45.743017] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12f4e251-643e-425a-8cae-acf9d513f972> (12f4e251-643e-425a-8cae-acf9d513f972) [No such file or directory] >[2016-04-19 07:24:45.743228] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:12f4e251-643e-425a-8cae-acf9d513f972>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.753294] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.754401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f> (42d83ed4-94a5-4338-955f-fb47ac25300f) [No such file or directory] >[2016-04-19 07:24:45.754671] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f> (42d83ed4-94a5-4338-955f-fb47ac25300f) [No such file or directory] >[2016-04-19 07:24:45.755508] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 42d83ed4-94a5-4338-955f-fb47ac25300f. (Possible split-brain) >[2016-04-19 07:24:45.756475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f> (42d83ed4-94a5-4338-955f-fb47ac25300f) [No such file or directory] >[2016-04-19 07:24:45.756529] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f> (42d83ed4-94a5-4338-955f-fb47ac25300f) [No such file or directory] >[2016-04-19 07:24:45.757682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f> (42d83ed4-94a5-4338-955f-fb47ac25300f) [No such file or directory] >[2016-04-19 07:24:45.757992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f> (42d83ed4-94a5-4338-955f-fb47ac25300f) [No such file or directory] >[2016-04-19 07:24:45.758109] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.760567] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 42d83ed4-94a5-4338-955f-fb47ac25300f. (Possible split-brain) >[2016-04-19 07:24:45.761478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f> (42d83ed4-94a5-4338-955f-fb47ac25300f) [No such file or directory] >[2016-04-19 07:24:45.761687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f> (42d83ed4-94a5-4338-955f-fb47ac25300f) [No such file or directory] >[2016-04-19 07:24:45.764146] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f> (42d83ed4-94a5-4338-955f-fb47ac25300f) [No such file or directory] >[2016-04-19 07:24:45.764667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f> (42d83ed4-94a5-4338-955f-fb47ac25300f) [No such file or directory] >[2016-04-19 07:24:45.764980] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:42d83ed4-94a5-4338-955f-fb47ac25300f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.775423] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.776248] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f> (c3c75843-7775-4fb0-acb3-098265854b7f) [No such file or directory] >[2016-04-19 07:24:45.776425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f> (c3c75843-7775-4fb0-acb3-098265854b7f) [No such file or directory] >[2016-04-19 07:24:45.778939] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c3c75843-7775-4fb0-acb3-098265854b7f. (Possible split-brain) >[2016-04-19 07:24:45.779919] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f> (c3c75843-7775-4fb0-acb3-098265854b7f) [No such file or directory] >[2016-04-19 07:24:45.780225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f> (c3c75843-7775-4fb0-acb3-098265854b7f) [No such file or directory] >[2016-04-19 07:24:45.781750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f> (c3c75843-7775-4fb0-acb3-098265854b7f) [No such file or directory] >[2016-04-19 07:24:45.781778] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f> (c3c75843-7775-4fb0-acb3-098265854b7f) [No such file or directory] >[2016-04-19 07:24:45.781922] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.784400] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c3c75843-7775-4fb0-acb3-098265854b7f. (Possible split-brain) >[2016-04-19 07:24:45.785148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f> (c3c75843-7775-4fb0-acb3-098265854b7f) [No such file or directory] >[2016-04-19 07:24:45.785505] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f> (c3c75843-7775-4fb0-acb3-098265854b7f) [No such file or directory] >[2016-04-19 07:24:45.788202] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f> (c3c75843-7775-4fb0-acb3-098265854b7f) [No such file or directory] >[2016-04-19 07:24:45.788367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f> (c3c75843-7775-4fb0-acb3-098265854b7f) [No such file or directory] >[2016-04-19 07:24:45.788532] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c3c75843-7775-4fb0-acb3-098265854b7f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.796971] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.797951] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6> (6212b945-c96d-4f36-8f7e-de3733b5cfa6) [No such file or directory] >[2016-04-19 07:24:45.797966] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6> (6212b945-c96d-4f36-8f7e-de3733b5cfa6) [No such file or directory] >[2016-04-19 07:24:45.801617] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6212b945-c96d-4f36-8f7e-de3733b5cfa6. (Possible split-brain) >[2016-04-19 07:24:45.802689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6> (6212b945-c96d-4f36-8f7e-de3733b5cfa6) [No such file or directory] >[2016-04-19 07:24:45.802946] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6> (6212b945-c96d-4f36-8f7e-de3733b5cfa6) [No such file or directory] >[2016-04-19 07:24:45.804160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6> (6212b945-c96d-4f36-8f7e-de3733b5cfa6) [No such file or directory] >[2016-04-19 07:24:45.804521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6> (6212b945-c96d-4f36-8f7e-de3733b5cfa6) [No such file or directory] >[2016-04-19 07:24:45.804730] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.807231] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6212b945-c96d-4f36-8f7e-de3733b5cfa6. (Possible split-brain) >[2016-04-19 07:24:45.808452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6> (6212b945-c96d-4f36-8f7e-de3733b5cfa6) [No such file or directory] >[2016-04-19 07:24:45.808452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6> (6212b945-c96d-4f36-8f7e-de3733b5cfa6) [No such file or directory] >[2016-04-19 07:24:45.811214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6> (6212b945-c96d-4f36-8f7e-de3733b5cfa6) [No such file or directory] >[2016-04-19 07:24:45.811303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6> (6212b945-c96d-4f36-8f7e-de3733b5cfa6) [No such file or directory] >[2016-04-19 07:24:45.811457] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6212b945-c96d-4f36-8f7e-de3733b5cfa6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.820128] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.820946] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65> (650ff45a-4e4c-407d-bf8f-6c049a44ed65) [No such file or directory] >[2016-04-19 07:24:45.821180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65> (650ff45a-4e4c-407d-bf8f-6c049a44ed65) [No such file or directory] >[2016-04-19 07:24:45.822275] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 650ff45a-4e4c-407d-bf8f-6c049a44ed65. (Possible split-brain) >[2016-04-19 07:24:45.823349] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65> (650ff45a-4e4c-407d-bf8f-6c049a44ed65) [No such file or directory] >[2016-04-19 07:24:45.823585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65> (650ff45a-4e4c-407d-bf8f-6c049a44ed65) [No such file or directory] >[2016-04-19 07:24:45.824773] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65> (650ff45a-4e4c-407d-bf8f-6c049a44ed65) [No such file or directory] >[2016-04-19 07:24:45.825029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65> (650ff45a-4e4c-407d-bf8f-6c049a44ed65) [No such file or directory] >[2016-04-19 07:24:45.825212] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.827705] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 650ff45a-4e4c-407d-bf8f-6c049a44ed65. (Possible split-brain) >[2016-04-19 07:24:45.828717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65> (650ff45a-4e4c-407d-bf8f-6c049a44ed65) [No such file or directory] >[2016-04-19 07:24:45.828819] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65> (650ff45a-4e4c-407d-bf8f-6c049a44ed65) [No such file or directory] >[2016-04-19 07:24:45.831673] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65> (650ff45a-4e4c-407d-bf8f-6c049a44ed65) [No such file or directory] >[2016-04-19 07:24:45.831707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65> (650ff45a-4e4c-407d-bf8f-6c049a44ed65) [No such file or directory] >[2016-04-19 07:24:45.831879] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:650ff45a-4e4c-407d-bf8f-6c049a44ed65>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.840501] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.841419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8> (cc562fbe-d97e-417e-b48e-e0fe910b0ef8) [No such file or directory] >[2016-04-19 07:24:45.841497] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8> (cc562fbe-d97e-417e-b48e-e0fe910b0ef8) [No such file or directory] >[2016-04-19 07:24:45.843446] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cc562fbe-d97e-417e-b48e-e0fe910b0ef8. (Possible split-brain) >[2016-04-19 07:24:45.844416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8> (cc562fbe-d97e-417e-b48e-e0fe910b0ef8) [No such file or directory] >[2016-04-19 07:24:45.844476] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8> (cc562fbe-d97e-417e-b48e-e0fe910b0ef8) [No such file or directory] >[2016-04-19 07:24:45.845649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8> (cc562fbe-d97e-417e-b48e-e0fe910b0ef8) [No such file or directory] >[2016-04-19 07:24:45.845713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8> (cc562fbe-d97e-417e-b48e-e0fe910b0ef8) [No such file or directory] >[2016-04-19 07:24:45.846114] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.848626] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cc562fbe-d97e-417e-b48e-e0fe910b0ef8. (Possible split-brain) >[2016-04-19 07:24:45.849522] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8> (cc562fbe-d97e-417e-b48e-e0fe910b0ef8) [No such file or directory] >[2016-04-19 07:24:45.849622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8> (cc562fbe-d97e-417e-b48e-e0fe910b0ef8) [No such file or directory] >[2016-04-19 07:24:45.852028] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8> (cc562fbe-d97e-417e-b48e-e0fe910b0ef8) [No such file or directory] >[2016-04-19 07:24:45.852052] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8> (cc562fbe-d97e-417e-b48e-e0fe910b0ef8) [No such file or directory] >[2016-04-19 07:24:45.852197] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cc562fbe-d97e-417e-b48e-e0fe910b0ef8>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.861900] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.862987] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1> (103d212c-52c3-4fce-b627-297ddf3121f1) [No such file or directory] >[2016-04-19 07:24:45.863066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1> (103d212c-52c3-4fce-b627-297ddf3121f1) [No such file or directory] >[2016-04-19 07:24:45.863936] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 103d212c-52c3-4fce-b627-297ddf3121f1. (Possible split-brain) >[2016-04-19 07:24:45.864986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1> (103d212c-52c3-4fce-b627-297ddf3121f1) [No such file or directory] >[2016-04-19 07:24:45.865002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1> (103d212c-52c3-4fce-b627-297ddf3121f1) [No such file or directory] >[2016-04-19 07:24:45.866119] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1> (103d212c-52c3-4fce-b627-297ddf3121f1) [No such file or directory] >[2016-04-19 07:24:45.866215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1> (103d212c-52c3-4fce-b627-297ddf3121f1) [No such file or directory] >[2016-04-19 07:24:45.866754] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.869239] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 103d212c-52c3-4fce-b627-297ddf3121f1. (Possible split-brain) >[2016-04-19 07:24:45.870309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1> (103d212c-52c3-4fce-b627-297ddf3121f1) [No such file or directory] >[2016-04-19 07:24:45.870463] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1> (103d212c-52c3-4fce-b627-297ddf3121f1) [No such file or directory] >[2016-04-19 07:24:45.873460] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1> (103d212c-52c3-4fce-b627-297ddf3121f1) [No such file or directory] >[2016-04-19 07:24:45.873967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1> (103d212c-52c3-4fce-b627-297ddf3121f1) [No such file or directory] >[2016-04-19 07:24:45.874155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:103d212c-52c3-4fce-b627-297ddf3121f1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.883944] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.884858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:268c6c25-4c40-4008-85db-a4da57689800> (268c6c25-4c40-4008-85db-a4da57689800) [No such file or directory] >[2016-04-19 07:24:45.885066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:268c6c25-4c40-4008-85db-a4da57689800> (268c6c25-4c40-4008-85db-a4da57689800) [No such file or directory] >[2016-04-19 07:24:45.885958] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 268c6c25-4c40-4008-85db-a4da57689800. (Possible split-brain) >[2016-04-19 07:24:45.886809] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:268c6c25-4c40-4008-85db-a4da57689800> (268c6c25-4c40-4008-85db-a4da57689800) [No such file or directory] >[2016-04-19 07:24:45.887254] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:268c6c25-4c40-4008-85db-a4da57689800> (268c6c25-4c40-4008-85db-a4da57689800) [No such file or directory] >[2016-04-19 07:24:45.888491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:268c6c25-4c40-4008-85db-a4da57689800> (268c6c25-4c40-4008-85db-a4da57689800) [No such file or directory] >[2016-04-19 07:24:45.888793] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:268c6c25-4c40-4008-85db-a4da57689800> (268c6c25-4c40-4008-85db-a4da57689800) [No such file or directory] >[2016-04-19 07:24:45.888952] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:268c6c25-4c40-4008-85db-a4da57689800>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.891402] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 268c6c25-4c40-4008-85db-a4da57689800. (Possible split-brain) >[2016-04-19 07:24:45.892745] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:268c6c25-4c40-4008-85db-a4da57689800> (268c6c25-4c40-4008-85db-a4da57689800) [No such file or directory] >[2016-04-19 07:24:45.892852] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:268c6c25-4c40-4008-85db-a4da57689800> (268c6c25-4c40-4008-85db-a4da57689800) [No such file or directory] >[2016-04-19 07:24:45.895136] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:268c6c25-4c40-4008-85db-a4da57689800> (268c6c25-4c40-4008-85db-a4da57689800) [No such file or directory] >[2016-04-19 07:24:45.895449] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:268c6c25-4c40-4008-85db-a4da57689800> (268c6c25-4c40-4008-85db-a4da57689800) [No such file or directory] >[2016-04-19 07:24:45.895617] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:268c6c25-4c40-4008-85db-a4da57689800>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.906459] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.907152] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020> (eb9fb714-dd6d-40f1-940d-4c94e4d69020) [No such file or directory] >[2016-04-19 07:24:45.907493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020> (eb9fb714-dd6d-40f1-940d-4c94e4d69020) [No such file or directory] >[2016-04-19 07:24:45.908421] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid eb9fb714-dd6d-40f1-940d-4c94e4d69020. (Possible split-brain) >[2016-04-19 07:24:45.909201] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020> (eb9fb714-dd6d-40f1-940d-4c94e4d69020) [No such file or directory] >[2016-04-19 07:24:45.909527] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020> (eb9fb714-dd6d-40f1-940d-4c94e4d69020) [No such file or directory] >[2016-04-19 07:24:45.910929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020> (eb9fb714-dd6d-40f1-940d-4c94e4d69020) [No such file or directory] >[2016-04-19 07:24:45.911009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020> (eb9fb714-dd6d-40f1-940d-4c94e4d69020) [No such file or directory] >[2016-04-19 07:24:45.911176] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.913678] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid eb9fb714-dd6d-40f1-940d-4c94e4d69020. (Possible split-brain) >[2016-04-19 07:24:45.914554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020> (eb9fb714-dd6d-40f1-940d-4c94e4d69020) [No such file or directory] >[2016-04-19 07:24:45.914674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020> (eb9fb714-dd6d-40f1-940d-4c94e4d69020) [No such file or directory] >[2016-04-19 07:24:45.917873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020> (eb9fb714-dd6d-40f1-940d-4c94e4d69020) [No such file or directory] >[2016-04-19 07:24:45.917976] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020> (eb9fb714-dd6d-40f1-940d-4c94e4d69020) [No such file or directory] >[2016-04-19 07:24:45.918141] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:eb9fb714-dd6d-40f1-940d-4c94e4d69020>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.926547] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.927485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2> (59cb2b63-2903-4a15-a69d-30c8882c7cb2) [No such file or directory] >[2016-04-19 07:24:45.927589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2> (59cb2b63-2903-4a15-a69d-30c8882c7cb2) [No such file or directory] >[2016-04-19 07:24:45.930024] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 59cb2b63-2903-4a15-a69d-30c8882c7cb2. (Possible split-brain) >[2016-04-19 07:24:45.930883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2> (59cb2b63-2903-4a15-a69d-30c8882c7cb2) [No such file or directory] >[2016-04-19 07:24:45.930996] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2> (59cb2b63-2903-4a15-a69d-30c8882c7cb2) [No such file or directory] >[2016-04-19 07:24:45.932362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2> (59cb2b63-2903-4a15-a69d-30c8882c7cb2) [No such file or directory] >[2016-04-19 07:24:45.932667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2> (59cb2b63-2903-4a15-a69d-30c8882c7cb2) [No such file or directory] >[2016-04-19 07:24:45.932754] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.935277] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 59cb2b63-2903-4a15-a69d-30c8882c7cb2. (Possible split-brain) >[2016-04-19 07:24:45.936423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2> (59cb2b63-2903-4a15-a69d-30c8882c7cb2) [No such file or directory] >[2016-04-19 07:24:45.936474] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2> (59cb2b63-2903-4a15-a69d-30c8882c7cb2) [No such file or directory] >[2016-04-19 07:24:45.938781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2> (59cb2b63-2903-4a15-a69d-30c8882c7cb2) [No such file or directory] >[2016-04-19 07:24:45.938900] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2> (59cb2b63-2903-4a15-a69d-30c8882c7cb2) [No such file or directory] >[2016-04-19 07:24:45.939069] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:59cb2b63-2903-4a15-a69d-30c8882c7cb2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.949595] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.950430] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7> (ba519e35-b5b1-4c90-916a-84ed7b4023a7) [No such file or directory] >[2016-04-19 07:24:45.950653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7> (ba519e35-b5b1-4c90-916a-84ed7b4023a7) [No such file or directory] >[2016-04-19 07:24:45.951458] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ba519e35-b5b1-4c90-916a-84ed7b4023a7. (Possible split-brain) >[2016-04-19 07:24:45.952475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7> (ba519e35-b5b1-4c90-916a-84ed7b4023a7) [No such file or directory] >[2016-04-19 07:24:45.952475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7> (ba519e35-b5b1-4c90-916a-84ed7b4023a7) [No such file or directory] >[2016-04-19 07:24:45.953471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7> (ba519e35-b5b1-4c90-916a-84ed7b4023a7) [No such file or directory] >[2016-04-19 07:24:45.953781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7> (ba519e35-b5b1-4c90-916a-84ed7b4023a7) [No such file or directory] >[2016-04-19 07:24:45.954350] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:45.956752] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ba519e35-b5b1-4c90-916a-84ed7b4023a7. (Possible split-brain) >[2016-04-19 07:24:45.957643] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7> (ba519e35-b5b1-4c90-916a-84ed7b4023a7) [No such file or directory] >[2016-04-19 07:24:45.957669] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7> (ba519e35-b5b1-4c90-916a-84ed7b4023a7) [No such file or directory] >[2016-04-19 07:24:45.960003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7> (ba519e35-b5b1-4c90-916a-84ed7b4023a7) [No such file or directory] >[2016-04-19 07:24:45.960271] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7> (ba519e35-b5b1-4c90-916a-84ed7b4023a7) [No such file or directory] >[2016-04-19 07:24:45.961002] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ba519e35-b5b1-4c90-916a-84ed7b4023a7>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:45.969232] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.969977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e> (5bf9b5ea-e182-430f-a21a-d4afe3c8797e) [No such file or directory] >[2016-04-19 07:24:45.970389] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e> (5bf9b5ea-e182-430f-a21a-d4afe3c8797e) [No such file or directory] >[2016-04-19 07:24:45.972919] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5bf9b5ea-e182-430f-a21a-d4afe3c8797e. (Possible split-brain) >[2016-04-19 07:24:45.974109] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e> (5bf9b5ea-e182-430f-a21a-d4afe3c8797e) [No such file or directory] >[2016-04-19 07:24:45.974183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e> (5bf9b5ea-e182-430f-a21a-d4afe3c8797e) [No such file or directory] >[2016-04-19 07:24:45.975404] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e> (5bf9b5ea-e182-430f-a21a-d4afe3c8797e) [No such file or directory] >[2016-04-19 07:24:45.975640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e> (5bf9b5ea-e182-430f-a21a-d4afe3c8797e) [No such file or directory] >[2016-04-19 07:24:45.975851] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:45.978343] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5bf9b5ea-e182-430f-a21a-d4afe3c8797e. (Possible split-brain) >[2016-04-19 07:24:45.979161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e> (5bf9b5ea-e182-430f-a21a-d4afe3c8797e) [No such file or directory] >[2016-04-19 07:24:45.979389] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e> (5bf9b5ea-e182-430f-a21a-d4afe3c8797e) [No such file or directory] >[2016-04-19 07:24:45.982116] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e> (5bf9b5ea-e182-430f-a21a-d4afe3c8797e) [No such file or directory] >[2016-04-19 07:24:45.982517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e> (5bf9b5ea-e182-430f-a21a-d4afe3c8797e) [No such file or directory] >[2016-04-19 07:24:45.982703] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5bf9b5ea-e182-430f-a21a-d4afe3c8797e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:45.992952] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:45.993765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a> (f2e8d240-c9c0-450a-b731-c989940f553a) [No such file or directory] >[2016-04-19 07:24:45.994176] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a> (f2e8d240-c9c0-450a-b731-c989940f553a) [No such file or directory] >[2016-04-19 07:24:45.997110] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f2e8d240-c9c0-450a-b731-c989940f553a. (Possible split-brain) >[2016-04-19 07:24:45.997939] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a> (f2e8d240-c9c0-450a-b731-c989940f553a) [No such file or directory] >[2016-04-19 07:24:45.998457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a> (f2e8d240-c9c0-450a-b731-c989940f553a) [No such file or directory] >[2016-04-19 07:24:45.999597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a> (f2e8d240-c9c0-450a-b731-c989940f553a) [No such file or directory] >[2016-04-19 07:24:45.999915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a> (f2e8d240-c9c0-450a-b731-c989940f553a) [No such file or directory] >[2016-04-19 07:24:46.000037] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.002911] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f2e8d240-c9c0-450a-b731-c989940f553a. (Possible split-brain) >[2016-04-19 07:24:46.003730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a> (f2e8d240-c9c0-450a-b731-c989940f553a) [No such file or directory] >[2016-04-19 07:24:46.004090] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a> (f2e8d240-c9c0-450a-b731-c989940f553a) [No such file or directory] >[2016-04-19 07:24:46.006613] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a> (f2e8d240-c9c0-450a-b731-c989940f553a) [No such file or directory] >[2016-04-19 07:24:46.006738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a> (f2e8d240-c9c0-450a-b731-c989940f553a) [No such file or directory] >[2016-04-19 07:24:46.007065] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f2e8d240-c9c0-450a-b731-c989940f553a>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.015491] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.016465] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b> (f9c20a90-9056-4b0f-af9a-aa86221a0c4b) [No such file or directory] >[2016-04-19 07:24:46.016750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b> (f9c20a90-9056-4b0f-af9a-aa86221a0c4b) [No such file or directory] >[2016-04-19 07:24:46.019589] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f9c20a90-9056-4b0f-af9a-aa86221a0c4b. (Possible split-brain) >[2016-04-19 07:24:46.020340] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b> (f9c20a90-9056-4b0f-af9a-aa86221a0c4b) [No such file or directory] >[2016-04-19 07:24:46.020658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b> (f9c20a90-9056-4b0f-af9a-aa86221a0c4b) [No such file or directory] >[2016-04-19 07:24:46.021461] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b> (f9c20a90-9056-4b0f-af9a-aa86221a0c4b) [No such file or directory] >[2016-04-19 07:24:46.021630] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b> (f9c20a90-9056-4b0f-af9a-aa86221a0c4b) [No such file or directory] >[2016-04-19 07:24:46.021958] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.024408] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f9c20a90-9056-4b0f-af9a-aa86221a0c4b. (Possible split-brain) >[2016-04-19 07:24:46.025144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b> (f9c20a90-9056-4b0f-af9a-aa86221a0c4b) [No such file or directory] >[2016-04-19 07:24:46.025519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b> (f9c20a90-9056-4b0f-af9a-aa86221a0c4b) [No such file or directory] >[2016-04-19 07:24:46.028379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b> (f9c20a90-9056-4b0f-af9a-aa86221a0c4b) [No such file or directory] >[2016-04-19 07:24:46.028437] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b> (f9c20a90-9056-4b0f-af9a-aa86221a0c4b) [No such file or directory] >[2016-04-19 07:24:46.028671] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f9c20a90-9056-4b0f-af9a-aa86221a0c4b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.037786] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.038742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86> (413019ee-964d-475e-9c3b-58e50d0ebd86) [No such file or directory] >[2016-04-19 07:24:46.039094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86> (413019ee-964d-475e-9c3b-58e50d0ebd86) [No such file or directory] >[2016-04-19 07:24:46.042042] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 413019ee-964d-475e-9c3b-58e50d0ebd86. (Possible split-brain) >[2016-04-19 07:24:46.042915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86> (413019ee-964d-475e-9c3b-58e50d0ebd86) [No such file or directory] >[2016-04-19 07:24:46.043211] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86> (413019ee-964d-475e-9c3b-58e50d0ebd86) [No such file or directory] >[2016-04-19 07:24:46.044428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86> (413019ee-964d-475e-9c3b-58e50d0ebd86) [No such file or directory] >[2016-04-19 07:24:46.044564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86> (413019ee-964d-475e-9c3b-58e50d0ebd86) [No such file or directory] >[2016-04-19 07:24:46.044718] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.047296] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 413019ee-964d-475e-9c3b-58e50d0ebd86. (Possible split-brain) >[2016-04-19 07:24:46.048400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86> (413019ee-964d-475e-9c3b-58e50d0ebd86) [No such file or directory] >[2016-04-19 07:24:46.048407] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86> (413019ee-964d-475e-9c3b-58e50d0ebd86) [No such file or directory] >[2016-04-19 07:24:46.051038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86> (413019ee-964d-475e-9c3b-58e50d0ebd86) [No such file or directory] >[2016-04-19 07:24:46.051376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86> (413019ee-964d-475e-9c3b-58e50d0ebd86) [No such file or directory] >[2016-04-19 07:24:46.051541] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:413019ee-964d-475e-9c3b-58e50d0ebd86>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.061119] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.061937] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2> (ada5ed4b-fe4a-4b21-a256-36fdf70a13b2) [No such file or directory] >[2016-04-19 07:24:46.062442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2> (ada5ed4b-fe4a-4b21-a256-36fdf70a13b2) [No such file or directory] >[2016-04-19 07:24:46.065029] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ada5ed4b-fe4a-4b21-a256-36fdf70a13b2. (Possible split-brain) >[2016-04-19 07:24:46.065959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2> (ada5ed4b-fe4a-4b21-a256-36fdf70a13b2) [No such file or directory] >[2016-04-19 07:24:46.066425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2> (ada5ed4b-fe4a-4b21-a256-36fdf70a13b2) [No such file or directory] >[2016-04-19 07:24:46.067387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2> (ada5ed4b-fe4a-4b21-a256-36fdf70a13b2) [No such file or directory] >[2016-04-19 07:24:46.067683] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2> (ada5ed4b-fe4a-4b21-a256-36fdf70a13b2) [No such file or directory] >[2016-04-19 07:24:46.067955] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.070499] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ada5ed4b-fe4a-4b21-a256-36fdf70a13b2. (Possible split-brain) >[2016-04-19 07:24:46.071521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2> (ada5ed4b-fe4a-4b21-a256-36fdf70a13b2) [No such file or directory] >[2016-04-19 07:24:46.071811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2> (ada5ed4b-fe4a-4b21-a256-36fdf70a13b2) [No such file or directory] >[2016-04-19 07:24:46.074092] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2> (ada5ed4b-fe4a-4b21-a256-36fdf70a13b2) [No such file or directory] >[2016-04-19 07:24:46.074416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2> (ada5ed4b-fe4a-4b21-a256-36fdf70a13b2) [No such file or directory] >[2016-04-19 07:24:46.074617] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ada5ed4b-fe4a-4b21-a256-36fdf70a13b2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.083987] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.084792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9> (d24b0a6a-03d7-444b-b1e5-bd7a677351f9) [No such file or directory] >[2016-04-19 07:24:46.084967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9> (d24b0a6a-03d7-444b-b1e5-bd7a677351f9) [No such file or directory] >[2016-04-19 07:24:46.087873] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d24b0a6a-03d7-444b-b1e5-bd7a677351f9. (Possible split-brain) >[2016-04-19 07:24:46.088655] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9> (d24b0a6a-03d7-444b-b1e5-bd7a677351f9) [No such file or directory] >[2016-04-19 07:24:46.088970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9> (d24b0a6a-03d7-444b-b1e5-bd7a677351f9) [No such file or directory] >[2016-04-19 07:24:46.090229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9> (d24b0a6a-03d7-444b-b1e5-bd7a677351f9) [No such file or directory] >[2016-04-19 07:24:46.090462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9> (d24b0a6a-03d7-444b-b1e5-bd7a677351f9) [No such file or directory] >[2016-04-19 07:24:46.090591] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.093172] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d24b0a6a-03d7-444b-b1e5-bd7a677351f9. (Possible split-brain) >[2016-04-19 07:24:46.094029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9> (d24b0a6a-03d7-444b-b1e5-bd7a677351f9) [No such file or directory] >[2016-04-19 07:24:46.094155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9> (d24b0a6a-03d7-444b-b1e5-bd7a677351f9) [No such file or directory] >[2016-04-19 07:24:46.096998] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9> (d24b0a6a-03d7-444b-b1e5-bd7a677351f9) [No such file or directory] >[2016-04-19 07:24:46.097304] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9> (d24b0a6a-03d7-444b-b1e5-bd7a677351f9) [No such file or directory] >[2016-04-19 07:24:46.097490] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d24b0a6a-03d7-444b-b1e5-bd7a677351f9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.105953] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.106787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603> (84e4a859-d487-4cdc-aaa6-05e568c41603) [No such file or directory] >[2016-04-19 07:24:46.106864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603> (84e4a859-d487-4cdc-aaa6-05e568c41603) [No such file or directory] >[2016-04-19 07:24:46.109769] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 84e4a859-d487-4cdc-aaa6-05e568c41603. (Possible split-brain) >[2016-04-19 07:24:46.110576] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603> (84e4a859-d487-4cdc-aaa6-05e568c41603) [No such file or directory] >[2016-04-19 07:24:46.110671] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603> (84e4a859-d487-4cdc-aaa6-05e568c41603) [No such file or directory] >[2016-04-19 07:24:46.112141] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603> (84e4a859-d487-4cdc-aaa6-05e568c41603) [No such file or directory] >[2016-04-19 07:24:46.112374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603> (84e4a859-d487-4cdc-aaa6-05e568c41603) [No such file or directory] >[2016-04-19 07:24:46.112523] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.115038] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 84e4a859-d487-4cdc-aaa6-05e568c41603. (Possible split-brain) >[2016-04-19 07:24:46.116049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603> (84e4a859-d487-4cdc-aaa6-05e568c41603) [No such file or directory] >[2016-04-19 07:24:46.116166] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603> (84e4a859-d487-4cdc-aaa6-05e568c41603) [No such file or directory] >[2016-04-19 07:24:46.118705] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603> (84e4a859-d487-4cdc-aaa6-05e568c41603) [No such file or directory] >[2016-04-19 07:24:46.118949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603> (84e4a859-d487-4cdc-aaa6-05e568c41603) [No such file or directory] >[2016-04-19 07:24:46.119171] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:84e4a859-d487-4cdc-aaa6-05e568c41603>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.128234] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.129452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9> (96af50dc-48ba-4515-a479-801378c0e4a9) [No such file or directory] >[2016-04-19 07:24:46.129549] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9> (96af50dc-48ba-4515-a479-801378c0e4a9) [No such file or directory] >[2016-04-19 07:24:46.132420] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 96af50dc-48ba-4515-a479-801378c0e4a9. (Possible split-brain) >[2016-04-19 07:24:46.133378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9> (96af50dc-48ba-4515-a479-801378c0e4a9) [No such file or directory] >[2016-04-19 07:24:46.133754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9> (96af50dc-48ba-4515-a479-801378c0e4a9) [No such file or directory] >[2016-04-19 07:24:46.135122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9> (96af50dc-48ba-4515-a479-801378c0e4a9) [No such file or directory] >[2016-04-19 07:24:46.135402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9> (96af50dc-48ba-4515-a479-801378c0e4a9) [No such file or directory] >[2016-04-19 07:24:46.135551] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.138057] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 96af50dc-48ba-4515-a479-801378c0e4a9. (Possible split-brain) >[2016-04-19 07:24:46.138896] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9> (96af50dc-48ba-4515-a479-801378c0e4a9) [No such file or directory] >[2016-04-19 07:24:46.139090] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9> (96af50dc-48ba-4515-a479-801378c0e4a9) [No such file or directory] >[2016-04-19 07:24:46.141918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9> (96af50dc-48ba-4515-a479-801378c0e4a9) [No such file or directory] >[2016-04-19 07:24:46.142024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9> (96af50dc-48ba-4515-a479-801378c0e4a9) [No such file or directory] >[2016-04-19 07:24:46.142158] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:96af50dc-48ba-4515-a479-801378c0e4a9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.151180] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.152088] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae> (c8ef236f-8fcf-41f9-b2af-7699266ac1ae) [No such file or directory] >[2016-04-19 07:24:46.152160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae> (c8ef236f-8fcf-41f9-b2af-7699266ac1ae) [No such file or directory] >[2016-04-19 07:24:46.154805] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c8ef236f-8fcf-41f9-b2af-7699266ac1ae. (Possible split-brain) >[2016-04-19 07:24:46.155832] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae> (c8ef236f-8fcf-41f9-b2af-7699266ac1ae) [No such file or directory] >[2016-04-19 07:24:46.155964] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae> (c8ef236f-8fcf-41f9-b2af-7699266ac1ae) [No such file or directory] >[2016-04-19 07:24:46.157435] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae> (c8ef236f-8fcf-41f9-b2af-7699266ac1ae) [No such file or directory] >[2016-04-19 07:24:46.157471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae> (c8ef236f-8fcf-41f9-b2af-7699266ac1ae) [No such file or directory] >[2016-04-19 07:24:46.158108] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.160692] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c8ef236f-8fcf-41f9-b2af-7699266ac1ae. (Possible split-brain) >[2016-04-19 07:24:46.161748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae> (c8ef236f-8fcf-41f9-b2af-7699266ac1ae) [No such file or directory] >[2016-04-19 07:24:46.161930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae> (c8ef236f-8fcf-41f9-b2af-7699266ac1ae) [No such file or directory] >[2016-04-19 07:24:46.164673] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae> (c8ef236f-8fcf-41f9-b2af-7699266ac1ae) [No such file or directory] >[2016-04-19 07:24:46.164767] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae> (c8ef236f-8fcf-41f9-b2af-7699266ac1ae) [No such file or directory] >[2016-04-19 07:24:46.165002] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c8ef236f-8fcf-41f9-b2af-7699266ac1ae>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.174154] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.175111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904> (a4cfe9f9-36f8-4092-bd94-62619be9b904) [No such file or directory] >[2016-04-19 07:24:46.175204] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904> (a4cfe9f9-36f8-4092-bd94-62619be9b904) [No such file or directory] >[2016-04-19 07:24:46.176351] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a4cfe9f9-36f8-4092-bd94-62619be9b904. (Possible split-brain) >[2016-04-19 07:24:46.177198] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904> (a4cfe9f9-36f8-4092-bd94-62619be9b904) [No such file or directory] >[2016-04-19 07:24:46.177277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904> (a4cfe9f9-36f8-4092-bd94-62619be9b904) [No such file or directory] >[2016-04-19 07:24:46.178845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904> (a4cfe9f9-36f8-4092-bd94-62619be9b904) [No such file or directory] >[2016-04-19 07:24:46.178930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904> (a4cfe9f9-36f8-4092-bd94-62619be9b904) [No such file or directory] >[2016-04-19 07:24:46.179042] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.181560] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a4cfe9f9-36f8-4092-bd94-62619be9b904. (Possible split-brain) >[2016-04-19 07:24:46.182744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904> (a4cfe9f9-36f8-4092-bd94-62619be9b904) [No such file or directory] >[2016-04-19 07:24:46.182842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904> (a4cfe9f9-36f8-4092-bd94-62619be9b904) [No such file or directory] >[2016-04-19 07:24:46.185971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904> (a4cfe9f9-36f8-4092-bd94-62619be9b904) [No such file or directory] >[2016-04-19 07:24:46.186299] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904> (a4cfe9f9-36f8-4092-bd94-62619be9b904) [No such file or directory] >[2016-04-19 07:24:46.186447] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a4cfe9f9-36f8-4092-bd94-62619be9b904>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.195590] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.196612] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d> (11532c8b-eb9a-4b94-83a4-570e3fd0b18d) [No such file or directory] >[2016-04-19 07:24:46.196666] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d> (11532c8b-eb9a-4b94-83a4-570e3fd0b18d) [No such file or directory] >[2016-04-19 07:24:46.197756] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 11532c8b-eb9a-4b94-83a4-570e3fd0b18d. (Possible split-brain) >[2016-04-19 07:24:46.198921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d> (11532c8b-eb9a-4b94-83a4-570e3fd0b18d) [No such file or directory] >[2016-04-19 07:24:46.198992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d> (11532c8b-eb9a-4b94-83a4-570e3fd0b18d) [No such file or directory] >[2016-04-19 07:24:46.200246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d> (11532c8b-eb9a-4b94-83a4-570e3fd0b18d) [No such file or directory] >[2016-04-19 07:24:46.200246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d> (11532c8b-eb9a-4b94-83a4-570e3fd0b18d) [No such file or directory] >[2016-04-19 07:24:46.200507] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.202996] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 11532c8b-eb9a-4b94-83a4-570e3fd0b18d. (Possible split-brain) >[2016-04-19 07:24:46.203956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d> (11532c8b-eb9a-4b94-83a4-570e3fd0b18d) [No such file or directory] >[2016-04-19 07:24:46.204226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d> (11532c8b-eb9a-4b94-83a4-570e3fd0b18d) [No such file or directory] >[2016-04-19 07:24:46.206923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d> (11532c8b-eb9a-4b94-83a4-570e3fd0b18d) [No such file or directory] >[2016-04-19 07:24:46.207137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d> (11532c8b-eb9a-4b94-83a4-570e3fd0b18d) [No such file or directory] >[2016-04-19 07:24:46.207262] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:11532c8b-eb9a-4b94-83a4-570e3fd0b18d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.217609] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.218520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d> (5ffdbcf6-c84e-4275-bf59-ebe422373d3d) [No such file or directory] >[2016-04-19 07:24:46.218552] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d> (5ffdbcf6-c84e-4275-bf59-ebe422373d3d) [No such file or directory] >[2016-04-19 07:24:46.221490] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5ffdbcf6-c84e-4275-bf59-ebe422373d3d. (Possible split-brain) >[2016-04-19 07:24:46.222692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d> (5ffdbcf6-c84e-4275-bf59-ebe422373d3d) [No such file or directory] >[2016-04-19 07:24:46.222782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d> (5ffdbcf6-c84e-4275-bf59-ebe422373d3d) [No such file or directory] >[2016-04-19 07:24:46.223949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d> (5ffdbcf6-c84e-4275-bf59-ebe422373d3d) [No such file or directory] >[2016-04-19 07:24:46.224426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d> (5ffdbcf6-c84e-4275-bf59-ebe422373d3d) [No such file or directory] >[2016-04-19 07:24:46.224621] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.227137] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5ffdbcf6-c84e-4275-bf59-ebe422373d3d. (Possible split-brain) >[2016-04-19 07:24:46.228466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d> (5ffdbcf6-c84e-4275-bf59-ebe422373d3d) [No such file or directory] >[2016-04-19 07:24:46.228553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d> (5ffdbcf6-c84e-4275-bf59-ebe422373d3d) [No such file or directory] >[2016-04-19 07:24:46.231094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d> (5ffdbcf6-c84e-4275-bf59-ebe422373d3d) [No such file or directory] >[2016-04-19 07:24:46.231125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d> (5ffdbcf6-c84e-4275-bf59-ebe422373d3d) [No such file or directory] >[2016-04-19 07:24:46.231709] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5ffdbcf6-c84e-4275-bf59-ebe422373d3d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.239961] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.240789] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659> (84ace0a3-12ff-4a5d-a7f0-d3de380f6659) [No such file or directory] >[2016-04-19 07:24:46.241061] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659> (84ace0a3-12ff-4a5d-a7f0-d3de380f6659) [No such file or directory] >[2016-04-19 07:24:46.243951] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 84ace0a3-12ff-4a5d-a7f0-d3de380f6659. (Possible split-brain) >[2016-04-19 07:24:46.244898] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659> (84ace0a3-12ff-4a5d-a7f0-d3de380f6659) [No such file or directory] >[2016-04-19 07:24:46.245249] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659> (84ace0a3-12ff-4a5d-a7f0-d3de380f6659) [No such file or directory] >[2016-04-19 07:24:46.246792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659> (84ace0a3-12ff-4a5d-a7f0-d3de380f6659) [No such file or directory] >[2016-04-19 07:24:46.246810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659> (84ace0a3-12ff-4a5d-a7f0-d3de380f6659) [No such file or directory] >[2016-04-19 07:24:46.246971] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.249551] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 84ace0a3-12ff-4a5d-a7f0-d3de380f6659. (Possible split-brain) >[2016-04-19 07:24:46.250608] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659> (84ace0a3-12ff-4a5d-a7f0-d3de380f6659) [No such file or directory] >[2016-04-19 07:24:46.250646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659> (84ace0a3-12ff-4a5d-a7f0-d3de380f6659) [No such file or directory] >[2016-04-19 07:24:46.253615] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659> (84ace0a3-12ff-4a5d-a7f0-d3de380f6659) [No such file or directory] >[2016-04-19 07:24:46.253865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659> (84ace0a3-12ff-4a5d-a7f0-d3de380f6659) [No such file or directory] >[2016-04-19 07:24:46.254056] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:84ace0a3-12ff-4a5d-a7f0-d3de380f6659>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.263621] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.264453] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af> (7df2a5b4-5832-4496-9f0e-f376050bb0af) [No such file or directory] >[2016-04-19 07:24:46.264891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af> (7df2a5b4-5832-4496-9f0e-f376050bb0af) [No such file or directory] >[2016-04-19 07:24:46.266034] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7df2a5b4-5832-4496-9f0e-f376050bb0af. (Possible split-brain) >[2016-04-19 07:24:46.267100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af> (7df2a5b4-5832-4496-9f0e-f376050bb0af) [No such file or directory] >[2016-04-19 07:24:46.267458] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af> (7df2a5b4-5832-4496-9f0e-f376050bb0af) [No such file or directory] >[2016-04-19 07:24:46.268954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af> (7df2a5b4-5832-4496-9f0e-f376050bb0af) [No such file or directory] >[2016-04-19 07:24:46.269145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af> (7df2a5b4-5832-4496-9f0e-f376050bb0af) [No such file or directory] >[2016-04-19 07:24:46.269298] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.271850] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7df2a5b4-5832-4496-9f0e-f376050bb0af. (Possible split-brain) >[2016-04-19 07:24:46.272791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af> (7df2a5b4-5832-4496-9f0e-f376050bb0af) [No such file or directory] >[2016-04-19 07:24:46.273248] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af> (7df2a5b4-5832-4496-9f0e-f376050bb0af) [No such file or directory] >[2016-04-19 07:24:46.276513] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af> (7df2a5b4-5832-4496-9f0e-f376050bb0af) [No such file or directory] >[2016-04-19 07:24:46.276625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af> (7df2a5b4-5832-4496-9f0e-f376050bb0af) [No such file or directory] >[2016-04-19 07:24:46.276810] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7df2a5b4-5832-4496-9f0e-f376050bb0af>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.286763] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.287833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78> (89afaad7-d002-4cda-899e-dbb3c9ce6d78) [No such file or directory] >[2016-04-19 07:24:46.287915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78> (89afaad7-d002-4cda-899e-dbb3c9ce6d78) [No such file or directory] >[2016-04-19 07:24:46.289045] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 89afaad7-d002-4cda-899e-dbb3c9ce6d78. (Possible split-brain) >[2016-04-19 07:24:46.290449] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78> (89afaad7-d002-4cda-899e-dbb3c9ce6d78) [No such file or directory] >[2016-04-19 07:24:46.290558] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78> (89afaad7-d002-4cda-899e-dbb3c9ce6d78) [No such file or directory] >[2016-04-19 07:24:46.291918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78> (89afaad7-d002-4cda-899e-dbb3c9ce6d78) [No such file or directory] >[2016-04-19 07:24:46.291936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78> (89afaad7-d002-4cda-899e-dbb3c9ce6d78) [No such file or directory] >[2016-04-19 07:24:46.292378] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.294839] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 89afaad7-d002-4cda-899e-dbb3c9ce6d78. (Possible split-brain) >[2016-04-19 07:24:46.295933] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78> (89afaad7-d002-4cda-899e-dbb3c9ce6d78) [No such file or directory] >[2016-04-19 07:24:46.296204] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78> (89afaad7-d002-4cda-899e-dbb3c9ce6d78) [No such file or directory] >[2016-04-19 07:24:46.299518] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78> (89afaad7-d002-4cda-899e-dbb3c9ce6d78) [No such file or directory] >[2016-04-19 07:24:46.299602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78> (89afaad7-d002-4cda-899e-dbb3c9ce6d78) [No such file or directory] >[2016-04-19 07:24:46.299744] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:89afaad7-d002-4cda-899e-dbb3c9ce6d78>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.308020] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.308986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a> (04cc62f9-84d4-4c73-acf0-0975fc646e7a) [No such file or directory] >[2016-04-19 07:24:46.308995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a> (04cc62f9-84d4-4c73-acf0-0975fc646e7a) [No such file or directory] >[2016-04-19 07:24:46.311941] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 04cc62f9-84d4-4c73-acf0-0975fc646e7a. (Possible split-brain) >[2016-04-19 07:24:46.313021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a> (04cc62f9-84d4-4c73-acf0-0975fc646e7a) [No such file or directory] >[2016-04-19 07:24:46.313290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a> (04cc62f9-84d4-4c73-acf0-0975fc646e7a) [No such file or directory] >[2016-04-19 07:24:46.315153] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a> (04cc62f9-84d4-4c73-acf0-0975fc646e7a) [No such file or directory] >[2016-04-19 07:24:46.315197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a> (04cc62f9-84d4-4c73-acf0-0975fc646e7a) [No such file or directory] >[2016-04-19 07:24:46.315388] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.317942] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 04cc62f9-84d4-4c73-acf0-0975fc646e7a. (Possible split-brain) >[2016-04-19 07:24:46.319035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a> (04cc62f9-84d4-4c73-acf0-0975fc646e7a) [No such file or directory] >[2016-04-19 07:24:46.319129] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a> (04cc62f9-84d4-4c73-acf0-0975fc646e7a) [No such file or directory] >[2016-04-19 07:24:46.322066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a> (04cc62f9-84d4-4c73-acf0-0975fc646e7a) [No such file or directory] >[2016-04-19 07:24:46.322353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a> (04cc62f9-84d4-4c73-acf0-0975fc646e7a) [No such file or directory] >[2016-04-19 07:24:46.322582] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:04cc62f9-84d4-4c73-acf0-0975fc646e7a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.332218] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.333308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d> (1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d) [No such file or directory] >[2016-04-19 07:24:46.333444] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d> (1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d) [No such file or directory] >[2016-04-19 07:24:46.334584] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d. (Possible split-brain) >[2016-04-19 07:24:46.335662] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d> (1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d) [No such file or directory] >[2016-04-19 07:24:46.335754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d> (1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d) [No such file or directory] >[2016-04-19 07:24:46.336842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d> (1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d) [No such file or directory] >[2016-04-19 07:24:46.337023] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d> (1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d) [No such file or directory] >[2016-04-19 07:24:46.337186] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.339714] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d. (Possible split-brain) >[2016-04-19 07:24:46.340762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d> (1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d) [No such file or directory] >[2016-04-19 07:24:46.340850] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d> (1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d) [No such file or directory] >[2016-04-19 07:24:46.343963] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d> (1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d) [No such file or directory] >[2016-04-19 07:24:46.344013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d> (1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d) [No such file or directory] >[2016-04-19 07:24:46.344232] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1ffd17a8-c2ed-49c4-8d0e-a71d64109e8d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.353520] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.354508] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:802dba79-0301-4f48-9673-889391db2ee3> (802dba79-0301-4f48-9673-889391db2ee3) [No such file or directory] >[2016-04-19 07:24:46.354538] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:802dba79-0301-4f48-9673-889391db2ee3> (802dba79-0301-4f48-9673-889391db2ee3) [No such file or directory] >[2016-04-19 07:24:46.357365] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 802dba79-0301-4f48-9673-889391db2ee3. (Possible split-brain) >[2016-04-19 07:24:46.358382] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:802dba79-0301-4f48-9673-889391db2ee3> (802dba79-0301-4f48-9673-889391db2ee3) [No such file or directory] >[2016-04-19 07:24:46.358462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:802dba79-0301-4f48-9673-889391db2ee3> (802dba79-0301-4f48-9673-889391db2ee3) [No such file or directory] >[2016-04-19 07:24:46.359907] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:802dba79-0301-4f48-9673-889391db2ee3> (802dba79-0301-4f48-9673-889391db2ee3) [No such file or directory] >[2016-04-19 07:24:46.359986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:802dba79-0301-4f48-9673-889391db2ee3> (802dba79-0301-4f48-9673-889391db2ee3) [No such file or directory] >[2016-04-19 07:24:46.360101] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:802dba79-0301-4f48-9673-889391db2ee3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.362674] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 802dba79-0301-4f48-9673-889391db2ee3. (Possible split-brain) >[2016-04-19 07:24:46.363532] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:802dba79-0301-4f48-9673-889391db2ee3> (802dba79-0301-4f48-9673-889391db2ee3) [No such file or directory] >[2016-04-19 07:24:46.363602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:802dba79-0301-4f48-9673-889391db2ee3> (802dba79-0301-4f48-9673-889391db2ee3) [No such file or directory] >[2016-04-19 07:24:46.366250] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:802dba79-0301-4f48-9673-889391db2ee3> (802dba79-0301-4f48-9673-889391db2ee3) [No such file or directory] >[2016-04-19 07:24:46.366371] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:802dba79-0301-4f48-9673-889391db2ee3> (802dba79-0301-4f48-9673-889391db2ee3) [No such file or directory] >[2016-04-19 07:24:46.366533] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:802dba79-0301-4f48-9673-889391db2ee3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.374428] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.375378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:faa48734-4d13-4250-89fc-06b52b67a798> (faa48734-4d13-4250-89fc-06b52b67a798) [No such file or directory] >[2016-04-19 07:24:46.375383] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:faa48734-4d13-4250-89fc-06b52b67a798> (faa48734-4d13-4250-89fc-06b52b67a798) [No such file or directory] >[2016-04-19 07:24:46.378254] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid faa48734-4d13-4250-89fc-06b52b67a798. (Possible split-brain) >[2016-04-19 07:24:46.379135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:faa48734-4d13-4250-89fc-06b52b67a798> (faa48734-4d13-4250-89fc-06b52b67a798) [No such file or directory] >[2016-04-19 07:24:46.379168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:faa48734-4d13-4250-89fc-06b52b67a798> (faa48734-4d13-4250-89fc-06b52b67a798) [No such file or directory] >[2016-04-19 07:24:46.380619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:faa48734-4d13-4250-89fc-06b52b67a798> (faa48734-4d13-4250-89fc-06b52b67a798) [No such file or directory] >[2016-04-19 07:24:46.380811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:faa48734-4d13-4250-89fc-06b52b67a798> (faa48734-4d13-4250-89fc-06b52b67a798) [No such file or directory] >[2016-04-19 07:24:46.380937] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:faa48734-4d13-4250-89fc-06b52b67a798>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.383560] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid faa48734-4d13-4250-89fc-06b52b67a798. (Possible split-brain) >[2016-04-19 07:24:46.384545] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:faa48734-4d13-4250-89fc-06b52b67a798> (faa48734-4d13-4250-89fc-06b52b67a798) [No such file or directory] >[2016-04-19 07:24:46.384554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:faa48734-4d13-4250-89fc-06b52b67a798> (faa48734-4d13-4250-89fc-06b52b67a798) [No such file or directory] >[2016-04-19 07:24:46.387667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:faa48734-4d13-4250-89fc-06b52b67a798> (faa48734-4d13-4250-89fc-06b52b67a798) [No such file or directory] >[2016-04-19 07:24:46.387694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:faa48734-4d13-4250-89fc-06b52b67a798> (faa48734-4d13-4250-89fc-06b52b67a798) [No such file or directory] >[2016-04-19 07:24:46.387935] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:faa48734-4d13-4250-89fc-06b52b67a798>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.397963] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.399104] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db> (6c3df812-216d-47f3-a8de-79578d1ba4db) [No such file or directory] >[2016-04-19 07:24:46.399115] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db> (6c3df812-216d-47f3-a8de-79578d1ba4db) [No such file or directory] >[2016-04-19 07:24:46.402107] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6c3df812-216d-47f3-a8de-79578d1ba4db. (Possible split-brain) >[2016-04-19 07:24:46.403140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db> (6c3df812-216d-47f3-a8de-79578d1ba4db) [No such file or directory] >[2016-04-19 07:24:46.403157] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db> (6c3df812-216d-47f3-a8de-79578d1ba4db) [No such file or directory] >[2016-04-19 07:24:46.404767] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db> (6c3df812-216d-47f3-a8de-79578d1ba4db) [No such file or directory] >[2016-04-19 07:24:46.404792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db> (6c3df812-216d-47f3-a8de-79578d1ba4db) [No such file or directory] >[2016-04-19 07:24:46.405005] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.407665] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6c3df812-216d-47f3-a8de-79578d1ba4db. (Possible split-brain) >[2016-04-19 07:24:46.408858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db> (6c3df812-216d-47f3-a8de-79578d1ba4db) [No such file or directory] >[2016-04-19 07:24:46.408955] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db> (6c3df812-216d-47f3-a8de-79578d1ba4db) [No such file or directory] >[2016-04-19 07:24:46.411603] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db> (6c3df812-216d-47f3-a8de-79578d1ba4db) [No such file or directory] >[2016-04-19 07:24:46.412044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db> (6c3df812-216d-47f3-a8de-79578d1ba4db) [No such file or directory] >[2016-04-19 07:24:46.412362] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6c3df812-216d-47f3-a8de-79578d1ba4db>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.421646] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.422569] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6> (800cde3b-fae4-4041-8687-71b509e66bf6) [No such file or directory] >[2016-04-19 07:24:46.422577] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6> (800cde3b-fae4-4041-8687-71b509e66bf6) [No such file or directory] >[2016-04-19 07:24:46.423721] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 800cde3b-fae4-4041-8687-71b509e66bf6. (Possible split-brain) >[2016-04-19 07:24:46.424495] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6> (800cde3b-fae4-4041-8687-71b509e66bf6) [No such file or directory] >[2016-04-19 07:24:46.424597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6> (800cde3b-fae4-4041-8687-71b509e66bf6) [No such file or directory] >[2016-04-19 07:24:46.425930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6> (800cde3b-fae4-4041-8687-71b509e66bf6) [No such file or directory] >[2016-04-19 07:24:46.425961] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6> (800cde3b-fae4-4041-8687-71b509e66bf6) [No such file or directory] >[2016-04-19 07:24:46.426117] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.428619] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 800cde3b-fae4-4041-8687-71b509e66bf6. (Possible split-brain) >[2016-04-19 07:24:46.429514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6> (800cde3b-fae4-4041-8687-71b509e66bf6) [No such file or directory] >[2016-04-19 07:24:46.429547] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6> (800cde3b-fae4-4041-8687-71b509e66bf6) [No such file or directory] >[2016-04-19 07:24:46.432740] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6> (800cde3b-fae4-4041-8687-71b509e66bf6) [No such file or directory] >[2016-04-19 07:24:46.432799] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6> (800cde3b-fae4-4041-8687-71b509e66bf6) [No such file or directory] >[2016-04-19 07:24:46.433241] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:800cde3b-fae4-4041-8687-71b509e66bf6>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.443797] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.444661] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540> (07081be3-e1c5-43b3-a0c3-0ace89a54540) [No such file or directory] >[2016-04-19 07:24:46.444962] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540> (07081be3-e1c5-43b3-a0c3-0ace89a54540) [No such file or directory] >[2016-04-19 07:24:46.447483] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 07081be3-e1c5-43b3-a0c3-0ace89a54540. (Possible split-brain) >[2016-04-19 07:24:46.448685] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540> (07081be3-e1c5-43b3-a0c3-0ace89a54540) [No such file or directory] >[2016-04-19 07:24:46.448777] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540> (07081be3-e1c5-43b3-a0c3-0ace89a54540) [No such file or directory] >[2016-04-19 07:24:46.450125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540> (07081be3-e1c5-43b3-a0c3-0ace89a54540) [No such file or directory] >[2016-04-19 07:24:46.450149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540> (07081be3-e1c5-43b3-a0c3-0ace89a54540) [No such file or directory] >[2016-04-19 07:24:46.450289] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.452904] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 07081be3-e1c5-43b3-a0c3-0ace89a54540. (Possible split-brain) >[2016-04-19 07:24:46.453874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540> (07081be3-e1c5-43b3-a0c3-0ace89a54540) [No such file or directory] >[2016-04-19 07:24:46.454139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540> (07081be3-e1c5-43b3-a0c3-0ace89a54540) [No such file or directory] >[2016-04-19 07:24:46.456905] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540> (07081be3-e1c5-43b3-a0c3-0ace89a54540) [No such file or directory] >[2016-04-19 07:24:46.457040] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540> (07081be3-e1c5-43b3-a0c3-0ace89a54540) [No such file or directory] >[2016-04-19 07:24:46.457180] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:07081be3-e1c5-43b3-a0c3-0ace89a54540>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.466824] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.467688] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5> (5005113a-29d1-4d17-818b-de2fd888d3c5) [No such file or directory] >[2016-04-19 07:24:46.468012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5> (5005113a-29d1-4d17-818b-de2fd888d3c5) [No such file or directory] >[2016-04-19 07:24:46.469121] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5005113a-29d1-4d17-818b-de2fd888d3c5. (Possible split-brain) >[2016-04-19 07:24:46.470229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5> (5005113a-29d1-4d17-818b-de2fd888d3c5) [No such file or directory] >[2016-04-19 07:24:46.470238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5> (5005113a-29d1-4d17-818b-de2fd888d3c5) [No such file or directory] >[2016-04-19 07:24:46.471487] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5> (5005113a-29d1-4d17-818b-de2fd888d3c5) [No such file or directory] >[2016-04-19 07:24:46.471804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5> (5005113a-29d1-4d17-818b-de2fd888d3c5) [No such file or directory] >[2016-04-19 07:24:46.471966] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.474435] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5005113a-29d1-4d17-818b-de2fd888d3c5. (Possible split-brain) >[2016-04-19 07:24:46.475442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5> (5005113a-29d1-4d17-818b-de2fd888d3c5) [No such file or directory] >[2016-04-19 07:24:46.475490] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5> (5005113a-29d1-4d17-818b-de2fd888d3c5) [No such file or directory] >[2016-04-19 07:24:46.478572] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5> (5005113a-29d1-4d17-818b-de2fd888d3c5) [No such file or directory] >[2016-04-19 07:24:46.478678] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5> (5005113a-29d1-4d17-818b-de2fd888d3c5) [No such file or directory] >[2016-04-19 07:24:46.478962] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5005113a-29d1-4d17-818b-de2fd888d3c5>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.488771] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.489783] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba> (42c0b5e6-b685-405d-8906-0e9301b6c5ba) [No such file or directory] >[2016-04-19 07:24:46.489883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba> (42c0b5e6-b685-405d-8906-0e9301b6c5ba) [No such file or directory] >[2016-04-19 07:24:46.492773] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 42c0b5e6-b685-405d-8906-0e9301b6c5ba. (Possible split-brain) >[2016-04-19 07:24:46.493755] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba> (42c0b5e6-b685-405d-8906-0e9301b6c5ba) [No such file or directory] >[2016-04-19 07:24:46.493834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba> (42c0b5e6-b685-405d-8906-0e9301b6c5ba) [No such file or directory] >[2016-04-19 07:24:46.495093] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba> (42c0b5e6-b685-405d-8906-0e9301b6c5ba) [No such file or directory] >[2016-04-19 07:24:46.495376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba> (42c0b5e6-b685-405d-8906-0e9301b6c5ba) [No such file or directory] >[2016-04-19 07:24:46.495541] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.498099] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 42c0b5e6-b685-405d-8906-0e9301b6c5ba. (Possible split-brain) >[2016-04-19 07:24:46.498889] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba> (42c0b5e6-b685-405d-8906-0e9301b6c5ba) [No such file or directory] >[2016-04-19 07:24:46.499151] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba> (42c0b5e6-b685-405d-8906-0e9301b6c5ba) [No such file or directory] >[2016-04-19 07:24:46.502490] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba> (42c0b5e6-b685-405d-8906-0e9301b6c5ba) [No such file or directory] >[2016-04-19 07:24:46.502583] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba> (42c0b5e6-b685-405d-8906-0e9301b6c5ba) [No such file or directory] >[2016-04-19 07:24:46.502724] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:42c0b5e6-b685-405d-8906-0e9301b6c5ba>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.512217] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.513455] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1> (5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1) [No such file or directory] >[2016-04-19 07:24:46.513554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1> (5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1) [No such file or directory] >[2016-04-19 07:24:46.516437] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1. (Possible split-brain) >[2016-04-19 07:24:46.517807] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1> (5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1) [No such file or directory] >[2016-04-19 07:24:46.517891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1> (5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1) [No such file or directory] >[2016-04-19 07:24:46.519095] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1> (5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1) [No such file or directory] >[2016-04-19 07:24:46.519356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1> (5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1) [No such file or directory] >[2016-04-19 07:24:46.519585] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.522178] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1. (Possible split-brain) >[2016-04-19 07:24:46.523349] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1> (5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1) [No such file or directory] >[2016-04-19 07:24:46.523379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1> (5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1) [No such file or directory] >[2016-04-19 07:24:46.526179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1> (5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1) [No such file or directory] >[2016-04-19 07:24:46.526281] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1> (5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1) [No such file or directory] >[2016-04-19 07:24:46.526509] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5d20a1b7-cfb3-4431-bc0e-aad73d2ac4f1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.536138] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.536867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a> (d95032b3-5f28-41d3-b6b1-548c01d4ba7a) [No such file or directory] >[2016-04-19 07:24:46.537109] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a> (d95032b3-5f28-41d3-b6b1-548c01d4ba7a) [No such file or directory] >[2016-04-19 07:24:46.538225] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d95032b3-5f28-41d3-b6b1-548c01d4ba7a. (Possible split-brain) >[2016-04-19 07:24:46.538981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a> (d95032b3-5f28-41d3-b6b1-548c01d4ba7a) [No such file or directory] >[2016-04-19 07:24:46.539310] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a> (d95032b3-5f28-41d3-b6b1-548c01d4ba7a) [No such file or directory] >[2016-04-19 07:24:46.540716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a> (d95032b3-5f28-41d3-b6b1-548c01d4ba7a) [No such file or directory] >[2016-04-19 07:24:46.540772] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a> (d95032b3-5f28-41d3-b6b1-548c01d4ba7a) [No such file or directory] >[2016-04-19 07:24:46.540920] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.543349] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d95032b3-5f28-41d3-b6b1-548c01d4ba7a. (Possible split-brain) >[2016-04-19 07:24:46.544102] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a> (d95032b3-5f28-41d3-b6b1-548c01d4ba7a) [No such file or directory] >[2016-04-19 07:24:46.544192] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a> (d95032b3-5f28-41d3-b6b1-548c01d4ba7a) [No such file or directory] >[2016-04-19 07:24:46.547025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a> (d95032b3-5f28-41d3-b6b1-548c01d4ba7a) [No such file or directory] >[2016-04-19 07:24:46.547108] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a> (d95032b3-5f28-41d3-b6b1-548c01d4ba7a) [No such file or directory] >[2016-04-19 07:24:46.547243] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d95032b3-5f28-41d3-b6b1-548c01d4ba7a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.556024] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.557104] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df> (0c7eb36f-d68e-420e-91a8-c7844d3aa2df) [No such file or directory] >[2016-04-19 07:24:46.557184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df> (0c7eb36f-d68e-420e-91a8-c7844d3aa2df) [No such file or directory] >[2016-04-19 07:24:46.558263] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0c7eb36f-d68e-420e-91a8-c7844d3aa2df. (Possible split-brain) >[2016-04-19 07:24:46.559551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df> (0c7eb36f-d68e-420e-91a8-c7844d3aa2df) [No such file or directory] >[2016-04-19 07:24:46.559635] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df> (0c7eb36f-d68e-420e-91a8-c7844d3aa2df) [No such file or directory] >[2016-04-19 07:24:46.561071] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df> (0c7eb36f-d68e-420e-91a8-c7844d3aa2df) [No such file or directory] >[2016-04-19 07:24:46.561158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df> (0c7eb36f-d68e-420e-91a8-c7844d3aa2df) [No such file or directory] >[2016-04-19 07:24:46.561657] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.564186] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0c7eb36f-d68e-420e-91a8-c7844d3aa2df. (Possible split-brain) >[2016-04-19 07:24:46.565398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df> (0c7eb36f-d68e-420e-91a8-c7844d3aa2df) [No such file or directory] >[2016-04-19 07:24:46.565485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df> (0c7eb36f-d68e-420e-91a8-c7844d3aa2df) [No such file or directory] >[2016-04-19 07:24:46.568757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df> (0c7eb36f-d68e-420e-91a8-c7844d3aa2df) [No such file or directory] >[2016-04-19 07:24:46.568768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df> (0c7eb36f-d68e-420e-91a8-c7844d3aa2df) [No such file or directory] >[2016-04-19 07:24:46.568949] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0c7eb36f-d68e-420e-91a8-c7844d3aa2df>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.579105] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.580233] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5> (21511883-b663-4d2b-ac55-b6e3cc3fe5a5) [No such file or directory] >[2016-04-19 07:24:46.580312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5> (21511883-b663-4d2b-ac55-b6e3cc3fe5a5) [No such file or directory] >[2016-04-19 07:24:46.581463] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 21511883-b663-4d2b-ac55-b6e3cc3fe5a5. (Possible split-brain) >[2016-04-19 07:24:46.582607] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5> (21511883-b663-4d2b-ac55-b6e3cc3fe5a5) [No such file or directory] >[2016-04-19 07:24:46.582709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5> (21511883-b663-4d2b-ac55-b6e3cc3fe5a5) [No such file or directory] >[2016-04-19 07:24:46.583967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5> (21511883-b663-4d2b-ac55-b6e3cc3fe5a5) [No such file or directory] >[2016-04-19 07:24:46.584043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5> (21511883-b663-4d2b-ac55-b6e3cc3fe5a5) [No such file or directory] >[2016-04-19 07:24:46.584175] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.586670] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 21511883-b663-4d2b-ac55-b6e3cc3fe5a5. (Possible split-brain) >[2016-04-19 07:24:46.587763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5> (21511883-b663-4d2b-ac55-b6e3cc3fe5a5) [No such file or directory] >[2016-04-19 07:24:46.587863] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5> (21511883-b663-4d2b-ac55-b6e3cc3fe5a5) [No such file or directory] >[2016-04-19 07:24:46.590707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5> (21511883-b663-4d2b-ac55-b6e3cc3fe5a5) [No such file or directory] >[2016-04-19 07:24:46.590754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5> (21511883-b663-4d2b-ac55-b6e3cc3fe5a5) [No such file or directory] >[2016-04-19 07:24:46.590989] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:21511883-b663-4d2b-ac55-b6e3cc3fe5a5>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.600393] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.601412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1> (d64c7427-e1e7-4d93-abca-65b10a18d7f1) [No such file or directory] >[2016-04-19 07:24:46.601419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1> (d64c7427-e1e7-4d93-abca-65b10a18d7f1) [No such file or directory] >[2016-04-19 07:24:46.602564] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d64c7427-e1e7-4d93-abca-65b10a18d7f1. (Possible split-brain) >[2016-04-19 07:24:46.603493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1> (d64c7427-e1e7-4d93-abca-65b10a18d7f1) [No such file or directory] >[2016-04-19 07:24:46.603821] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1> (d64c7427-e1e7-4d93-abca-65b10a18d7f1) [No such file or directory] >[2016-04-19 07:24:46.605038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1> (d64c7427-e1e7-4d93-abca-65b10a18d7f1) [No such file or directory] >[2016-04-19 07:24:46.605262] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1> (d64c7427-e1e7-4d93-abca-65b10a18d7f1) [No such file or directory] >[2016-04-19 07:24:46.605449] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.607964] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d64c7427-e1e7-4d93-abca-65b10a18d7f1. (Possible split-brain) >[2016-04-19 07:24:46.608858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1> (d64c7427-e1e7-4d93-abca-65b10a18d7f1) [No such file or directory] >[2016-04-19 07:24:46.609253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1> (d64c7427-e1e7-4d93-abca-65b10a18d7f1) [No such file or directory] >[2016-04-19 07:24:46.612222] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1> (d64c7427-e1e7-4d93-abca-65b10a18d7f1) [No such file or directory] >[2016-04-19 07:24:46.612381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1> (d64c7427-e1e7-4d93-abca-65b10a18d7f1) [No such file or directory] >[2016-04-19 07:24:46.612590] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d64c7427-e1e7-4d93-abca-65b10a18d7f1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.621884] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.622723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722> (e3f6461e-da9b-4aa0-bb03-2b17a1a9e722) [No such file or directory] >[2016-04-19 07:24:46.622746] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722> (e3f6461e-da9b-4aa0-bb03-2b17a1a9e722) [No such file or directory] >[2016-04-19 07:24:46.625701] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e3f6461e-da9b-4aa0-bb03-2b17a1a9e722. (Possible split-brain) >[2016-04-19 07:24:46.626600] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722> (e3f6461e-da9b-4aa0-bb03-2b17a1a9e722) [No such file or directory] >[2016-04-19 07:24:46.626698] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722> (e3f6461e-da9b-4aa0-bb03-2b17a1a9e722) [No such file or directory] >[2016-04-19 07:24:46.628005] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722> (e3f6461e-da9b-4aa0-bb03-2b17a1a9e722) [No such file or directory] >[2016-04-19 07:24:46.628101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722> (e3f6461e-da9b-4aa0-bb03-2b17a1a9e722) [No such file or directory] >[2016-04-19 07:24:46.628247] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.630820] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e3f6461e-da9b-4aa0-bb03-2b17a1a9e722. (Possible split-brain) >[2016-04-19 07:24:46.631670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722> (e3f6461e-da9b-4aa0-bb03-2b17a1a9e722) [No such file or directory] >[2016-04-19 07:24:46.631810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722> (e3f6461e-da9b-4aa0-bb03-2b17a1a9e722) [No such file or directory] >[2016-04-19 07:24:46.635050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722> (e3f6461e-da9b-4aa0-bb03-2b17a1a9e722) [No such file or directory] >[2016-04-19 07:24:46.635079] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722> (e3f6461e-da9b-4aa0-bb03-2b17a1a9e722) [No such file or directory] >[2016-04-19 07:24:46.635517] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e3f6461e-da9b-4aa0-bb03-2b17a1a9e722>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.644241] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.645164] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb> (e69b6215-aaa4-4328-921e-77193046f5cb) [No such file or directory] >[2016-04-19 07:24:46.645165] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb> (e69b6215-aaa4-4328-921e-77193046f5cb) [No such file or directory] >[2016-04-19 07:24:46.648097] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e69b6215-aaa4-4328-921e-77193046f5cb. (Possible split-brain) >[2016-04-19 07:24:46.648846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb> (e69b6215-aaa4-4328-921e-77193046f5cb) [No such file or directory] >[2016-04-19 07:24:46.648967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb> (e69b6215-aaa4-4328-921e-77193046f5cb) [No such file or directory] >[2016-04-19 07:24:46.650430] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb> (e69b6215-aaa4-4328-921e-77193046f5cb) [No such file or directory] >[2016-04-19 07:24:46.650533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb> (e69b6215-aaa4-4328-921e-77193046f5cb) [No such file or directory] >[2016-04-19 07:24:46.650708] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.653291] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e69b6215-aaa4-4328-921e-77193046f5cb. (Possible split-brain) >[2016-04-19 07:24:46.654103] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb> (e69b6215-aaa4-4328-921e-77193046f5cb) [No such file or directory] >[2016-04-19 07:24:46.654189] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb> (e69b6215-aaa4-4328-921e-77193046f5cb) [No such file or directory] >[2016-04-19 07:24:46.656695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb> (e69b6215-aaa4-4328-921e-77193046f5cb) [No such file or directory] >[2016-04-19 07:24:46.656804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb> (e69b6215-aaa4-4328-921e-77193046f5cb) [No such file or directory] >[2016-04-19 07:24:46.656902] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e69b6215-aaa4-4328-921e-77193046f5cb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.666651] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.667760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f> (23a50c32-e69d-4f4f-888a-ee011ff8078f) [No such file or directory] >[2016-04-19 07:24:46.667841] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f> (23a50c32-e69d-4f4f-888a-ee011ff8078f) [No such file or directory] >[2016-04-19 07:24:46.670766] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 23a50c32-e69d-4f4f-888a-ee011ff8078f. (Possible split-brain) >[2016-04-19 07:24:46.671905] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f> (23a50c32-e69d-4f4f-888a-ee011ff8078f) [No such file or directory] >[2016-04-19 07:24:46.671911] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f> (23a50c32-e69d-4f4f-888a-ee011ff8078f) [No such file or directory] >[2016-04-19 07:24:46.672933] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f> (23a50c32-e69d-4f4f-888a-ee011ff8078f) [No such file or directory] >[2016-04-19 07:24:46.673177] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f> (23a50c32-e69d-4f4f-888a-ee011ff8078f) [No such file or directory] >[2016-04-19 07:24:46.673356] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.675842] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 23a50c32-e69d-4f4f-888a-ee011ff8078f. (Possible split-brain) >[2016-04-19 07:24:46.677111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f> (23a50c32-e69d-4f4f-888a-ee011ff8078f) [No such file or directory] >[2016-04-19 07:24:46.677144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f> (23a50c32-e69d-4f4f-888a-ee011ff8078f) [No such file or directory] >[2016-04-19 07:24:46.680094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f> (23a50c32-e69d-4f4f-888a-ee011ff8078f) [No such file or directory] >[2016-04-19 07:24:46.680228] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f> (23a50c32-e69d-4f4f-888a-ee011ff8078f) [No such file or directory] >[2016-04-19 07:24:46.680392] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:23a50c32-e69d-4f4f-888a-ee011ff8078f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.689064] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.690024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe> (e2b557de-b049-41e3-b791-c5438ed7c1fe) [No such file or directory] >[2016-04-19 07:24:46.690086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe> (e2b557de-b049-41e3-b791-c5438ed7c1fe) [No such file or directory] >[2016-04-19 07:24:46.692652] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e2b557de-b049-41e3-b791-c5438ed7c1fe. (Possible split-brain) >[2016-04-19 07:24:46.693593] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe> (e2b557de-b049-41e3-b791-c5438ed7c1fe) [No such file or directory] >[2016-04-19 07:24:46.693909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe> (e2b557de-b049-41e3-b791-c5438ed7c1fe) [No such file or directory] >[2016-04-19 07:24:46.695449] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe> (e2b557de-b049-41e3-b791-c5438ed7c1fe) [No such file or directory] >[2016-04-19 07:24:46.695749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe> (e2b557de-b049-41e3-b791-c5438ed7c1fe) [No such file or directory] >[2016-04-19 07:24:46.695865] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.698447] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e2b557de-b049-41e3-b791-c5438ed7c1fe. (Possible split-brain) >[2016-04-19 07:24:46.699512] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe> (e2b557de-b049-41e3-b791-c5438ed7c1fe) [No such file or directory] >[2016-04-19 07:24:46.699600] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe> (e2b557de-b049-41e3-b791-c5438ed7c1fe) [No such file or directory] >[2016-04-19 07:24:46.702762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe> (e2b557de-b049-41e3-b791-c5438ed7c1fe) [No such file or directory] >[2016-04-19 07:24:46.702791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe> (e2b557de-b049-41e3-b791-c5438ed7c1fe) [No such file or directory] >[2016-04-19 07:24:46.702970] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e2b557de-b049-41e3-b791-c5438ed7c1fe>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.713387] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.714508] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3> (041ad446-1559-4a48-afc0-69660ba0dad3) [No such file or directory] >[2016-04-19 07:24:46.714590] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3> (041ad446-1559-4a48-afc0-69660ba0dad3) [No such file or directory] >[2016-04-19 07:24:46.715708] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 041ad446-1559-4a48-afc0-69660ba0dad3. (Possible split-brain) >[2016-04-19 07:24:46.716887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3> (041ad446-1559-4a48-afc0-69660ba0dad3) [No such file or directory] >[2016-04-19 07:24:46.716901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3> (041ad446-1559-4a48-afc0-69660ba0dad3) [No such file or directory] >[2016-04-19 07:24:46.717938] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3> (041ad446-1559-4a48-afc0-69660ba0dad3) [No such file or directory] >[2016-04-19 07:24:46.718248] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3> (041ad446-1559-4a48-afc0-69660ba0dad3) [No such file or directory] >[2016-04-19 07:24:46.718390] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.720853] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 041ad446-1559-4a48-afc0-69660ba0dad3. (Possible split-brain) >[2016-04-19 07:24:46.721951] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3> (041ad446-1559-4a48-afc0-69660ba0dad3) [No such file or directory] >[2016-04-19 07:24:46.722027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3> (041ad446-1559-4a48-afc0-69660ba0dad3) [No such file or directory] >[2016-04-19 07:24:46.724681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3> (041ad446-1559-4a48-afc0-69660ba0dad3) [No such file or directory] >[2016-04-19 07:24:46.724766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3> (041ad446-1559-4a48-afc0-69660ba0dad3) [No such file or directory] >[2016-04-19 07:24:46.724893] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:041ad446-1559-4a48-afc0-69660ba0dad3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.733816] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.734826] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b> (7d2d421b-6973-4991-957c-2789a57dba6b) [No such file or directory] >[2016-04-19 07:24:46.734909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b> (7d2d421b-6973-4991-957c-2789a57dba6b) [No such file or directory] >[2016-04-19 07:24:46.736056] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7d2d421b-6973-4991-957c-2789a57dba6b. (Possible split-brain) >[2016-04-19 07:24:46.737022] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b> (7d2d421b-6973-4991-957c-2789a57dba6b) [No such file or directory] >[2016-04-19 07:24:46.737286] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b> (7d2d421b-6973-4991-957c-2789a57dba6b) [No such file or directory] >[2016-04-19 07:24:46.738658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b> (7d2d421b-6973-4991-957c-2789a57dba6b) [No such file or directory] >[2016-04-19 07:24:46.738711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b> (7d2d421b-6973-4991-957c-2789a57dba6b) [No such file or directory] >[2016-04-19 07:24:46.738911] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.741388] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7d2d421b-6973-4991-957c-2789a57dba6b. (Possible split-brain) >[2016-04-19 07:24:46.742524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b> (7d2d421b-6973-4991-957c-2789a57dba6b) [No such file or directory] >[2016-04-19 07:24:46.742599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b> (7d2d421b-6973-4991-957c-2789a57dba6b) [No such file or directory] >[2016-04-19 07:24:46.745285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b> (7d2d421b-6973-4991-957c-2789a57dba6b) [No such file or directory] >[2016-04-19 07:24:46.745305] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b> (7d2d421b-6973-4991-957c-2789a57dba6b) [No such file or directory] >[2016-04-19 07:24:46.745494] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7d2d421b-6973-4991-957c-2789a57dba6b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.754687] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.755761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381> (95cafc69-3ca3-4757-b899-3fa7ae0c9381) [No such file or directory] >[2016-04-19 07:24:46.755789] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381> (95cafc69-3ca3-4757-b899-3fa7ae0c9381) [No such file or directory] >[2016-04-19 07:24:46.756895] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 95cafc69-3ca3-4757-b899-3fa7ae0c9381. (Possible split-brain) >[2016-04-19 07:24:46.757924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381> (95cafc69-3ca3-4757-b899-3fa7ae0c9381) [No such file or directory] >[2016-04-19 07:24:46.757954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381> (95cafc69-3ca3-4757-b899-3fa7ae0c9381) [No such file or directory] >[2016-04-19 07:24:46.758943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381> (95cafc69-3ca3-4757-b899-3fa7ae0c9381) [No such file or directory] >[2016-04-19 07:24:46.759287] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381> (95cafc69-3ca3-4757-b899-3fa7ae0c9381) [No such file or directory] >[2016-04-19 07:24:46.759491] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.762028] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 95cafc69-3ca3-4757-b899-3fa7ae0c9381. (Possible split-brain) >[2016-04-19 07:24:46.763249] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381> (95cafc69-3ca3-4757-b899-3fa7ae0c9381) [No such file or directory] >[2016-04-19 07:24:46.763275] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381> (95cafc69-3ca3-4757-b899-3fa7ae0c9381) [No such file or directory] >[2016-04-19 07:24:46.766050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381> (95cafc69-3ca3-4757-b899-3fa7ae0c9381) [No such file or directory] >[2016-04-19 07:24:46.766156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381> (95cafc69-3ca3-4757-b899-3fa7ae0c9381) [No such file or directory] >[2016-04-19 07:24:46.766587] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:95cafc69-3ca3-4757-b899-3fa7ae0c9381>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.773973] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.774880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b> (a75f56a6-86e9-446b-a1d6-cf3c7ba7661b) [No such file or directory] >[2016-04-19 07:24:46.774881] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b> (a75f56a6-86e9-446b-a1d6-cf3c7ba7661b) [No such file or directory] >[2016-04-19 07:24:46.775864] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a75f56a6-86e9-446b-a1d6-cf3c7ba7661b. (Possible split-brain) >[2016-04-19 07:24:46.776609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b> (a75f56a6-86e9-446b-a1d6-cf3c7ba7661b) [No such file or directory] >[2016-04-19 07:24:46.776720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b> (a75f56a6-86e9-446b-a1d6-cf3c7ba7661b) [No such file or directory] >[2016-04-19 07:24:46.778125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b> (a75f56a6-86e9-446b-a1d6-cf3c7ba7661b) [No such file or directory] >[2016-04-19 07:24:46.778202] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b> (a75f56a6-86e9-446b-a1d6-cf3c7ba7661b) [No such file or directory] >[2016-04-19 07:24:46.778301] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.780867] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a75f56a6-86e9-446b-a1d6-cf3c7ba7661b. (Possible split-brain) >[2016-04-19 07:24:46.781700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b> (a75f56a6-86e9-446b-a1d6-cf3c7ba7661b) [No such file or directory] >[2016-04-19 07:24:46.781781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b> (a75f56a6-86e9-446b-a1d6-cf3c7ba7661b) [No such file or directory] >[2016-04-19 07:24:46.784840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b> (a75f56a6-86e9-446b-a1d6-cf3c7ba7661b) [No such file or directory] >[2016-04-19 07:24:46.784883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b> (a75f56a6-86e9-446b-a1d6-cf3c7ba7661b) [No such file or directory] >[2016-04-19 07:24:46.785053] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a75f56a6-86e9-446b-a1d6-cf3c7ba7661b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.793439] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.794357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573> (bbe84de9-e368-40eb-bc9d-fc1fb1ea2573) [No such file or directory] >[2016-04-19 07:24:46.794652] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573> (bbe84de9-e368-40eb-bc9d-fc1fb1ea2573) [No such file or directory] >[2016-04-19 07:24:46.795751] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bbe84de9-e368-40eb-bc9d-fc1fb1ea2573. (Possible split-brain) >[2016-04-19 07:24:46.796863] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573> (bbe84de9-e368-40eb-bc9d-fc1fb1ea2573) [No such file or directory] >[2016-04-19 07:24:46.796934] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573> (bbe84de9-e368-40eb-bc9d-fc1fb1ea2573) [No such file or directory] >[2016-04-19 07:24:46.798247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573> (bbe84de9-e368-40eb-bc9d-fc1fb1ea2573) [No such file or directory] >[2016-04-19 07:24:46.798285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573> (bbe84de9-e368-40eb-bc9d-fc1fb1ea2573) [No such file or directory] >[2016-04-19 07:24:46.798492] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.801112] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bbe84de9-e368-40eb-bc9d-fc1fb1ea2573. (Possible split-brain) >[2016-04-19 07:24:46.802387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573> (bbe84de9-e368-40eb-bc9d-fc1fb1ea2573) [No such file or directory] >[2016-04-19 07:24:46.802407] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573> (bbe84de9-e368-40eb-bc9d-fc1fb1ea2573) [No such file or directory] >[2016-04-19 07:24:46.805118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573> (bbe84de9-e368-40eb-bc9d-fc1fb1ea2573) [No such file or directory] >[2016-04-19 07:24:46.805272] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573> (bbe84de9-e368-40eb-bc9d-fc1fb1ea2573) [No such file or directory] >[2016-04-19 07:24:46.805488] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bbe84de9-e368-40eb-bc9d-fc1fb1ea2573>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.813080] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.813795] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e> (c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e) [No such file or directory] >[2016-04-19 07:24:46.813975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e> (c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e) [No such file or directory] >[2016-04-19 07:24:46.816944] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e. (Possible split-brain) >[2016-04-19 07:24:46.817711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e> (c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e) [No such file or directory] >[2016-04-19 07:24:46.817926] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e> (c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e) [No such file or directory] >[2016-04-19 07:24:46.819227] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e> (c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e) [No such file or directory] >[2016-04-19 07:24:46.819456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e> (c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e) [No such file or directory] >[2016-04-19 07:24:46.819719] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.822352] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e. (Possible split-brain) >[2016-04-19 07:24:46.823118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e> (c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e) [No such file or directory] >[2016-04-19 07:24:46.823368] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e> (c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e) [No such file or directory] >[2016-04-19 07:24:46.826011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e> (c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e) [No such file or directory] >[2016-04-19 07:24:46.826150] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e> (c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e) [No such file or directory] >[2016-04-19 07:24:46.826291] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c930cbdb-58f8-49b1-b6ac-06eff4f0bf6e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.835563] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.836290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5> (8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5) [No such file or directory] >[2016-04-19 07:24:46.836556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5> (8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5) [No such file or directory] >[2016-04-19 07:24:46.839516] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5. (Possible split-brain) >[2016-04-19 07:24:46.840379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5> (8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5) [No such file or directory] >[2016-04-19 07:24:46.840485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5> (8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5) [No such file or directory] >[2016-04-19 07:24:46.841999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5> (8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5) [No such file or directory] >[2016-04-19 07:24:46.842034] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5> (8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5) [No such file or directory] >[2016-04-19 07:24:46.842230] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.844877] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5. (Possible split-brain) >[2016-04-19 07:24:46.845816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5> (8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5) [No such file or directory] >[2016-04-19 07:24:46.845839] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5> (8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5) [No such file or directory] >[2016-04-19 07:24:46.848503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5> (8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5) [No such file or directory] >[2016-04-19 07:24:46.849049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5> (8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5) [No such file or directory] >[2016-04-19 07:24:46.849293] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8e1a9d63-4f86-4bbf-a2c8-52aa93e7aff5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.857181] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.857979] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89> (01c04753-f67d-45c8-8399-2d21001b9d89) [No such file or directory] >[2016-04-19 07:24:46.858060] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89> (01c04753-f67d-45c8-8399-2d21001b9d89) [No such file or directory] >[2016-04-19 07:24:46.858950] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 01c04753-f67d-45c8-8399-2d21001b9d89. (Possible split-brain) >[2016-04-19 07:24:46.859805] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89> (01c04753-f67d-45c8-8399-2d21001b9d89) [No such file or directory] >[2016-04-19 07:24:46.860035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89> (01c04753-f67d-45c8-8399-2d21001b9d89) [No such file or directory] >[2016-04-19 07:24:46.861888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89> (01c04753-f67d-45c8-8399-2d21001b9d89) [No such file or directory] >[2016-04-19 07:24:46.861981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89> (01c04753-f67d-45c8-8399-2d21001b9d89) [No such file or directory] >[2016-04-19 07:24:46.862090] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.864596] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 01c04753-f67d-45c8-8399-2d21001b9d89. (Possible split-brain) >[2016-04-19 07:24:46.865344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89> (01c04753-f67d-45c8-8399-2d21001b9d89) [No such file or directory] >[2016-04-19 07:24:46.865495] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89> (01c04753-f67d-45c8-8399-2d21001b9d89) [No such file or directory] >[2016-04-19 07:24:46.868677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89> (01c04753-f67d-45c8-8399-2d21001b9d89) [No such file or directory] >[2016-04-19 07:24:46.868978] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89> (01c04753-f67d-45c8-8399-2d21001b9d89) [No such file or directory] >[2016-04-19 07:24:46.869109] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:01c04753-f67d-45c8-8399-2d21001b9d89>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.879260] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.880274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3> (8edea24b-0dc7-407e-bdbe-7e708d08dfa3) [No such file or directory] >[2016-04-19 07:24:46.880662] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3> (8edea24b-0dc7-407e-bdbe-7e708d08dfa3) [No such file or directory] >[2016-04-19 07:24:46.881533] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8edea24b-0dc7-407e-bdbe-7e708d08dfa3. (Possible split-brain) >[2016-04-19 07:24:46.882696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3> (8edea24b-0dc7-407e-bdbe-7e708d08dfa3) [No such file or directory] >[2016-04-19 07:24:46.882691] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3> (8edea24b-0dc7-407e-bdbe-7e708d08dfa3) [No such file or directory] >[2016-04-19 07:24:46.883803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3> (8edea24b-0dc7-407e-bdbe-7e708d08dfa3) [No such file or directory] >[2016-04-19 07:24:46.884020] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3> (8edea24b-0dc7-407e-bdbe-7e708d08dfa3) [No such file or directory] >[2016-04-19 07:24:46.884512] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.886963] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8edea24b-0dc7-407e-bdbe-7e708d08dfa3. (Possible split-brain) >[2016-04-19 07:24:46.888024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3> (8edea24b-0dc7-407e-bdbe-7e708d08dfa3) [No such file or directory] >[2016-04-19 07:24:46.888111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3> (8edea24b-0dc7-407e-bdbe-7e708d08dfa3) [No such file or directory] >[2016-04-19 07:24:46.890810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3> (8edea24b-0dc7-407e-bdbe-7e708d08dfa3) [No such file or directory] >[2016-04-19 07:24:46.891019] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3> (8edea24b-0dc7-407e-bdbe-7e708d08dfa3) [No such file or directory] >[2016-04-19 07:24:46.891140] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8edea24b-0dc7-407e-bdbe-7e708d08dfa3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.900433] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.901541] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36> (8a8a428d-c7a4-4f98-aae0-bdafeda1fd36) [No such file or directory] >[2016-04-19 07:24:46.901673] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36> (8a8a428d-c7a4-4f98-aae0-bdafeda1fd36) [No such file or directory] >[2016-04-19 07:24:46.904179] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8a8a428d-c7a4-4f98-aae0-bdafeda1fd36. (Possible split-brain) >[2016-04-19 07:24:46.905121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36> (8a8a428d-c7a4-4f98-aae0-bdafeda1fd36) [No such file or directory] >[2016-04-19 07:24:46.905287] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36> (8a8a428d-c7a4-4f98-aae0-bdafeda1fd36) [No such file or directory] >[2016-04-19 07:24:46.906526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36> (8a8a428d-c7a4-4f98-aae0-bdafeda1fd36) [No such file or directory] >[2016-04-19 07:24:46.906601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36> (8a8a428d-c7a4-4f98-aae0-bdafeda1fd36) [No such file or directory] >[2016-04-19 07:24:46.906898] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.909353] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8a8a428d-c7a4-4f98-aae0-bdafeda1fd36. (Possible split-brain) >[2016-04-19 07:24:46.910417] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36> (8a8a428d-c7a4-4f98-aae0-bdafeda1fd36) [No such file or directory] >[2016-04-19 07:24:46.910428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36> (8a8a428d-c7a4-4f98-aae0-bdafeda1fd36) [No such file or directory] >[2016-04-19 07:24:46.913284] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36> (8a8a428d-c7a4-4f98-aae0-bdafeda1fd36) [No such file or directory] >[2016-04-19 07:24:46.913423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36> (8a8a428d-c7a4-4f98-aae0-bdafeda1fd36) [No such file or directory] >[2016-04-19 07:24:46.913812] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8a8a428d-c7a4-4f98-aae0-bdafeda1fd36>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.922858] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.923788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695> (2fa45cfd-112c-4f8c-805b-4f514d07a695) [No such file or directory] >[2016-04-19 07:24:46.923871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695> (2fa45cfd-112c-4f8c-805b-4f514d07a695) [No such file or directory] >[2016-04-19 07:24:46.924758] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2fa45cfd-112c-4f8c-805b-4f514d07a695. (Possible split-brain) >[2016-04-19 07:24:46.925742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695> (2fa45cfd-112c-4f8c-805b-4f514d07a695) [No such file or directory] >[2016-04-19 07:24:46.925811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695> (2fa45cfd-112c-4f8c-805b-4f514d07a695) [No such file or directory] >[2016-04-19 07:24:46.926847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695> (2fa45cfd-112c-4f8c-805b-4f514d07a695) [No such file or directory] >[2016-04-19 07:24:46.926875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695> (2fa45cfd-112c-4f8c-805b-4f514d07a695) [No such file or directory] >[2016-04-19 07:24:46.927412] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.929873] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2fa45cfd-112c-4f8c-805b-4f514d07a695. (Possible split-brain) >[2016-04-19 07:24:46.930806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695> (2fa45cfd-112c-4f8c-805b-4f514d07a695) [No such file or directory] >[2016-04-19 07:24:46.931083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695> (2fa45cfd-112c-4f8c-805b-4f514d07a695) [No such file or directory] >[2016-04-19 07:24:46.933960] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695> (2fa45cfd-112c-4f8c-805b-4f514d07a695) [No such file or directory] >[2016-04-19 07:24:46.933987] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695> (2fa45cfd-112c-4f8c-805b-4f514d07a695) [No such file or directory] >[2016-04-19 07:24:46.934443] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2fa45cfd-112c-4f8c-805b-4f514d07a695>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.943262] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.944184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5> (90c7c943-2ddd-40c5-af09-fdd9c3e79de5) [No such file or directory] >[2016-04-19 07:24:46.944536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5> (90c7c943-2ddd-40c5-af09-fdd9c3e79de5) [No such file or directory] >[2016-04-19 07:24:46.947282] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 90c7c943-2ddd-40c5-af09-fdd9c3e79de5. (Possible split-brain) >[2016-04-19 07:24:46.948487] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5> (90c7c943-2ddd-40c5-af09-fdd9c3e79de5) [No such file or directory] >[2016-04-19 07:24:46.948601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5> (90c7c943-2ddd-40c5-af09-fdd9c3e79de5) [No such file or directory] >[2016-04-19 07:24:46.949997] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5> (90c7c943-2ddd-40c5-af09-fdd9c3e79de5) [No such file or directory] >[2016-04-19 07:24:46.950005] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5> (90c7c943-2ddd-40c5-af09-fdd9c3e79de5) [No such file or directory] >[2016-04-19 07:24:46.950620] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:46.953905] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 90c7c943-2ddd-40c5-af09-fdd9c3e79de5. (Possible split-brain) >[2016-04-19 07:24:46.954970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5> (90c7c943-2ddd-40c5-af09-fdd9c3e79de5) [No such file or directory] >[2016-04-19 07:24:46.955288] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5> (90c7c943-2ddd-40c5-af09-fdd9c3e79de5) [No such file or directory] >[2016-04-19 07:24:46.958636] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5> (90c7c943-2ddd-40c5-af09-fdd9c3e79de5) [No such file or directory] >[2016-04-19 07:24:46.959002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5> (90c7c943-2ddd-40c5-af09-fdd9c3e79de5) [No such file or directory] >[2016-04-19 07:24:46.959929] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:90c7c943-2ddd-40c5-af09-fdd9c3e79de5>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:46.969039] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.969821] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6> (75a15ccf-9465-44de-a25f-4481e9a1c8d6) [No such file or directory] >[2016-04-19 07:24:46.969911] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6> (75a15ccf-9465-44de-a25f-4481e9a1c8d6) [No such file or directory] >[2016-04-19 07:24:46.972776] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 75a15ccf-9465-44de-a25f-4481e9a1c8d6. (Possible split-brain) >[2016-04-19 07:24:46.973619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6> (75a15ccf-9465-44de-a25f-4481e9a1c8d6) [No such file or directory] >[2016-04-19 07:24:46.973749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6> (75a15ccf-9465-44de-a25f-4481e9a1c8d6) [No such file or directory] >[2016-04-19 07:24:46.975025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6> (75a15ccf-9465-44de-a25f-4481e9a1c8d6) [No such file or directory] >[2016-04-19 07:24:46.975120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6> (75a15ccf-9465-44de-a25f-4481e9a1c8d6) [No such file or directory] >[2016-04-19 07:24:46.975435] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.978272] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 75a15ccf-9465-44de-a25f-4481e9a1c8d6. (Possible split-brain) >[2016-04-19 07:24:46.979202] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6> (75a15ccf-9465-44de-a25f-4481e9a1c8d6) [No such file or directory] >[2016-04-19 07:24:46.979309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6> (75a15ccf-9465-44de-a25f-4481e9a1c8d6) [No such file or directory] >[2016-04-19 07:24:46.983363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6> (75a15ccf-9465-44de-a25f-4481e9a1c8d6) [No such file or directory] >[2016-04-19 07:24:46.983597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6> (75a15ccf-9465-44de-a25f-4481e9a1c8d6) [No such file or directory] >[2016-04-19 07:24:46.983973] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:75a15ccf-9465-44de-a25f-4481e9a1c8d6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:46.992232] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:46.992902] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07432f9c-2780-4345-885d-ed76de773726> (07432f9c-2780-4345-885d-ed76de773726) [No such file or directory] >[2016-04-19 07:24:46.992947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07432f9c-2780-4345-885d-ed76de773726> (07432f9c-2780-4345-885d-ed76de773726) [No such file or directory] >[2016-04-19 07:24:46.993520] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 07432f9c-2780-4345-885d-ed76de773726. (Possible split-brain) >[2016-04-19 07:24:46.994184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07432f9c-2780-4345-885d-ed76de773726> (07432f9c-2780-4345-885d-ed76de773726) [No such file or directory] >[2016-04-19 07:24:46.994221] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07432f9c-2780-4345-885d-ed76de773726> (07432f9c-2780-4345-885d-ed76de773726) [No such file or directory] >[2016-04-19 07:24:46.994948] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07432f9c-2780-4345-885d-ed76de773726> (07432f9c-2780-4345-885d-ed76de773726) [No such file or directory] >[2016-04-19 07:24:46.995105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07432f9c-2780-4345-885d-ed76de773726> (07432f9c-2780-4345-885d-ed76de773726) [No such file or directory] >[2016-04-19 07:24:46.995246] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:07432f9c-2780-4345-885d-ed76de773726>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:46.997910] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 07432f9c-2780-4345-885d-ed76de773726. (Possible split-brain) >[2016-04-19 07:24:46.998827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07432f9c-2780-4345-885d-ed76de773726> (07432f9c-2780-4345-885d-ed76de773726) [No such file or directory] >[2016-04-19 07:24:46.998936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07432f9c-2780-4345-885d-ed76de773726> (07432f9c-2780-4345-885d-ed76de773726) [No such file or directory] >[2016-04-19 07:24:47.003074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:07432f9c-2780-4345-885d-ed76de773726> (07432f9c-2780-4345-885d-ed76de773726) [No such file or directory] >[2016-04-19 07:24:47.003099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:07432f9c-2780-4345-885d-ed76de773726> (07432f9c-2780-4345-885d-ed76de773726) [No such file or directory] >[2016-04-19 07:24:47.003689] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:07432f9c-2780-4345-885d-ed76de773726>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.013772] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.014655] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983> (9fb2f604-1142-40a9-aeb5-0966fe440983) [No such file or directory] >[2016-04-19 07:24:47.014882] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983> (9fb2f604-1142-40a9-aeb5-0966fe440983) [No such file or directory] >[2016-04-19 07:24:47.017562] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9fb2f604-1142-40a9-aeb5-0966fe440983. (Possible split-brain) >[2016-04-19 07:24:47.018690] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983> (9fb2f604-1142-40a9-aeb5-0966fe440983) [No such file or directory] >[2016-04-19 07:24:47.018762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983> (9fb2f604-1142-40a9-aeb5-0966fe440983) [No such file or directory] >[2016-04-19 07:24:47.019923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983> (9fb2f604-1142-40a9-aeb5-0966fe440983) [No such file or directory] >[2016-04-19 07:24:47.019954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983> (9fb2f604-1142-40a9-aeb5-0966fe440983) [No such file or directory] >[2016-04-19 07:24:47.020510] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.023265] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9fb2f604-1142-40a9-aeb5-0966fe440983. (Possible split-brain) >[2016-04-19 07:24:47.024463] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983> (9fb2f604-1142-40a9-aeb5-0966fe440983) [No such file or directory] >[2016-04-19 07:24:47.024492] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983> (9fb2f604-1142-40a9-aeb5-0966fe440983) [No such file or directory] >[2016-04-19 07:24:47.028246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983> (9fb2f604-1142-40a9-aeb5-0966fe440983) [No such file or directory] >[2016-04-19 07:24:47.028384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983> (9fb2f604-1142-40a9-aeb5-0966fe440983) [No such file or directory] >[2016-04-19 07:24:47.029005] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9fb2f604-1142-40a9-aeb5-0966fe440983>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.036412] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.037254] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999> (4445e490-2287-4de0-a800-3c33fb3cd999) [No such file or directory] >[2016-04-19 07:24:47.037361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999> (4445e490-2287-4de0-a800-3c33fb3cd999) [No such file or directory] >[2016-04-19 07:24:47.038510] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4445e490-2287-4de0-a800-3c33fb3cd999. (Possible split-brain) >[2016-04-19 07:24:47.039366] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999> (4445e490-2287-4de0-a800-3c33fb3cd999) [No such file or directory] >[2016-04-19 07:24:47.039434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999> (4445e490-2287-4de0-a800-3c33fb3cd999) [No such file or directory] >[2016-04-19 07:24:47.040674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999> (4445e490-2287-4de0-a800-3c33fb3cd999) [No such file or directory] >[2016-04-19 07:24:47.040760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999> (4445e490-2287-4de0-a800-3c33fb3cd999) [No such file or directory] >[2016-04-19 07:24:47.041138] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.043873] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4445e490-2287-4de0-a800-3c33fb3cd999. (Possible split-brain) >[2016-04-19 07:24:47.044710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999> (4445e490-2287-4de0-a800-3c33fb3cd999) [No such file or directory] >[2016-04-19 07:24:47.044796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999> (4445e490-2287-4de0-a800-3c33fb3cd999) [No such file or directory] >[2016-04-19 07:24:47.049253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999> (4445e490-2287-4de0-a800-3c33fb3cd999) [No such file or directory] >[2016-04-19 07:24:47.049265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999> (4445e490-2287-4de0-a800-3c33fb3cd999) [No such file or directory] >[2016-04-19 07:24:47.049549] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4445e490-2287-4de0-a800-3c33fb3cd999>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.056681] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.057071] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666> (b4d01f84-af08-4891-9933-b85dd2a82666) [No such file or directory] >[2016-04-19 07:24:47.057241] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666> (b4d01f84-af08-4891-9933-b85dd2a82666) [No such file or directory] >[2016-04-19 07:24:47.058157] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b4d01f84-af08-4891-9933-b85dd2a82666. (Possible split-brain) >[2016-04-19 07:24:47.059014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666> (b4d01f84-af08-4891-9933-b85dd2a82666) [No such file or directory] >[2016-04-19 07:24:47.059077] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666> (b4d01f84-af08-4891-9933-b85dd2a82666) [No such file or directory] >[2016-04-19 07:24:47.060061] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666> (b4d01f84-af08-4891-9933-b85dd2a82666) [No such file or directory] >[2016-04-19 07:24:47.060062] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666> (b4d01f84-af08-4891-9933-b85dd2a82666) [No such file or directory] >[2016-04-19 07:24:47.060419] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.063118] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b4d01f84-af08-4891-9933-b85dd2a82666. (Possible split-brain) >[2016-04-19 07:24:47.063699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666> (b4d01f84-af08-4891-9933-b85dd2a82666) [No such file or directory] >[2016-04-19 07:24:47.063892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666> (b4d01f84-af08-4891-9933-b85dd2a82666) [No such file or directory] >[2016-04-19 07:24:47.067076] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666> (b4d01f84-af08-4891-9933-b85dd2a82666) [No such file or directory] >[2016-04-19 07:24:47.067133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666> (b4d01f84-af08-4891-9933-b85dd2a82666) [No such file or directory] >[2016-04-19 07:24:47.067406] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b4d01f84-af08-4891-9933-b85dd2a82666>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.075039] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.075576] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0> (2ed59e4f-d29a-412a-8925-8509398f16a0) [No such file or directory] >[2016-04-19 07:24:47.075656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0> (2ed59e4f-d29a-412a-8925-8509398f16a0) [No such file or directory] >[2016-04-19 07:24:47.076854] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2ed59e4f-d29a-412a-8925-8509398f16a0. (Possible split-brain) >[2016-04-19 07:24:47.077650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0> (2ed59e4f-d29a-412a-8925-8509398f16a0) [No such file or directory] >[2016-04-19 07:24:47.077716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0> (2ed59e4f-d29a-412a-8925-8509398f16a0) [No such file or directory] >[2016-04-19 07:24:47.078909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0> (2ed59e4f-d29a-412a-8925-8509398f16a0) [No such file or directory] >[2016-04-19 07:24:47.078984] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0> (2ed59e4f-d29a-412a-8925-8509398f16a0) [No such file or directory] >[2016-04-19 07:24:47.079090] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.081681] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2ed59e4f-d29a-412a-8925-8509398f16a0. (Possible split-brain) >[2016-04-19 07:24:47.082520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0> (2ed59e4f-d29a-412a-8925-8509398f16a0) [No such file or directory] >[2016-04-19 07:24:47.082662] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0> (2ed59e4f-d29a-412a-8925-8509398f16a0) [No such file or directory] >[2016-04-19 07:24:47.086868] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0> (2ed59e4f-d29a-412a-8925-8509398f16a0) [No such file or directory] >[2016-04-19 07:24:47.086903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0> (2ed59e4f-d29a-412a-8925-8509398f16a0) [No such file or directory] >[2016-04-19 07:24:47.087092] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2ed59e4f-d29a-412a-8925-8509398f16a0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.096605] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.097590] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e> (a3ca74d8-b828-436b-8631-0349a11dd54e) [No such file or directory] >[2016-04-19 07:24:47.097854] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e> (a3ca74d8-b828-436b-8631-0349a11dd54e) [No such file or directory] >[2016-04-19 07:24:47.098966] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a3ca74d8-b828-436b-8631-0349a11dd54e. (Possible split-brain) >[2016-04-19 07:24:47.100228] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e> (a3ca74d8-b828-436b-8631-0349a11dd54e) [No such file or directory] >[2016-04-19 07:24:47.100284] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e> (a3ca74d8-b828-436b-8631-0349a11dd54e) [No such file or directory] >[2016-04-19 07:24:47.101523] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e> (a3ca74d8-b828-436b-8631-0349a11dd54e) [No such file or directory] >[2016-04-19 07:24:47.101554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e> (a3ca74d8-b828-436b-8631-0349a11dd54e) [No such file or directory] >[2016-04-19 07:24:47.102118] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.104826] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a3ca74d8-b828-436b-8631-0349a11dd54e. (Possible split-brain) >[2016-04-19 07:24:47.106188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e> (a3ca74d8-b828-436b-8631-0349a11dd54e) [No such file or directory] >[2016-04-19 07:24:47.106274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e> (a3ca74d8-b828-436b-8631-0349a11dd54e) [No such file or directory] >[2016-04-19 07:24:47.109381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e> (a3ca74d8-b828-436b-8631-0349a11dd54e) [No such file or directory] >[2016-04-19 07:24:47.109473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e> (a3ca74d8-b828-436b-8631-0349a11dd54e) [No such file or directory] >[2016-04-19 07:24:47.109595] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a3ca74d8-b828-436b-8631-0349a11dd54e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.118504] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.119485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9> (4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9) [No such file or directory] >[2016-04-19 07:24:47.119604] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9> (4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9) [No such file or directory] >[2016-04-19 07:24:47.120748] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9. (Possible split-brain) >[2016-04-19 07:24:47.121768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9> (4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9) [No such file or directory] >[2016-04-19 07:24:47.121853] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9> (4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9) [No such file or directory] >[2016-04-19 07:24:47.123103] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9> (4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9) [No such file or directory] >[2016-04-19 07:24:47.123138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9> (4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9) [No such file or directory] >[2016-04-19 07:24:47.123430] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.126161] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9. (Possible split-brain) >[2016-04-19 07:24:47.127029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9> (4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9) [No such file or directory] >[2016-04-19 07:24:47.127179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9> (4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9) [No such file or directory] >[2016-04-19 07:24:47.130732] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9> (4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9) [No such file or directory] >[2016-04-19 07:24:47.131236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9> (4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9) [No such file or directory] >[2016-04-19 07:24:47.131538] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4b2a7cd2-f98a-4dc7-9b24-8b8b431c7aa9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.141272] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.142133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b> (bf1374d7-509c-431b-95cc-bd85803d334b) [No such file or directory] >[2016-04-19 07:24:47.142394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b> (bf1374d7-509c-431b-95cc-bd85803d334b) [No such file or directory] >[2016-04-19 07:24:47.143508] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bf1374d7-509c-431b-95cc-bd85803d334b. (Possible split-brain) >[2016-04-19 07:24:47.144581] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b> (bf1374d7-509c-431b-95cc-bd85803d334b) [No such file or directory] >[2016-04-19 07:24:47.144590] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b> (bf1374d7-509c-431b-95cc-bd85803d334b) [No such file or directory] >[2016-04-19 07:24:47.145915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b> (bf1374d7-509c-431b-95cc-bd85803d334b) [No such file or directory] >[2016-04-19 07:24:47.145947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b> (bf1374d7-509c-431b-95cc-bd85803d334b) [No such file or directory] >[2016-04-19 07:24:47.146618] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.149371] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bf1374d7-509c-431b-95cc-bd85803d334b. (Possible split-brain) >[2016-04-19 07:24:47.150337] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b> (bf1374d7-509c-431b-95cc-bd85803d334b) [No such file or directory] >[2016-04-19 07:24:47.150397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b> (bf1374d7-509c-431b-95cc-bd85803d334b) [No such file or directory] >[2016-04-19 07:24:47.154012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b> (bf1374d7-509c-431b-95cc-bd85803d334b) [No such file or directory] >[2016-04-19 07:24:47.154561] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b> (bf1374d7-509c-431b-95cc-bd85803d334b) [No such file or directory] >[2016-04-19 07:24:47.154950] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bf1374d7-509c-431b-95cc-bd85803d334b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.164036] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.164894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84> (b5e38b49-53f8-4909-9fa0-092d217c8a84) [No such file or directory] >[2016-04-19 07:24:47.165230] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84> (b5e38b49-53f8-4909-9fa0-092d217c8a84) [No such file or directory] >[2016-04-19 07:24:47.167918] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b5e38b49-53f8-4909-9fa0-092d217c8a84. (Possible split-brain) >[2016-04-19 07:24:47.169135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84> (b5e38b49-53f8-4909-9fa0-092d217c8a84) [No such file or directory] >[2016-04-19 07:24:47.169241] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84> (b5e38b49-53f8-4909-9fa0-092d217c8a84) [No such file or directory] >[2016-04-19 07:24:47.170603] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84> (b5e38b49-53f8-4909-9fa0-092d217c8a84) [No such file or directory] >[2016-04-19 07:24:47.170682] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84> (b5e38b49-53f8-4909-9fa0-092d217c8a84) [No such file or directory] >[2016-04-19 07:24:47.170946] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.173748] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b5e38b49-53f8-4909-9fa0-092d217c8a84. (Possible split-brain) >[2016-04-19 07:24:47.175012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84> (b5e38b49-53f8-4909-9fa0-092d217c8a84) [No such file or directory] >[2016-04-19 07:24:47.175130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84> (b5e38b49-53f8-4909-9fa0-092d217c8a84) [No such file or directory] >[2016-04-19 07:24:47.178884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84> (b5e38b49-53f8-4909-9fa0-092d217c8a84) [No such file or directory] >[2016-04-19 07:24:47.178988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84> (b5e38b49-53f8-4909-9fa0-092d217c8a84) [No such file or directory] >[2016-04-19 07:24:47.179612] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b5e38b49-53f8-4909-9fa0-092d217c8a84>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.188614] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.189452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968> (0aaf7ad3-00c4-4e79-95bd-bb88663a8968) [No such file or directory] >[2016-04-19 07:24:47.189522] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968> (0aaf7ad3-00c4-4e79-95bd-bb88663a8968) [No such file or directory] >[2016-04-19 07:24:47.190688] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0aaf7ad3-00c4-4e79-95bd-bb88663a8968. (Possible split-brain) >[2016-04-19 07:24:47.191530] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968> (0aaf7ad3-00c4-4e79-95bd-bb88663a8968) [No such file or directory] >[2016-04-19 07:24:47.191546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968> (0aaf7ad3-00c4-4e79-95bd-bb88663a8968) [No such file or directory] >[2016-04-19 07:24:47.192855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968> (0aaf7ad3-00c4-4e79-95bd-bb88663a8968) [No such file or directory] >[2016-04-19 07:24:47.192995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968> (0aaf7ad3-00c4-4e79-95bd-bb88663a8968) [No such file or directory] >[2016-04-19 07:24:47.193427] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.196149] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0aaf7ad3-00c4-4e79-95bd-bb88663a8968. (Possible split-brain) >[2016-04-19 07:24:47.197001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968> (0aaf7ad3-00c4-4e79-95bd-bb88663a8968) [No such file or directory] >[2016-04-19 07:24:47.197113] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968> (0aaf7ad3-00c4-4e79-95bd-bb88663a8968) [No such file or directory] >[2016-04-19 07:24:47.200641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968> (0aaf7ad3-00c4-4e79-95bd-bb88663a8968) [No such file or directory] >[2016-04-19 07:24:47.200836] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968> (0aaf7ad3-00c4-4e79-95bd-bb88663a8968) [No such file or directory] >[2016-04-19 07:24:47.200960] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0aaf7ad3-00c4-4e79-95bd-bb88663a8968>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.208896] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.209917] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc> (98da67ee-151b-472c-a91e-9aa83d954bbc) [No such file or directory] >[2016-04-19 07:24:47.209939] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc> (98da67ee-151b-472c-a91e-9aa83d954bbc) [No such file or directory] >[2016-04-19 07:24:47.210827] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 98da67ee-151b-472c-a91e-9aa83d954bbc. (Possible split-brain) >[2016-04-19 07:24:47.211431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc> (98da67ee-151b-472c-a91e-9aa83d954bbc) [No such file or directory] >[2016-04-19 07:24:47.211518] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc> (98da67ee-151b-472c-a91e-9aa83d954bbc) [No such file or directory] >[2016-04-19 07:24:47.213119] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc> (98da67ee-151b-472c-a91e-9aa83d954bbc) [No such file or directory] >[2016-04-19 07:24:47.213131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc> (98da67ee-151b-472c-a91e-9aa83d954bbc) [No such file or directory] >[2016-04-19 07:24:47.213375] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.216174] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 98da67ee-151b-472c-a91e-9aa83d954bbc. (Possible split-brain) >[2016-04-19 07:24:47.217125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc> (98da67ee-151b-472c-a91e-9aa83d954bbc) [No such file or directory] >[2016-04-19 07:24:47.217432] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc> (98da67ee-151b-472c-a91e-9aa83d954bbc) [No such file or directory] >[2016-04-19 07:24:47.220705] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc> (98da67ee-151b-472c-a91e-9aa83d954bbc) [No such file or directory] >[2016-04-19 07:24:47.220793] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc> (98da67ee-151b-472c-a91e-9aa83d954bbc) [No such file or directory] >[2016-04-19 07:24:47.220922] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:98da67ee-151b-472c-a91e-9aa83d954bbc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.230935] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.231780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5> (0076171e-ce53-460e-8633-d9e2e89390a5) [No such file or directory] >[2016-04-19 07:24:47.232182] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5> (0076171e-ce53-460e-8633-d9e2e89390a5) [No such file or directory] >[2016-04-19 07:24:47.234983] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0076171e-ce53-460e-8633-d9e2e89390a5. (Possible split-brain) >[2016-04-19 07:24:47.236174] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5> (0076171e-ce53-460e-8633-d9e2e89390a5) [No such file or directory] >[2016-04-19 07:24:47.236183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5> (0076171e-ce53-460e-8633-d9e2e89390a5) [No such file or directory] >[2016-04-19 07:24:47.237399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5> (0076171e-ce53-460e-8633-d9e2e89390a5) [No such file or directory] >[2016-04-19 07:24:47.237455] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5> (0076171e-ce53-460e-8633-d9e2e89390a5) [No such file or directory] >[2016-04-19 07:24:47.237993] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.240779] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0076171e-ce53-460e-8633-d9e2e89390a5. (Possible split-brain) >[2016-04-19 07:24:47.242050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5> (0076171e-ce53-460e-8633-d9e2e89390a5) [No such file or directory] >[2016-04-19 07:24:47.242078] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5> (0076171e-ce53-460e-8633-d9e2e89390a5) [No such file or directory] >[2016-04-19 07:24:47.245741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5> (0076171e-ce53-460e-8633-d9e2e89390a5) [No such file or directory] >[2016-04-19 07:24:47.246343] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5> (0076171e-ce53-460e-8633-d9e2e89390a5) [No such file or directory] >[2016-04-19 07:24:47.246864] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0076171e-ce53-460e-8633-d9e2e89390a5>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.256451] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.257440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2> (0ac80c04-a189-4aaa-bdad-fac3904aafb2) [No such file or directory] >[2016-04-19 07:24:47.257711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2> (0ac80c04-a189-4aaa-bdad-fac3904aafb2) [No such file or directory] >[2016-04-19 07:24:47.258837] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0ac80c04-a189-4aaa-bdad-fac3904aafb2. (Possible split-brain) >[2016-04-19 07:24:47.259978] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2> (0ac80c04-a189-4aaa-bdad-fac3904aafb2) [No such file or directory] >[2016-04-19 07:24:47.260056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2> (0ac80c04-a189-4aaa-bdad-fac3904aafb2) [No such file or directory] >[2016-04-19 07:24:47.261370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2> (0ac80c04-a189-4aaa-bdad-fac3904aafb2) [No such file or directory] >[2016-04-19 07:24:47.261474] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2> (0ac80c04-a189-4aaa-bdad-fac3904aafb2) [No such file or directory] >[2016-04-19 07:24:47.261893] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.264622] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0ac80c04-a189-4aaa-bdad-fac3904aafb2. (Possible split-brain) >[2016-04-19 07:24:47.265650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2> (0ac80c04-a189-4aaa-bdad-fac3904aafb2) [No such file or directory] >[2016-04-19 07:24:47.265750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2> (0ac80c04-a189-4aaa-bdad-fac3904aafb2) [No such file or directory] >[2016-04-19 07:24:47.269919] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2> (0ac80c04-a189-4aaa-bdad-fac3904aafb2) [No such file or directory] >[2016-04-19 07:24:47.269981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2> (0ac80c04-a189-4aaa-bdad-fac3904aafb2) [No such file or directory] >[2016-04-19 07:24:47.270155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0ac80c04-a189-4aaa-bdad-fac3904aafb2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.277762] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.278556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4> (7d8fb73d-8618-4fd1-a55e-109573bb9bf4) [No such file or directory] >[2016-04-19 07:24:47.278696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4> (7d8fb73d-8618-4fd1-a55e-109573bb9bf4) [No such file or directory] >[2016-04-19 07:24:47.279786] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7d8fb73d-8618-4fd1-a55e-109573bb9bf4. (Possible split-brain) >[2016-04-19 07:24:47.280386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4> (7d8fb73d-8618-4fd1-a55e-109573bb9bf4) [No such file or directory] >[2016-04-19 07:24:47.280431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4> (7d8fb73d-8618-4fd1-a55e-109573bb9bf4) [No such file or directory] >[2016-04-19 07:24:47.281817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4> (7d8fb73d-8618-4fd1-a55e-109573bb9bf4) [No such file or directory] >[2016-04-19 07:24:47.282082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4> (7d8fb73d-8618-4fd1-a55e-109573bb9bf4) [No such file or directory] >[2016-04-19 07:24:47.282213] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.284999] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7d8fb73d-8618-4fd1-a55e-109573bb9bf4. (Possible split-brain) >[2016-04-19 07:24:47.285901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4> (7d8fb73d-8618-4fd1-a55e-109573bb9bf4) [No such file or directory] >[2016-04-19 07:24:47.285988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4> (7d8fb73d-8618-4fd1-a55e-109573bb9bf4) [No such file or directory] >[2016-04-19 07:24:47.289064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4> (7d8fb73d-8618-4fd1-a55e-109573bb9bf4) [No such file or directory] >[2016-04-19 07:24:47.289152] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4> (7d8fb73d-8618-4fd1-a55e-109573bb9bf4) [No such file or directory] >[2016-04-19 07:24:47.289372] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7d8fb73d-8618-4fd1-a55e-109573bb9bf4>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.297851] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.299008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad> (8d51f61b-3e1e-4b46-96cd-fd10b6059aad) [No such file or directory] >[2016-04-19 07:24:47.299088] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad> (8d51f61b-3e1e-4b46-96cd-fd10b6059aad) [No such file or directory] >[2016-04-19 07:24:47.300272] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8d51f61b-3e1e-4b46-96cd-fd10b6059aad. (Possible split-brain) >[2016-04-19 07:24:47.301695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad> (8d51f61b-3e1e-4b46-96cd-fd10b6059aad) [No such file or directory] >[2016-04-19 07:24:47.301788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad> (8d51f61b-3e1e-4b46-96cd-fd10b6059aad) [No such file or directory] >[2016-04-19 07:24:47.303084] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad> (8d51f61b-3e1e-4b46-96cd-fd10b6059aad) [No such file or directory] >[2016-04-19 07:24:47.303167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad> (8d51f61b-3e1e-4b46-96cd-fd10b6059aad) [No such file or directory] >[2016-04-19 07:24:47.303567] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.306250] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8d51f61b-3e1e-4b46-96cd-fd10b6059aad. (Possible split-brain) >[2016-04-19 07:24:47.307240] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad> (8d51f61b-3e1e-4b46-96cd-fd10b6059aad) [No such file or directory] >[2016-04-19 07:24:47.307605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad> (8d51f61b-3e1e-4b46-96cd-fd10b6059aad) [No such file or directory] >[2016-04-19 07:24:47.310703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad> (8d51f61b-3e1e-4b46-96cd-fd10b6059aad) [No such file or directory] >[2016-04-19 07:24:47.310814] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad> (8d51f61b-3e1e-4b46-96cd-fd10b6059aad) [No such file or directory] >[2016-04-19 07:24:47.310989] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8d51f61b-3e1e-4b46-96cd-fd10b6059aad>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.319620] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.320452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336> (10408ba5-cc45-4e71-8fc6-2d65d28cf336) [No such file or directory] >[2016-04-19 07:24:47.320550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336> (10408ba5-cc45-4e71-8fc6-2d65d28cf336) [No such file or directory] >[2016-04-19 07:24:47.321708] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 10408ba5-cc45-4e71-8fc6-2d65d28cf336. (Possible split-brain) >[2016-04-19 07:24:47.322803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336> (10408ba5-cc45-4e71-8fc6-2d65d28cf336) [No such file or directory] >[2016-04-19 07:24:47.322806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336> (10408ba5-cc45-4e71-8fc6-2d65d28cf336) [No such file or directory] >[2016-04-19 07:24:47.323992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336> (10408ba5-cc45-4e71-8fc6-2d65d28cf336) [No such file or directory] >[2016-04-19 07:24:47.324120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336> (10408ba5-cc45-4e71-8fc6-2d65d28cf336) [No such file or directory] >[2016-04-19 07:24:47.324574] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.327284] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 10408ba5-cc45-4e71-8fc6-2d65d28cf336. (Possible split-brain) >[2016-04-19 07:24:47.328180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336> (10408ba5-cc45-4e71-8fc6-2d65d28cf336) [No such file or directory] >[2016-04-19 07:24:47.328266] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336> (10408ba5-cc45-4e71-8fc6-2d65d28cf336) [No such file or directory] >[2016-04-19 07:24:47.332548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336> (10408ba5-cc45-4e71-8fc6-2d65d28cf336) [No such file or directory] >[2016-04-19 07:24:47.332756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336> (10408ba5-cc45-4e71-8fc6-2d65d28cf336) [No such file or directory] >[2016-04-19 07:24:47.332959] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:10408ba5-cc45-4e71-8fc6-2d65d28cf336>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.341365] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.342225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729> (78c62410-b97d-4c21-afbc-85f9d0630729) [No such file or directory] >[2016-04-19 07:24:47.342255] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729> (78c62410-b97d-4c21-afbc-85f9d0630729) [No such file or directory] >[2016-04-19 07:24:47.343351] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 78c62410-b97d-4c21-afbc-85f9d0630729. (Possible split-brain) >[2016-04-19 07:24:47.344202] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729> (78c62410-b97d-4c21-afbc-85f9d0630729) [No such file or directory] >[2016-04-19 07:24:47.344295] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729> (78c62410-b97d-4c21-afbc-85f9d0630729) [No such file or directory] >[2016-04-19 07:24:47.345848] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729> (78c62410-b97d-4c21-afbc-85f9d0630729) [No such file or directory] >[2016-04-19 07:24:47.345849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729> (78c62410-b97d-4c21-afbc-85f9d0630729) [No such file or directory] >[2016-04-19 07:24:47.346026] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.348769] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 78c62410-b97d-4c21-afbc-85f9d0630729. (Possible split-brain) >[2016-04-19 07:24:47.349680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729> (78c62410-b97d-4c21-afbc-85f9d0630729) [No such file or directory] >[2016-04-19 07:24:47.349749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729> (78c62410-b97d-4c21-afbc-85f9d0630729) [No such file or directory] >[2016-04-19 07:24:47.353967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729> (78c62410-b97d-4c21-afbc-85f9d0630729) [No such file or directory] >[2016-04-19 07:24:47.353983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729> (78c62410-b97d-4c21-afbc-85f9d0630729) [No such file or directory] >[2016-04-19 07:24:47.354228] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:78c62410-b97d-4c21-afbc-85f9d0630729>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.362515] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.363448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff> (d60694f5-3e76-4842-a712-17dd104b30ff) [No such file or directory] >[2016-04-19 07:24:47.363464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff> (d60694f5-3e76-4842-a712-17dd104b30ff) [No such file or directory] >[2016-04-19 07:24:47.364683] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d60694f5-3e76-4842-a712-17dd104b30ff. (Possible split-brain) >[2016-04-19 07:24:47.365627] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff> (d60694f5-3e76-4842-a712-17dd104b30ff) [No such file or directory] >[2016-04-19 07:24:47.365636] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff> (d60694f5-3e76-4842-a712-17dd104b30ff) [No such file or directory] >[2016-04-19 07:24:47.367306] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff> (d60694f5-3e76-4842-a712-17dd104b30ff) [No such file or directory] >[2016-04-19 07:24:47.367351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff> (d60694f5-3e76-4842-a712-17dd104b30ff) [No such file or directory] >[2016-04-19 07:24:47.367539] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.370249] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d60694f5-3e76-4842-a712-17dd104b30ff. (Possible split-brain) >[2016-04-19 07:24:47.371376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff> (d60694f5-3e76-4842-a712-17dd104b30ff) [No such file or directory] >[2016-04-19 07:24:47.371402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff> (d60694f5-3e76-4842-a712-17dd104b30ff) [No such file or directory] >[2016-04-19 07:24:47.374631] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff> (d60694f5-3e76-4842-a712-17dd104b30ff) [No such file or directory] >[2016-04-19 07:24:47.374646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff> (d60694f5-3e76-4842-a712-17dd104b30ff) [No such file or directory] >[2016-04-19 07:24:47.374817] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d60694f5-3e76-4842-a712-17dd104b30ff>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.384039] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.384951] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e> (ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e) [No such file or directory] >[2016-04-19 07:24:47.385033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e> (ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e) [No such file or directory] >[2016-04-19 07:24:47.386147] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e. (Possible split-brain) >[2016-04-19 07:24:47.387401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e> (ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e) [No such file or directory] >[2016-04-19 07:24:47.387421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e> (ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e) [No such file or directory] >[2016-04-19 07:24:47.388739] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e> (ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e) [No such file or directory] >[2016-04-19 07:24:47.388887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e> (ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e) [No such file or directory] >[2016-04-19 07:24:47.389051] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.391640] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e. (Possible split-brain) >[2016-04-19 07:24:47.392932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e> (ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e) [No such file or directory] >[2016-04-19 07:24:47.393027] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e> (ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e) [No such file or directory] >[2016-04-19 07:24:47.396610] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e> (ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e) [No such file or directory] >[2016-04-19 07:24:47.396852] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e> (ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e) [No such file or directory] >[2016-04-19 07:24:47.397534] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ccb1fb29-a8fb-4ffc-8bf6-1aae99d1094e>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.407066] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.408174] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d> (2415439e-f6e0-4663-87a4-784e58ed4d8d) [No such file or directory] >[2016-04-19 07:24:47.408187] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d> (2415439e-f6e0-4663-87a4-784e58ed4d8d) [No such file or directory] >[2016-04-19 07:24:47.411096] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2415439e-f6e0-4663-87a4-784e58ed4d8d. (Possible split-brain) >[2016-04-19 07:24:47.412379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d> (2415439e-f6e0-4663-87a4-784e58ed4d8d) [No such file or directory] >[2016-04-19 07:24:47.412394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d> (2415439e-f6e0-4663-87a4-784e58ed4d8d) [No such file or directory] >[2016-04-19 07:24:47.413873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d> (2415439e-f6e0-4663-87a4-784e58ed4d8d) [No such file or directory] >[2016-04-19 07:24:47.413904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d> (2415439e-f6e0-4663-87a4-784e58ed4d8d) [No such file or directory] >[2016-04-19 07:24:47.414411] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.417186] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2415439e-f6e0-4663-87a4-784e58ed4d8d. (Possible split-brain) >[2016-04-19 07:24:47.418478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d> (2415439e-f6e0-4663-87a4-784e58ed4d8d) [No such file or directory] >[2016-04-19 07:24:47.418548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d> (2415439e-f6e0-4663-87a4-784e58ed4d8d) [No such file or directory] >[2016-04-19 07:24:47.422225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d> (2415439e-f6e0-4663-87a4-784e58ed4d8d) [No such file or directory] >[2016-04-19 07:24:47.422758] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d> (2415439e-f6e0-4663-87a4-784e58ed4d8d) [No such file or directory] >[2016-04-19 07:24:47.423075] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2415439e-f6e0-4663-87a4-784e58ed4d8d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.432504] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.433406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561> (ca61ae57-726e-4a69-a5b1-159a5aec0561) [No such file or directory] >[2016-04-19 07:24:47.433728] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561> (ca61ae57-726e-4a69-a5b1-159a5aec0561) [No such file or directory] >[2016-04-19 07:24:47.436583] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ca61ae57-726e-4a69-a5b1-159a5aec0561. (Possible split-brain) >[2016-04-19 07:24:47.437961] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561> (ca61ae57-726e-4a69-a5b1-159a5aec0561) [No such file or directory] >[2016-04-19 07:24:47.437967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561> (ca61ae57-726e-4a69-a5b1-159a5aec0561) [No such file or directory] >[2016-04-19 07:24:47.439286] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561> (ca61ae57-726e-4a69-a5b1-159a5aec0561) [No such file or directory] >[2016-04-19 07:24:47.439548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561> (ca61ae57-726e-4a69-a5b1-159a5aec0561) [No such file or directory] >[2016-04-19 07:24:47.439950] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.442730] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ca61ae57-726e-4a69-a5b1-159a5aec0561. (Possible split-brain) >[2016-04-19 07:24:47.444051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561> (ca61ae57-726e-4a69-a5b1-159a5aec0561) [No such file or directory] >[2016-04-19 07:24:47.444067] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561> (ca61ae57-726e-4a69-a5b1-159a5aec0561) [No such file or directory] >[2016-04-19 07:24:47.447898] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561> (ca61ae57-726e-4a69-a5b1-159a5aec0561) [No such file or directory] >[2016-04-19 07:24:47.448586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561> (ca61ae57-726e-4a69-a5b1-159a5aec0561) [No such file or directory] >[2016-04-19 07:24:47.448903] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ca61ae57-726e-4a69-a5b1-159a5aec0561>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.458750] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.459735] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca> (dd69948e-152d-4c43-9f36-987b0dcd64ca) [No such file or directory] >[2016-04-19 07:24:47.459794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca> (dd69948e-152d-4c43-9f36-987b0dcd64ca) [No such file or directory] >[2016-04-19 07:24:47.462674] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid dd69948e-152d-4c43-9f36-987b0dcd64ca. (Possible split-brain) >[2016-04-19 07:24:47.463530] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca> (dd69948e-152d-4c43-9f36-987b0dcd64ca) [No such file or directory] >[2016-04-19 07:24:47.463589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca> (dd69948e-152d-4c43-9f36-987b0dcd64ca) [No such file or directory] >[2016-04-19 07:24:47.464958] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca> (dd69948e-152d-4c43-9f36-987b0dcd64ca) [No such file or directory] >[2016-04-19 07:24:47.465099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca> (dd69948e-152d-4c43-9f36-987b0dcd64ca) [No such file or directory] >[2016-04-19 07:24:47.465368] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.468176] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid dd69948e-152d-4c43-9f36-987b0dcd64ca. (Possible split-brain) >[2016-04-19 07:24:47.469148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca> (dd69948e-152d-4c43-9f36-987b0dcd64ca) [No such file or directory] >[2016-04-19 07:24:47.469172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca> (dd69948e-152d-4c43-9f36-987b0dcd64ca) [No such file or directory] >[2016-04-19 07:24:47.473726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca> (dd69948e-152d-4c43-9f36-987b0dcd64ca) [No such file or directory] >[2016-04-19 07:24:47.474005] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca> (dd69948e-152d-4c43-9f36-987b0dcd64ca) [No such file or directory] >[2016-04-19 07:24:47.474199] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:dd69948e-152d-4c43-9f36-987b0dcd64ca>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.483657] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.484527] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707> (492820b3-494a-45c5-bfb7-a77a74a28707) [No such file or directory] >[2016-04-19 07:24:47.484855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707> (492820b3-494a-45c5-bfb7-a77a74a28707) [No such file or directory] >[2016-04-19 07:24:47.487622] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 492820b3-494a-45c5-bfb7-a77a74a28707. (Possible split-brain) >[2016-04-19 07:24:47.488442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707> (492820b3-494a-45c5-bfb7-a77a74a28707) [No such file or directory] >[2016-04-19 07:24:47.488710] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707> (492820b3-494a-45c5-bfb7-a77a74a28707) [No such file or directory] >[2016-04-19 07:24:47.489747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707> (492820b3-494a-45c5-bfb7-a77a74a28707) [No such file or directory] >[2016-04-19 07:24:47.490276] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707> (492820b3-494a-45c5-bfb7-a77a74a28707) [No such file or directory] >[2016-04-19 07:24:47.490509] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.493079] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 492820b3-494a-45c5-bfb7-a77a74a28707. (Possible split-brain) >[2016-04-19 07:24:47.494209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707> (492820b3-494a-45c5-bfb7-a77a74a28707) [No such file or directory] >[2016-04-19 07:24:47.494412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707> (492820b3-494a-45c5-bfb7-a77a74a28707) [No such file or directory] >[2016-04-19 07:24:47.497063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707> (492820b3-494a-45c5-bfb7-a77a74a28707) [No such file or directory] >[2016-04-19 07:24:47.497080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707> (492820b3-494a-45c5-bfb7-a77a74a28707) [No such file or directory] >[2016-04-19 07:24:47.497245] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:492820b3-494a-45c5-bfb7-a77a74a28707>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.507037] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.507916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb> (d8076820-ae81-4b85-a14f-be8b45a614bb) [No such file or directory] >[2016-04-19 07:24:47.507984] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb> (d8076820-ae81-4b85-a14f-be8b45a614bb) [No such file or directory] >[2016-04-19 07:24:47.510880] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d8076820-ae81-4b85-a14f-be8b45a614bb. (Possible split-brain) >[2016-04-19 07:24:47.511951] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb> (d8076820-ae81-4b85-a14f-be8b45a614bb) [No such file or directory] >[2016-04-19 07:24:47.512034] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb> (d8076820-ae81-4b85-a14f-be8b45a614bb) [No such file or directory] >[2016-04-19 07:24:47.513545] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb> (d8076820-ae81-4b85-a14f-be8b45a614bb) [No such file or directory] >[2016-04-19 07:24:47.513602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb> (d8076820-ae81-4b85-a14f-be8b45a614bb) [No such file or directory] >[2016-04-19 07:24:47.513884] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.516730] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d8076820-ae81-4b85-a14f-be8b45a614bb. (Possible split-brain) >[2016-04-19 07:24:47.517659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb> (d8076820-ae81-4b85-a14f-be8b45a614bb) [No such file or directory] >[2016-04-19 07:24:47.517752] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb> (d8076820-ae81-4b85-a14f-be8b45a614bb) [No such file or directory] >[2016-04-19 07:24:47.521981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb> (d8076820-ae81-4b85-a14f-be8b45a614bb) [No such file or directory] >[2016-04-19 07:24:47.522051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb> (d8076820-ae81-4b85-a14f-be8b45a614bb) [No such file or directory] >[2016-04-19 07:24:47.522187] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d8076820-ae81-4b85-a14f-be8b45a614bb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.531139] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.532001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67> (a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67) [No such file or directory] >[2016-04-19 07:24:47.532305] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67> (a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67) [No such file or directory] >[2016-04-19 07:24:47.533476] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67. (Possible split-brain) >[2016-04-19 07:24:47.534370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67> (a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67) [No such file or directory] >[2016-04-19 07:24:47.534645] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67> (a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67) [No such file or directory] >[2016-04-19 07:24:47.535689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67> (a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67) [No such file or directory] >[2016-04-19 07:24:47.535784] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67> (a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67) [No such file or directory] >[2016-04-19 07:24:47.536288] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.539072] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67. (Possible split-brain) >[2016-04-19 07:24:47.539852] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67> (a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67) [No such file or directory] >[2016-04-19 07:24:47.540085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67> (a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67) [No such file or directory] >[2016-04-19 07:24:47.543769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67> (a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67) [No such file or directory] >[2016-04-19 07:24:47.544538] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67> (a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67) [No such file or directory] >[2016-04-19 07:24:47.544808] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a4de0fcb-bcdb-4cf6-96aa-b2764d9c2c67>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.553643] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.554676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335> (fb951f1b-cd64-4be5-bb6a-b3e8eb37c335) [No such file or directory] >[2016-04-19 07:24:47.554660] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335> (fb951f1b-cd64-4be5-bb6a-b3e8eb37c335) [No such file or directory] >[2016-04-19 07:24:47.555856] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fb951f1b-cd64-4be5-bb6a-b3e8eb37c335. (Possible split-brain) >[2016-04-19 07:24:47.556589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335> (fb951f1b-cd64-4be5-bb6a-b3e8eb37c335) [No such file or directory] >[2016-04-19 07:24:47.556695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335> (fb951f1b-cd64-4be5-bb6a-b3e8eb37c335) [No such file or directory] >[2016-04-19 07:24:47.558050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335> (fb951f1b-cd64-4be5-bb6a-b3e8eb37c335) [No such file or directory] >[2016-04-19 07:24:47.558083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335> (fb951f1b-cd64-4be5-bb6a-b3e8eb37c335) [No such file or directory] >[2016-04-19 07:24:47.558548] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.561293] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fb951f1b-cd64-4be5-bb6a-b3e8eb37c335. (Possible split-brain) >[2016-04-19 07:24:47.562157] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335> (fb951f1b-cd64-4be5-bb6a-b3e8eb37c335) [No such file or directory] >[2016-04-19 07:24:47.562339] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335> (fb951f1b-cd64-4be5-bb6a-b3e8eb37c335) [No such file or directory] >[2016-04-19 07:24:47.565398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335> (fb951f1b-cd64-4be5-bb6a-b3e8eb37c335) [No such file or directory] >[2016-04-19 07:24:47.565470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335> (fb951f1b-cd64-4be5-bb6a-b3e8eb37c335) [No such file or directory] >[2016-04-19 07:24:47.565670] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fb951f1b-cd64-4be5-bb6a-b3e8eb37c335>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.574844] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.575640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d> (278f510e-d55b-42ca-adb5-e6f149d7cb0d) [No such file or directory] >[2016-04-19 07:24:47.575934] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d> (278f510e-d55b-42ca-adb5-e6f149d7cb0d) [No such file or directory] >[2016-04-19 07:24:47.576796] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 278f510e-d55b-42ca-adb5-e6f149d7cb0d. (Possible split-brain) >[2016-04-19 07:24:47.577625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d> (278f510e-d55b-42ca-adb5-e6f149d7cb0d) [No such file or directory] >[2016-04-19 07:24:47.577885] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d> (278f510e-d55b-42ca-adb5-e6f149d7cb0d) [No such file or directory] >[2016-04-19 07:24:47.579025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d> (278f510e-d55b-42ca-adb5-e6f149d7cb0d) [No such file or directory] >[2016-04-19 07:24:47.579130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d> (278f510e-d55b-42ca-adb5-e6f149d7cb0d) [No such file or directory] >[2016-04-19 07:24:47.579601] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.582365] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 278f510e-d55b-42ca-adb5-e6f149d7cb0d. (Possible split-brain) >[2016-04-19 07:24:47.583499] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d> (278f510e-d55b-42ca-adb5-e6f149d7cb0d) [No such file or directory] >[2016-04-19 07:24:47.583601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d> (278f510e-d55b-42ca-adb5-e6f149d7cb0d) [No such file or directory] >[2016-04-19 07:24:47.586003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d> (278f510e-d55b-42ca-adb5-e6f149d7cb0d) [No such file or directory] >[2016-04-19 07:24:47.586619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d> (278f510e-d55b-42ca-adb5-e6f149d7cb0d) [No such file or directory] >[2016-04-19 07:24:47.586823] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:278f510e-d55b-42ca-adb5-e6f149d7cb0d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.595714] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.596467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9> (691b5f75-244a-4cf4-a80a-967b950a73a9) [No such file or directory] >[2016-04-19 07:24:47.596725] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9> (691b5f75-244a-4cf4-a80a-967b950a73a9) [No such file or directory] >[2016-04-19 07:24:47.597829] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 691b5f75-244a-4cf4-a80a-967b950a73a9. (Possible split-brain) >[2016-04-19 07:24:47.598659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9> (691b5f75-244a-4cf4-a80a-967b950a73a9) [No such file or directory] >[2016-04-19 07:24:47.598926] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9> (691b5f75-244a-4cf4-a80a-967b950a73a9) [No such file or directory] >[2016-04-19 07:24:47.600304] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9> (691b5f75-244a-4cf4-a80a-967b950a73a9) [No such file or directory] >[2016-04-19 07:24:47.600430] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9> (691b5f75-244a-4cf4-a80a-967b950a73a9) [No such file or directory] >[2016-04-19 07:24:47.600731] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.603468] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 691b5f75-244a-4cf4-a80a-967b950a73a9. (Possible split-brain) >[2016-04-19 07:24:47.604446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9> (691b5f75-244a-4cf4-a80a-967b950a73a9) [No such file or directory] >[2016-04-19 07:24:47.604604] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9> (691b5f75-244a-4cf4-a80a-967b950a73a9) [No such file or directory] >[2016-04-19 07:24:47.607534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9> (691b5f75-244a-4cf4-a80a-967b950a73a9) [No such file or directory] >[2016-04-19 07:24:47.607562] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9> (691b5f75-244a-4cf4-a80a-967b950a73a9) [No such file or directory] >[2016-04-19 07:24:47.607723] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:691b5f75-244a-4cf4-a80a-967b950a73a9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.616274] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.617173] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4> (74b4882d-99cd-4547-8511-0522ed5fe4d4) [No such file or directory] >[2016-04-19 07:24:47.617262] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4> (74b4882d-99cd-4547-8511-0522ed5fe4d4) [No such file or directory] >[2016-04-19 07:24:47.620065] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 74b4882d-99cd-4547-8511-0522ed5fe4d4. (Possible split-brain) >[2016-04-19 07:24:47.620864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4> (74b4882d-99cd-4547-8511-0522ed5fe4d4) [No such file or directory] >[2016-04-19 07:24:47.621097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4> (74b4882d-99cd-4547-8511-0522ed5fe4d4) [No such file or directory] >[2016-04-19 07:24:47.622359] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4> (74b4882d-99cd-4547-8511-0522ed5fe4d4) [No such file or directory] >[2016-04-19 07:24:47.622363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4> (74b4882d-99cd-4547-8511-0522ed5fe4d4) [No such file or directory] >[2016-04-19 07:24:47.622835] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.625551] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 74b4882d-99cd-4547-8511-0522ed5fe4d4. (Possible split-brain) >[2016-04-19 07:24:47.626245] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4> (74b4882d-99cd-4547-8511-0522ed5fe4d4) [No such file or directory] >[2016-04-19 07:24:47.626596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4> (74b4882d-99cd-4547-8511-0522ed5fe4d4) [No such file or directory] >[2016-04-19 07:24:47.630507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4> (74b4882d-99cd-4547-8511-0522ed5fe4d4) [No such file or directory] >[2016-04-19 07:24:47.630664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4> (74b4882d-99cd-4547-8511-0522ed5fe4d4) [No such file or directory] >[2016-04-19 07:24:47.630844] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:74b4882d-99cd-4547-8511-0522ed5fe4d4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.640386] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.641428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698> (01355639-b164-4f43-a29e-a72f6c9d3698) [No such file or directory] >[2016-04-19 07:24:47.641526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698> (01355639-b164-4f43-a29e-a72f6c9d3698) [No such file or directory] >[2016-04-19 07:24:47.642639] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 01355639-b164-4f43-a29e-a72f6c9d3698. (Possible split-brain) >[2016-04-19 07:24:47.643406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698> (01355639-b164-4f43-a29e-a72f6c9d3698) [No such file or directory] >[2016-04-19 07:24:47.643740] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698> (01355639-b164-4f43-a29e-a72f6c9d3698) [No such file or directory] >[2016-04-19 07:24:47.645243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698> (01355639-b164-4f43-a29e-a72f6c9d3698) [No such file or directory] >[2016-04-19 07:24:47.645364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698> (01355639-b164-4f43-a29e-a72f6c9d3698) [No such file or directory] >[2016-04-19 07:24:47.646311] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.649093] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 01355639-b164-4f43-a29e-a72f6c9d3698. (Possible split-brain) >[2016-04-19 07:24:47.649946] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698> (01355639-b164-4f43-a29e-a72f6c9d3698) [No such file or directory] >[2016-04-19 07:24:47.650043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698> (01355639-b164-4f43-a29e-a72f6c9d3698) [No such file or directory] >[2016-04-19 07:24:47.655427] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698> (01355639-b164-4f43-a29e-a72f6c9d3698) [No such file or directory] >[2016-04-19 07:24:47.655433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698> (01355639-b164-4f43-a29e-a72f6c9d3698) [No such file or directory] >[2016-04-19 07:24:47.655748] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:01355639-b164-4f43-a29e-a72f6c9d3698>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.666028] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.666897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a> (3508732f-f5f6-4d2d-b4cd-367aa5cc316a) [No such file or directory] >[2016-04-19 07:24:47.667183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a> (3508732f-f5f6-4d2d-b4cd-367aa5cc316a) [No such file or directory] >[2016-04-19 07:24:47.670060] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3508732f-f5f6-4d2d-b4cd-367aa5cc316a. (Possible split-brain) >[2016-04-19 07:24:47.671394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a> (3508732f-f5f6-4d2d-b4cd-367aa5cc316a) [No such file or directory] >[2016-04-19 07:24:47.671516] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a> (3508732f-f5f6-4d2d-b4cd-367aa5cc316a) [No such file or directory] >[2016-04-19 07:24:47.672551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a> (3508732f-f5f6-4d2d-b4cd-367aa5cc316a) [No such file or directory] >[2016-04-19 07:24:47.672757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a> (3508732f-f5f6-4d2d-b4cd-367aa5cc316a) [No such file or directory] >[2016-04-19 07:24:47.673424] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.676167] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3508732f-f5f6-4d2d-b4cd-367aa5cc316a. (Possible split-brain) >[2016-04-19 07:24:47.677403] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a> (3508732f-f5f6-4d2d-b4cd-367aa5cc316a) [No such file or directory] >[2016-04-19 07:24:47.677423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a> (3508732f-f5f6-4d2d-b4cd-367aa5cc316a) [No such file or directory] >[2016-04-19 07:24:47.681396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a> (3508732f-f5f6-4d2d-b4cd-367aa5cc316a) [No such file or directory] >[2016-04-19 07:24:47.682077] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a> (3508732f-f5f6-4d2d-b4cd-367aa5cc316a) [No such file or directory] >[2016-04-19 07:24:47.682622] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3508732f-f5f6-4d2d-b4cd-367aa5cc316a>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.692386] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.693515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02> (c9e67698-653f-4d55-b2b0-3a6deb72bf02) [No such file or directory] >[2016-04-19 07:24:47.693611] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02> (c9e67698-653f-4d55-b2b0-3a6deb72bf02) [No such file or directory] >[2016-04-19 07:24:47.694712] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c9e67698-653f-4d55-b2b0-3a6deb72bf02. (Possible split-brain) >[2016-04-19 07:24:47.695845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02> (c9e67698-653f-4d55-b2b0-3a6deb72bf02) [No such file or directory] >[2016-04-19 07:24:47.695863] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02> (c9e67698-653f-4d55-b2b0-3a6deb72bf02) [No such file or directory] >[2016-04-19 07:24:47.697211] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02> (c9e67698-653f-4d55-b2b0-3a6deb72bf02) [No such file or directory] >[2016-04-19 07:24:47.697243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02> (c9e67698-653f-4d55-b2b0-3a6deb72bf02) [No such file or directory] >[2016-04-19 07:24:47.697947] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.700739] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c9e67698-653f-4d55-b2b0-3a6deb72bf02. (Possible split-brain) >[2016-04-19 07:24:47.701564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02> (c9e67698-653f-4d55-b2b0-3a6deb72bf02) [No such file or directory] >[2016-04-19 07:24:47.701940] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02> (c9e67698-653f-4d55-b2b0-3a6deb72bf02) [No such file or directory] >[2016-04-19 07:24:47.705378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02> (c9e67698-653f-4d55-b2b0-3a6deb72bf02) [No such file or directory] >[2016-04-19 07:24:47.705460] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02> (c9e67698-653f-4d55-b2b0-3a6deb72bf02) [No such file or directory] >[2016-04-19 07:24:47.705685] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c9e67698-653f-4d55-b2b0-3a6deb72bf02>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.715191] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.716031] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970> (bd270f4e-1b1f-45a5-af75-2b8a3f363970) [No such file or directory] >[2016-04-19 07:24:47.716370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970> (bd270f4e-1b1f-45a5-af75-2b8a3f363970) [No such file or directory] >[2016-04-19 07:24:47.719237] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bd270f4e-1b1f-45a5-af75-2b8a3f363970. (Possible split-brain) >[2016-04-19 07:24:47.720022] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970> (bd270f4e-1b1f-45a5-af75-2b8a3f363970) [No such file or directory] >[2016-04-19 07:24:47.720396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970> (bd270f4e-1b1f-45a5-af75-2b8a3f363970) [No such file or directory] >[2016-04-19 07:24:47.721808] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970> (bd270f4e-1b1f-45a5-af75-2b8a3f363970) [No such file or directory] >[2016-04-19 07:24:47.721971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970> (bd270f4e-1b1f-45a5-af75-2b8a3f363970) [No such file or directory] >[2016-04-19 07:24:47.722144] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.724990] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bd270f4e-1b1f-45a5-af75-2b8a3f363970. (Possible split-brain) >[2016-04-19 07:24:47.725805] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970> (bd270f4e-1b1f-45a5-af75-2b8a3f363970) [No such file or directory] >[2016-04-19 07:24:47.726224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970> (bd270f4e-1b1f-45a5-af75-2b8a3f363970) [No such file or directory] >[2016-04-19 07:24:47.730921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970> (bd270f4e-1b1f-45a5-af75-2b8a3f363970) [No such file or directory] >[2016-04-19 07:24:47.730928] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970> (bd270f4e-1b1f-45a5-af75-2b8a3f363970) [No such file or directory] >[2016-04-19 07:24:47.731420] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bd270f4e-1b1f-45a5-af75-2b8a3f363970>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.741845] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.742801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1> (1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1) [No such file or directory] >[2016-04-19 07:24:47.742817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1> (1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1) [No such file or directory] >[2016-04-19 07:24:47.745759] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1. (Possible split-brain) >[2016-04-19 07:24:47.746885] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1> (1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1) [No such file or directory] >[2016-04-19 07:24:47.746913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1> (1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1) [No such file or directory] >[2016-04-19 07:24:47.748148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1> (1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1) [No such file or directory] >[2016-04-19 07:24:47.748353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1> (1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1) [No such file or directory] >[2016-04-19 07:24:47.748813] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.751598] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1. (Possible split-brain) >[2016-04-19 07:24:47.752776] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1> (1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1) [No such file or directory] >[2016-04-19 07:24:47.752806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1> (1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1) [No such file or directory] >[2016-04-19 07:24:47.756780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1> (1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1) [No such file or directory] >[2016-04-19 07:24:47.757164] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1> (1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1) [No such file or directory] >[2016-04-19 07:24:47.758068] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1eea8d7f-2aa5-4c0f-bcb6-8e81f774c1f1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.766482] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.767341] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9> (9a63718f-9280-4a73-bb18-5a7612acbbc9) [No such file or directory] >[2016-04-19 07:24:47.767664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9> (9a63718f-9280-4a73-bb18-5a7612acbbc9) [No such file or directory] >[2016-04-19 07:24:47.768765] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9a63718f-9280-4a73-bb18-5a7612acbbc9. (Possible split-brain) >[2016-04-19 07:24:47.769881] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9> (9a63718f-9280-4a73-bb18-5a7612acbbc9) [No such file or directory] >[2016-04-19 07:24:47.769890] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9> (9a63718f-9280-4a73-bb18-5a7612acbbc9) [No such file or directory] >[2016-04-19 07:24:47.771146] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9> (9a63718f-9280-4a73-bb18-5a7612acbbc9) [No such file or directory] >[2016-04-19 07:24:47.771466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9> (9a63718f-9280-4a73-bb18-5a7612acbbc9) [No such file or directory] >[2016-04-19 07:24:47.771899] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.774662] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9a63718f-9280-4a73-bb18-5a7612acbbc9. (Possible split-brain) >[2016-04-19 07:24:47.775733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9> (9a63718f-9280-4a73-bb18-5a7612acbbc9) [No such file or directory] >[2016-04-19 07:24:47.775847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9> (9a63718f-9280-4a73-bb18-5a7612acbbc9) [No such file or directory] >[2016-04-19 07:24:47.779986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9> (9a63718f-9280-4a73-bb18-5a7612acbbc9) [No such file or directory] >[2016-04-19 07:24:47.780016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9> (9a63718f-9280-4a73-bb18-5a7612acbbc9) [No such file or directory] >[2016-04-19 07:24:47.780427] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9a63718f-9280-4a73-bb18-5a7612acbbc9>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.787782] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.788161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503> (70124d8c-57bd-401a-badd-32cc8ac84503) [No such file or directory] >[2016-04-19 07:24:47.788625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503> (70124d8c-57bd-401a-badd-32cc8ac84503) [No such file or directory] >[2016-04-19 07:24:47.789712] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 70124d8c-57bd-401a-badd-32cc8ac84503. (Possible split-brain) >[2016-04-19 07:24:47.790365] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503> (70124d8c-57bd-401a-badd-32cc8ac84503) [No such file or directory] >[2016-04-19 07:24:47.790595] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503> (70124d8c-57bd-401a-badd-32cc8ac84503) [No such file or directory] >[2016-04-19 07:24:47.791736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503> (70124d8c-57bd-401a-badd-32cc8ac84503) [No such file or directory] >[2016-04-19 07:24:47.792063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503> (70124d8c-57bd-401a-badd-32cc8ac84503) [No such file or directory] >[2016-04-19 07:24:47.792207] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.795047] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 70124d8c-57bd-401a-badd-32cc8ac84503. (Possible split-brain) >[2016-04-19 07:24:47.795844] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503> (70124d8c-57bd-401a-badd-32cc8ac84503) [No such file or directory] >[2016-04-19 07:24:47.796132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503> (70124d8c-57bd-401a-badd-32cc8ac84503) [No such file or directory] >[2016-04-19 07:24:47.798845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503> (70124d8c-57bd-401a-badd-32cc8ac84503) [No such file or directory] >[2016-04-19 07:24:47.798998] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503> (70124d8c-57bd-401a-badd-32cc8ac84503) [No such file or directory] >[2016-04-19 07:24:47.799556] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:70124d8c-57bd-401a-badd-32cc8ac84503>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.807112] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.807932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205> (9a2e04bb-84ee-490e-b9c6-2fd917a49205) [No such file or directory] >[2016-04-19 07:24:47.808016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205> (9a2e04bb-84ee-490e-b9c6-2fd917a49205) [No such file or directory] >[2016-04-19 07:24:47.810800] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9a2e04bb-84ee-490e-b9c6-2fd917a49205. (Possible split-brain) >[2016-04-19 07:24:47.811570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205> (9a2e04bb-84ee-490e-b9c6-2fd917a49205) [No such file or directory] >[2016-04-19 07:24:47.811797] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205> (9a2e04bb-84ee-490e-b9c6-2fd917a49205) [No such file or directory] >[2016-04-19 07:24:47.813074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205> (9a2e04bb-84ee-490e-b9c6-2fd917a49205) [No such file or directory] >[2016-04-19 07:24:47.813457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205> (9a2e04bb-84ee-490e-b9c6-2fd917a49205) [No such file or directory] >[2016-04-19 07:24:47.813867] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.816655] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9a2e04bb-84ee-490e-b9c6-2fd917a49205. (Possible split-brain) >[2016-04-19 07:24:47.817461] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205> (9a2e04bb-84ee-490e-b9c6-2fd917a49205) [No such file or directory] >[2016-04-19 07:24:47.817763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205> (9a2e04bb-84ee-490e-b9c6-2fd917a49205) [No such file or directory] >[2016-04-19 07:24:47.821365] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205> (9a2e04bb-84ee-490e-b9c6-2fd917a49205) [No such file or directory] >[2016-04-19 07:24:47.821565] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205> (9a2e04bb-84ee-490e-b9c6-2fd917a49205) [No such file or directory] >[2016-04-19 07:24:47.821704] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9a2e04bb-84ee-490e-b9c6-2fd917a49205>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.829761] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.830565] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42> (5f2bece1-9ebf-445d-b4b7-4e1281189e42) [No such file or directory] >[2016-04-19 07:24:47.830747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42> (5f2bece1-9ebf-445d-b4b7-4e1281189e42) [No such file or directory] >[2016-04-19 07:24:47.831657] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5f2bece1-9ebf-445d-b4b7-4e1281189e42. (Possible split-brain) >[2016-04-19 07:24:47.832436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42> (5f2bece1-9ebf-445d-b4b7-4e1281189e42) [No such file or directory] >[2016-04-19 07:24:47.832654] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42> (5f2bece1-9ebf-445d-b4b7-4e1281189e42) [No such file or directory] >[2016-04-19 07:24:47.833788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42> (5f2bece1-9ebf-445d-b4b7-4e1281189e42) [No such file or directory] >[2016-04-19 07:24:47.833849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42> (5f2bece1-9ebf-445d-b4b7-4e1281189e42) [No such file or directory] >[2016-04-19 07:24:47.834003] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.836603] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5f2bece1-9ebf-445d-b4b7-4e1281189e42. (Possible split-brain) >[2016-04-19 07:24:47.837587] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42> (5f2bece1-9ebf-445d-b4b7-4e1281189e42) [No such file or directory] >[2016-04-19 07:24:47.837838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42> (5f2bece1-9ebf-445d-b4b7-4e1281189e42) [No such file or directory] >[2016-04-19 07:24:47.842402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42> (5f2bece1-9ebf-445d-b4b7-4e1281189e42) [No such file or directory] >[2016-04-19 07:24:47.842660] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42> (5f2bece1-9ebf-445d-b4b7-4e1281189e42) [No such file or directory] >[2016-04-19 07:24:47.843286] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5f2bece1-9ebf-445d-b4b7-4e1281189e42>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.851669] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.852409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8919e0da-72ff-4824-b117-0c482599c79e> (8919e0da-72ff-4824-b117-0c482599c79e) [No such file or directory] >[2016-04-19 07:24:47.852628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8919e0da-72ff-4824-b117-0c482599c79e> (8919e0da-72ff-4824-b117-0c482599c79e) [No such file or directory] >[2016-04-19 07:24:47.853733] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8919e0da-72ff-4824-b117-0c482599c79e. (Possible split-brain) >[2016-04-19 07:24:47.854524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8919e0da-72ff-4824-b117-0c482599c79e> (8919e0da-72ff-4824-b117-0c482599c79e) [No such file or directory] >[2016-04-19 07:24:47.854577] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8919e0da-72ff-4824-b117-0c482599c79e> (8919e0da-72ff-4824-b117-0c482599c79e) [No such file or directory] >[2016-04-19 07:24:47.856013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8919e0da-72ff-4824-b117-0c482599c79e> (8919e0da-72ff-4824-b117-0c482599c79e) [No such file or directory] >[2016-04-19 07:24:47.856100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8919e0da-72ff-4824-b117-0c482599c79e> (8919e0da-72ff-4824-b117-0c482599c79e) [No such file or directory] >[2016-04-19 07:24:47.856414] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8919e0da-72ff-4824-b117-0c482599c79e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.859089] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8919e0da-72ff-4824-b117-0c482599c79e. (Possible split-brain) >[2016-04-19 07:24:47.859837] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8919e0da-72ff-4824-b117-0c482599c79e> (8919e0da-72ff-4824-b117-0c482599c79e) [No such file or directory] >[2016-04-19 07:24:47.860095] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8919e0da-72ff-4824-b117-0c482599c79e> (8919e0da-72ff-4824-b117-0c482599c79e) [No such file or directory] >[2016-04-19 07:24:47.862983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8919e0da-72ff-4824-b117-0c482599c79e> (8919e0da-72ff-4824-b117-0c482599c79e) [No such file or directory] >[2016-04-19 07:24:47.863065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8919e0da-72ff-4824-b117-0c482599c79e> (8919e0da-72ff-4824-b117-0c482599c79e) [No such file or directory] >[2016-04-19 07:24:47.863182] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8919e0da-72ff-4824-b117-0c482599c79e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.871662] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.872500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744> (95ab5c55-a2b6-4d1c-9cfb-25adf61b9744) [No such file or directory] >[2016-04-19 07:24:47.872574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744> (95ab5c55-a2b6-4d1c-9cfb-25adf61b9744) [No such file or directory] >[2016-04-19 07:24:47.875382] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 95ab5c55-a2b6-4d1c-9cfb-25adf61b9744. (Possible split-brain) >[2016-04-19 07:24:47.876512] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744> (95ab5c55-a2b6-4d1c-9cfb-25adf61b9744) [No such file or directory] >[2016-04-19 07:24:47.876601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744> (95ab5c55-a2b6-4d1c-9cfb-25adf61b9744) [No such file or directory] >[2016-04-19 07:24:47.877904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744> (95ab5c55-a2b6-4d1c-9cfb-25adf61b9744) [No such file or directory] >[2016-04-19 07:24:47.877909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744> (95ab5c55-a2b6-4d1c-9cfb-25adf61b9744) [No such file or directory] >[2016-04-19 07:24:47.878222] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.881022] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 95ab5c55-a2b6-4d1c-9cfb-25adf61b9744. (Possible split-brain) >[2016-04-19 07:24:47.881835] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744> (95ab5c55-a2b6-4d1c-9cfb-25adf61b9744) [No such file or directory] >[2016-04-19 07:24:47.882146] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744> (95ab5c55-a2b6-4d1c-9cfb-25adf61b9744) [No such file or directory] >[2016-04-19 07:24:47.887342] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744> (95ab5c55-a2b6-4d1c-9cfb-25adf61b9744) [No such file or directory] >[2016-04-19 07:24:47.887357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744> (95ab5c55-a2b6-4d1c-9cfb-25adf61b9744) [No such file or directory] >[2016-04-19 07:24:47.887676] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:95ab5c55-a2b6-4d1c-9cfb-25adf61b9744>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.896050] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.896819] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48e211ae-7441-4027-924d-129a1494017c> (48e211ae-7441-4027-924d-129a1494017c) [No such file or directory] >[2016-04-19 07:24:47.896975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48e211ae-7441-4027-924d-129a1494017c> (48e211ae-7441-4027-924d-129a1494017c) [No such file or directory] >[2016-04-19 07:24:47.897812] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 48e211ae-7441-4027-924d-129a1494017c. (Possible split-brain) >[2016-04-19 07:24:47.898781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48e211ae-7441-4027-924d-129a1494017c> (48e211ae-7441-4027-924d-129a1494017c) [No such file or directory] >[2016-04-19 07:24:47.898788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48e211ae-7441-4027-924d-129a1494017c> (48e211ae-7441-4027-924d-129a1494017c) [No such file or directory] >[2016-04-19 07:24:47.900277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48e211ae-7441-4027-924d-129a1494017c> (48e211ae-7441-4027-924d-129a1494017c) [No such file or directory] >[2016-04-19 07:24:47.900508] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48e211ae-7441-4027-924d-129a1494017c> (48e211ae-7441-4027-924d-129a1494017c) [No such file or directory] >[2016-04-19 07:24:47.900731] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:48e211ae-7441-4027-924d-129a1494017c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:47.903477] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 48e211ae-7441-4027-924d-129a1494017c. (Possible split-brain) >[2016-04-19 07:24:47.904437] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48e211ae-7441-4027-924d-129a1494017c> (48e211ae-7441-4027-924d-129a1494017c) [No such file or directory] >[2016-04-19 07:24:47.904594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48e211ae-7441-4027-924d-129a1494017c> (48e211ae-7441-4027-924d-129a1494017c) [No such file or directory] >[2016-04-19 07:24:47.909012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:48e211ae-7441-4027-924d-129a1494017c> (48e211ae-7441-4027-924d-129a1494017c) [No such file or directory] >[2016-04-19 07:24:47.909041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:48e211ae-7441-4027-924d-129a1494017c> (48e211ae-7441-4027-924d-129a1494017c) [No such file or directory] >[2016-04-19 07:24:47.909425] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:48e211ae-7441-4027-924d-129a1494017c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.918070] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.918915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e> (a1eca85f-ce05-40bf-8b52-302871bf1c1e) [No such file or directory] >[2016-04-19 07:24:47.918996] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e> (a1eca85f-ce05-40bf-8b52-302871bf1c1e) [No such file or directory] >[2016-04-19 07:24:47.919891] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a1eca85f-ce05-40bf-8b52-302871bf1c1e. (Possible split-brain) >[2016-04-19 07:24:47.920895] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e> (a1eca85f-ce05-40bf-8b52-302871bf1c1e) [No such file or directory] >[2016-04-19 07:24:47.921008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e> (a1eca85f-ce05-40bf-8b52-302871bf1c1e) [No such file or directory] >[2016-04-19 07:24:47.921988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e> (a1eca85f-ce05-40bf-8b52-302871bf1c1e) [No such file or directory] >[2016-04-19 07:24:47.922033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e> (a1eca85f-ce05-40bf-8b52-302871bf1c1e) [No such file or directory] >[2016-04-19 07:24:47.922800] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.925482] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a1eca85f-ce05-40bf-8b52-302871bf1c1e. (Possible split-brain) >[2016-04-19 07:24:47.926343] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e> (a1eca85f-ce05-40bf-8b52-302871bf1c1e) [No such file or directory] >[2016-04-19 07:24:47.926635] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e> (a1eca85f-ce05-40bf-8b52-302871bf1c1e) [No such file or directory] >[2016-04-19 07:24:47.930521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e> (a1eca85f-ce05-40bf-8b52-302871bf1c1e) [No such file or directory] >[2016-04-19 07:24:47.930535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e> (a1eca85f-ce05-40bf-8b52-302871bf1c1e) [No such file or directory] >[2016-04-19 07:24:47.930646] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a1eca85f-ce05-40bf-8b52-302871bf1c1e>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.937227] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.937631] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f> (bfa892e7-79e9-4c1b-97d1-f6d3d476395f) [No such file or directory] >[2016-04-19 07:24:47.937833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f> (bfa892e7-79e9-4c1b-97d1-f6d3d476395f) [No such file or directory] >[2016-04-19 07:24:47.939700] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bfa892e7-79e9-4c1b-97d1-f6d3d476395f. (Possible split-brain) >[2016-04-19 07:24:47.940443] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f> (bfa892e7-79e9-4c1b-97d1-f6d3d476395f) [No such file or directory] >[2016-04-19 07:24:47.940557] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f> (bfa892e7-79e9-4c1b-97d1-f6d3d476395f) [No such file or directory] >[2016-04-19 07:24:47.941520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f> (bfa892e7-79e9-4c1b-97d1-f6d3d476395f) [No such file or directory] >[2016-04-19 07:24:47.941671] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f> (bfa892e7-79e9-4c1b-97d1-f6d3d476395f) [No such file or directory] >[2016-04-19 07:24:47.941784] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.944387] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bfa892e7-79e9-4c1b-97d1-f6d3d476395f. (Possible split-brain) >[2016-04-19 07:24:47.945065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f> (bfa892e7-79e9-4c1b-97d1-f6d3d476395f) [No such file or directory] >[2016-04-19 07:24:47.945397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f> (bfa892e7-79e9-4c1b-97d1-f6d3d476395f) [No such file or directory] >[2016-04-19 07:24:47.948011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f> (bfa892e7-79e9-4c1b-97d1-f6d3d476395f) [No such file or directory] >[2016-04-19 07:24:47.948381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f> (bfa892e7-79e9-4c1b-97d1-f6d3d476395f) [No such file or directory] >[2016-04-19 07:24:47.948471] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bfa892e7-79e9-4c1b-97d1-f6d3d476395f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.957421] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.958272] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:71a1f467-0baf-448a-8595-53405e0255c3> (71a1f467-0baf-448a-8595-53405e0255c3) [No such file or directory] >[2016-04-19 07:24:47.958566] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:71a1f467-0baf-448a-8595-53405e0255c3> (71a1f467-0baf-448a-8595-53405e0255c3) [No such file or directory] >[2016-04-19 07:24:47.959698] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 71a1f467-0baf-448a-8595-53405e0255c3. (Possible split-brain) >[2016-04-19 07:24:47.960752] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:71a1f467-0baf-448a-8595-53405e0255c3> (71a1f467-0baf-448a-8595-53405e0255c3) [No such file or directory] >[2016-04-19 07:24:47.960936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:71a1f467-0baf-448a-8595-53405e0255c3> (71a1f467-0baf-448a-8595-53405e0255c3) [No such file or directory] >[2016-04-19 07:24:47.962118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:71a1f467-0baf-448a-8595-53405e0255c3> (71a1f467-0baf-448a-8595-53405e0255c3) [No such file or directory] >[2016-04-19 07:24:47.962207] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:71a1f467-0baf-448a-8595-53405e0255c3> (71a1f467-0baf-448a-8595-53405e0255c3) [No such file or directory] >[2016-04-19 07:24:47.962886] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:71a1f467-0baf-448a-8595-53405e0255c3>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.965646] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 71a1f467-0baf-448a-8595-53405e0255c3. (Possible split-brain) >[2016-04-19 07:24:47.966629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:71a1f467-0baf-448a-8595-53405e0255c3> (71a1f467-0baf-448a-8595-53405e0255c3) [No such file or directory] >[2016-04-19 07:24:47.966714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:71a1f467-0baf-448a-8595-53405e0255c3> (71a1f467-0baf-448a-8595-53405e0255c3) [No such file or directory] >[2016-04-19 07:24:47.970614] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:71a1f467-0baf-448a-8595-53405e0255c3> (71a1f467-0baf-448a-8595-53405e0255c3) [No such file or directory] >[2016-04-19 07:24:47.970628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:71a1f467-0baf-448a-8595-53405e0255c3> (71a1f467-0baf-448a-8595-53405e0255c3) [No such file or directory] >[2016-04-19 07:24:47.970702] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:71a1f467-0baf-448a-8595-53405e0255c3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:47.977710] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.978435] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1> (442abadc-0915-4593-a501-0ef15bddfbb1) [No such file or directory] >[2016-04-19 07:24:47.978591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1> (442abadc-0915-4593-a501-0ef15bddfbb1) [No such file or directory] >[2016-04-19 07:24:47.979539] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 442abadc-0915-4593-a501-0ef15bddfbb1. (Possible split-brain) >[2016-04-19 07:24:47.980515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1> (442abadc-0915-4593-a501-0ef15bddfbb1) [No such file or directory] >[2016-04-19 07:24:47.980554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1> (442abadc-0915-4593-a501-0ef15bddfbb1) [No such file or directory] >[2016-04-19 07:24:47.981737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1> (442abadc-0915-4593-a501-0ef15bddfbb1) [No such file or directory] >[2016-04-19 07:24:47.981764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1> (442abadc-0915-4593-a501-0ef15bddfbb1) [No such file or directory] >[2016-04-19 07:24:47.982518] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:47.985236] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 442abadc-0915-4593-a501-0ef15bddfbb1. (Possible split-brain) >[2016-04-19 07:24:47.986340] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1> (442abadc-0915-4593-a501-0ef15bddfbb1) [No such file or directory] >[2016-04-19 07:24:47.986397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1> (442abadc-0915-4593-a501-0ef15bddfbb1) [No such file or directory] >[2016-04-19 07:24:47.990763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1> (442abadc-0915-4593-a501-0ef15bddfbb1) [No such file or directory] >[2016-04-19 07:24:47.990786] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1> (442abadc-0915-4593-a501-0ef15bddfbb1) [No such file or directory] >[2016-04-19 07:24:47.991147] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:442abadc-0915-4593-a501-0ef15bddfbb1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:47.998390] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:47.998769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50> (008da3f6-8725-42b3-8bbf-7c28f9aa6d50) [No such file or directory] >[2016-04-19 07:24:47.999068] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50> (008da3f6-8725-42b3-8bbf-7c28f9aa6d50) [No such file or directory] >[2016-04-19 07:24:48.001150] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 008da3f6-8725-42b3-8bbf-7c28f9aa6d50. (Possible split-brain) >[2016-04-19 07:24:48.001953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50> (008da3f6-8725-42b3-8bbf-7c28f9aa6d50) [No such file or directory] >[2016-04-19 07:24:48.002309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50> (008da3f6-8725-42b3-8bbf-7c28f9aa6d50) [No such file or directory] >[2016-04-19 07:24:48.003580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50> (008da3f6-8725-42b3-8bbf-7c28f9aa6d50) [No such file or directory] >[2016-04-19 07:24:48.004065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50> (008da3f6-8725-42b3-8bbf-7c28f9aa6d50) [No such file or directory] >[2016-04-19 07:24:48.004252] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.006779] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 008da3f6-8725-42b3-8bbf-7c28f9aa6d50. (Possible split-brain) >[2016-04-19 07:24:48.007585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50> (008da3f6-8725-42b3-8bbf-7c28f9aa6d50) [No such file or directory] >[2016-04-19 07:24:48.007831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50> (008da3f6-8725-42b3-8bbf-7c28f9aa6d50) [No such file or directory] >[2016-04-19 07:24:48.010917] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50> (008da3f6-8725-42b3-8bbf-7c28f9aa6d50) [No such file or directory] >[2016-04-19 07:24:48.010925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50> (008da3f6-8725-42b3-8bbf-7c28f9aa6d50) [No such file or directory] >[2016-04-19 07:24:48.011113] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:008da3f6-8725-42b3-8bbf-7c28f9aa6d50>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.019458] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.020169] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8956b13-d419-438c-b611-7c85773825a3> (f8956b13-d419-438c-b611-7c85773825a3) [No such file or directory] >[2016-04-19 07:24:48.020457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8956b13-d419-438c-b611-7c85773825a3> (f8956b13-d419-438c-b611-7c85773825a3) [No such file or directory] >[2016-04-19 07:24:48.021653] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f8956b13-d419-438c-b611-7c85773825a3. (Possible split-brain) >[2016-04-19 07:24:48.022455] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8956b13-d419-438c-b611-7c85773825a3> (f8956b13-d419-438c-b611-7c85773825a3) [No such file or directory] >[2016-04-19 07:24:48.022581] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8956b13-d419-438c-b611-7c85773825a3> (f8956b13-d419-438c-b611-7c85773825a3) [No such file or directory] >[2016-04-19 07:24:48.023731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8956b13-d419-438c-b611-7c85773825a3> (f8956b13-d419-438c-b611-7c85773825a3) [No such file or directory] >[2016-04-19 07:24:48.024088] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8956b13-d419-438c-b611-7c85773825a3> (f8956b13-d419-438c-b611-7c85773825a3) [No such file or directory] >[2016-04-19 07:24:48.024202] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f8956b13-d419-438c-b611-7c85773825a3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.026768] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f8956b13-d419-438c-b611-7c85773825a3. (Possible split-brain) >[2016-04-19 07:24:48.027533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8956b13-d419-438c-b611-7c85773825a3> (f8956b13-d419-438c-b611-7c85773825a3) [No such file or directory] >[2016-04-19 07:24:48.027882] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8956b13-d419-438c-b611-7c85773825a3> (f8956b13-d419-438c-b611-7c85773825a3) [No such file or directory] >[2016-04-19 07:24:48.030943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8956b13-d419-438c-b611-7c85773825a3> (f8956b13-d419-438c-b611-7c85773825a3) [No such file or directory] >[2016-04-19 07:24:48.031137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8956b13-d419-438c-b611-7c85773825a3> (f8956b13-d419-438c-b611-7c85773825a3) [No such file or directory] >[2016-04-19 07:24:48.031243] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f8956b13-d419-438c-b611-7c85773825a3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.040134] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.041096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff> (08e56082-3679-4a0e-acb2-6152dc1ed3ff) [No such file or directory] >[2016-04-19 07:24:48.041174] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff> (08e56082-3679-4a0e-acb2-6152dc1ed3ff) [No such file or directory] >[2016-04-19 07:24:48.043982] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 08e56082-3679-4a0e-acb2-6152dc1ed3ff. (Possible split-brain) >[2016-04-19 07:24:48.044824] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff> (08e56082-3679-4a0e-acb2-6152dc1ed3ff) [No such file or directory] >[2016-04-19 07:24:48.044903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff> (08e56082-3679-4a0e-acb2-6152dc1ed3ff) [No such file or directory] >[2016-04-19 07:24:48.046056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff> (08e56082-3679-4a0e-acb2-6152dc1ed3ff) [No such file or directory] >[2016-04-19 07:24:48.046080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff> (08e56082-3679-4a0e-acb2-6152dc1ed3ff) [No such file or directory] >[2016-04-19 07:24:48.046372] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.049030] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 08e56082-3679-4a0e-acb2-6152dc1ed3ff. (Possible split-brain) >[2016-04-19 07:24:48.050109] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff> (08e56082-3679-4a0e-acb2-6152dc1ed3ff) [No such file or directory] >[2016-04-19 07:24:48.050179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff> (08e56082-3679-4a0e-acb2-6152dc1ed3ff) [No such file or directory] >[2016-04-19 07:24:48.053117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff> (08e56082-3679-4a0e-acb2-6152dc1ed3ff) [No such file or directory] >[2016-04-19 07:24:48.053141] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff> (08e56082-3679-4a0e-acb2-6152dc1ed3ff) [No such file or directory] >[2016-04-19 07:24:48.053411] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:08e56082-3679-4a0e-acb2-6152dc1ed3ff>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:48.062622] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.063565] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d> (3f7a17a8-100e-495a-a96d-07546c88b87d) [No such file or directory] >[2016-04-19 07:24:48.063672] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d> (3f7a17a8-100e-495a-a96d-07546c88b87d) [No such file or directory] >[2016-04-19 07:24:48.066434] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3f7a17a8-100e-495a-a96d-07546c88b87d. (Possible split-brain) >[2016-04-19 07:24:48.067501] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d> (3f7a17a8-100e-495a-a96d-07546c88b87d) [No such file or directory] >[2016-04-19 07:24:48.067520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d> (3f7a17a8-100e-495a-a96d-07546c88b87d) [No such file or directory] >[2016-04-19 07:24:48.068743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d> (3f7a17a8-100e-495a-a96d-07546c88b87d) [No such file or directory] >[2016-04-19 07:24:48.068766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d> (3f7a17a8-100e-495a-a96d-07546c88b87d) [No such file or directory] >[2016-04-19 07:24:48.069193] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.071832] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3f7a17a8-100e-495a-a96d-07546c88b87d. (Possible split-brain) >[2016-04-19 07:24:48.072904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d> (3f7a17a8-100e-495a-a96d-07546c88b87d) [No such file or directory] >[2016-04-19 07:24:48.072967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d> (3f7a17a8-100e-495a-a96d-07546c88b87d) [No such file or directory] >[2016-04-19 07:24:48.075867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d> (3f7a17a8-100e-495a-a96d-07546c88b87d) [No such file or directory] >[2016-04-19 07:24:48.075895] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d> (3f7a17a8-100e-495a-a96d-07546c88b87d) [No such file or directory] >[2016-04-19 07:24:48.076151] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3f7a17a8-100e-495a-a96d-07546c88b87d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:48.084623] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.085365] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14> (183a2a5b-b9e5-44f6-af23-117b571bdd14) [No such file or directory] >[2016-04-19 07:24:48.085739] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14> (183a2a5b-b9e5-44f6-af23-117b571bdd14) [No such file or directory] >[2016-04-19 07:24:48.086843] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 183a2a5b-b9e5-44f6-af23-117b571bdd14. (Possible split-brain) >[2016-04-19 07:24:48.087642] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14> (183a2a5b-b9e5-44f6-af23-117b571bdd14) [No such file or directory] >[2016-04-19 07:24:48.087884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14> (183a2a5b-b9e5-44f6-af23-117b571bdd14) [No such file or directory] >[2016-04-19 07:24:48.089062] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14> (183a2a5b-b9e5-44f6-af23-117b571bdd14) [No such file or directory] >[2016-04-19 07:24:48.089450] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14> (183a2a5b-b9e5-44f6-af23-117b571bdd14) [No such file or directory] >[2016-04-19 07:24:48.089639] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.092193] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 183a2a5b-b9e5-44f6-af23-117b571bdd14. (Possible split-brain) >[2016-04-19 07:24:48.092925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14> (183a2a5b-b9e5-44f6-af23-117b571bdd14) [No such file or directory] >[2016-04-19 07:24:48.093299] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14> (183a2a5b-b9e5-44f6-af23-117b571bdd14) [No such file or directory] >[2016-04-19 07:24:48.096291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14> (183a2a5b-b9e5-44f6-af23-117b571bdd14) [No such file or directory] >[2016-04-19 07:24:48.096771] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14> (183a2a5b-b9e5-44f6-af23-117b571bdd14) [No such file or directory] >[2016-04-19 07:24:48.096937] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:183a2a5b-b9e5-44f6-af23-117b571bdd14>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.105548] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.106208] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2> (4ff3ac58-5a32-42f7-b790-6d09f34d68a2) [No such file or directory] >[2016-04-19 07:24:48.106600] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2> (4ff3ac58-5a32-42f7-b790-6d09f34d68a2) [No such file or directory] >[2016-04-19 07:24:48.107701] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4ff3ac58-5a32-42f7-b790-6d09f34d68a2. (Possible split-brain) >[2016-04-19 07:24:48.108433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2> (4ff3ac58-5a32-42f7-b790-6d09f34d68a2) [No such file or directory] >[2016-04-19 07:24:48.108774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2> (4ff3ac58-5a32-42f7-b790-6d09f34d68a2) [No such file or directory] >[2016-04-19 07:24:48.109876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2> (4ff3ac58-5a32-42f7-b790-6d09f34d68a2) [No such file or directory] >[2016-04-19 07:24:48.110421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2> (4ff3ac58-5a32-42f7-b790-6d09f34d68a2) [No such file or directory] >[2016-04-19 07:24:48.110617] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.113349] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4ff3ac58-5a32-42f7-b790-6d09f34d68a2. (Possible split-brain) >[2016-04-19 07:24:48.114063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2> (4ff3ac58-5a32-42f7-b790-6d09f34d68a2) [No such file or directory] >[2016-04-19 07:24:48.114633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2> (4ff3ac58-5a32-42f7-b790-6d09f34d68a2) [No such file or directory] >[2016-04-19 07:24:48.117355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2> (4ff3ac58-5a32-42f7-b790-6d09f34d68a2) [No such file or directory] >[2016-04-19 07:24:48.117754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2> (4ff3ac58-5a32-42f7-b790-6d09f34d68a2) [No such file or directory] >[2016-04-19 07:24:48.117905] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4ff3ac58-5a32-42f7-b790-6d09f34d68a2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.127202] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.128158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2e806848-94bd-4938-9427-c0589d6555f1> (2e806848-94bd-4938-9427-c0589d6555f1) [No such file or directory] >[2016-04-19 07:24:48.128238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2e806848-94bd-4938-9427-c0589d6555f1> (2e806848-94bd-4938-9427-c0589d6555f1) [No such file or directory] >[2016-04-19 07:24:48.131090] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2e806848-94bd-4938-9427-c0589d6555f1. (Possible split-brain) >[2016-04-19 07:24:48.131951] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2e806848-94bd-4938-9427-c0589d6555f1> (2e806848-94bd-4938-9427-c0589d6555f1) [No such file or directory] >[2016-04-19 07:24:48.132023] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2e806848-94bd-4938-9427-c0589d6555f1> (2e806848-94bd-4938-9427-c0589d6555f1) [No such file or directory] >[2016-04-19 07:24:48.133212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2e806848-94bd-4938-9427-c0589d6555f1> (2e806848-94bd-4938-9427-c0589d6555f1) [No such file or directory] >[2016-04-19 07:24:48.133236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2e806848-94bd-4938-9427-c0589d6555f1> (2e806848-94bd-4938-9427-c0589d6555f1) [No such file or directory] >[2016-04-19 07:24:48.133627] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2e806848-94bd-4938-9427-c0589d6555f1>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.136126] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2e806848-94bd-4938-9427-c0589d6555f1. (Possible split-brain) >[2016-04-19 07:24:48.137297] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2e806848-94bd-4938-9427-c0589d6555f1> (2e806848-94bd-4938-9427-c0589d6555f1) [No such file or directory] >[2016-04-19 07:24:48.137309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2e806848-94bd-4938-9427-c0589d6555f1> (2e806848-94bd-4938-9427-c0589d6555f1) [No such file or directory] >[2016-04-19 07:24:48.140448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2e806848-94bd-4938-9427-c0589d6555f1> (2e806848-94bd-4938-9427-c0589d6555f1) [No such file or directory] >[2016-04-19 07:24:48.140514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2e806848-94bd-4938-9427-c0589d6555f1> (2e806848-94bd-4938-9427-c0589d6555f1) [No such file or directory] >[2016-04-19 07:24:48.140697] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2e806848-94bd-4938-9427-c0589d6555f1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.148264] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.149158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f> (2d960957-51c7-4411-bd58-8a854df9f58f) [No such file or directory] >[2016-04-19 07:24:48.149171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f> (2d960957-51c7-4411-bd58-8a854df9f58f) [No such file or directory] >[2016-04-19 07:24:48.152013] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2d960957-51c7-4411-bd58-8a854df9f58f. (Possible split-brain) >[2016-04-19 07:24:48.152794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f> (2d960957-51c7-4411-bd58-8a854df9f58f) [No such file or directory] >[2016-04-19 07:24:48.153107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f> (2d960957-51c7-4411-bd58-8a854df9f58f) [No such file or directory] >[2016-04-19 07:24:48.154369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f> (2d960957-51c7-4411-bd58-8a854df9f58f) [No such file or directory] >[2016-04-19 07:24:48.154529] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f> (2d960957-51c7-4411-bd58-8a854df9f58f) [No such file or directory] >[2016-04-19 07:24:48.154660] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.157348] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2d960957-51c7-4411-bd58-8a854df9f58f. (Possible split-brain) >[2016-04-19 07:24:48.158079] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f> (2d960957-51c7-4411-bd58-8a854df9f58f) [No such file or directory] >[2016-04-19 07:24:48.158418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f> (2d960957-51c7-4411-bd58-8a854df9f58f) [No such file or directory] >[2016-04-19 07:24:48.161544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f> (2d960957-51c7-4411-bd58-8a854df9f58f) [No such file or directory] >[2016-04-19 07:24:48.161758] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f> (2d960957-51c7-4411-bd58-8a854df9f58f) [No such file or directory] >[2016-04-19 07:24:48.161881] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2d960957-51c7-4411-bd58-8a854df9f58f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.171383] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.172583] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632> (f08e5ee0-4948-4653-b2ca-ff771ddf5632) [No such file or directory] >[2016-04-19 07:24:48.172680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632> (f08e5ee0-4948-4653-b2ca-ff771ddf5632) [No such file or directory] >[2016-04-19 07:24:48.173572] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f08e5ee0-4948-4653-b2ca-ff771ddf5632. (Possible split-brain) >[2016-04-19 07:24:48.174481] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632> (f08e5ee0-4948-4653-b2ca-ff771ddf5632) [No such file or directory] >[2016-04-19 07:24:48.174564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632> (f08e5ee0-4948-4653-b2ca-ff771ddf5632) [No such file or directory] >[2016-04-19 07:24:48.175712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632> (f08e5ee0-4948-4653-b2ca-ff771ddf5632) [No such file or directory] >[2016-04-19 07:24:48.175800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632> (f08e5ee0-4948-4653-b2ca-ff771ddf5632) [No such file or directory] >[2016-04-19 07:24:48.176019] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.178600] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f08e5ee0-4948-4653-b2ca-ff771ddf5632. (Possible split-brain) >[2016-04-19 07:24:48.179420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632> (f08e5ee0-4948-4653-b2ca-ff771ddf5632) [No such file or directory] >[2016-04-19 07:24:48.179517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632> (f08e5ee0-4948-4653-b2ca-ff771ddf5632) [No such file or directory] >[2016-04-19 07:24:48.182741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632> (f08e5ee0-4948-4653-b2ca-ff771ddf5632) [No such file or directory] >[2016-04-19 07:24:48.182770] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632> (f08e5ee0-4948-4653-b2ca-ff771ddf5632) [No such file or directory] >[2016-04-19 07:24:48.182947] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f08e5ee0-4948-4653-b2ca-ff771ddf5632>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.190483] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.191208] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5> (ea1b2ac0-6019-4635-b7ab-8087452db1f5) [No such file or directory] >[2016-04-19 07:24:48.191539] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5> (ea1b2ac0-6019-4635-b7ab-8087452db1f5) [No such file or directory] >[2016-04-19 07:24:48.194400] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ea1b2ac0-6019-4635-b7ab-8087452db1f5. (Possible split-brain) >[2016-04-19 07:24:48.195198] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5> (ea1b2ac0-6019-4635-b7ab-8087452db1f5) [No such file or directory] >[2016-04-19 07:24:48.195299] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5> (ea1b2ac0-6019-4635-b7ab-8087452db1f5) [No such file or directory] >[2016-04-19 07:24:48.196640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5> (ea1b2ac0-6019-4635-b7ab-8087452db1f5) [No such file or directory] >[2016-04-19 07:24:48.197111] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5> (ea1b2ac0-6019-4635-b7ab-8087452db1f5) [No such file or directory] >[2016-04-19 07:24:48.197267] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.199834] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ea1b2ac0-6019-4635-b7ab-8087452db1f5. (Possible split-brain) >[2016-04-19 07:24:48.200714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5> (ea1b2ac0-6019-4635-b7ab-8087452db1f5) [No such file or directory] >[2016-04-19 07:24:48.200847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5> (ea1b2ac0-6019-4635-b7ab-8087452db1f5) [No such file or directory] >[2016-04-19 07:24:48.203203] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5> (ea1b2ac0-6019-4635-b7ab-8087452db1f5) [No such file or directory] >[2016-04-19 07:24:48.203256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5> (ea1b2ac0-6019-4635-b7ab-8087452db1f5) [No such file or directory] >[2016-04-19 07:24:48.203491] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ea1b2ac0-6019-4635-b7ab-8087452db1f5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.212168] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.213181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588> (14c4df70-50b0-466d-9ec2-e9e559102588) [No such file or directory] >[2016-04-19 07:24:48.213185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588> (14c4df70-50b0-466d-9ec2-e9e559102588) [No such file or directory] >[2016-04-19 07:24:48.214373] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 14c4df70-50b0-466d-9ec2-e9e559102588. (Possible split-brain) >[2016-04-19 07:24:48.215147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588> (14c4df70-50b0-466d-9ec2-e9e559102588) [No such file or directory] >[2016-04-19 07:24:48.215440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588> (14c4df70-50b0-466d-9ec2-e9e559102588) [No such file or directory] >[2016-04-19 07:24:48.216956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588> (14c4df70-50b0-466d-9ec2-e9e559102588) [No such file or directory] >[2016-04-19 07:24:48.217184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588> (14c4df70-50b0-466d-9ec2-e9e559102588) [No such file or directory] >[2016-04-19 07:24:48.217369] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.219942] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 14c4df70-50b0-466d-9ec2-e9e559102588. (Possible split-brain) >[2016-04-19 07:24:48.221054] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588> (14c4df70-50b0-466d-9ec2-e9e559102588) [No such file or directory] >[2016-04-19 07:24:48.221092] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588> (14c4df70-50b0-466d-9ec2-e9e559102588) [No such file or directory] >[2016-04-19 07:24:48.224213] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588> (14c4df70-50b0-466d-9ec2-e9e559102588) [No such file or directory] >[2016-04-19 07:24:48.224693] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588> (14c4df70-50b0-466d-9ec2-e9e559102588) [No such file or directory] >[2016-04-19 07:24:48.224836] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:14c4df70-50b0-466d-9ec2-e9e559102588>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.233478] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.234384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555> (d33666f3-bce1-47bb-8ae9-ecbd3e912555) [No such file or directory] >[2016-04-19 07:24:48.234641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555> (d33666f3-bce1-47bb-8ae9-ecbd3e912555) [No such file or directory] >[2016-04-19 07:24:48.237575] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d33666f3-bce1-47bb-8ae9-ecbd3e912555. (Possible split-brain) >[2016-04-19 07:24:48.238596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555> (d33666f3-bce1-47bb-8ae9-ecbd3e912555) [No such file or directory] >[2016-04-19 07:24:48.238617] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555> (d33666f3-bce1-47bb-8ae9-ecbd3e912555) [No such file or directory] >[2016-04-19 07:24:48.240242] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555> (d33666f3-bce1-47bb-8ae9-ecbd3e912555) [No such file or directory] >[2016-04-19 07:24:48.240629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555> (d33666f3-bce1-47bb-8ae9-ecbd3e912555) [No such file or directory] >[2016-04-19 07:24:48.240802] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.243530] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d33666f3-bce1-47bb-8ae9-ecbd3e912555. (Possible split-brain) >[2016-04-19 07:24:48.244474] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555> (d33666f3-bce1-47bb-8ae9-ecbd3e912555) [No such file or directory] >[2016-04-19 07:24:48.244506] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555> (d33666f3-bce1-47bb-8ae9-ecbd3e912555) [No such file or directory] >[2016-04-19 07:24:48.247645] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555> (d33666f3-bce1-47bb-8ae9-ecbd3e912555) [No such file or directory] >[2016-04-19 07:24:48.247811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555> (d33666f3-bce1-47bb-8ae9-ecbd3e912555) [No such file or directory] >[2016-04-19 07:24:48.248028] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d33666f3-bce1-47bb-8ae9-ecbd3e912555>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.257398] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.258420] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7> (541f151d-d5fb-47c1-a18a-98b21c79b6b7) [No such file or directory] >[2016-04-19 07:24:48.258531] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7> (541f151d-d5fb-47c1-a18a-98b21c79b6b7) [No such file or directory] >[2016-04-19 07:24:48.259644] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 541f151d-d5fb-47c1-a18a-98b21c79b6b7. (Possible split-brain) >[2016-04-19 07:24:48.260763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7> (541f151d-d5fb-47c1-a18a-98b21c79b6b7) [No such file or directory] >[2016-04-19 07:24:48.260773] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7> (541f151d-d5fb-47c1-a18a-98b21c79b6b7) [No such file or directory] >[2016-04-19 07:24:48.261705] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7> (541f151d-d5fb-47c1-a18a-98b21c79b6b7) [No such file or directory] >[2016-04-19 07:24:48.261800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7> (541f151d-d5fb-47c1-a18a-98b21c79b6b7) [No such file or directory] >[2016-04-19 07:24:48.261952] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.264740] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 541f151d-d5fb-47c1-a18a-98b21c79b6b7. (Possible split-brain) >[2016-04-19 07:24:48.265842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7> (541f151d-d5fb-47c1-a18a-98b21c79b6b7) [No such file or directory] >[2016-04-19 07:24:48.265845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7> (541f151d-d5fb-47c1-a18a-98b21c79b6b7) [No such file or directory] >[2016-04-19 07:24:48.268622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7> (541f151d-d5fb-47c1-a18a-98b21c79b6b7) [No such file or directory] >[2016-04-19 07:24:48.268760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7> (541f151d-d5fb-47c1-a18a-98b21c79b6b7) [No such file or directory] >[2016-04-19 07:24:48.268925] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:541f151d-d5fb-47c1-a18a-98b21c79b6b7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.276813] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.277645] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd> (d5479439-d7e4-4a65-86f8-4a2993e4e8bd) [No such file or directory] >[2016-04-19 07:24:48.277921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd> (d5479439-d7e4-4a65-86f8-4a2993e4e8bd) [No such file or directory] >[2016-04-19 07:24:48.280728] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d5479439-d7e4-4a65-86f8-4a2993e4e8bd. (Possible split-brain) >[2016-04-19 07:24:48.281593] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd> (d5479439-d7e4-4a65-86f8-4a2993e4e8bd) [No such file or directory] >[2016-04-19 07:24:48.281894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd> (d5479439-d7e4-4a65-86f8-4a2993e4e8bd) [No such file or directory] >[2016-04-19 07:24:48.283012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd> (d5479439-d7e4-4a65-86f8-4a2993e4e8bd) [No such file or directory] >[2016-04-19 07:24:48.283405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd> (d5479439-d7e4-4a65-86f8-4a2993e4e8bd) [No such file or directory] >[2016-04-19 07:24:48.283579] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.286127] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d5479439-d7e4-4a65-86f8-4a2993e4e8bd. (Possible split-brain) >[2016-04-19 07:24:48.287424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd> (d5479439-d7e4-4a65-86f8-4a2993e4e8bd) [No such file or directory] >[2016-04-19 07:24:48.287509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd> (d5479439-d7e4-4a65-86f8-4a2993e4e8bd) [No such file or directory] >[2016-04-19 07:24:48.290610] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd> (d5479439-d7e4-4a65-86f8-4a2993e4e8bd) [No such file or directory] >[2016-04-19 07:24:48.290918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd> (d5479439-d7e4-4a65-86f8-4a2993e4e8bd) [No such file or directory] >[2016-04-19 07:24:48.291054] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d5479439-d7e4-4a65-86f8-4a2993e4e8bd>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:48.299448] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.300156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:17553d70-9469-4a56-b7e6-484d88311265> (17553d70-9469-4a56-b7e6-484d88311265) [No such file or directory] >[2016-04-19 07:24:48.300513] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:17553d70-9469-4a56-b7e6-484d88311265> (17553d70-9469-4a56-b7e6-484d88311265) [No such file or directory] >[2016-04-19 07:24:48.301660] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 17553d70-9469-4a56-b7e6-484d88311265. (Possible split-brain) >[2016-04-19 07:24:48.302721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:17553d70-9469-4a56-b7e6-484d88311265> (17553d70-9469-4a56-b7e6-484d88311265) [No such file or directory] >[2016-04-19 07:24:48.302813] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:17553d70-9469-4a56-b7e6-484d88311265> (17553d70-9469-4a56-b7e6-484d88311265) [No such file or directory] >[2016-04-19 07:24:48.303963] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:17553d70-9469-4a56-b7e6-484d88311265> (17553d70-9469-4a56-b7e6-484d88311265) [No such file or directory] >[2016-04-19 07:24:48.304447] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:17553d70-9469-4a56-b7e6-484d88311265> (17553d70-9469-4a56-b7e6-484d88311265) [No such file or directory] >[2016-04-19 07:24:48.304613] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:17553d70-9469-4a56-b7e6-484d88311265>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.307157] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 17553d70-9469-4a56-b7e6-484d88311265. (Possible split-brain) >[2016-04-19 07:24:48.308158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:17553d70-9469-4a56-b7e6-484d88311265> (17553d70-9469-4a56-b7e6-484d88311265) [No such file or directory] >[2016-04-19 07:24:48.308176] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:17553d70-9469-4a56-b7e6-484d88311265> (17553d70-9469-4a56-b7e6-484d88311265) [No such file or directory] >[2016-04-19 07:24:48.311256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:17553d70-9469-4a56-b7e6-484d88311265> (17553d70-9469-4a56-b7e6-484d88311265) [No such file or directory] >[2016-04-19 07:24:48.311587] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:17553d70-9469-4a56-b7e6-484d88311265> (17553d70-9469-4a56-b7e6-484d88311265) [No such file or directory] >[2016-04-19 07:24:48.311753] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:17553d70-9469-4a56-b7e6-484d88311265>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.319998] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.320787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3> (ee0d3aa0-f385-43de-bd1a-c82caf918dd3) [No such file or directory] >[2016-04-19 07:24:48.321015] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3> (ee0d3aa0-f385-43de-bd1a-c82caf918dd3) [No such file or directory] >[2016-04-19 07:24:48.322115] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ee0d3aa0-f385-43de-bd1a-c82caf918dd3. (Possible split-brain) >[2016-04-19 07:24:48.322805] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3> (ee0d3aa0-f385-43de-bd1a-c82caf918dd3) [No such file or directory] >[2016-04-19 07:24:48.323104] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3> (ee0d3aa0-f385-43de-bd1a-c82caf918dd3) [No such file or directory] >[2016-04-19 07:24:48.324454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3> (ee0d3aa0-f385-43de-bd1a-c82caf918dd3) [No such file or directory] >[2016-04-19 07:24:48.324580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3> (ee0d3aa0-f385-43de-bd1a-c82caf918dd3) [No such file or directory] >[2016-04-19 07:24:48.324702] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.327395] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ee0d3aa0-f385-43de-bd1a-c82caf918dd3. (Possible split-brain) >[2016-04-19 07:24:48.328086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3> (ee0d3aa0-f385-43de-bd1a-c82caf918dd3) [No such file or directory] >[2016-04-19 07:24:48.328195] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3> (ee0d3aa0-f385-43de-bd1a-c82caf918dd3) [No such file or directory] >[2016-04-19 07:24:48.330716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3> (ee0d3aa0-f385-43de-bd1a-c82caf918dd3) [No such file or directory] >[2016-04-19 07:24:48.330808] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3> (ee0d3aa0-f385-43de-bd1a-c82caf918dd3) [No such file or directory] >[2016-04-19 07:24:48.330995] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ee0d3aa0-f385-43de-bd1a-c82caf918dd3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.340688] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.341563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022> (739d38b9-366a-4c95-b39c-acf9d6750022) [No such file or directory] >[2016-04-19 07:24:48.341901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022> (739d38b9-366a-4c95-b39c-acf9d6750022) [No such file or directory] >[2016-04-19 07:24:48.344768] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 739d38b9-366a-4c95-b39c-acf9d6750022. (Possible split-brain) >[2016-04-19 07:24:48.345838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022> (739d38b9-366a-4c95-b39c-acf9d6750022) [No such file or directory] >[2016-04-19 07:24:48.345928] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022> (739d38b9-366a-4c95-b39c-acf9d6750022) [No such file or directory] >[2016-04-19 07:24:48.347213] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022> (739d38b9-366a-4c95-b39c-acf9d6750022) [No such file or directory] >[2016-04-19 07:24:48.347179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022> (739d38b9-366a-4c95-b39c-acf9d6750022) [No such file or directory] >[2016-04-19 07:24:48.347509] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.350281] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 739d38b9-366a-4c95-b39c-acf9d6750022. (Possible split-brain) >[2016-04-19 07:24:48.351451] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022> (739d38b9-366a-4c95-b39c-acf9d6750022) [No such file or directory] >[2016-04-19 07:24:48.351592] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022> (739d38b9-366a-4c95-b39c-acf9d6750022) [No such file or directory] >[2016-04-19 07:24:48.354193] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022> (739d38b9-366a-4c95-b39c-acf9d6750022) [No such file or directory] >[2016-04-19 07:24:48.354294] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022> (739d38b9-366a-4c95-b39c-acf9d6750022) [No such file or directory] >[2016-04-19 07:24:48.354451] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:739d38b9-366a-4c95-b39c-acf9d6750022>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.362765] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.363429] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e> (2e53a117-62bb-4c99-88db-a03ee7d1b07e) [No such file or directory] >[2016-04-19 07:24:48.363768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e> (2e53a117-62bb-4c99-88db-a03ee7d1b07e) [No such file or directory] >[2016-04-19 07:24:48.367299] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e53a117-62bb-4c99-88db-a03ee7d1b07e. (Possible split-brain) >[2016-04-19 07:24:48.368464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e> (2e53a117-62bb-4c99-88db-a03ee7d1b07e) [No such file or directory] >[2016-04-19 07:24:48.368582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e> (2e53a117-62bb-4c99-88db-a03ee7d1b07e) [No such file or directory] >[2016-04-19 07:24:48.369736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e> (2e53a117-62bb-4c99-88db-a03ee7d1b07e) [No such file or directory] >[2016-04-19 07:24:48.369897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e> (2e53a117-62bb-4c99-88db-a03ee7d1b07e) [No such file or directory] >[2016-04-19 07:24:48.370025] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.372737] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e53a117-62bb-4c99-88db-a03ee7d1b07e. (Possible split-brain) >[2016-04-19 07:24:48.373689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e> (2e53a117-62bb-4c99-88db-a03ee7d1b07e) [No such file or directory] >[2016-04-19 07:24:48.373719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e> (2e53a117-62bb-4c99-88db-a03ee7d1b07e) [No such file or directory] >[2016-04-19 07:24:48.376285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e> (2e53a117-62bb-4c99-88db-a03ee7d1b07e) [No such file or directory] >[2016-04-19 07:24:48.376598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e> (2e53a117-62bb-4c99-88db-a03ee7d1b07e) [No such file or directory] >[2016-04-19 07:24:48.376724] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2e53a117-62bb-4c99-88db-a03ee7d1b07e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.386551] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.387638] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27> (c71ad0d8-5c3b-434e-b325-db4120957a27) [No such file or directory] >[2016-04-19 07:24:48.387641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27> (c71ad0d8-5c3b-434e-b325-db4120957a27) [No such file or directory] >[2016-04-19 07:24:48.388820] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c71ad0d8-5c3b-434e-b325-db4120957a27. (Possible split-brain) >[2016-04-19 07:24:48.389894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27> (c71ad0d8-5c3b-434e-b325-db4120957a27) [No such file or directory] >[2016-04-19 07:24:48.389925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27> (c71ad0d8-5c3b-434e-b325-db4120957a27) [No such file or directory] >[2016-04-19 07:24:48.390986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27> (c71ad0d8-5c3b-434e-b325-db4120957a27) [No such file or directory] >[2016-04-19 07:24:48.391006] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27> (c71ad0d8-5c3b-434e-b325-db4120957a27) [No such file or directory] >[2016-04-19 07:24:48.391355] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.394136] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c71ad0d8-5c3b-434e-b325-db4120957a27. (Possible split-brain) >[2016-04-19 07:24:48.395247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27> (c71ad0d8-5c3b-434e-b325-db4120957a27) [No such file or directory] >[2016-04-19 07:24:48.395276] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27> (c71ad0d8-5c3b-434e-b325-db4120957a27) [No such file or directory] >[2016-04-19 07:24:48.398009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27> (c71ad0d8-5c3b-434e-b325-db4120957a27) [No such file or directory] >[2016-04-19 07:24:48.398035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27> (c71ad0d8-5c3b-434e-b325-db4120957a27) [No such file or directory] >[2016-04-19 07:24:48.398263] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c71ad0d8-5c3b-434e-b325-db4120957a27>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:48.406434] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.407312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1> (7ec6fc32-cd54-40d3-82fa-e8189b470ab1) [No such file or directory] >[2016-04-19 07:24:48.407434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1> (7ec6fc32-cd54-40d3-82fa-e8189b470ab1) [No such file or directory] >[2016-04-19 07:24:48.408617] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7ec6fc32-cd54-40d3-82fa-e8189b470ab1. (Possible split-brain) >[2016-04-19 07:24:48.409550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1> (7ec6fc32-cd54-40d3-82fa-e8189b470ab1) [No such file or directory] >[2016-04-19 07:24:48.409848] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1> (7ec6fc32-cd54-40d3-82fa-e8189b470ab1) [No such file or directory] >[2016-04-19 07:24:48.411043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1> (7ec6fc32-cd54-40d3-82fa-e8189b470ab1) [No such file or directory] >[2016-04-19 07:24:48.411373] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1> (7ec6fc32-cd54-40d3-82fa-e8189b470ab1) [No such file or directory] >[2016-04-19 07:24:48.411539] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.414151] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7ec6fc32-cd54-40d3-82fa-e8189b470ab1. (Possible split-brain) >[2016-04-19 07:24:48.414918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1> (7ec6fc32-cd54-40d3-82fa-e8189b470ab1) [No such file or directory] >[2016-04-19 07:24:48.415218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1> (7ec6fc32-cd54-40d3-82fa-e8189b470ab1) [No such file or directory] >[2016-04-19 07:24:48.417612] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1> (7ec6fc32-cd54-40d3-82fa-e8189b470ab1) [No such file or directory] >[2016-04-19 07:24:48.417719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1> (7ec6fc32-cd54-40d3-82fa-e8189b470ab1) [No such file or directory] >[2016-04-19 07:24:48.417850] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7ec6fc32-cd54-40d3-82fa-e8189b470ab1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.427069] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.427821] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01> (c63f96f2-2728-48c1-a3e1-4c2900d9fe01) [No such file or directory] >[2016-04-19 07:24:48.428087] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01> (c63f96f2-2728-48c1-a3e1-4c2900d9fe01) [No such file or directory] >[2016-04-19 07:24:48.429160] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c63f96f2-2728-48c1-a3e1-4c2900d9fe01. (Possible split-brain) >[2016-04-19 07:24:48.429861] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01> (c63f96f2-2728-48c1-a3e1-4c2900d9fe01) [No such file or directory] >[2016-04-19 07:24:48.430181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01> (c63f96f2-2728-48c1-a3e1-4c2900d9fe01) [No such file or directory] >[2016-04-19 07:24:48.431552] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01> (c63f96f2-2728-48c1-a3e1-4c2900d9fe01) [No such file or directory] >[2016-04-19 07:24:48.431648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01> (c63f96f2-2728-48c1-a3e1-4c2900d9fe01) [No such file or directory] >[2016-04-19 07:24:48.431758] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.434451] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c63f96f2-2728-48c1-a3e1-4c2900d9fe01. (Possible split-brain) >[2016-04-19 07:24:48.435145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01> (c63f96f2-2728-48c1-a3e1-4c2900d9fe01) [No such file or directory] >[2016-04-19 07:24:48.435402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01> (c63f96f2-2728-48c1-a3e1-4c2900d9fe01) [No such file or directory] >[2016-04-19 07:24:48.438241] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01> (c63f96f2-2728-48c1-a3e1-4c2900d9fe01) [No such file or directory] >[2016-04-19 07:24:48.438400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01> (c63f96f2-2728-48c1-a3e1-4c2900d9fe01) [No such file or directory] >[2016-04-19 07:24:48.438547] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c63f96f2-2728-48c1-a3e1-4c2900d9fe01>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.446858] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.447589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae> (285e2f23-fe77-412f-a4c2-b634e1e29fae) [No such file or directory] >[2016-04-19 07:24:48.447839] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae> (285e2f23-fe77-412f-a4c2-b634e1e29fae) [No such file or directory] >[2016-04-19 07:24:48.448938] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 285e2f23-fe77-412f-a4c2-b634e1e29fae. (Possible split-brain) >[2016-04-19 07:24:48.449696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae> (285e2f23-fe77-412f-a4c2-b634e1e29fae) [No such file or directory] >[2016-04-19 07:24:48.449822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae> (285e2f23-fe77-412f-a4c2-b634e1e29fae) [No such file or directory] >[2016-04-19 07:24:48.451021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae> (285e2f23-fe77-412f-a4c2-b634e1e29fae) [No such file or directory] >[2016-04-19 07:24:48.451121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae> (285e2f23-fe77-412f-a4c2-b634e1e29fae) [No such file or directory] >[2016-04-19 07:24:48.451234] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.453777] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 285e2f23-fe77-412f-a4c2-b634e1e29fae. (Possible split-brain) >[2016-04-19 07:24:48.454515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae> (285e2f23-fe77-412f-a4c2-b634e1e29fae) [No such file or directory] >[2016-04-19 07:24:48.454741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae> (285e2f23-fe77-412f-a4c2-b634e1e29fae) [No such file or directory] >[2016-04-19 07:24:48.457417] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae> (285e2f23-fe77-412f-a4c2-b634e1e29fae) [No such file or directory] >[2016-04-19 07:24:48.457441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae> (285e2f23-fe77-412f-a4c2-b634e1e29fae) [No such file or directory] >[2016-04-19 07:24:48.457644] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:285e2f23-fe77-412f-a4c2-b634e1e29fae>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.466467] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.467162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057> (ee9ae6a6-df6e-4fac-9687-fa8d512a6057) [No such file or directory] >[2016-04-19 07:24:48.467515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057> (ee9ae6a6-df6e-4fac-9687-fa8d512a6057) [No such file or directory] >[2016-04-19 07:24:48.470475] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ee9ae6a6-df6e-4fac-9687-fa8d512a6057. (Possible split-brain) >[2016-04-19 07:24:48.471133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057> (ee9ae6a6-df6e-4fac-9687-fa8d512a6057) [No such file or directory] >[2016-04-19 07:24:48.471403] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057> (ee9ae6a6-df6e-4fac-9687-fa8d512a6057) [No such file or directory] >[2016-04-19 07:24:48.472894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057> (ee9ae6a6-df6e-4fac-9687-fa8d512a6057) [No such file or directory] >[2016-04-19 07:24:48.472977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057> (ee9ae6a6-df6e-4fac-9687-fa8d512a6057) [No such file or directory] >[2016-04-19 07:24:48.473084] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.475793] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ee9ae6a6-df6e-4fac-9687-fa8d512a6057. (Possible split-brain) >[2016-04-19 07:24:48.476870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057> (ee9ae6a6-df6e-4fac-9687-fa8d512a6057) [No such file or directory] >[2016-04-19 07:24:48.476957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057> (ee9ae6a6-df6e-4fac-9687-fa8d512a6057) [No such file or directory] >[2016-04-19 07:24:48.479347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057> (ee9ae6a6-df6e-4fac-9687-fa8d512a6057) [No such file or directory] >[2016-04-19 07:24:48.479641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057> (ee9ae6a6-df6e-4fac-9687-fa8d512a6057) [No such file or directory] >[2016-04-19 07:24:48.479771] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ee9ae6a6-df6e-4fac-9687-fa8d512a6057>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.488807] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.489874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d> (b1a54b2f-7abb-4a8a-a052-a6994155e58d) [No such file or directory] >[2016-04-19 07:24:48.489888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d> (b1a54b2f-7abb-4a8a-a052-a6994155e58d) [No such file or directory] >[2016-04-19 07:24:48.491055] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b1a54b2f-7abb-4a8a-a052-a6994155e58d. (Possible split-brain) >[2016-04-19 07:24:48.492265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d> (b1a54b2f-7abb-4a8a-a052-a6994155e58d) [No such file or directory] >[2016-04-19 07:24:48.492292] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d> (b1a54b2f-7abb-4a8a-a052-a6994155e58d) [No such file or directory] >[2016-04-19 07:24:48.493527] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d> (b1a54b2f-7abb-4a8a-a052-a6994155e58d) [No such file or directory] >[2016-04-19 07:24:48.493609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d> (b1a54b2f-7abb-4a8a-a052-a6994155e58d) [No such file or directory] >[2016-04-19 07:24:48.493826] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.496417] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b1a54b2f-7abb-4a8a-a052-a6994155e58d. (Possible split-brain) >[2016-04-19 07:24:48.497261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d> (b1a54b2f-7abb-4a8a-a052-a6994155e58d) [No such file or directory] >[2016-04-19 07:24:48.497711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d> (b1a54b2f-7abb-4a8a-a052-a6994155e58d) [No such file or directory] >[2016-04-19 07:24:48.500171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d> (b1a54b2f-7abb-4a8a-a052-a6994155e58d) [No such file or directory] >[2016-04-19 07:24:48.500265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d> (b1a54b2f-7abb-4a8a-a052-a6994155e58d) [No such file or directory] >[2016-04-19 07:24:48.500692] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b1a54b2f-7abb-4a8a-a052-a6994155e58d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:48.510297] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.511402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92720c11-023f-4f14-a788-f020b352990f> (92720c11-023f-4f14-a788-f020b352990f) [No such file or directory] >[2016-04-19 07:24:48.511407] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92720c11-023f-4f14-a788-f020b352990f> (92720c11-023f-4f14-a788-f020b352990f) [No such file or directory] >[2016-04-19 07:24:48.512635] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 92720c11-023f-4f14-a788-f020b352990f. (Possible split-brain) >[2016-04-19 07:24:48.513638] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92720c11-023f-4f14-a788-f020b352990f> (92720c11-023f-4f14-a788-f020b352990f) [No such file or directory] >[2016-04-19 07:24:48.513747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92720c11-023f-4f14-a788-f020b352990f> (92720c11-023f-4f14-a788-f020b352990f) [No such file or directory] >[2016-04-19 07:24:48.515073] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92720c11-023f-4f14-a788-f020b352990f> (92720c11-023f-4f14-a788-f020b352990f) [No such file or directory] >[2016-04-19 07:24:48.515089] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92720c11-023f-4f14-a788-f020b352990f> (92720c11-023f-4f14-a788-f020b352990f) [No such file or directory] >[2016-04-19 07:24:48.515441] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:92720c11-023f-4f14-a788-f020b352990f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.517987] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 92720c11-023f-4f14-a788-f020b352990f. (Possible split-brain) >[2016-04-19 07:24:48.519179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92720c11-023f-4f14-a788-f020b352990f> (92720c11-023f-4f14-a788-f020b352990f) [No such file or directory] >[2016-04-19 07:24:48.519184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92720c11-023f-4f14-a788-f020b352990f> (92720c11-023f-4f14-a788-f020b352990f) [No such file or directory] >[2016-04-19 07:24:48.521828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:92720c11-023f-4f14-a788-f020b352990f> (92720c11-023f-4f14-a788-f020b352990f) [No such file or directory] >[2016-04-19 07:24:48.521850] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:92720c11-023f-4f14-a788-f020b352990f> (92720c11-023f-4f14-a788-f020b352990f) [No such file or directory] >[2016-04-19 07:24:48.522004] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:92720c11-023f-4f14-a788-f020b352990f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.531032] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.532063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267> (ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267) [No such file or directory] >[2016-04-19 07:24:48.532085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267> (ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267) [No such file or directory] >[2016-04-19 07:24:48.533271] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267. (Possible split-brain) >[2016-04-19 07:24:48.534296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267> (ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267) [No such file or directory] >[2016-04-19 07:24:48.534344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267> (ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267) [No such file or directory] >[2016-04-19 07:24:48.535373] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267> (ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267) [No such file or directory] >[2016-04-19 07:24:48.535540] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267> (ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267) [No such file or directory] >[2016-04-19 07:24:48.535815] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.538268] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267. (Possible split-brain) >[2016-04-19 07:24:48.539405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267> (ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267) [No such file or directory] >[2016-04-19 07:24:48.539531] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267> (ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267) [No such file or directory] >[2016-04-19 07:24:48.542063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267> (ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267) [No such file or directory] >[2016-04-19 07:24:48.542092] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267> (ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267) [No such file or directory] >[2016-04-19 07:24:48.542634] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ae3f4755-c7ba-4b0a-a8ed-0a6ea86a6267>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:48.551859] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.552714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0> (d39c8584-5938-41ae-89bc-13afa2b573a0) [No such file or directory] >[2016-04-19 07:24:48.552991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0> (d39c8584-5938-41ae-89bc-13afa2b573a0) [No such file or directory] >[2016-04-19 07:24:48.554149] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d39c8584-5938-41ae-89bc-13afa2b573a0. (Possible split-brain) >[2016-04-19 07:24:48.555148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0> (d39c8584-5938-41ae-89bc-13afa2b573a0) [No such file or directory] >[2016-04-19 07:24:48.555457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0> (d39c8584-5938-41ae-89bc-13afa2b573a0) [No such file or directory] >[2016-04-19 07:24:48.556726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0> (d39c8584-5938-41ae-89bc-13afa2b573a0) [No such file or directory] >[2016-04-19 07:24:48.557019] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0> (d39c8584-5938-41ae-89bc-13afa2b573a0) [No such file or directory] >[2016-04-19 07:24:48.557192] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.559938] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d39c8584-5938-41ae-89bc-13afa2b573a0. (Possible split-brain) >[2016-04-19 07:24:48.560858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0> (d39c8584-5938-41ae-89bc-13afa2b573a0) [No such file or directory] >[2016-04-19 07:24:48.560880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0> (d39c8584-5938-41ae-89bc-13afa2b573a0) [No such file or directory] >[2016-04-19 07:24:48.564035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0> (d39c8584-5938-41ae-89bc-13afa2b573a0) [No such file or directory] >[2016-04-19 07:24:48.564122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0> (d39c8584-5938-41ae-89bc-13afa2b573a0) [No such file or directory] >[2016-04-19 07:24:48.564240] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d39c8584-5938-41ae-89bc-13afa2b573a0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.573271] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.574253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb> (30faff0d-a00b-497d-808c-c6990f1f33fb) [No such file or directory] >[2016-04-19 07:24:48.574653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb> (30faff0d-a00b-497d-808c-c6990f1f33fb) [No such file or directory] >[2016-04-19 07:24:48.577473] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 30faff0d-a00b-497d-808c-c6990f1f33fb. (Possible split-brain) >[2016-04-19 07:24:48.578363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb> (30faff0d-a00b-497d-808c-c6990f1f33fb) [No such file or directory] >[2016-04-19 07:24:48.578652] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb> (30faff0d-a00b-497d-808c-c6990f1f33fb) [No such file or directory] >[2016-04-19 07:24:48.579840] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb> (30faff0d-a00b-497d-808c-c6990f1f33fb) [No such file or directory] >[2016-04-19 07:24:48.579877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb> (30faff0d-a00b-497d-808c-c6990f1f33fb) [No such file or directory] >[2016-04-19 07:24:48.580021] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.582575] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 30faff0d-a00b-497d-808c-c6990f1f33fb. (Possible split-brain) >[2016-04-19 07:24:48.583597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb> (30faff0d-a00b-497d-808c-c6990f1f33fb) [No such file or directory] >[2016-04-19 07:24:48.583845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb> (30faff0d-a00b-497d-808c-c6990f1f33fb) [No such file or directory] >[2016-04-19 07:24:48.586952] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb> (30faff0d-a00b-497d-808c-c6990f1f33fb) [No such file or directory] >[2016-04-19 07:24:48.587032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb> (30faff0d-a00b-497d-808c-c6990f1f33fb) [No such file or directory] >[2016-04-19 07:24:48.587181] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:30faff0d-a00b-497d-808c-c6990f1f33fb>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:48.597785] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.598901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87> (c185975f-ffed-45a9-b66e-b3b19a88eb87) [No such file or directory] >[2016-04-19 07:24:48.598914] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87> (c185975f-ffed-45a9-b66e-b3b19a88eb87) [No such file or directory] >[2016-04-19 07:24:48.600064] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c185975f-ffed-45a9-b66e-b3b19a88eb87. (Possible split-brain) >[2016-04-19 07:24:48.600968] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87> (c185975f-ffed-45a9-b66e-b3b19a88eb87) [No such file or directory] >[2016-04-19 07:24:48.601284] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87> (c185975f-ffed-45a9-b66e-b3b19a88eb87) [No such file or directory] >[2016-04-19 07:24:48.602456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87> (c185975f-ffed-45a9-b66e-b3b19a88eb87) [No such file or directory] >[2016-04-19 07:24:48.602458] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87> (c185975f-ffed-45a9-b66e-b3b19a88eb87) [No such file or directory] >[2016-04-19 07:24:48.602642] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.605142] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c185975f-ffed-45a9-b66e-b3b19a88eb87. (Possible split-brain) >[2016-04-19 07:24:48.606282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87> (c185975f-ffed-45a9-b66e-b3b19a88eb87) [No such file or directory] >[2016-04-19 07:24:48.606308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87> (c185975f-ffed-45a9-b66e-b3b19a88eb87) [No such file or directory] >[2016-04-19 07:24:48.609031] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87> (c185975f-ffed-45a9-b66e-b3b19a88eb87) [No such file or directory] >[2016-04-19 07:24:48.609471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87> (c185975f-ffed-45a9-b66e-b3b19a88eb87) [No such file or directory] >[2016-04-19 07:24:48.609707] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c185975f-ffed-45a9-b66e-b3b19a88eb87>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:48.618365] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.619069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b97a0973-e00d-4055-b220-f731832695ea> (b97a0973-e00d-4055-b220-f731832695ea) [No such file or directory] >[2016-04-19 07:24:48.619464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b97a0973-e00d-4055-b220-f731832695ea> (b97a0973-e00d-4055-b220-f731832695ea) [No such file or directory] >[2016-04-19 07:24:48.620582] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b97a0973-e00d-4055-b220-f731832695ea. (Possible split-brain) >[2016-04-19 07:24:48.621245] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b97a0973-e00d-4055-b220-f731832695ea> (b97a0973-e00d-4055-b220-f731832695ea) [No such file or directory] >[2016-04-19 07:24:48.621587] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b97a0973-e00d-4055-b220-f731832695ea> (b97a0973-e00d-4055-b220-f731832695ea) [No such file or directory] >[2016-04-19 07:24:48.622803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b97a0973-e00d-4055-b220-f731832695ea> (b97a0973-e00d-4055-b220-f731832695ea) [No such file or directory] >[2016-04-19 07:24:48.623038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b97a0973-e00d-4055-b220-f731832695ea> (b97a0973-e00d-4055-b220-f731832695ea) [No such file or directory] >[2016-04-19 07:24:48.623155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b97a0973-e00d-4055-b220-f731832695ea>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.625932] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b97a0973-e00d-4055-b220-f731832695ea. (Possible split-brain) >[2016-04-19 07:24:48.626769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b97a0973-e00d-4055-b220-f731832695ea> (b97a0973-e00d-4055-b220-f731832695ea) [No such file or directory] >[2016-04-19 07:24:48.626853] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b97a0973-e00d-4055-b220-f731832695ea> (b97a0973-e00d-4055-b220-f731832695ea) [No such file or directory] >[2016-04-19 07:24:48.630015] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b97a0973-e00d-4055-b220-f731832695ea> (b97a0973-e00d-4055-b220-f731832695ea) [No such file or directory] >[2016-04-19 07:24:48.630096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b97a0973-e00d-4055-b220-f731832695ea> (b97a0973-e00d-4055-b220-f731832695ea) [No such file or directory] >[2016-04-19 07:24:48.630205] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b97a0973-e00d-4055-b220-f731832695ea>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.639219] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.639968] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6> (3b880c84-e547-48c0-b4f2-55641775d5b6) [No such file or directory] >[2016-04-19 07:24:48.640254] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6> (3b880c84-e547-48c0-b4f2-55641775d5b6) [No such file or directory] >[2016-04-19 07:24:48.643096] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3b880c84-e547-48c0-b4f2-55641775d5b6. (Possible split-brain) >[2016-04-19 07:24:48.643873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6> (3b880c84-e547-48c0-b4f2-55641775d5b6) [No such file or directory] >[2016-04-19 07:24:48.644397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6> (3b880c84-e547-48c0-b4f2-55641775d5b6) [No such file or directory] >[2016-04-19 07:24:48.645763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6> (3b880c84-e547-48c0-b4f2-55641775d5b6) [No such file or directory] >[2016-04-19 07:24:48.645846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6> (3b880c84-e547-48c0-b4f2-55641775d5b6) [No such file or directory] >[2016-04-19 07:24:48.645995] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.648498] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3b880c84-e547-48c0-b4f2-55641775d5b6. (Possible split-brain) >[2016-04-19 07:24:48.649258] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6> (3b880c84-e547-48c0-b4f2-55641775d5b6) [No such file or directory] >[2016-04-19 07:24:48.649564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6> (3b880c84-e547-48c0-b4f2-55641775d5b6) [No such file or directory] >[2016-04-19 07:24:48.652747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6> (3b880c84-e547-48c0-b4f2-55641775d5b6) [No such file or directory] >[2016-04-19 07:24:48.652881] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6> (3b880c84-e547-48c0-b4f2-55641775d5b6) [No such file or directory] >[2016-04-19 07:24:48.652998] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3b880c84-e547-48c0-b4f2-55641775d5b6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.662535] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.663561] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343> (46d6ed29-1a4f-4345-9e97-bf5d0c312343) [No such file or directory] >[2016-04-19 07:24:48.663637] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343> (46d6ed29-1a4f-4345-9e97-bf5d0c312343) [No such file or directory] >[2016-04-19 07:24:48.666517] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 46d6ed29-1a4f-4345-9e97-bf5d0c312343. (Possible split-brain) >[2016-04-19 07:24:48.667731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343> (46d6ed29-1a4f-4345-9e97-bf5d0c312343) [No such file or directory] >[2016-04-19 07:24:48.667743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343> (46d6ed29-1a4f-4345-9e97-bf5d0c312343) [No such file or directory] >[2016-04-19 07:24:48.669057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343> (46d6ed29-1a4f-4345-9e97-bf5d0c312343) [No such file or directory] >[2016-04-19 07:24:48.669058] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343> (46d6ed29-1a4f-4345-9e97-bf5d0c312343) [No such file or directory] >[2016-04-19 07:24:48.669251] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.671851] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 46d6ed29-1a4f-4345-9e97-bf5d0c312343. (Possible split-brain) >[2016-04-19 07:24:48.672919] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343> (46d6ed29-1a4f-4345-9e97-bf5d0c312343) [No such file or directory] >[2016-04-19 07:24:48.672941] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343> (46d6ed29-1a4f-4345-9e97-bf5d0c312343) [No such file or directory] >[2016-04-19 07:24:48.676188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343> (46d6ed29-1a4f-4345-9e97-bf5d0c312343) [No such file or directory] >[2016-04-19 07:24:48.676282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343> (46d6ed29-1a4f-4345-9e97-bf5d0c312343) [No such file or directory] >[2016-04-19 07:24:48.676539] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:46d6ed29-1a4f-4345-9e97-bf5d0c312343>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:48.687633] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.688663] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff> (a6b009df-aaca-4d2d-a557-682042d263ff) [No such file or directory] >[2016-04-19 07:24:48.688750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff> (a6b009df-aaca-4d2d-a557-682042d263ff) [No such file or directory] >[2016-04-19 07:24:48.689922] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a6b009df-aaca-4d2d-a557-682042d263ff. (Possible split-brain) >[2016-04-19 07:24:48.691021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff> (a6b009df-aaca-4d2d-a557-682042d263ff) [No such file or directory] >[2016-04-19 07:24:48.691105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff> (a6b009df-aaca-4d2d-a557-682042d263ff) [No such file or directory] >[2016-04-19 07:24:48.692405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff> (a6b009df-aaca-4d2d-a557-682042d263ff) [No such file or directory] >[2016-04-19 07:24:48.692514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff> (a6b009df-aaca-4d2d-a557-682042d263ff) [No such file or directory] >[2016-04-19 07:24:48.692701] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.695179] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a6b009df-aaca-4d2d-a557-682042d263ff. (Possible split-brain) >[2016-04-19 07:24:48.696406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff> (a6b009df-aaca-4d2d-a557-682042d263ff) [No such file or directory] >[2016-04-19 07:24:48.696492] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff> (a6b009df-aaca-4d2d-a557-682042d263ff) [No such file or directory] >[2016-04-19 07:24:48.699155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff> (a6b009df-aaca-4d2d-a557-682042d263ff) [No such file or directory] >[2016-04-19 07:24:48.699540] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff> (a6b009df-aaca-4d2d-a557-682042d263ff) [No such file or directory] >[2016-04-19 07:24:48.699689] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a6b009df-aaca-4d2d-a557-682042d263ff>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.709606] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.710434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16> (12e9ab5a-d585-4116-9a76-eedd06d4dc16) [No such file or directory] >[2016-04-19 07:24:48.710779] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16> (12e9ab5a-d585-4116-9a76-eedd06d4dc16) [No such file or directory] >[2016-04-19 07:24:48.713580] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 12e9ab5a-d585-4116-9a76-eedd06d4dc16. (Possible split-brain) >[2016-04-19 07:24:48.714612] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16> (12e9ab5a-d585-4116-9a76-eedd06d4dc16) [No such file or directory] >[2016-04-19 07:24:48.714726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16> (12e9ab5a-d585-4116-9a76-eedd06d4dc16) [No such file or directory] >[2016-04-19 07:24:48.715950] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16> (12e9ab5a-d585-4116-9a76-eedd06d4dc16) [No such file or directory] >[2016-04-19 07:24:48.716040] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16> (12e9ab5a-d585-4116-9a76-eedd06d4dc16) [No such file or directory] >[2016-04-19 07:24:48.716173] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.718745] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 12e9ab5a-d585-4116-9a76-eedd06d4dc16. (Possible split-brain) >[2016-04-19 07:24:48.719875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16> (12e9ab5a-d585-4116-9a76-eedd06d4dc16) [No such file or directory] >[2016-04-19 07:24:48.719948] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16> (12e9ab5a-d585-4116-9a76-eedd06d4dc16) [No such file or directory] >[2016-04-19 07:24:48.722714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16> (12e9ab5a-d585-4116-9a76-eedd06d4dc16) [No such file or directory] >[2016-04-19 07:24:48.722837] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16> (12e9ab5a-d585-4116-9a76-eedd06d4dc16) [No such file or directory] >[2016-04-19 07:24:48.722968] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:12e9ab5a-d585-4116-9a76-eedd06d4dc16>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.731841] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.732639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e> (1d1bf5e2-f040-434c-b04b-e77e8c00f74e) [No such file or directory] >[2016-04-19 07:24:48.732742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e> (1d1bf5e2-f040-434c-b04b-e77e8c00f74e) [No such file or directory] >[2016-04-19 07:24:48.735609] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1d1bf5e2-f040-434c-b04b-e77e8c00f74e. (Possible split-brain) >[2016-04-19 07:24:48.736413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e> (1d1bf5e2-f040-434c-b04b-e77e8c00f74e) [No such file or directory] >[2016-04-19 07:24:48.736727] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e> (1d1bf5e2-f040-434c-b04b-e77e8c00f74e) [No such file or directory] >[2016-04-19 07:24:48.737930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e> (1d1bf5e2-f040-434c-b04b-e77e8c00f74e) [No such file or directory] >[2016-04-19 07:24:48.738035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e> (1d1bf5e2-f040-434c-b04b-e77e8c00f74e) [No such file or directory] >[2016-04-19 07:24:48.738179] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.740783] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1d1bf5e2-f040-434c-b04b-e77e8c00f74e. (Possible split-brain) >[2016-04-19 07:24:48.741574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e> (1d1bf5e2-f040-434c-b04b-e77e8c00f74e) [No such file or directory] >[2016-04-19 07:24:48.741666] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e> (1d1bf5e2-f040-434c-b04b-e77e8c00f74e) [No such file or directory] >[2016-04-19 07:24:48.744707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e> (1d1bf5e2-f040-434c-b04b-e77e8c00f74e) [No such file or directory] >[2016-04-19 07:24:48.744719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e> (1d1bf5e2-f040-434c-b04b-e77e8c00f74e) [No such file or directory] >[2016-04-19 07:24:48.744875] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1d1bf5e2-f040-434c-b04b-e77e8c00f74e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.753037] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.754026] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8> (0e9750b1-e746-4f77-8f7b-1569c36abad8) [No such file or directory] >[2016-04-19 07:24:48.754057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8> (0e9750b1-e746-4f77-8f7b-1569c36abad8) [No such file or directory] >[2016-04-19 07:24:48.755194] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0e9750b1-e746-4f77-8f7b-1569c36abad8. (Possible split-brain) >[2016-04-19 07:24:48.755957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8> (0e9750b1-e746-4f77-8f7b-1569c36abad8) [No such file or directory] >[2016-04-19 07:24:48.756377] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8> (0e9750b1-e746-4f77-8f7b-1569c36abad8) [No such file or directory] >[2016-04-19 07:24:48.757476] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8> (0e9750b1-e746-4f77-8f7b-1569c36abad8) [No such file or directory] >[2016-04-19 07:24:48.757772] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8> (0e9750b1-e746-4f77-8f7b-1569c36abad8) [No such file or directory] >[2016-04-19 07:24:48.757925] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.760503] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0e9750b1-e746-4f77-8f7b-1569c36abad8. (Possible split-brain) >[2016-04-19 07:24:48.761212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8> (0e9750b1-e746-4f77-8f7b-1569c36abad8) [No such file or directory] >[2016-04-19 07:24:48.761525] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8> (0e9750b1-e746-4f77-8f7b-1569c36abad8) [No such file or directory] >[2016-04-19 07:24:48.764180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8> (0e9750b1-e746-4f77-8f7b-1569c36abad8) [No such file or directory] >[2016-04-19 07:24:48.764187] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8> (0e9750b1-e746-4f77-8f7b-1569c36abad8) [No such file or directory] >[2016-04-19 07:24:48.764405] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0e9750b1-e746-4f77-8f7b-1569c36abad8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.774615] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.775718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42> (fb3bb456-3bff-41db-874f-e11be53ead42) [No such file or directory] >[2016-04-19 07:24:48.775790] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42> (fb3bb456-3bff-41db-874f-e11be53ead42) [No such file or directory] >[2016-04-19 07:24:48.778670] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fb3bb456-3bff-41db-874f-e11be53ead42. (Possible split-brain) >[2016-04-19 07:24:48.779706] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42> (fb3bb456-3bff-41db-874f-e11be53ead42) [No such file or directory] >[2016-04-19 07:24:48.779812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42> (fb3bb456-3bff-41db-874f-e11be53ead42) [No such file or directory] >[2016-04-19 07:24:48.781295] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42> (fb3bb456-3bff-41db-874f-e11be53ead42) [No such file or directory] >[2016-04-19 07:24:48.781350] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42> (fb3bb456-3bff-41db-874f-e11be53ead42) [No such file or directory] >[2016-04-19 07:24:48.781523] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.784193] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fb3bb456-3bff-41db-874f-e11be53ead42. (Possible split-brain) >[2016-04-19 07:24:48.785162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42> (fb3bb456-3bff-41db-874f-e11be53ead42) [No such file or directory] >[2016-04-19 07:24:48.785357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42> (fb3bb456-3bff-41db-874f-e11be53ead42) [No such file or directory] >[2016-04-19 07:24:48.787881] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42> (fb3bb456-3bff-41db-874f-e11be53ead42) [No such file or directory] >[2016-04-19 07:24:48.787907] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42> (fb3bb456-3bff-41db-874f-e11be53ead42) [No such file or directory] >[2016-04-19 07:24:48.788077] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fb3bb456-3bff-41db-874f-e11be53ead42>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.797482] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.798384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a> (a76fa274-ab5c-489c-b790-e7648a83c00a) [No such file or directory] >[2016-04-19 07:24:48.798539] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a> (a76fa274-ab5c-489c-b790-e7648a83c00a) [No such file or directory] >[2016-04-19 07:24:48.801423] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a76fa274-ab5c-489c-b790-e7648a83c00a. (Possible split-brain) >[2016-04-19 07:24:48.802431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a> (a76fa274-ab5c-489c-b790-e7648a83c00a) [No such file or directory] >[2016-04-19 07:24:48.802536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a> (a76fa274-ab5c-489c-b790-e7648a83c00a) [No such file or directory] >[2016-04-19 07:24:48.803870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a> (a76fa274-ab5c-489c-b790-e7648a83c00a) [No such file or directory] >[2016-04-19 07:24:48.804051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a> (a76fa274-ab5c-489c-b790-e7648a83c00a) [No such file or directory] >[2016-04-19 07:24:48.804233] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.806966] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a76fa274-ab5c-489c-b790-e7648a83c00a. (Possible split-brain) >[2016-04-19 07:24:48.808172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a> (a76fa274-ab5c-489c-b790-e7648a83c00a) [No such file or directory] >[2016-04-19 07:24:48.808270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a> (a76fa274-ab5c-489c-b790-e7648a83c00a) [No such file or directory] >[2016-04-19 07:24:48.810982] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a> (a76fa274-ab5c-489c-b790-e7648a83c00a) [No such file or directory] >[2016-04-19 07:24:48.810997] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a> (a76fa274-ab5c-489c-b790-e7648a83c00a) [No such file or directory] >[2016-04-19 07:24:48.811159] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a76fa274-ab5c-489c-b790-e7648a83c00a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.821150] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.822195] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a> (8761e603-08ce-4526-ae45-a1e5b0b4114a) [No such file or directory] >[2016-04-19 07:24:48.822209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a> (8761e603-08ce-4526-ae45-a1e5b0b4114a) [No such file or directory] >[2016-04-19 07:24:48.823392] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8761e603-08ce-4526-ae45-a1e5b0b4114a. (Possible split-brain) >[2016-04-19 07:24:48.824378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a> (8761e603-08ce-4526-ae45-a1e5b0b4114a) [No such file or directory] >[2016-04-19 07:24:48.824743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a> (8761e603-08ce-4526-ae45-a1e5b0b4114a) [No such file or directory] >[2016-04-19 07:24:48.825887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a> (8761e603-08ce-4526-ae45-a1e5b0b4114a) [No such file or directory] >[2016-04-19 07:24:48.825907] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a> (8761e603-08ce-4526-ae45-a1e5b0b4114a) [No such file or directory] >[2016-04-19 07:24:48.826256] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.828815] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8761e603-08ce-4526-ae45-a1e5b0b4114a. (Possible split-brain) >[2016-04-19 07:24:48.829723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a> (8761e603-08ce-4526-ae45-a1e5b0b4114a) [No such file or directory] >[2016-04-19 07:24:48.830140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a> (8761e603-08ce-4526-ae45-a1e5b0b4114a) [No such file or directory] >[2016-04-19 07:24:48.832600] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a> (8761e603-08ce-4526-ae45-a1e5b0b4114a) [No such file or directory] >[2016-04-19 07:24:48.832680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a> (8761e603-08ce-4526-ae45-a1e5b0b4114a) [No such file or directory] >[2016-04-19 07:24:48.832839] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8761e603-08ce-4526-ae45-a1e5b0b4114a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.841062] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.842065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147> (b9b1c65a-da1e-4027-adb8-848baa44a147) [No such file or directory] >[2016-04-19 07:24:48.842162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147> (b9b1c65a-da1e-4027-adb8-848baa44a147) [No such file or directory] >[2016-04-19 07:24:48.843240] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b9b1c65a-da1e-4027-adb8-848baa44a147. (Possible split-brain) >[2016-04-19 07:24:48.844022] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147> (b9b1c65a-da1e-4027-adb8-848baa44a147) [No such file or directory] >[2016-04-19 07:24:48.844347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147> (b9b1c65a-da1e-4027-adb8-848baa44a147) [No such file or directory] >[2016-04-19 07:24:48.845628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147> (b9b1c65a-da1e-4027-adb8-848baa44a147) [No such file or directory] >[2016-04-19 07:24:48.845870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147> (b9b1c65a-da1e-4027-adb8-848baa44a147) [No such file or directory] >[2016-04-19 07:24:48.845997] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.848689] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b9b1c65a-da1e-4027-adb8-848baa44a147. (Possible split-brain) >[2016-04-19 07:24:48.849459] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147> (b9b1c65a-da1e-4027-adb8-848baa44a147) [No such file or directory] >[2016-04-19 07:24:48.849585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147> (b9b1c65a-da1e-4027-adb8-848baa44a147) [No such file or directory] >[2016-04-19 07:24:48.852872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147> (b9b1c65a-da1e-4027-adb8-848baa44a147) [No such file or directory] >[2016-04-19 07:24:48.852944] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147> (b9b1c65a-da1e-4027-adb8-848baa44a147) [No such file or directory] >[2016-04-19 07:24:48.853073] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b9b1c65a-da1e-4027-adb8-848baa44a147>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.862193] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.863142] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd> (2e01eae2-1c62-484b-9eb0-469a8bf826bd) [No such file or directory] >[2016-04-19 07:24:48.863167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd> (2e01eae2-1c62-484b-9eb0-469a8bf826bd) [No such file or directory] >[2016-04-19 07:24:48.864260] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e01eae2-1c62-484b-9eb0-469a8bf826bd. (Possible split-brain) >[2016-04-19 07:24:48.865427] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd> (2e01eae2-1c62-484b-9eb0-469a8bf826bd) [No such file or directory] >[2016-04-19 07:24:48.865801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd> (2e01eae2-1c62-484b-9eb0-469a8bf826bd) [No such file or directory] >[2016-04-19 07:24:48.866973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd> (2e01eae2-1c62-484b-9eb0-469a8bf826bd) [No such file or directory] >[2016-04-19 07:24:48.867002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd> (2e01eae2-1c62-484b-9eb0-469a8bf826bd) [No such file or directory] >[2016-04-19 07:24:48.867161] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.869783] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e01eae2-1c62-484b-9eb0-469a8bf826bd. (Possible split-brain) >[2016-04-19 07:24:48.870804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd> (2e01eae2-1c62-484b-9eb0-469a8bf826bd) [No such file or directory] >[2016-04-19 07:24:48.871230] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd> (2e01eae2-1c62-484b-9eb0-469a8bf826bd) [No such file or directory] >[2016-04-19 07:24:48.873816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd> (2e01eae2-1c62-484b-9eb0-469a8bf826bd) [No such file or directory] >[2016-04-19 07:24:48.873935] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd> (2e01eae2-1c62-484b-9eb0-469a8bf826bd) [No such file or directory] >[2016-04-19 07:24:48.874121] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2e01eae2-1c62-484b-9eb0-469a8bf826bd>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.882481] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.883467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759> (8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759) [No such file or directory] >[2016-04-19 07:24:48.883484] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759> (8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759) [No such file or directory] >[2016-04-19 07:24:48.886277] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759. (Possible split-brain) >[2016-04-19 07:24:48.887263] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759> (8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759) [No such file or directory] >[2016-04-19 07:24:48.887503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759> (8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759) [No such file or directory] >[2016-04-19 07:24:48.888669] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759> (8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759) [No such file or directory] >[2016-04-19 07:24:48.888956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759> (8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759) [No such file or directory] >[2016-04-19 07:24:48.889109] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.891876] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759. (Possible split-brain) >[2016-04-19 07:24:48.892798] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759> (8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759) [No such file or directory] >[2016-04-19 07:24:48.892828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759> (8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759) [No such file or directory] >[2016-04-19 07:24:48.895305] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759> (8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759) [No such file or directory] >[2016-04-19 07:24:48.895616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759> (8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759) [No such file or directory] >[2016-04-19 07:24:48.895748] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8e7d4bd2-7b0e-4ed9-ac5b-dcadb288e759>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.905689] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.906656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867> (e0253885-e692-4aac-8521-8a99e7d3d867) [No such file or directory] >[2016-04-19 07:24:48.906687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867> (e0253885-e692-4aac-8521-8a99e7d3d867) [No such file or directory] >[2016-04-19 07:24:48.907777] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e0253885-e692-4aac-8521-8a99e7d3d867. (Possible split-brain) >[2016-04-19 07:24:48.908677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867> (e0253885-e692-4aac-8521-8a99e7d3d867) [No such file or directory] >[2016-04-19 07:24:48.908703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867> (e0253885-e692-4aac-8521-8a99e7d3d867) [No such file or directory] >[2016-04-19 07:24:48.909873] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867> (e0253885-e692-4aac-8521-8a99e7d3d867) [No such file or directory] >[2016-04-19 07:24:48.909945] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867> (e0253885-e692-4aac-8521-8a99e7d3d867) [No such file or directory] >[2016-04-19 07:24:48.910198] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.912724] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e0253885-e692-4aac-8521-8a99e7d3d867. (Possible split-brain) >[2016-04-19 07:24:48.913793] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867> (e0253885-e692-4aac-8521-8a99e7d3d867) [No such file or directory] >[2016-04-19 07:24:48.913865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867> (e0253885-e692-4aac-8521-8a99e7d3d867) [No such file or directory] >[2016-04-19 07:24:48.916409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867> (e0253885-e692-4aac-8521-8a99e7d3d867) [No such file or directory] >[2016-04-19 07:24:48.916560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867> (e0253885-e692-4aac-8521-8a99e7d3d867) [No such file or directory] >[2016-04-19 07:24:48.916724] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e0253885-e692-4aac-8521-8a99e7d3d867>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.924986] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.925824] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8> (44d3ab01-7d4e-4d98-bd47-652f630c28a8) [No such file or directory] >[2016-04-19 07:24:48.925877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8> (44d3ab01-7d4e-4d98-bd47-652f630c28a8) [No such file or directory] >[2016-04-19 07:24:48.928823] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 44d3ab01-7d4e-4d98-bd47-652f630c28a8. (Possible split-brain) >[2016-04-19 07:24:48.929640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8> (44d3ab01-7d4e-4d98-bd47-652f630c28a8) [No such file or directory] >[2016-04-19 07:24:48.929738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8> (44d3ab01-7d4e-4d98-bd47-652f630c28a8) [No such file or directory] >[2016-04-19 07:24:48.930851] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8> (44d3ab01-7d4e-4d98-bd47-652f630c28a8) [No such file or directory] >[2016-04-19 07:24:48.931209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8> (44d3ab01-7d4e-4d98-bd47-652f630c28a8) [No such file or directory] >[2016-04-19 07:24:48.931378] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.934096] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 44d3ab01-7d4e-4d98-bd47-652f630c28a8. (Possible split-brain) >[2016-04-19 07:24:48.935137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8> (44d3ab01-7d4e-4d98-bd47-652f630c28a8) [No such file or directory] >[2016-04-19 07:24:48.935357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8> (44d3ab01-7d4e-4d98-bd47-652f630c28a8) [No such file or directory] >[2016-04-19 07:24:48.938398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8> (44d3ab01-7d4e-4d98-bd47-652f630c28a8) [No such file or directory] >[2016-04-19 07:24:48.938579] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8> (44d3ab01-7d4e-4d98-bd47-652f630c28a8) [No such file or directory] >[2016-04-19 07:24:48.938702] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:44d3ab01-7d4e-4d98-bd47-652f630c28a8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.947788] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.948659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c> (98481fb6-8fbb-4503-a475-213a0d0ae91c) [No such file or directory] >[2016-04-19 07:24:48.948913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c> (98481fb6-8fbb-4503-a475-213a0d0ae91c) [No such file or directory] >[2016-04-19 07:24:48.951744] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 98481fb6-8fbb-4503-a475-213a0d0ae91c. (Possible split-brain) >[2016-04-19 07:24:48.952741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c> (98481fb6-8fbb-4503-a475-213a0d0ae91c) [No such file or directory] >[2016-04-19 07:24:48.953013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c> (98481fb6-8fbb-4503-a475-213a0d0ae91c) [No such file or directory] >[2016-04-19 07:24:48.954226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c> (98481fb6-8fbb-4503-a475-213a0d0ae91c) [No such file or directory] >[2016-04-19 07:24:48.954303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c> (98481fb6-8fbb-4503-a475-213a0d0ae91c) [No such file or directory] >[2016-04-19 07:24:48.954492] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:48.957246] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 98481fb6-8fbb-4503-a475-213a0d0ae91c. (Possible split-brain) >[2016-04-19 07:24:48.958368] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c> (98481fb6-8fbb-4503-a475-213a0d0ae91c) [No such file or directory] >[2016-04-19 07:24:48.958383] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c> (98481fb6-8fbb-4503-a475-213a0d0ae91c) [No such file or directory] >[2016-04-19 07:24:48.961042] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c> (98481fb6-8fbb-4503-a475-213a0d0ae91c) [No such file or directory] >[2016-04-19 07:24:48.961226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c> (98481fb6-8fbb-4503-a475-213a0d0ae91c) [No such file or directory] >[2016-04-19 07:24:48.961374] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:98481fb6-8fbb-4503-a475-213a0d0ae91c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:48.969547] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.970369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13> (0ea4d02d-25c8-4efc-b4eb-c9d264008b13) [No such file or directory] >[2016-04-19 07:24:48.970625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13> (0ea4d02d-25c8-4efc-b4eb-c9d264008b13) [No such file or directory] >[2016-04-19 07:24:48.973478] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0ea4d02d-25c8-4efc-b4eb-c9d264008b13. (Possible split-brain) >[2016-04-19 07:24:48.974260] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13> (0ea4d02d-25c8-4efc-b4eb-c9d264008b13) [No such file or directory] >[2016-04-19 07:24:48.974367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13> (0ea4d02d-25c8-4efc-b4eb-c9d264008b13) [No such file or directory] >[2016-04-19 07:24:48.976133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13> (0ea4d02d-25c8-4efc-b4eb-c9d264008b13) [No such file or directory] >[2016-04-19 07:24:48.976145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13> (0ea4d02d-25c8-4efc-b4eb-c9d264008b13) [No such file or directory] >[2016-04-19 07:24:48.976287] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:48.979027] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0ea4d02d-25c8-4efc-b4eb-c9d264008b13. (Possible split-brain) >[2016-04-19 07:24:48.979877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13> (0ea4d02d-25c8-4efc-b4eb-c9d264008b13) [No such file or directory] >[2016-04-19 07:24:48.980140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13> (0ea4d02d-25c8-4efc-b4eb-c9d264008b13) [No such file or directory] >[2016-04-19 07:24:48.983012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13> (0ea4d02d-25c8-4efc-b4eb-c9d264008b13) [No such file or directory] >[2016-04-19 07:24:48.983177] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13> (0ea4d02d-25c8-4efc-b4eb-c9d264008b13) [No such file or directory] >[2016-04-19 07:24:48.983363] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0ea4d02d-25c8-4efc-b4eb-c9d264008b13>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:48.991708] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:48.992604] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46> (218d49ea-d1f9-4283-8c42-f371d842cd46) [No such file or directory] >[2016-04-19 07:24:48.992871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46> (218d49ea-d1f9-4283-8c42-f371d842cd46) [No such file or directory] >[2016-04-19 07:24:48.995765] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 218d49ea-d1f9-4283-8c42-f371d842cd46. (Possible split-brain) >[2016-04-19 07:24:48.997128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46> (218d49ea-d1f9-4283-8c42-f371d842cd46) [No such file or directory] >[2016-04-19 07:24:48.997191] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46> (218d49ea-d1f9-4283-8c42-f371d842cd46) [No such file or directory] >[2016-04-19 07:24:49.002738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46> (218d49ea-d1f9-4283-8c42-f371d842cd46) [No such file or directory] >[2016-04-19 07:24:49.002764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46> (218d49ea-d1f9-4283-8c42-f371d842cd46) [No such file or directory] >[2016-04-19 07:24:49.002914] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.005811] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 218d49ea-d1f9-4283-8c42-f371d842cd46. (Possible split-brain) >[2016-04-19 07:24:49.006568] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46> (218d49ea-d1f9-4283-8c42-f371d842cd46) [No such file or directory] >[2016-04-19 07:24:49.006668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46> (218d49ea-d1f9-4283-8c42-f371d842cd46) [No such file or directory] >[2016-04-19 07:24:49.009355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46> (218d49ea-d1f9-4283-8c42-f371d842cd46) [No such file or directory] >[2016-04-19 07:24:49.009544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46> (218d49ea-d1f9-4283-8c42-f371d842cd46) [No such file or directory] >[2016-04-19 07:24:49.009617] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:218d49ea-d1f9-4283-8c42-f371d842cd46>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:49.017647] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.018366] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce> (198c25a2-b222-4591-bb49-87eed7c82dce) [No such file or directory] >[2016-04-19 07:24:49.018579] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce> (198c25a2-b222-4591-bb49-87eed7c82dce) [No such file or directory] >[2016-04-19 07:24:49.021199] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 198c25a2-b222-4591-bb49-87eed7c82dce. (Possible split-brain) >[2016-04-19 07:24:49.022011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce> (198c25a2-b222-4591-bb49-87eed7c82dce) [No such file or directory] >[2016-04-19 07:24:49.025003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce> (198c25a2-b222-4591-bb49-87eed7c82dce) [No such file or directory] >[2016-04-19 07:24:49.026658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce> (198c25a2-b222-4591-bb49-87eed7c82dce) [No such file or directory] >[2016-04-19 07:24:49.026738] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce> (198c25a2-b222-4591-bb49-87eed7c82dce) [No such file or directory] >[2016-04-19 07:24:49.026867] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.028731] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 198c25a2-b222-4591-bb49-87eed7c82dce. (Possible split-brain) >[2016-04-19 07:24:49.029421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce> (198c25a2-b222-4591-bb49-87eed7c82dce) [No such file or directory] >[2016-04-19 07:24:49.029510] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce> (198c25a2-b222-4591-bb49-87eed7c82dce) [No such file or directory] >[2016-04-19 07:24:49.031602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce> (198c25a2-b222-4591-bb49-87eed7c82dce) [No such file or directory] >[2016-04-19 07:24:49.031628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce> (198c25a2-b222-4591-bb49-87eed7c82dce) [No such file or directory] >[2016-04-19 07:24:49.032766] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:198c25a2-b222-4591-bb49-87eed7c82dce>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:49.042538] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.043226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86> (2300f467-8136-46dd-9d70-71ecd7f84b86) [No such file or directory] >[2016-04-19 07:24:49.043523] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86> (2300f467-8136-46dd-9d70-71ecd7f84b86) [No such file or directory] >[2016-04-19 07:24:49.044464] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2300f467-8136-46dd-9d70-71ecd7f84b86. (Possible split-brain) >[2016-04-19 07:24:49.045184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86> (2300f467-8136-46dd-9d70-71ecd7f84b86) [No such file or directory] >[2016-04-19 07:24:49.045552] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86> (2300f467-8136-46dd-9d70-71ecd7f84b86) [No such file or directory] >[2016-04-19 07:24:49.046379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86> (2300f467-8136-46dd-9d70-71ecd7f84b86) [No such file or directory] >[2016-04-19 07:24:49.046667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86> (2300f467-8136-46dd-9d70-71ecd7f84b86) [No such file or directory] >[2016-04-19 07:24:49.046803] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.048688] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2300f467-8136-46dd-9d70-71ecd7f84b86. (Possible split-brain) >[2016-04-19 07:24:49.049401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86> (2300f467-8136-46dd-9d70-71ecd7f84b86) [No such file or directory] >[2016-04-19 07:24:49.049461] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86> (2300f467-8136-46dd-9d70-71ecd7f84b86) [No such file or directory] >[2016-04-19 07:24:49.052485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86> (2300f467-8136-46dd-9d70-71ecd7f84b86) [No such file or directory] >[2016-04-19 07:24:49.052554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86> (2300f467-8136-46dd-9d70-71ecd7f84b86) [No such file or directory] >[2016-04-19 07:24:49.052665] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2300f467-8136-46dd-9d70-71ecd7f84b86>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.062110] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.063356] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb> (d2401e68-0a14-44aa-9fd3-cef0b99901bb) [No such file or directory] >[2016-04-19 07:24:49.063374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb> (d2401e68-0a14-44aa-9fd3-cef0b99901bb) [No such file or directory] >[2016-04-19 07:24:49.064536] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d2401e68-0a14-44aa-9fd3-cef0b99901bb. (Possible split-brain) >[2016-04-19 07:24:49.065687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb> (d2401e68-0a14-44aa-9fd3-cef0b99901bb) [No such file or directory] >[2016-04-19 07:24:49.065758] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb> (d2401e68-0a14-44aa-9fd3-cef0b99901bb) [No such file or directory] >[2016-04-19 07:24:49.067089] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb> (d2401e68-0a14-44aa-9fd3-cef0b99901bb) [No such file or directory] >[2016-04-19 07:24:49.067170] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb> (d2401e68-0a14-44aa-9fd3-cef0b99901bb) [No such file or directory] >[2016-04-19 07:24:49.067285] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.069934] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d2401e68-0a14-44aa-9fd3-cef0b99901bb. (Possible split-brain) >[2016-04-19 07:24:49.070874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb> (d2401e68-0a14-44aa-9fd3-cef0b99901bb) [No such file or directory] >[2016-04-19 07:24:49.071130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb> (d2401e68-0a14-44aa-9fd3-cef0b99901bb) [No such file or directory] >[2016-04-19 07:24:49.073625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb> (d2401e68-0a14-44aa-9fd3-cef0b99901bb) [No such file or directory] >[2016-04-19 07:24:49.073870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb> (d2401e68-0a14-44aa-9fd3-cef0b99901bb) [No such file or directory] >[2016-04-19 07:24:49.074025] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d2401e68-0a14-44aa-9fd3-cef0b99901bb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.083179] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.084141] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e> (7bd795b2-e62c-409a-a082-a9a588303c2e) [No such file or directory] >[2016-04-19 07:24:49.084168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e> (7bd795b2-e62c-409a-a082-a9a588303c2e) [No such file or directory] >[2016-04-19 07:24:49.085268] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7bd795b2-e62c-409a-a082-a9a588303c2e. (Possible split-brain) >[2016-04-19 07:24:49.086385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e> (7bd795b2-e62c-409a-a082-a9a588303c2e) [No such file or directory] >[2016-04-19 07:24:49.086465] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e> (7bd795b2-e62c-409a-a082-a9a588303c2e) [No such file or directory] >[2016-04-19 07:24:49.087865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e> (7bd795b2-e62c-409a-a082-a9a588303c2e) [No such file or directory] >[2016-04-19 07:24:49.087867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e> (7bd795b2-e62c-409a-a082-a9a588303c2e) [No such file or directory] >[2016-04-19 07:24:49.088023] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.090789] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7bd795b2-e62c-409a-a082-a9a588303c2e. (Possible split-brain) >[2016-04-19 07:24:49.091597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e> (7bd795b2-e62c-409a-a082-a9a588303c2e) [No such file or directory] >[2016-04-19 07:24:49.091677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e> (7bd795b2-e62c-409a-a082-a9a588303c2e) [No such file or directory] >[2016-04-19 07:24:49.094576] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e> (7bd795b2-e62c-409a-a082-a9a588303c2e) [No such file or directory] >[2016-04-19 07:24:49.094585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e> (7bd795b2-e62c-409a-a082-a9a588303c2e) [No such file or directory] >[2016-04-19 07:24:49.094766] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7bd795b2-e62c-409a-a082-a9a588303c2e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.103159] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.104070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4> (4f069089-b051-4bc5-b1fc-659e091bd4a4) [No such file or directory] >[2016-04-19 07:24:49.104074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4> (4f069089-b051-4bc5-b1fc-659e091bd4a4) [No such file or directory] >[2016-04-19 07:24:49.105274] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4f069089-b051-4bc5-b1fc-659e091bd4a4. (Possible split-brain) >[2016-04-19 07:24:49.106245] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4> (4f069089-b051-4bc5-b1fc-659e091bd4a4) [No such file or directory] >[2016-04-19 07:24:49.106273] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4> (4f069089-b051-4bc5-b1fc-659e091bd4a4) [No such file or directory] >[2016-04-19 07:24:49.107465] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4> (4f069089-b051-4bc5-b1fc-659e091bd4a4) [No such file or directory] >[2016-04-19 07:24:49.107673] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4> (4f069089-b051-4bc5-b1fc-659e091bd4a4) [No such file or directory] >[2016-04-19 07:24:49.107793] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.110349] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4f069089-b051-4bc5-b1fc-659e091bd4a4. (Possible split-brain) >[2016-04-19 07:24:49.111125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4> (4f069089-b051-4bc5-b1fc-659e091bd4a4) [No such file or directory] >[2016-04-19 07:24:49.111217] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4> (4f069089-b051-4bc5-b1fc-659e091bd4a4) [No such file or directory] >[2016-04-19 07:24:49.114293] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4> (4f069089-b051-4bc5-b1fc-659e091bd4a4) [No such file or directory] >[2016-04-19 07:24:49.114349] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4> (4f069089-b051-4bc5-b1fc-659e091bd4a4) [No such file or directory] >[2016-04-19 07:24:49.114516] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4f069089-b051-4bc5-b1fc-659e091bd4a4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.123251] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.124105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:778282d6-500b-40f1-b879-20554afaba8c> (778282d6-500b-40f1-b879-20554afaba8c) [No such file or directory] >[2016-04-19 07:24:49.124138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:778282d6-500b-40f1-b879-20554afaba8c> (778282d6-500b-40f1-b879-20554afaba8c) [No such file or directory] >[2016-04-19 07:24:49.125230] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 778282d6-500b-40f1-b879-20554afaba8c. (Possible split-brain) >[2016-04-19 07:24:49.126103] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:778282d6-500b-40f1-b879-20554afaba8c> (778282d6-500b-40f1-b879-20554afaba8c) [No such file or directory] >[2016-04-19 07:24:49.126128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:778282d6-500b-40f1-b879-20554afaba8c> (778282d6-500b-40f1-b879-20554afaba8c) [No such file or directory] >[2016-04-19 07:24:49.127467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:778282d6-500b-40f1-b879-20554afaba8c> (778282d6-500b-40f1-b879-20554afaba8c) [No such file or directory] >[2016-04-19 07:24:49.127843] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:778282d6-500b-40f1-b879-20554afaba8c> (778282d6-500b-40f1-b879-20554afaba8c) [No such file or directory] >[2016-04-19 07:24:49.128075] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:778282d6-500b-40f1-b879-20554afaba8c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.130867] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 778282d6-500b-40f1-b879-20554afaba8c. (Possible split-brain) >[2016-04-19 07:24:49.131670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:778282d6-500b-40f1-b879-20554afaba8c> (778282d6-500b-40f1-b879-20554afaba8c) [No such file or directory] >[2016-04-19 07:24:49.131872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:778282d6-500b-40f1-b879-20554afaba8c> (778282d6-500b-40f1-b879-20554afaba8c) [No such file or directory] >[2016-04-19 07:24:49.134730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:778282d6-500b-40f1-b879-20554afaba8c> (778282d6-500b-40f1-b879-20554afaba8c) [No such file or directory] >[2016-04-19 07:24:49.134747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:778282d6-500b-40f1-b879-20554afaba8c> (778282d6-500b-40f1-b879-20554afaba8c) [No such file or directory] >[2016-04-19 07:24:49.135081] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:778282d6-500b-40f1-b879-20554afaba8c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:49.144570] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.145707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d> (95f02c02-f93d-40ee-aa53-3eafd5142c1d) [No such file or directory] >[2016-04-19 07:24:49.145708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d> (95f02c02-f93d-40ee-aa53-3eafd5142c1d) [No such file or directory] >[2016-04-19 07:24:49.148547] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 95f02c02-f93d-40ee-aa53-3eafd5142c1d. (Possible split-brain) >[2016-04-19 07:24:49.149696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d> (95f02c02-f93d-40ee-aa53-3eafd5142c1d) [No such file or directory] >[2016-04-19 07:24:49.149714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d> (95f02c02-f93d-40ee-aa53-3eafd5142c1d) [No such file or directory] >[2016-04-19 07:24:49.150967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d> (95f02c02-f93d-40ee-aa53-3eafd5142c1d) [No such file or directory] >[2016-04-19 07:24:49.151059] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d> (95f02c02-f93d-40ee-aa53-3eafd5142c1d) [No such file or directory] >[2016-04-19 07:24:49.151188] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.153839] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 95f02c02-f93d-40ee-aa53-3eafd5142c1d. (Possible split-brain) >[2016-04-19 07:24:49.154826] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d> (95f02c02-f93d-40ee-aa53-3eafd5142c1d) [No such file or directory] >[2016-04-19 07:24:49.154849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d> (95f02c02-f93d-40ee-aa53-3eafd5142c1d) [No such file or directory] >[2016-04-19 07:24:49.157868] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d> (95f02c02-f93d-40ee-aa53-3eafd5142c1d) [No such file or directory] >[2016-04-19 07:24:49.158023] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d> (95f02c02-f93d-40ee-aa53-3eafd5142c1d) [No such file or directory] >[2016-04-19 07:24:49.158181] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:95f02c02-f93d-40ee-aa53-3eafd5142c1d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.167098] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.167875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20> (3901b661-496e-4a8b-bab7-41eefae19c20) [No such file or directory] >[2016-04-19 07:24:49.168171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20> (3901b661-496e-4a8b-bab7-41eefae19c20) [No such file or directory] >[2016-04-19 07:24:49.169255] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3901b661-496e-4a8b-bab7-41eefae19c20. (Possible split-brain) >[2016-04-19 07:24:49.170035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20> (3901b661-496e-4a8b-bab7-41eefae19c20) [No such file or directory] >[2016-04-19 07:24:49.170243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20> (3901b661-496e-4a8b-bab7-41eefae19c20) [No such file or directory] >[2016-04-19 07:24:49.171534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20> (3901b661-496e-4a8b-bab7-41eefae19c20) [No such file or directory] >[2016-04-19 07:24:49.171995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20> (3901b661-496e-4a8b-bab7-41eefae19c20) [No such file or directory] >[2016-04-19 07:24:49.172194] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.174748] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3901b661-496e-4a8b-bab7-41eefae19c20. (Possible split-brain) >[2016-04-19 07:24:49.175686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20> (3901b661-496e-4a8b-bab7-41eefae19c20) [No such file or directory] >[2016-04-19 07:24:49.175715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20> (3901b661-496e-4a8b-bab7-41eefae19c20) [No such file or directory] >[2016-04-19 07:24:49.178599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20> (3901b661-496e-4a8b-bab7-41eefae19c20) [No such file or directory] >[2016-04-19 07:24:49.178737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20> (3901b661-496e-4a8b-bab7-41eefae19c20) [No such file or directory] >[2016-04-19 07:24:49.178953] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3901b661-496e-4a8b-bab7-41eefae19c20>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.186833] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.187597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066> (38c1a9be-d566-4437-bac7-f17b5a34d066) [No such file or directory] >[2016-04-19 07:24:49.187878] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066> (38c1a9be-d566-4437-bac7-f17b5a34d066) [No such file or directory] >[2016-04-19 07:24:49.190824] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 38c1a9be-d566-4437-bac7-f17b5a34d066. (Possible split-brain) >[2016-04-19 07:24:49.191801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066> (38c1a9be-d566-4437-bac7-f17b5a34d066) [No such file or directory] >[2016-04-19 07:24:49.191896] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066> (38c1a9be-d566-4437-bac7-f17b5a34d066) [No such file or directory] >[2016-04-19 07:24:49.193135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066> (38c1a9be-d566-4437-bac7-f17b5a34d066) [No such file or directory] >[2016-04-19 07:24:49.193387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066> (38c1a9be-d566-4437-bac7-f17b5a34d066) [No such file or directory] >[2016-04-19 07:24:49.193588] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.196355] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 38c1a9be-d566-4437-bac7-f17b5a34d066. (Possible split-brain) >[2016-04-19 07:24:49.197119] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066> (38c1a9be-d566-4437-bac7-f17b5a34d066) [No such file or directory] >[2016-04-19 07:24:49.197215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066> (38c1a9be-d566-4437-bac7-f17b5a34d066) [No such file or directory] >[2016-04-19 07:24:49.199838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066> (38c1a9be-d566-4437-bac7-f17b5a34d066) [No such file or directory] >[2016-04-19 07:24:49.199863] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066> (38c1a9be-d566-4437-bac7-f17b5a34d066) [No such file or directory] >[2016-04-19 07:24:49.200058] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:38c1a9be-d566-4437-bac7-f17b5a34d066>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.208981] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.209791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32> (eb185c67-c101-42ed-b975-62c0ae78aa32) [No such file or directory] >[2016-04-19 07:24:49.210038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32> (eb185c67-c101-42ed-b975-62c0ae78aa32) [No such file or directory] >[2016-04-19 07:24:49.211198] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid eb185c67-c101-42ed-b975-62c0ae78aa32. (Possible split-brain) >[2016-04-19 07:24:49.211915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32> (eb185c67-c101-42ed-b975-62c0ae78aa32) [No such file or directory] >[2016-04-19 07:24:49.212181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32> (eb185c67-c101-42ed-b975-62c0ae78aa32) [No such file or directory] >[2016-04-19 07:24:49.213538] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32> (eb185c67-c101-42ed-b975-62c0ae78aa32) [No such file or directory] >[2016-04-19 07:24:49.213604] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32> (eb185c67-c101-42ed-b975-62c0ae78aa32) [No such file or directory] >[2016-04-19 07:24:49.213739] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.216458] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid eb185c67-c101-42ed-b975-62c0ae78aa32. (Possible split-brain) >[2016-04-19 07:24:49.217250] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32> (eb185c67-c101-42ed-b975-62c0ae78aa32) [No such file or directory] >[2016-04-19 07:24:49.217347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32> (eb185c67-c101-42ed-b975-62c0ae78aa32) [No such file or directory] >[2016-04-19 07:24:49.220591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32> (eb185c67-c101-42ed-b975-62c0ae78aa32) [No such file or directory] >[2016-04-19 07:24:49.220670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32> (eb185c67-c101-42ed-b975-62c0ae78aa32) [No such file or directory] >[2016-04-19 07:24:49.220774] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:eb185c67-c101-42ed-b975-62c0ae78aa32>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.228198] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.228982] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742> (5bd54243-e48d-4d19-bac4-0c270ef1e742) [No such file or directory] >[2016-04-19 07:24:49.229396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742> (5bd54243-e48d-4d19-bac4-0c270ef1e742) [No such file or directory] >[2016-04-19 07:24:49.232276] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5bd54243-e48d-4d19-bac4-0c270ef1e742. (Possible split-brain) >[2016-04-19 07:24:49.233283] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742> (5bd54243-e48d-4d19-bac4-0c270ef1e742) [No such file or directory] >[2016-04-19 07:24:49.233290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742> (5bd54243-e48d-4d19-bac4-0c270ef1e742) [No such file or directory] >[2016-04-19 07:24:49.234869] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742> (5bd54243-e48d-4d19-bac4-0c270ef1e742) [No such file or directory] >[2016-04-19 07:24:49.234904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742> (5bd54243-e48d-4d19-bac4-0c270ef1e742) [No such file or directory] >[2016-04-19 07:24:49.235071] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.237589] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5bd54243-e48d-4d19-bac4-0c270ef1e742. (Possible split-brain) >[2016-04-19 07:24:49.238391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742> (5bd54243-e48d-4d19-bac4-0c270ef1e742) [No such file or directory] >[2016-04-19 07:24:49.239375] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742> (5bd54243-e48d-4d19-bac4-0c270ef1e742) [No such file or directory] >[2016-04-19 07:24:49.242587] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742> (5bd54243-e48d-4d19-bac4-0c270ef1e742) [No such file or directory] >[2016-04-19 07:24:49.242708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742> (5bd54243-e48d-4d19-bac4-0c270ef1e742) [No such file or directory] >[2016-04-19 07:24:49.242820] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5bd54243-e48d-4d19-bac4-0c270ef1e742>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.251687] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.252461] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35> (b171f57a-2ce0-4da7-9821-d28995d03e35) [No such file or directory] >[2016-04-19 07:24:49.252719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35> (b171f57a-2ce0-4da7-9821-d28995d03e35) [No such file or directory] >[2016-04-19 07:24:49.255633] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b171f57a-2ce0-4da7-9821-d28995d03e35. (Possible split-brain) >[2016-04-19 07:24:49.256470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35> (b171f57a-2ce0-4da7-9821-d28995d03e35) [No such file or directory] >[2016-04-19 07:24:49.256564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35> (b171f57a-2ce0-4da7-9821-d28995d03e35) [No such file or directory] >[2016-04-19 07:24:49.257965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35> (b171f57a-2ce0-4da7-9821-d28995d03e35) [No such file or directory] >[2016-04-19 07:24:49.258210] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35> (b171f57a-2ce0-4da7-9821-d28995d03e35) [No such file or directory] >[2016-04-19 07:24:49.258438] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.261091] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b171f57a-2ce0-4da7-9821-d28995d03e35. (Possible split-brain) >[2016-04-19 07:24:49.261946] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35> (b171f57a-2ce0-4da7-9821-d28995d03e35) [No such file or directory] >[2016-04-19 07:24:49.262244] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35> (b171f57a-2ce0-4da7-9821-d28995d03e35) [No such file or directory] >[2016-04-19 07:24:49.265053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35> (b171f57a-2ce0-4da7-9821-d28995d03e35) [No such file or directory] >[2016-04-19 07:24:49.265079] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35> (b171f57a-2ce0-4da7-9821-d28995d03e35) [No such file or directory] >[2016-04-19 07:24:49.265201] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b171f57a-2ce0-4da7-9821-d28995d03e35>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.273236] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.274037] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821> (17a3825b-b20b-4922-94ba-68ebbd420821) [No such file or directory] >[2016-04-19 07:24:49.274350] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821> (17a3825b-b20b-4922-94ba-68ebbd420821) [No such file or directory] >[2016-04-19 07:24:49.275510] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 17a3825b-b20b-4922-94ba-68ebbd420821. (Possible split-brain) >[2016-04-19 07:24:49.276234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821> (17a3825b-b20b-4922-94ba-68ebbd420821) [No such file or directory] >[2016-04-19 07:24:49.276525] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821> (17a3825b-b20b-4922-94ba-68ebbd420821) [No such file or directory] >[2016-04-19 07:24:49.277750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821> (17a3825b-b20b-4922-94ba-68ebbd420821) [No such file or directory] >[2016-04-19 07:24:49.278157] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821> (17a3825b-b20b-4922-94ba-68ebbd420821) [No such file or directory] >[2016-04-19 07:24:49.278345] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.280393] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 17a3825b-b20b-4922-94ba-68ebbd420821. (Possible split-brain) >[2016-04-19 07:24:49.281016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821> (17a3825b-b20b-4922-94ba-68ebbd420821) [No such file or directory] >[2016-04-19 07:24:49.281029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821> (17a3825b-b20b-4922-94ba-68ebbd420821) [No such file or directory] >[2016-04-19 07:24:49.283736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821> (17a3825b-b20b-4922-94ba-68ebbd420821) [No such file or directory] >[2016-04-19 07:24:49.283789] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821> (17a3825b-b20b-4922-94ba-68ebbd420821) [No such file or directory] >[2016-04-19 07:24:49.283943] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:17a3825b-b20b-4922-94ba-68ebbd420821>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.294081] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.295229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f> (a0f61600-5502-4ce5-874e-1a59566b244f) [No such file or directory] >[2016-04-19 07:24:49.295344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f> (a0f61600-5502-4ce5-874e-1a59566b244f) [No such file or directory] >[2016-04-19 07:24:49.296501] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a0f61600-5502-4ce5-874e-1a59566b244f. (Possible split-brain) >[2016-04-19 07:24:49.297625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f> (a0f61600-5502-4ce5-874e-1a59566b244f) [No such file or directory] >[2016-04-19 07:24:49.297651] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f> (a0f61600-5502-4ce5-874e-1a59566b244f) [No such file or directory] >[2016-04-19 07:24:49.298579] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f> (a0f61600-5502-4ce5-874e-1a59566b244f) [No such file or directory] >[2016-04-19 07:24:49.298918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f> (a0f61600-5502-4ce5-874e-1a59566b244f) [No such file or directory] >[2016-04-19 07:24:49.299099] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.301868] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a0f61600-5502-4ce5-874e-1a59566b244f. (Possible split-brain) >[2016-04-19 07:24:49.302932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f> (a0f61600-5502-4ce5-874e-1a59566b244f) [No such file or directory] >[2016-04-19 07:24:49.303185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f> (a0f61600-5502-4ce5-874e-1a59566b244f) [No such file or directory] >[2016-04-19 07:24:49.306511] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f> (a0f61600-5502-4ce5-874e-1a59566b244f) [No such file or directory] >[2016-04-19 07:24:49.306592] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f> (a0f61600-5502-4ce5-874e-1a59566b244f) [No such file or directory] >[2016-04-19 07:24:49.306808] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a0f61600-5502-4ce5-874e-1a59566b244f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:49.316588] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.317669] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4f6805b8-894b-457d-98d2-35be318e5671> (4f6805b8-894b-457d-98d2-35be318e5671) [No such file or directory] >[2016-04-19 07:24:49.317754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4f6805b8-894b-457d-98d2-35be318e5671> (4f6805b8-894b-457d-98d2-35be318e5671) [No such file or directory] >[2016-04-19 07:24:49.320699] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4f6805b8-894b-457d-98d2-35be318e5671. (Possible split-brain) >[2016-04-19 07:24:49.321819] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4f6805b8-894b-457d-98d2-35be318e5671> (4f6805b8-894b-457d-98d2-35be318e5671) [No such file or directory] >[2016-04-19 07:24:49.321822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4f6805b8-894b-457d-98d2-35be318e5671> (4f6805b8-894b-457d-98d2-35be318e5671) [No such file or directory] >[2016-04-19 07:24:49.323070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4f6805b8-894b-457d-98d2-35be318e5671> (4f6805b8-894b-457d-98d2-35be318e5671) [No such file or directory] >[2016-04-19 07:24:49.323137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4f6805b8-894b-457d-98d2-35be318e5671> (4f6805b8-894b-457d-98d2-35be318e5671) [No such file or directory] >[2016-04-19 07:24:49.323362] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4f6805b8-894b-457d-98d2-35be318e5671>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:49.325946] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4f6805b8-894b-457d-98d2-35be318e5671. (Possible split-brain) >[2016-04-19 07:24:49.327077] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4f6805b8-894b-457d-98d2-35be318e5671> (4f6805b8-894b-457d-98d2-35be318e5671) [No such file or directory] >[2016-04-19 07:24:49.327169] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4f6805b8-894b-457d-98d2-35be318e5671> (4f6805b8-894b-457d-98d2-35be318e5671) [No such file or directory] >[2016-04-19 07:24:49.329832] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4f6805b8-894b-457d-98d2-35be318e5671> (4f6805b8-894b-457d-98d2-35be318e5671) [No such file or directory] >[2016-04-19 07:24:49.330212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4f6805b8-894b-457d-98d2-35be318e5671> (4f6805b8-894b-457d-98d2-35be318e5671) [No such file or directory] >[2016-04-19 07:24:49.330397] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4f6805b8-894b-457d-98d2-35be318e5671>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.340104] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.341172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144> (ddbae442-58c4-47d8-af4e-7e6196890144) [No such file or directory] >[2016-04-19 07:24:49.341185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144> (ddbae442-58c4-47d8-af4e-7e6196890144) [No such file or directory] >[2016-04-19 07:24:49.342424] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ddbae442-58c4-47d8-af4e-7e6196890144. (Possible split-brain) >[2016-04-19 07:24:49.343447] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144> (ddbae442-58c4-47d8-af4e-7e6196890144) [No such file or directory] >[2016-04-19 07:24:49.343468] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144> (ddbae442-58c4-47d8-af4e-7e6196890144) [No such file or directory] >[2016-04-19 07:24:49.344712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144> (ddbae442-58c4-47d8-af4e-7e6196890144) [No such file or directory] >[2016-04-19 07:24:49.344808] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144> (ddbae442-58c4-47d8-af4e-7e6196890144) [No such file or directory] >[2016-04-19 07:24:49.344900] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.347642] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ddbae442-58c4-47d8-af4e-7e6196890144. (Possible split-brain) >[2016-04-19 07:24:49.348706] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144> (ddbae442-58c4-47d8-af4e-7e6196890144) [No such file or directory] >[2016-04-19 07:24:49.348785] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144> (ddbae442-58c4-47d8-af4e-7e6196890144) [No such file or directory] >[2016-04-19 07:24:49.351572] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144> (ddbae442-58c4-47d8-af4e-7e6196890144) [No such file or directory] >[2016-04-19 07:24:49.351592] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144> (ddbae442-58c4-47d8-af4e-7e6196890144) [No such file or directory] >[2016-04-19 07:24:49.351831] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ddbae442-58c4-47d8-af4e-7e6196890144>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.360003] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.360795] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395> (8246d0fe-9495-456c-9bba-0a57db7c9395) [No such file or directory] >[2016-04-19 07:24:49.360964] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395> (8246d0fe-9495-456c-9bba-0a57db7c9395) [No such file or directory] >[2016-04-19 07:24:49.363888] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8246d0fe-9495-456c-9bba-0a57db7c9395. (Possible split-brain) >[2016-04-19 07:24:49.364765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395> (8246d0fe-9495-456c-9bba-0a57db7c9395) [No such file or directory] >[2016-04-19 07:24:49.365044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395> (8246d0fe-9495-456c-9bba-0a57db7c9395) [No such file or directory] >[2016-04-19 07:24:49.366392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395> (8246d0fe-9495-456c-9bba-0a57db7c9395) [No such file or directory] >[2016-04-19 07:24:49.366677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395> (8246d0fe-9495-456c-9bba-0a57db7c9395) [No such file or directory] >[2016-04-19 07:24:49.366906] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.369542] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 8246d0fe-9495-456c-9bba-0a57db7c9395. (Possible split-brain) >[2016-04-19 07:24:49.370425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395> (8246d0fe-9495-456c-9bba-0a57db7c9395) [No such file or directory] >[2016-04-19 07:24:49.370714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395> (8246d0fe-9495-456c-9bba-0a57db7c9395) [No such file or directory] >[2016-04-19 07:24:49.373694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395> (8246d0fe-9495-456c-9bba-0a57db7c9395) [No such file or directory] >[2016-04-19 07:24:49.373793] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395> (8246d0fe-9495-456c-9bba-0a57db7c9395) [No such file or directory] >[2016-04-19 07:24:49.373955] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8246d0fe-9495-456c-9bba-0a57db7c9395>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.383362] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.384097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b> (6dc0ff13-dbeb-4453-9542-cb5017e5fd2b) [No such file or directory] >[2016-04-19 07:24:49.384363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b> (6dc0ff13-dbeb-4453-9542-cb5017e5fd2b) [No such file or directory] >[2016-04-19 07:24:49.387245] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6dc0ff13-dbeb-4453-9542-cb5017e5fd2b. (Possible split-brain) >[2016-04-19 07:24:49.388172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b> (6dc0ff13-dbeb-4453-9542-cb5017e5fd2b) [No such file or directory] >[2016-04-19 07:24:49.388253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b> (6dc0ff13-dbeb-4453-9542-cb5017e5fd2b) [No such file or directory] >[2016-04-19 07:24:49.389575] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b> (6dc0ff13-dbeb-4453-9542-cb5017e5fd2b) [No such file or directory] >[2016-04-19 07:24:49.389684] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b> (6dc0ff13-dbeb-4453-9542-cb5017e5fd2b) [No such file or directory] >[2016-04-19 07:24:49.389859] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.392457] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6dc0ff13-dbeb-4453-9542-cb5017e5fd2b. (Possible split-brain) >[2016-04-19 07:24:49.393482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b> (6dc0ff13-dbeb-4453-9542-cb5017e5fd2b) [No such file or directory] >[2016-04-19 07:24:49.393577] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b> (6dc0ff13-dbeb-4453-9542-cb5017e5fd2b) [No such file or directory] >[2016-04-19 07:24:49.396358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b> (6dc0ff13-dbeb-4453-9542-cb5017e5fd2b) [No such file or directory] >[2016-04-19 07:24:49.396437] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b> (6dc0ff13-dbeb-4453-9542-cb5017e5fd2b) [No such file or directory] >[2016-04-19 07:24:49.396574] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6dc0ff13-dbeb-4453-9542-cb5017e5fd2b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.405123] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.405884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0403a34d-0696-476d-b9d9-4925e9553095> (0403a34d-0696-476d-b9d9-4925e9553095) [No such file or directory] >[2016-04-19 07:24:49.406193] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0403a34d-0696-476d-b9d9-4925e9553095> (0403a34d-0696-476d-b9d9-4925e9553095) [No such file or directory] >[2016-04-19 07:24:49.407308] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0403a34d-0696-476d-b9d9-4925e9553095. (Possible split-brain) >[2016-04-19 07:24:49.408019] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0403a34d-0696-476d-b9d9-4925e9553095> (0403a34d-0696-476d-b9d9-4925e9553095) [No such file or directory] >[2016-04-19 07:24:49.408270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0403a34d-0696-476d-b9d9-4925e9553095> (0403a34d-0696-476d-b9d9-4925e9553095) [No such file or directory] >[2016-04-19 07:24:49.409544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0403a34d-0696-476d-b9d9-4925e9553095> (0403a34d-0696-476d-b9d9-4925e9553095) [No such file or directory] >[2016-04-19 07:24:49.409573] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0403a34d-0696-476d-b9d9-4925e9553095> (0403a34d-0696-476d-b9d9-4925e9553095) [No such file or directory] >[2016-04-19 07:24:49.409779] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0403a34d-0696-476d-b9d9-4925e9553095>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.412298] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0403a34d-0696-476d-b9d9-4925e9553095. (Possible split-brain) >[2016-04-19 07:24:49.413059] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0403a34d-0696-476d-b9d9-4925e9553095> (0403a34d-0696-476d-b9d9-4925e9553095) [No such file or directory] >[2016-04-19 07:24:49.413458] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0403a34d-0696-476d-b9d9-4925e9553095> (0403a34d-0696-476d-b9d9-4925e9553095) [No such file or directory] >[2016-04-19 07:24:49.416148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0403a34d-0696-476d-b9d9-4925e9553095> (0403a34d-0696-476d-b9d9-4925e9553095) [No such file or directory] >[2016-04-19 07:24:49.416217] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0403a34d-0696-476d-b9d9-4925e9553095> (0403a34d-0696-476d-b9d9-4925e9553095) [No such file or directory] >[2016-04-19 07:24:49.416374] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0403a34d-0696-476d-b9d9-4925e9553095>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.426033] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.427064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d> (b6c84d2e-2d8a-4cc4-96ae-dc839239e04d) [No such file or directory] >[2016-04-19 07:24:49.427083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d> (b6c84d2e-2d8a-4cc4-96ae-dc839239e04d) [No such file or directory] >[2016-04-19 07:24:49.428346] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b6c84d2e-2d8a-4cc4-96ae-dc839239e04d. (Possible split-brain) >[2016-04-19 07:24:49.429376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d> (b6c84d2e-2d8a-4cc4-96ae-dc839239e04d) [No such file or directory] >[2016-04-19 07:24:49.429383] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d> (b6c84d2e-2d8a-4cc4-96ae-dc839239e04d) [No such file or directory] >[2016-04-19 07:24:49.430602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d> (b6c84d2e-2d8a-4cc4-96ae-dc839239e04d) [No such file or directory] >[2016-04-19 07:24:49.430618] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d> (b6c84d2e-2d8a-4cc4-96ae-dc839239e04d) [No such file or directory] >[2016-04-19 07:24:49.430785] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.433398] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b6c84d2e-2d8a-4cc4-96ae-dc839239e04d. (Possible split-brain) >[2016-04-19 07:24:49.434603] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d> (b6c84d2e-2d8a-4cc4-96ae-dc839239e04d) [No such file or directory] >[2016-04-19 07:24:49.434697] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d> (b6c84d2e-2d8a-4cc4-96ae-dc839239e04d) [No such file or directory] >[2016-04-19 07:24:49.437211] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d> (b6c84d2e-2d8a-4cc4-96ae-dc839239e04d) [No such file or directory] >[2016-04-19 07:24:49.437239] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d> (b6c84d2e-2d8a-4cc4-96ae-dc839239e04d) [No such file or directory] >[2016-04-19 07:24:49.437469] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b6c84d2e-2d8a-4cc4-96ae-dc839239e04d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.446801] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.447868] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b> (6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b) [No such file or directory] >[2016-04-19 07:24:49.447891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b> (6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b) [No such file or directory] >[2016-04-19 07:24:49.450830] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b. (Possible split-brain) >[2016-04-19 07:24:49.451762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b> (6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b) [No such file or directory] >[2016-04-19 07:24:49.452091] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b> (6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b) [No such file or directory] >[2016-04-19 07:24:49.453426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b> (6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b) [No such file or directory] >[2016-04-19 07:24:49.453472] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b> (6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b) [No such file or directory] >[2016-04-19 07:24:49.453746] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:49.456565] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b. (Possible split-brain) >[2016-04-19 07:24:49.457453] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b> (6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b) [No such file or directory] >[2016-04-19 07:24:49.457871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b> (6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b) [No such file or directory] >[2016-04-19 07:24:49.460369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b> (6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b) [No such file or directory] >[2016-04-19 07:24:49.460527] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b> (6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b) [No such file or directory] >[2016-04-19 07:24:49.460708] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6fe0a5c3-d0da-47fb-9d2d-d4213a1ed27b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.469378] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.470081] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80> (f863eb2d-7fd6-4d62-952d-4f6a92d0ae80) [No such file or directory] >[2016-04-19 07:24:49.470423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80> (f863eb2d-7fd6-4d62-952d-4f6a92d0ae80) [No such file or directory] >[2016-04-19 07:24:49.471556] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f863eb2d-7fd6-4d62-952d-4f6a92d0ae80. (Possible split-brain) >[2016-04-19 07:24:49.472166] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80> (f863eb2d-7fd6-4d62-952d-4f6a92d0ae80) [No such file or directory] >[2016-04-19 07:24:49.472580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80> (f863eb2d-7fd6-4d62-952d-4f6a92d0ae80) [No such file or directory] >[2016-04-19 07:24:49.473909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80> (f863eb2d-7fd6-4d62-952d-4f6a92d0ae80) [No such file or directory] >[2016-04-19 07:24:49.473947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80> (f863eb2d-7fd6-4d62-952d-4f6a92d0ae80) [No such file or directory] >[2016-04-19 07:24:49.474106] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.476838] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f863eb2d-7fd6-4d62-952d-4f6a92d0ae80. (Possible split-brain) >[2016-04-19 07:24:49.477571] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80> (f863eb2d-7fd6-4d62-952d-4f6a92d0ae80) [No such file or directory] >[2016-04-19 07:24:49.477663] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80> (f863eb2d-7fd6-4d62-952d-4f6a92d0ae80) [No such file or directory] >[2016-04-19 07:24:49.480224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80> (f863eb2d-7fd6-4d62-952d-4f6a92d0ae80) [No such file or directory] >[2016-04-19 07:24:49.480303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80> (f863eb2d-7fd6-4d62-952d-4f6a92d0ae80) [No such file or directory] >[2016-04-19 07:24:49.480537] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f863eb2d-7fd6-4d62-952d-4f6a92d0ae80>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.488708] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.489606] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac> (83e7f3c6-5efc-4b3a-b080-d336524468ac) [No such file or directory] >[2016-04-19 07:24:49.489686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac> (83e7f3c6-5efc-4b3a-b080-d336524468ac) [No such file or directory] >[2016-04-19 07:24:49.490802] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 83e7f3c6-5efc-4b3a-b080-d336524468ac. (Possible split-brain) >[2016-04-19 07:24:49.491695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac> (83e7f3c6-5efc-4b3a-b080-d336524468ac) [No such file or directory] >[2016-04-19 07:24:49.491788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac> (83e7f3c6-5efc-4b3a-b080-d336524468ac) [No such file or directory] >[2016-04-19 07:24:49.493149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac> (83e7f3c6-5efc-4b3a-b080-d336524468ac) [No such file or directory] >[2016-04-19 07:24:49.493370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac> (83e7f3c6-5efc-4b3a-b080-d336524468ac) [No such file or directory] >[2016-04-19 07:24:49.493489] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.495957] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 83e7f3c6-5efc-4b3a-b080-d336524468ac. (Possible split-brain) >[2016-04-19 07:24:49.496910] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac> (83e7f3c6-5efc-4b3a-b080-d336524468ac) [No such file or directory] >[2016-04-19 07:24:49.496927] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac> (83e7f3c6-5efc-4b3a-b080-d336524468ac) [No such file or directory] >[2016-04-19 07:24:49.499833] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac> (83e7f3c6-5efc-4b3a-b080-d336524468ac) [No such file or directory] >[2016-04-19 07:24:49.499935] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac> (83e7f3c6-5efc-4b3a-b080-d336524468ac) [No such file or directory] >[2016-04-19 07:24:49.500043] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:83e7f3c6-5efc-4b3a-b080-d336524468ac>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.508796] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.509718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04> (f8df0c5c-1003-4847-8ccc-dbec0f80cc04) [No such file or directory] >[2016-04-19 07:24:49.509740] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04> (f8df0c5c-1003-4847-8ccc-dbec0f80cc04) [No such file or directory] >[2016-04-19 07:24:49.510853] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f8df0c5c-1003-4847-8ccc-dbec0f80cc04. (Possible split-brain) >[2016-04-19 07:24:49.511700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04> (f8df0c5c-1003-4847-8ccc-dbec0f80cc04) [No such file or directory] >[2016-04-19 07:24:49.511779] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04> (f8df0c5c-1003-4847-8ccc-dbec0f80cc04) [No such file or directory] >[2016-04-19 07:24:49.513106] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04> (f8df0c5c-1003-4847-8ccc-dbec0f80cc04) [No such file or directory] >[2016-04-19 07:24:49.513183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04> (f8df0c5c-1003-4847-8ccc-dbec0f80cc04) [No such file or directory] >[2016-04-19 07:24:49.513338] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.516062] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f8df0c5c-1003-4847-8ccc-dbec0f80cc04. (Possible split-brain) >[2016-04-19 07:24:49.516742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04> (f8df0c5c-1003-4847-8ccc-dbec0f80cc04) [No such file or directory] >[2016-04-19 07:24:49.517070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04> (f8df0c5c-1003-4847-8ccc-dbec0f80cc04) [No such file or directory] >[2016-04-19 07:24:49.519644] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04> (f8df0c5c-1003-4847-8ccc-dbec0f80cc04) [No such file or directory] >[2016-04-19 07:24:49.519732] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04> (f8df0c5c-1003-4847-8ccc-dbec0f80cc04) [No such file or directory] >[2016-04-19 07:24:49.519855] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f8df0c5c-1003-4847-8ccc-dbec0f80cc04>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.528075] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.528987] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f9eed684-54be-403e-878e-baba34d077fa> (f9eed684-54be-403e-878e-baba34d077fa) [No such file or directory] >[2016-04-19 07:24:49.529070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f9eed684-54be-403e-878e-baba34d077fa> (f9eed684-54be-403e-878e-baba34d077fa) [No such file or directory] >[2016-04-19 07:24:49.531898] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f9eed684-54be-403e-878e-baba34d077fa. (Possible split-brain) >[2016-04-19 07:24:49.532920] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f9eed684-54be-403e-878e-baba34d077fa> (f9eed684-54be-403e-878e-baba34d077fa) [No such file or directory] >[2016-04-19 07:24:49.533021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f9eed684-54be-403e-878e-baba34d077fa> (f9eed684-54be-403e-878e-baba34d077fa) [No such file or directory] >[2016-04-19 07:24:49.534414] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f9eed684-54be-403e-878e-baba34d077fa> (f9eed684-54be-403e-878e-baba34d077fa) [No such file or directory] >[2016-04-19 07:24:49.534582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f9eed684-54be-403e-878e-baba34d077fa> (f9eed684-54be-403e-878e-baba34d077fa) [No such file or directory] >[2016-04-19 07:24:49.534696] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f9eed684-54be-403e-878e-baba34d077fa>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.537194] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f9eed684-54be-403e-878e-baba34d077fa. (Possible split-brain) >[2016-04-19 07:24:49.538094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f9eed684-54be-403e-878e-baba34d077fa> (f9eed684-54be-403e-878e-baba34d077fa) [No such file or directory] >[2016-04-19 07:24:49.538165] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f9eed684-54be-403e-878e-baba34d077fa> (f9eed684-54be-403e-878e-baba34d077fa) [No such file or directory] >[2016-04-19 07:24:49.541093] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f9eed684-54be-403e-878e-baba34d077fa> (f9eed684-54be-403e-878e-baba34d077fa) [No such file or directory] >[2016-04-19 07:24:49.541172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f9eed684-54be-403e-878e-baba34d077fa> (f9eed684-54be-403e-878e-baba34d077fa) [No such file or directory] >[2016-04-19 07:24:49.541380] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f9eed684-54be-403e-878e-baba34d077fa>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.550115] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.551063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f> (9fdfb802-3743-4ebb-b2b7-aab634a7f08f) [No such file or directory] >[2016-04-19 07:24:49.551154] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f> (9fdfb802-3743-4ebb-b2b7-aab634a7f08f) [No such file or directory] >[2016-04-19 07:24:49.552217] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9fdfb802-3743-4ebb-b2b7-aab634a7f08f. (Possible split-brain) >[2016-04-19 07:24:49.553082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f> (9fdfb802-3743-4ebb-b2b7-aab634a7f08f) [No such file or directory] >[2016-04-19 07:24:49.553543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f> (9fdfb802-3743-4ebb-b2b7-aab634a7f08f) [No such file or directory] >[2016-04-19 07:24:49.555082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f> (9fdfb802-3743-4ebb-b2b7-aab634a7f08f) [No such file or directory] >[2016-04-19 07:24:49.555238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f> (9fdfb802-3743-4ebb-b2b7-aab634a7f08f) [No such file or directory] >[2016-04-19 07:24:49.555366] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.558135] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9fdfb802-3743-4ebb-b2b7-aab634a7f08f. (Possible split-brain) >[2016-04-19 07:24:49.559092] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f> (9fdfb802-3743-4ebb-b2b7-aab634a7f08f) [No such file or directory] >[2016-04-19 07:24:49.559384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f> (9fdfb802-3743-4ebb-b2b7-aab634a7f08f) [No such file or directory] >[2016-04-19 07:24:49.562194] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f> (9fdfb802-3743-4ebb-b2b7-aab634a7f08f) [No such file or directory] >[2016-04-19 07:24:49.562199] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f> (9fdfb802-3743-4ebb-b2b7-aab634a7f08f) [No such file or directory] >[2016-04-19 07:24:49.562367] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9fdfb802-3743-4ebb-b2b7-aab634a7f08f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.570559] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.571478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c392423-b134-4de4-bf79-91116e7962fe> (7c392423-b134-4de4-bf79-91116e7962fe) [No such file or directory] >[2016-04-19 07:24:49.571514] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c392423-b134-4de4-bf79-91116e7962fe> (7c392423-b134-4de4-bf79-91116e7962fe) [No such file or directory] >[2016-04-19 07:24:49.574271] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7c392423-b134-4de4-bf79-91116e7962fe. (Possible split-brain) >[2016-04-19 07:24:49.575261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c392423-b134-4de4-bf79-91116e7962fe> (7c392423-b134-4de4-bf79-91116e7962fe) [No such file or directory] >[2016-04-19 07:24:49.575609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c392423-b134-4de4-bf79-91116e7962fe> (7c392423-b134-4de4-bf79-91116e7962fe) [No such file or directory] >[2016-04-19 07:24:49.576936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c392423-b134-4de4-bf79-91116e7962fe> (7c392423-b134-4de4-bf79-91116e7962fe) [No such file or directory] >[2016-04-19 07:24:49.576959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c392423-b134-4de4-bf79-91116e7962fe> (7c392423-b134-4de4-bf79-91116e7962fe) [No such file or directory] >[2016-04-19 07:24:49.577109] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7c392423-b134-4de4-bf79-91116e7962fe>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.579660] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7c392423-b134-4de4-bf79-91116e7962fe. (Possible split-brain) >[2016-04-19 07:24:49.580448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c392423-b134-4de4-bf79-91116e7962fe> (7c392423-b134-4de4-bf79-91116e7962fe) [No such file or directory] >[2016-04-19 07:24:49.580732] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c392423-b134-4de4-bf79-91116e7962fe> (7c392423-b134-4de4-bf79-91116e7962fe) [No such file or directory] >[2016-04-19 07:24:49.583582] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c392423-b134-4de4-bf79-91116e7962fe> (7c392423-b134-4de4-bf79-91116e7962fe) [No such file or directory] >[2016-04-19 07:24:49.583592] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c392423-b134-4de4-bf79-91116e7962fe> (7c392423-b134-4de4-bf79-91116e7962fe) [No such file or directory] >[2016-04-19 07:24:49.583801] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7c392423-b134-4de4-bf79-91116e7962fe>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.594101] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.595056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243> (de3042d5-a8ef-4370-a651-6d68e1eaa243) [No such file or directory] >[2016-04-19 07:24:49.595395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243> (de3042d5-a8ef-4370-a651-6d68e1eaa243) [No such file or directory] >[2016-04-19 07:24:49.596503] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid de3042d5-a8ef-4370-a651-6d68e1eaa243. (Possible split-brain) >[2016-04-19 07:24:49.597594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243> (de3042d5-a8ef-4370-a651-6d68e1eaa243) [No such file or directory] >[2016-04-19 07:24:49.597623] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243> (de3042d5-a8ef-4370-a651-6d68e1eaa243) [No such file or directory] >[2016-04-19 07:24:49.599157] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243> (de3042d5-a8ef-4370-a651-6d68e1eaa243) [No such file or directory] >[2016-04-19 07:24:49.599266] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243> (de3042d5-a8ef-4370-a651-6d68e1eaa243) [No such file or directory] >[2016-04-19 07:24:49.599434] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.601991] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid de3042d5-a8ef-4370-a651-6d68e1eaa243. (Possible split-brain) >[2016-04-19 07:24:49.603012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243> (de3042d5-a8ef-4370-a651-6d68e1eaa243) [No such file or directory] >[2016-04-19 07:24:49.603108] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243> (de3042d5-a8ef-4370-a651-6d68e1eaa243) [No such file or directory] >[2016-04-19 07:24:49.605774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243> (de3042d5-a8ef-4370-a651-6d68e1eaa243) [No such file or directory] >[2016-04-19 07:24:49.606210] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243> (de3042d5-a8ef-4370-a651-6d68e1eaa243) [No such file or directory] >[2016-04-19 07:24:49.606616] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:de3042d5-a8ef-4370-a651-6d68e1eaa243>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:49.615673] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.616695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9> (9f34c946-49a7-4ad8-93de-2da3b7bea3f9) [No such file or directory] >[2016-04-19 07:24:49.616796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9> (9f34c946-49a7-4ad8-93de-2da3b7bea3f9) [No such file or directory] >[2016-04-19 07:24:49.619384] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9f34c946-49a7-4ad8-93de-2da3b7bea3f9. (Possible split-brain) >[2016-04-19 07:24:49.620371] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9> (9f34c946-49a7-4ad8-93de-2da3b7bea3f9) [No such file or directory] >[2016-04-19 07:24:49.620443] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9> (9f34c946-49a7-4ad8-93de-2da3b7bea3f9) [No such file or directory] >[2016-04-19 07:24:49.621790] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9> (9f34c946-49a7-4ad8-93de-2da3b7bea3f9) [No such file or directory] >[2016-04-19 07:24:49.622046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9> (9f34c946-49a7-4ad8-93de-2da3b7bea3f9) [No such file or directory] >[2016-04-19 07:24:49.622226] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.624933] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9f34c946-49a7-4ad8-93de-2da3b7bea3f9. (Possible split-brain) >[2016-04-19 07:24:49.625956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9> (9f34c946-49a7-4ad8-93de-2da3b7bea3f9) [No such file or directory] >[2016-04-19 07:24:49.625985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9> (9f34c946-49a7-4ad8-93de-2da3b7bea3f9) [No such file or directory] >[2016-04-19 07:24:49.629079] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9> (9f34c946-49a7-4ad8-93de-2da3b7bea3f9) [No such file or directory] >[2016-04-19 07:24:49.629571] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9> (9f34c946-49a7-4ad8-93de-2da3b7bea3f9) [No such file or directory] >[2016-04-19 07:24:49.629739] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9f34c946-49a7-4ad8-93de-2da3b7bea3f9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.639451] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.640423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2> (36437bb9-7bf5-4c30-a4c9-53ae705f0bb2) [No such file or directory] >[2016-04-19 07:24:49.640782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2> (36437bb9-7bf5-4c30-a4c9-53ae705f0bb2) [No such file or directory] >[2016-04-19 07:24:49.643661] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 36437bb9-7bf5-4c30-a4c9-53ae705f0bb2. (Possible split-brain) >[2016-04-19 07:24:49.644466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2> (36437bb9-7bf5-4c30-a4c9-53ae705f0bb2) [No such file or directory] >[2016-04-19 07:24:49.644747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2> (36437bb9-7bf5-4c30-a4c9-53ae705f0bb2) [No such file or directory] >[2016-04-19 07:24:49.646050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2> (36437bb9-7bf5-4c30-a4c9-53ae705f0bb2) [No such file or directory] >[2016-04-19 07:24:49.646136] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2> (36437bb9-7bf5-4c30-a4c9-53ae705f0bb2) [No such file or directory] >[2016-04-19 07:24:49.646378] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:49.649104] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 36437bb9-7bf5-4c30-a4c9-53ae705f0bb2. (Possible split-brain) >[2016-04-19 07:24:49.650406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2> (36437bb9-7bf5-4c30-a4c9-53ae705f0bb2) [No such file or directory] >[2016-04-19 07:24:49.650489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2> (36437bb9-7bf5-4c30-a4c9-53ae705f0bb2) [No such file or directory] >[2016-04-19 07:24:49.653759] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2> (36437bb9-7bf5-4c30-a4c9-53ae705f0bb2) [No such file or directory] >[2016-04-19 07:24:49.653781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2> (36437bb9-7bf5-4c30-a4c9-53ae705f0bb2) [No such file or directory] >[2016-04-19 07:24:49.654033] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:36437bb9-7bf5-4c30-a4c9-53ae705f0bb2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:49.663371] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.664594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584> (40c57751-99cc-4d32-9011-d3ad4851f584) [No such file or directory] >[2016-04-19 07:24:49.664607] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584> (40c57751-99cc-4d32-9011-d3ad4851f584) [No such file or directory] >[2016-04-19 07:24:49.665733] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 40c57751-99cc-4d32-9011-d3ad4851f584. (Possible split-brain) >[2016-04-19 07:24:49.666549] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584> (40c57751-99cc-4d32-9011-d3ad4851f584) [No such file or directory] >[2016-04-19 07:24:49.666920] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584> (40c57751-99cc-4d32-9011-d3ad4851f584) [No such file or directory] >[2016-04-19 07:24:49.668249] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584> (40c57751-99cc-4d32-9011-d3ad4851f584) [No such file or directory] >[2016-04-19 07:24:49.668370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584> (40c57751-99cc-4d32-9011-d3ad4851f584) [No such file or directory] >[2016-04-19 07:24:49.668496] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.671229] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 40c57751-99cc-4d32-9011-d3ad4851f584. (Possible split-brain) >[2016-04-19 07:24:49.672149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584> (40c57751-99cc-4d32-9011-d3ad4851f584) [No such file or directory] >[2016-04-19 07:24:49.672426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584> (40c57751-99cc-4d32-9011-d3ad4851f584) [No such file or directory] >[2016-04-19 07:24:49.675175] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584> (40c57751-99cc-4d32-9011-d3ad4851f584) [No such file or directory] >[2016-04-19 07:24:49.675195] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584> (40c57751-99cc-4d32-9011-d3ad4851f584) [No such file or directory] >[2016-04-19 07:24:49.675368] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:40c57751-99cc-4d32-9011-d3ad4851f584>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.685845] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.686932] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f0feb171-2cef-483d-8232-8a1d93087699> (f0feb171-2cef-483d-8232-8a1d93087699) [No such file or directory] >[2016-04-19 07:24:49.687011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f0feb171-2cef-483d-8232-8a1d93087699> (f0feb171-2cef-483d-8232-8a1d93087699) [No such file or directory] >[2016-04-19 07:24:49.689903] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f0feb171-2cef-483d-8232-8a1d93087699. (Possible split-brain) >[2016-04-19 07:24:49.690827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f0feb171-2cef-483d-8232-8a1d93087699> (f0feb171-2cef-483d-8232-8a1d93087699) [No such file or directory] >[2016-04-19 07:24:49.691120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f0feb171-2cef-483d-8232-8a1d93087699> (f0feb171-2cef-483d-8232-8a1d93087699) [No such file or directory] >[2016-04-19 07:24:49.692363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f0feb171-2cef-483d-8232-8a1d93087699> (f0feb171-2cef-483d-8232-8a1d93087699) [No such file or directory] >[2016-04-19 07:24:49.692379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f0feb171-2cef-483d-8232-8a1d93087699> (f0feb171-2cef-483d-8232-8a1d93087699) [No such file or directory] >[2016-04-19 07:24:49.692809] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f0feb171-2cef-483d-8232-8a1d93087699>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:49.695410] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f0feb171-2cef-483d-8232-8a1d93087699. (Possible split-brain) >[2016-04-19 07:24:49.696541] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f0feb171-2cef-483d-8232-8a1d93087699> (f0feb171-2cef-483d-8232-8a1d93087699) [No such file or directory] >[2016-04-19 07:24:49.696652] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f0feb171-2cef-483d-8232-8a1d93087699> (f0feb171-2cef-483d-8232-8a1d93087699) [No such file or directory] >[2016-04-19 07:24:49.699355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f0feb171-2cef-483d-8232-8a1d93087699> (f0feb171-2cef-483d-8232-8a1d93087699) [No such file or directory] >[2016-04-19 07:24:49.699379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f0feb171-2cef-483d-8232-8a1d93087699> (f0feb171-2cef-483d-8232-8a1d93087699) [No such file or directory] >[2016-04-19 07:24:49.699598] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f0feb171-2cef-483d-8232-8a1d93087699>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.708176] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.709306] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75> (d85dcd06-4bd5-422a-9769-6c23a2c4ab75) [No such file or directory] >[2016-04-19 07:24:49.709310] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75> (d85dcd06-4bd5-422a-9769-6c23a2c4ab75) [No such file or directory] >[2016-04-19 07:24:49.710497] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d85dcd06-4bd5-422a-9769-6c23a2c4ab75. (Possible split-brain) >[2016-04-19 07:24:49.711573] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75> (d85dcd06-4bd5-422a-9769-6c23a2c4ab75) [No such file or directory] >[2016-04-19 07:24:49.711666] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75> (d85dcd06-4bd5-422a-9769-6c23a2c4ab75) [No such file or directory] >[2016-04-19 07:24:49.713006] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75> (d85dcd06-4bd5-422a-9769-6c23a2c4ab75) [No such file or directory] >[2016-04-19 07:24:49.713091] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75> (d85dcd06-4bd5-422a-9769-6c23a2c4ab75) [No such file or directory] >[2016-04-19 07:24:49.713284] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.715884] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d85dcd06-4bd5-422a-9769-6c23a2c4ab75. (Possible split-brain) >[2016-04-19 07:24:49.716692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75> (d85dcd06-4bd5-422a-9769-6c23a2c4ab75) [No such file or directory] >[2016-04-19 07:24:49.716921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75> (d85dcd06-4bd5-422a-9769-6c23a2c4ab75) [No such file or directory] >[2016-04-19 07:24:49.720009] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75> (d85dcd06-4bd5-422a-9769-6c23a2c4ab75) [No such file or directory] >[2016-04-19 07:24:49.720085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75> (d85dcd06-4bd5-422a-9769-6c23a2c4ab75) [No such file or directory] >[2016-04-19 07:24:49.720791] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d85dcd06-4bd5-422a-9769-6c23a2c4ab75>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:49.729261] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.730342] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:05233512-d28f-471f-99df-5c50597fd50e> (05233512-d28f-471f-99df-5c50597fd50e) [No such file or directory] >[2016-04-19 07:24:49.730311] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:05233512-d28f-471f-99df-5c50597fd50e> (05233512-d28f-471f-99df-5c50597fd50e) [No such file or directory] >[2016-04-19 07:24:49.733012] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 05233512-d28f-471f-99df-5c50597fd50e. (Possible split-brain) >[2016-04-19 07:24:49.733971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:05233512-d28f-471f-99df-5c50597fd50e> (05233512-d28f-471f-99df-5c50597fd50e) [No such file or directory] >[2016-04-19 07:24:49.734097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:05233512-d28f-471f-99df-5c50597fd50e> (05233512-d28f-471f-99df-5c50597fd50e) [No such file or directory] >[2016-04-19 07:24:49.735283] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:05233512-d28f-471f-99df-5c50597fd50e> (05233512-d28f-471f-99df-5c50597fd50e) [No such file or directory] >[2016-04-19 07:24:49.735414] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:05233512-d28f-471f-99df-5c50597fd50e> (05233512-d28f-471f-99df-5c50597fd50e) [No such file or directory] >[2016-04-19 07:24:49.735575] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:05233512-d28f-471f-99df-5c50597fd50e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.738286] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 05233512-d28f-471f-99df-5c50597fd50e. (Possible split-brain) >[2016-04-19 07:24:49.739136] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:05233512-d28f-471f-99df-5c50597fd50e> (05233512-d28f-471f-99df-5c50597fd50e) [No such file or directory] >[2016-04-19 07:24:49.739415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:05233512-d28f-471f-99df-5c50597fd50e> (05233512-d28f-471f-99df-5c50597fd50e) [No such file or directory] >[2016-04-19 07:24:49.742552] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:05233512-d28f-471f-99df-5c50597fd50e> (05233512-d28f-471f-99df-5c50597fd50e) [No such file or directory] >[2016-04-19 07:24:49.742881] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:05233512-d28f-471f-99df-5c50597fd50e> (05233512-d28f-471f-99df-5c50597fd50e) [No such file or directory] >[2016-04-19 07:24:49.743119] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:05233512-d28f-471f-99df-5c50597fd50e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.751918] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.752783] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c> (e97db415-d6d5-47d5-b432-4ab7ea92281c) [No such file or directory] >[2016-04-19 07:24:49.752973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c> (e97db415-d6d5-47d5-b432-4ab7ea92281c) [No such file or directory] >[2016-04-19 07:24:49.755900] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e97db415-d6d5-47d5-b432-4ab7ea92281c. (Possible split-brain) >[2016-04-19 07:24:49.756811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c> (e97db415-d6d5-47d5-b432-4ab7ea92281c) [No such file or directory] >[2016-04-19 07:24:49.756921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c> (e97db415-d6d5-47d5-b432-4ab7ea92281c) [No such file or directory] >[2016-04-19 07:24:49.758351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c> (e97db415-d6d5-47d5-b432-4ab7ea92281c) [No such file or directory] >[2016-04-19 07:24:49.758374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c> (e97db415-d6d5-47d5-b432-4ab7ea92281c) [No such file or directory] >[2016-04-19 07:24:49.758505] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.761234] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e97db415-d6d5-47d5-b432-4ab7ea92281c. (Possible split-brain) >[2016-04-19 07:24:49.762142] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c> (e97db415-d6d5-47d5-b432-4ab7ea92281c) [No such file or directory] >[2016-04-19 07:24:49.762231] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c> (e97db415-d6d5-47d5-b432-4ab7ea92281c) [No such file or directory] >[2016-04-19 07:24:49.765392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c> (e97db415-d6d5-47d5-b432-4ab7ea92281c) [No such file or directory] >[2016-04-19 07:24:49.765480] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c> (e97db415-d6d5-47d5-b432-4ab7ea92281c) [No such file or directory] >[2016-04-19 07:24:49.765689] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e97db415-d6d5-47d5-b432-4ab7ea92281c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.774247] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.775083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d> (2e52e23f-99a7-4597-900c-0077f0d1194d) [No such file or directory] >[2016-04-19 07:24:49.775174] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d> (2e52e23f-99a7-4597-900c-0077f0d1194d) [No such file or directory] >[2016-04-19 07:24:49.777976] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e52e23f-99a7-4597-900c-0077f0d1194d. (Possible split-brain) >[2016-04-19 07:24:49.778958] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d> (2e52e23f-99a7-4597-900c-0077f0d1194d) [No such file or directory] >[2016-04-19 07:24:49.779051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d> (2e52e23f-99a7-4597-900c-0077f0d1194d) [No such file or directory] >[2016-04-19 07:24:49.780521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d> (2e52e23f-99a7-4597-900c-0077f0d1194d) [No such file or directory] >[2016-04-19 07:24:49.780540] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d> (2e52e23f-99a7-4597-900c-0077f0d1194d) [No such file or directory] >[2016-04-19 07:24:49.780704] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.783478] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e52e23f-99a7-4597-900c-0077f0d1194d. (Possible split-brain) >[2016-04-19 07:24:49.784229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d> (2e52e23f-99a7-4597-900c-0077f0d1194d) [No such file or directory] >[2016-04-19 07:24:49.784532] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d> (2e52e23f-99a7-4597-900c-0077f0d1194d) [No such file or directory] >[2016-04-19 07:24:49.787648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d> (2e52e23f-99a7-4597-900c-0077f0d1194d) [No such file or directory] >[2016-04-19 07:24:49.787971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d> (2e52e23f-99a7-4597-900c-0077f0d1194d) [No such file or directory] >[2016-04-19 07:24:49.788130] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2e52e23f-99a7-4597-900c-0077f0d1194d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.797364] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.798222] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8> (595fea46-f29b-4b42-b4ae-eaa7a5e74aa8) [No such file or directory] >[2016-04-19 07:24:49.798495] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8> (595fea46-f29b-4b42-b4ae-eaa7a5e74aa8) [No such file or directory] >[2016-04-19 07:24:49.799625] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 595fea46-f29b-4b42-b4ae-eaa7a5e74aa8. (Possible split-brain) >[2016-04-19 07:24:49.800536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8> (595fea46-f29b-4b42-b4ae-eaa7a5e74aa8) [No such file or directory] >[2016-04-19 07:24:49.800690] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8> (595fea46-f29b-4b42-b4ae-eaa7a5e74aa8) [No such file or directory] >[2016-04-19 07:24:49.801700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8> (595fea46-f29b-4b42-b4ae-eaa7a5e74aa8) [No such file or directory] >[2016-04-19 07:24:49.801823] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8> (595fea46-f29b-4b42-b4ae-eaa7a5e74aa8) [No such file or directory] >[2016-04-19 07:24:49.802000] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:49.804690] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 595fea46-f29b-4b42-b4ae-eaa7a5e74aa8. (Possible split-brain) >[2016-04-19 07:24:49.805634] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8> (595fea46-f29b-4b42-b4ae-eaa7a5e74aa8) [No such file or directory] >[2016-04-19 07:24:49.805950] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8> (595fea46-f29b-4b42-b4ae-eaa7a5e74aa8) [No such file or directory] >[2016-04-19 07:24:49.808451] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8> (595fea46-f29b-4b42-b4ae-eaa7a5e74aa8) [No such file or directory] >[2016-04-19 07:24:49.808473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8> (595fea46-f29b-4b42-b4ae-eaa7a5e74aa8) [No such file or directory] >[2016-04-19 07:24:49.808742] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:595fea46-f29b-4b42-b4ae-eaa7a5e74aa8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.817734] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.818566] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4> (e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4) [No such file or directory] >[2016-04-19 07:24:49.818726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4> (e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4) [No such file or directory] >[2016-04-19 07:24:49.819897] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4. (Possible split-brain) >[2016-04-19 07:24:49.820688] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4> (e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4) [No such file or directory] >[2016-04-19 07:24:49.820711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4> (e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4) [No such file or directory] >[2016-04-19 07:24:49.821867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4> (e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4) [No such file or directory] >[2016-04-19 07:24:49.822034] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4> (e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4) [No such file or directory] >[2016-04-19 07:24:49.822159] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.824810] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4. (Possible split-brain) >[2016-04-19 07:24:49.825562] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4> (e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4) [No such file or directory] >[2016-04-19 07:24:49.825685] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4> (e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4) [No such file or directory] >[2016-04-19 07:24:49.828845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4> (e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4) [No such file or directory] >[2016-04-19 07:24:49.829016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4> (e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4) [No such file or directory] >[2016-04-19 07:24:49.829258] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e6fb1ce0-7769-4524-bfef-b7f2d06e4ba4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.839399] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.840428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789> (c6df48e5-8d37-4b15-b66a-f3007a14b789) [No such file or directory] >[2016-04-19 07:24:49.840609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789> (c6df48e5-8d37-4b15-b66a-f3007a14b789) [No such file or directory] >[2016-04-19 07:24:49.843465] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c6df48e5-8d37-4b15-b66a-f3007a14b789. (Possible split-brain) >[2016-04-19 07:24:49.844478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789> (c6df48e5-8d37-4b15-b66a-f3007a14b789) [No such file or directory] >[2016-04-19 07:24:49.844511] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789> (c6df48e5-8d37-4b15-b66a-f3007a14b789) [No such file or directory] >[2016-04-19 07:24:49.845791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789> (c6df48e5-8d37-4b15-b66a-f3007a14b789) [No such file or directory] >[2016-04-19 07:24:49.845874] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789> (c6df48e5-8d37-4b15-b66a-f3007a14b789) [No such file or directory] >[2016-04-19 07:24:49.846009] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.848744] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c6df48e5-8d37-4b15-b66a-f3007a14b789. (Possible split-brain) >[2016-04-19 07:24:49.849771] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789> (c6df48e5-8d37-4b15-b66a-f3007a14b789) [No such file or directory] >[2016-04-19 07:24:49.849852] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789> (c6df48e5-8d37-4b15-b66a-f3007a14b789) [No such file or directory] >[2016-04-19 07:24:49.852599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789> (c6df48e5-8d37-4b15-b66a-f3007a14b789) [No such file or directory] >[2016-04-19 07:24:49.852811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789> (c6df48e5-8d37-4b15-b66a-f3007a14b789) [No such file or directory] >[2016-04-19 07:24:49.852940] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c6df48e5-8d37-4b15-b66a-f3007a14b789>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.861623] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.862537] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d> (c0331199-1207-4179-b536-5ca1e8b8321d) [No such file or directory] >[2016-04-19 07:24:49.862567] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d> (c0331199-1207-4179-b536-5ca1e8b8321d) [No such file or directory] >[2016-04-19 07:24:49.863667] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c0331199-1207-4179-b536-5ca1e8b8321d. (Possible split-brain) >[2016-04-19 07:24:49.864377] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d> (c0331199-1207-4179-b536-5ca1e8b8321d) [No such file or directory] >[2016-04-19 07:24:49.864748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d> (c0331199-1207-4179-b536-5ca1e8b8321d) [No such file or directory] >[2016-04-19 07:24:49.865965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d> (c0331199-1207-4179-b536-5ca1e8b8321d) [No such file or directory] >[2016-04-19 07:24:49.866277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d> (c0331199-1207-4179-b536-5ca1e8b8321d) [No such file or directory] >[2016-04-19 07:24:49.866479] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.869168] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c0331199-1207-4179-b536-5ca1e8b8321d. (Possible split-brain) >[2016-04-19 07:24:49.869949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d> (c0331199-1207-4179-b536-5ca1e8b8321d) [No such file or directory] >[2016-04-19 07:24:49.870047] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d> (c0331199-1207-4179-b536-5ca1e8b8321d) [No such file or directory] >[2016-04-19 07:24:49.872644] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d> (c0331199-1207-4179-b536-5ca1e8b8321d) [No such file or directory] >[2016-04-19 07:24:49.872842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d> (c0331199-1207-4179-b536-5ca1e8b8321d) [No such file or directory] >[2016-04-19 07:24:49.872962] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c0331199-1207-4179-b536-5ca1e8b8321d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.881869] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.882622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96> (f35ee6c5-148e-4572-99a3-c9856f173b96) [No such file or directory] >[2016-04-19 07:24:49.882925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96> (f35ee6c5-148e-4572-99a3-c9856f173b96) [No such file or directory] >[2016-04-19 07:24:49.884091] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f35ee6c5-148e-4572-99a3-c9856f173b96. (Possible split-brain) >[2016-04-19 07:24:49.884920] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96> (f35ee6c5-148e-4572-99a3-c9856f173b96) [No such file or directory] >[2016-04-19 07:24:49.885095] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96> (f35ee6c5-148e-4572-99a3-c9856f173b96) [No such file or directory] >[2016-04-19 07:24:49.886487] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96> (f35ee6c5-148e-4572-99a3-c9856f173b96) [No such file or directory] >[2016-04-19 07:24:49.886641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96> (f35ee6c5-148e-4572-99a3-c9856f173b96) [No such file or directory] >[2016-04-19 07:24:49.886863] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.889478] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f35ee6c5-148e-4572-99a3-c9856f173b96. (Possible split-brain) >[2016-04-19 07:24:49.890219] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96> (f35ee6c5-148e-4572-99a3-c9856f173b96) [No such file or directory] >[2016-04-19 07:24:49.890594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96> (f35ee6c5-148e-4572-99a3-c9856f173b96) [No such file or directory] >[2016-04-19 07:24:49.893402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96> (f35ee6c5-148e-4572-99a3-c9856f173b96) [No such file or directory] >[2016-04-19 07:24:49.893709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96> (f35ee6c5-148e-4572-99a3-c9856f173b96) [No such file or directory] >[2016-04-19 07:24:49.893850] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f35ee6c5-148e-4572-99a3-c9856f173b96>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.902963] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.903703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5> (c75be44b-b2e5-4f47-ada6-369ced5bcec5) [No such file or directory] >[2016-04-19 07:24:49.903911] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5> (c75be44b-b2e5-4f47-ada6-369ced5bcec5) [No such file or directory] >[2016-04-19 07:24:49.906763] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c75be44b-b2e5-4f47-ada6-369ced5bcec5. (Possible split-brain) >[2016-04-19 07:24:49.907533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5> (c75be44b-b2e5-4f47-ada6-369ced5bcec5) [No such file or directory] >[2016-04-19 07:24:49.907744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5> (c75be44b-b2e5-4f47-ada6-369ced5bcec5) [No such file or directory] >[2016-04-19 07:24:49.909115] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5> (c75be44b-b2e5-4f47-ada6-369ced5bcec5) [No such file or directory] >[2016-04-19 07:24:49.909419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5> (c75be44b-b2e5-4f47-ada6-369ced5bcec5) [No such file or directory] >[2016-04-19 07:24:49.909606] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.912313] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c75be44b-b2e5-4f47-ada6-369ced5bcec5. (Possible split-brain) >[2016-04-19 07:24:49.913114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5> (c75be44b-b2e5-4f47-ada6-369ced5bcec5) [No such file or directory] >[2016-04-19 07:24:49.913525] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5> (c75be44b-b2e5-4f47-ada6-369ced5bcec5) [No such file or directory] >[2016-04-19 07:24:49.916380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5> (c75be44b-b2e5-4f47-ada6-369ced5bcec5) [No such file or directory] >[2016-04-19 07:24:49.916630] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5> (c75be44b-b2e5-4f47-ada6-369ced5bcec5) [No such file or directory] >[2016-04-19 07:24:49.916759] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c75be44b-b2e5-4f47-ada6-369ced5bcec5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.924664] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.925701] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622> (c6db60c0-fe46-4e37-9fac-059ed2581622) [No such file or directory] >[2016-04-19 07:24:49.925714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622> (c6db60c0-fe46-4e37-9fac-059ed2581622) [No such file or directory] >[2016-04-19 07:24:49.928560] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c6db60c0-fe46-4e37-9fac-059ed2581622. (Possible split-brain) >[2016-04-19 07:24:49.929382] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622> (c6db60c0-fe46-4e37-9fac-059ed2581622) [No such file or directory] >[2016-04-19 07:24:49.929722] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622> (c6db60c0-fe46-4e37-9fac-059ed2581622) [No such file or directory] >[2016-04-19 07:24:49.931355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622> (c6db60c0-fe46-4e37-9fac-059ed2581622) [No such file or directory] >[2016-04-19 07:24:49.931423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622> (c6db60c0-fe46-4e37-9fac-059ed2581622) [No such file or directory] >[2016-04-19 07:24:49.931702] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.934440] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c6db60c0-fe46-4e37-9fac-059ed2581622. (Possible split-brain) >[2016-04-19 07:24:49.935183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622> (c6db60c0-fe46-4e37-9fac-059ed2581622) [No such file or directory] >[2016-04-19 07:24:49.935620] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622> (c6db60c0-fe46-4e37-9fac-059ed2581622) [No such file or directory] >[2016-04-19 07:24:49.938730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622> (c6db60c0-fe46-4e37-9fac-059ed2581622) [No such file or directory] >[2016-04-19 07:24:49.938812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622> (c6db60c0-fe46-4e37-9fac-059ed2581622) [No such file or directory] >[2016-04-19 07:24:49.938948] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c6db60c0-fe46-4e37-9fac-059ed2581622>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.948641] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.949499] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd> (bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd) [No such file or directory] >[2016-04-19 07:24:49.949787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd> (bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd) [No such file or directory] >[2016-04-19 07:24:49.952613] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd. (Possible split-brain) >[2016-04-19 07:24:49.953644] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd> (bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd) [No such file or directory] >[2016-04-19 07:24:49.953808] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd> (bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd) [No such file or directory] >[2016-04-19 07:24:49.955062] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd> (bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd) [No such file or directory] >[2016-04-19 07:24:49.955091] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd> (bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd) [No such file or directory] >[2016-04-19 07:24:49.955456] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:49.958151] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd. (Possible split-brain) >[2016-04-19 07:24:49.959311] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd> (bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd) [No such file or directory] >[2016-04-19 07:24:49.959494] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd> (bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd) [No such file or directory] >[2016-04-19 07:24:49.962265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd> (bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd) [No such file or directory] >[2016-04-19 07:24:49.962457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd> (bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd) [No such file or directory] >[2016-04-19 07:24:49.962645] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bfda8b29-7bc0-4fb6-b1dc-af71c4a1eadd>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:49.969876] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.970487] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1> (10fbbfb3-e205-4cda-acc8-e2fa045349b1) [No such file or directory] >[2016-04-19 07:24:49.970642] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1> (10fbbfb3-e205-4cda-acc8-e2fa045349b1) [No such file or directory] >[2016-04-19 07:24:49.971523] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 10fbbfb3-e205-4cda-acc8-e2fa045349b1. (Possible split-brain) >[2016-04-19 07:24:49.972143] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1> (10fbbfb3-e205-4cda-acc8-e2fa045349b1) [No such file or directory] >[2016-04-19 07:24:49.972362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1> (10fbbfb3-e205-4cda-acc8-e2fa045349b1) [No such file or directory] >[2016-04-19 07:24:49.973504] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1> (10fbbfb3-e205-4cda-acc8-e2fa045349b1) [No such file or directory] >[2016-04-19 07:24:49.973637] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1> (10fbbfb3-e205-4cda-acc8-e2fa045349b1) [No such file or directory] >[2016-04-19 07:24:49.973777] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.976458] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 10fbbfb3-e205-4cda-acc8-e2fa045349b1. (Possible split-brain) >[2016-04-19 07:24:49.976973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1> (10fbbfb3-e205-4cda-acc8-e2fa045349b1) [No such file or directory] >[2016-04-19 07:24:49.977694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1> (10fbbfb3-e205-4cda-acc8-e2fa045349b1) [No such file or directory] >[2016-04-19 07:24:49.980521] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1> (10fbbfb3-e205-4cda-acc8-e2fa045349b1) [No such file or directory] >[2016-04-19 07:24:49.980659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1> (10fbbfb3-e205-4cda-acc8-e2fa045349b1) [No such file or directory] >[2016-04-19 07:24:49.980829] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:10fbbfb3-e205-4cda-acc8-e2fa045349b1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:49.989375] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:49.990183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81> (e3de3b71-6fa5-49d2-9946-a8d800c12b81) [No such file or directory] >[2016-04-19 07:24:49.990371] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81> (e3de3b71-6fa5-49d2-9946-a8d800c12b81) [No such file or directory] >[2016-04-19 07:24:49.991196] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e3de3b71-6fa5-49d2-9946-a8d800c12b81. (Possible split-brain) >[2016-04-19 07:24:49.992123] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81> (e3de3b71-6fa5-49d2-9946-a8d800c12b81) [No such file or directory] >[2016-04-19 07:24:49.992448] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81> (e3de3b71-6fa5-49d2-9946-a8d800c12b81) [No such file or directory] >[2016-04-19 07:24:49.993526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81> (e3de3b71-6fa5-49d2-9946-a8d800c12b81) [No such file or directory] >[2016-04-19 07:24:49.993920] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81> (e3de3b71-6fa5-49d2-9946-a8d800c12b81) [No such file or directory] >[2016-04-19 07:24:49.994068] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:49.996601] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e3de3b71-6fa5-49d2-9946-a8d800c12b81. (Possible split-brain) >[2016-04-19 07:24:49.997460] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81> (e3de3b71-6fa5-49d2-9946-a8d800c12b81) [No such file or directory] >[2016-04-19 07:24:49.997595] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81> (e3de3b71-6fa5-49d2-9946-a8d800c12b81) [No such file or directory] >[2016-04-19 07:24:50.000564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81> (e3de3b71-6fa5-49d2-9946-a8d800c12b81) [No such file or directory] >[2016-04-19 07:24:50.000677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81> (e3de3b71-6fa5-49d2-9946-a8d800c12b81) [No such file or directory] >[2016-04-19 07:24:50.000822] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e3de3b71-6fa5-49d2-9946-a8d800c12b81>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.009338] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.010094] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769> (7bf43636-9190-45ba-9bc6-dadf11663769) [No such file or directory] >[2016-04-19 07:24:50.010303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769> (7bf43636-9190-45ba-9bc6-dadf11663769) [No such file or directory] >[2016-04-19 07:24:50.013212] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7bf43636-9190-45ba-9bc6-dadf11663769. (Possible split-brain) >[2016-04-19 07:24:50.014113] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769> (7bf43636-9190-45ba-9bc6-dadf11663769) [No such file or directory] >[2016-04-19 07:24:50.014202] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769> (7bf43636-9190-45ba-9bc6-dadf11663769) [No such file or directory] >[2016-04-19 07:24:50.015507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769> (7bf43636-9190-45ba-9bc6-dadf11663769) [No such file or directory] >[2016-04-19 07:24:50.015699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769> (7bf43636-9190-45ba-9bc6-dadf11663769) [No such file or directory] >[2016-04-19 07:24:50.015824] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.018539] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7bf43636-9190-45ba-9bc6-dadf11663769. (Possible split-brain) >[2016-04-19 07:24:50.019344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769> (7bf43636-9190-45ba-9bc6-dadf11663769) [No such file or directory] >[2016-04-19 07:24:50.019496] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769> (7bf43636-9190-45ba-9bc6-dadf11663769) [No such file or directory] >[2016-04-19 07:24:50.021970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769> (7bf43636-9190-45ba-9bc6-dadf11663769) [No such file or directory] >[2016-04-19 07:24:50.022277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769> (7bf43636-9190-45ba-9bc6-dadf11663769) [No such file or directory] >[2016-04-19 07:24:50.022438] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7bf43636-9190-45ba-9bc6-dadf11663769>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.032614] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.033717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e> (f98b4835-86a5-4f0a-9f42-0fe628caa42e) [No such file or directory] >[2016-04-19 07:24:50.033740] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e> (f98b4835-86a5-4f0a-9f42-0fe628caa42e) [No such file or directory] >[2016-04-19 07:24:50.036712] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f98b4835-86a5-4f0a-9f42-0fe628caa42e. (Possible split-brain) >[2016-04-19 07:24:50.037723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e> (f98b4835-86a5-4f0a-9f42-0fe628caa42e) [No such file or directory] >[2016-04-19 07:24:50.037754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e> (f98b4835-86a5-4f0a-9f42-0fe628caa42e) [No such file or directory] >[2016-04-19 07:24:50.039033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e> (f98b4835-86a5-4f0a-9f42-0fe628caa42e) [No such file or directory] >[2016-04-19 07:24:50.039085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e> (f98b4835-86a5-4f0a-9f42-0fe628caa42e) [No such file or directory] >[2016-04-19 07:24:50.039398] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.042153] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f98b4835-86a5-4f0a-9f42-0fe628caa42e. (Possible split-brain) >[2016-04-19 07:24:50.043134] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e> (f98b4835-86a5-4f0a-9f42-0fe628caa42e) [No such file or directory] >[2016-04-19 07:24:50.043215] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e> (f98b4835-86a5-4f0a-9f42-0fe628caa42e) [No such file or directory] >[2016-04-19 07:24:50.045858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e> (f98b4835-86a5-4f0a-9f42-0fe628caa42e) [No such file or directory] >[2016-04-19 07:24:50.046028] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e> (f98b4835-86a5-4f0a-9f42-0fe628caa42e) [No such file or directory] >[2016-04-19 07:24:50.046147] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f98b4835-86a5-4f0a-9f42-0fe628caa42e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.055345] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.056409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96> (77fe3c85-b512-4b3f-b11d-111479a7fa96) [No such file or directory] >[2016-04-19 07:24:50.056423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96> (77fe3c85-b512-4b3f-b11d-111479a7fa96) [No such file or directory] >[2016-04-19 07:24:50.059297] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 77fe3c85-b512-4b3f-b11d-111479a7fa96. (Possible split-brain) >[2016-04-19 07:24:50.060358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96> (77fe3c85-b512-4b3f-b11d-111479a7fa96) [No such file or directory] >[2016-04-19 07:24:50.060360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96> (77fe3c85-b512-4b3f-b11d-111479a7fa96) [No such file or directory] >[2016-04-19 07:24:50.061696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96> (77fe3c85-b512-4b3f-b11d-111479a7fa96) [No such file or directory] >[2016-04-19 07:24:50.061761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96> (77fe3c85-b512-4b3f-b11d-111479a7fa96) [No such file or directory] >[2016-04-19 07:24:50.061912] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.064665] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 77fe3c85-b512-4b3f-b11d-111479a7fa96. (Possible split-brain) >[2016-04-19 07:24:50.065550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96> (77fe3c85-b512-4b3f-b11d-111479a7fa96) [No such file or directory] >[2016-04-19 07:24:50.065649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96> (77fe3c85-b512-4b3f-b11d-111479a7fa96) [No such file or directory] >[2016-04-19 07:24:50.068134] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96> (77fe3c85-b512-4b3f-b11d-111479a7fa96) [No such file or directory] >[2016-04-19 07:24:50.068209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96> (77fe3c85-b512-4b3f-b11d-111479a7fa96) [No such file or directory] >[2016-04-19 07:24:50.068374] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:77fe3c85-b512-4b3f-b11d-111479a7fa96>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.077193] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.078184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a> (83c99474-b8d9-4e0a-9a97-9b8a2d40735a) [No such file or directory] >[2016-04-19 07:24:50.078237] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a> (83c99474-b8d9-4e0a-9a97-9b8a2d40735a) [No such file or directory] >[2016-04-19 07:24:50.079381] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 83c99474-b8d9-4e0a-9a97-9b8a2d40735a. (Possible split-brain) >[2016-04-19 07:24:50.080226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a> (83c99474-b8d9-4e0a-9a97-9b8a2d40735a) [No such file or directory] >[2016-04-19 07:24:50.080290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a> (83c99474-b8d9-4e0a-9a97-9b8a2d40735a) [No such file or directory] >[2016-04-19 07:24:50.081645] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a> (83c99474-b8d9-4e0a-9a97-9b8a2d40735a) [No such file or directory] >[2016-04-19 07:24:50.081664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a> (83c99474-b8d9-4e0a-9a97-9b8a2d40735a) [No such file or directory] >[2016-04-19 07:24:50.081804] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.084485] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 83c99474-b8d9-4e0a-9a97-9b8a2d40735a. (Possible split-brain) >[2016-04-19 07:24:50.085214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a> (83c99474-b8d9-4e0a-9a97-9b8a2d40735a) [No such file or directory] >[2016-04-19 07:24:50.085520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a> (83c99474-b8d9-4e0a-9a97-9b8a2d40735a) [No such file or directory] >[2016-04-19 07:24:50.088122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a> (83c99474-b8d9-4e0a-9a97-9b8a2d40735a) [No such file or directory] >[2016-04-19 07:24:50.088283] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a> (83c99474-b8d9-4e0a-9a97-9b8a2d40735a) [No such file or directory] >[2016-04-19 07:24:50.088647] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:83c99474-b8d9-4e0a-9a97-9b8a2d40735a>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:50.097566] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.098646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470> (3140ffac-c4d7-4477-afb4-04e31e989470) [No such file or directory] >[2016-04-19 07:24:50.098656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470> (3140ffac-c4d7-4477-afb4-04e31e989470) [No such file or directory] >[2016-04-19 07:24:50.099855] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3140ffac-c4d7-4477-afb4-04e31e989470. (Possible split-brain) >[2016-04-19 07:24:50.100771] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470> (3140ffac-c4d7-4477-afb4-04e31e989470) [No such file or directory] >[2016-04-19 07:24:50.101110] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470> (3140ffac-c4d7-4477-afb4-04e31e989470) [No such file or directory] >[2016-04-19 07:24:50.102152] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470> (3140ffac-c4d7-4477-afb4-04e31e989470) [No such file or directory] >[2016-04-19 07:24:50.102487] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470> (3140ffac-c4d7-4477-afb4-04e31e989470) [No such file or directory] >[2016-04-19 07:24:50.102655] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.105287] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3140ffac-c4d7-4477-afb4-04e31e989470. (Possible split-brain) >[2016-04-19 07:24:50.106395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470> (3140ffac-c4d7-4477-afb4-04e31e989470) [No such file or directory] >[2016-04-19 07:24:50.106415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470> (3140ffac-c4d7-4477-afb4-04e31e989470) [No such file or directory] >[2016-04-19 07:24:50.108896] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470> (3140ffac-c4d7-4477-afb4-04e31e989470) [No such file or directory] >[2016-04-19 07:24:50.108994] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470> (3140ffac-c4d7-4477-afb4-04e31e989470) [No such file or directory] >[2016-04-19 07:24:50.109146] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3140ffac-c4d7-4477-afb4-04e31e989470>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:50.117572] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.118346] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3> (a0ee8089-43ce-4648-b032-94f2d4a3acd3) [No such file or directory] >[2016-04-19 07:24:50.118671] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3> (a0ee8089-43ce-4648-b032-94f2d4a3acd3) [No such file or directory] >[2016-04-19 07:24:50.121540] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a0ee8089-43ce-4648-b032-94f2d4a3acd3. (Possible split-brain) >[2016-04-19 07:24:50.122210] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3> (a0ee8089-43ce-4648-b032-94f2d4a3acd3) [No such file or directory] >[2016-04-19 07:24:50.122585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3> (a0ee8089-43ce-4648-b032-94f2d4a3acd3) [No such file or directory] >[2016-04-19 07:24:50.123971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3> (a0ee8089-43ce-4648-b032-94f2d4a3acd3) [No such file or directory] >[2016-04-19 07:24:50.124000] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3> (a0ee8089-43ce-4648-b032-94f2d4a3acd3) [No such file or directory] >[2016-04-19 07:24:50.124137] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.126859] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a0ee8089-43ce-4648-b032-94f2d4a3acd3. (Possible split-brain) >[2016-04-19 07:24:50.127803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3> (a0ee8089-43ce-4648-b032-94f2d4a3acd3) [No such file or directory] >[2016-04-19 07:24:50.127816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3> (a0ee8089-43ce-4648-b032-94f2d4a3acd3) [No such file or directory] >[2016-04-19 07:24:50.130539] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3> (a0ee8089-43ce-4648-b032-94f2d4a3acd3) [No such file or directory] >[2016-04-19 07:24:50.130763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3> (a0ee8089-43ce-4648-b032-94f2d4a3acd3) [No such file or directory] >[2016-04-19 07:24:50.130932] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a0ee8089-43ce-4648-b032-94f2d4a3acd3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.140102] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.141157] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:495bf25f-de32-4620-8b59-815bda60f399> (495bf25f-de32-4620-8b59-815bda60f399) [No such file or directory] >[2016-04-19 07:24:50.141169] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:495bf25f-de32-4620-8b59-815bda60f399> (495bf25f-de32-4620-8b59-815bda60f399) [No such file or directory] >[2016-04-19 07:24:50.143797] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 495bf25f-de32-4620-8b59-815bda60f399. (Possible split-brain) >[2016-04-19 07:24:50.144787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:495bf25f-de32-4620-8b59-815bda60f399> (495bf25f-de32-4620-8b59-815bda60f399) [No such file or directory] >[2016-04-19 07:24:50.144872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:495bf25f-de32-4620-8b59-815bda60f399> (495bf25f-de32-4620-8b59-815bda60f399) [No such file or directory] >[2016-04-19 07:24:50.146192] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:495bf25f-de32-4620-8b59-815bda60f399> (495bf25f-de32-4620-8b59-815bda60f399) [No such file or directory] >[2016-04-19 07:24:50.146280] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:495bf25f-de32-4620-8b59-815bda60f399> (495bf25f-de32-4620-8b59-815bda60f399) [No such file or directory] >[2016-04-19 07:24:50.146493] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:495bf25f-de32-4620-8b59-815bda60f399>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.149167] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 495bf25f-de32-4620-8b59-815bda60f399. (Possible split-brain) >[2016-04-19 07:24:50.150127] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:495bf25f-de32-4620-8b59-815bda60f399> (495bf25f-de32-4620-8b59-815bda60f399) [No such file or directory] >[2016-04-19 07:24:50.150425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:495bf25f-de32-4620-8b59-815bda60f399> (495bf25f-de32-4620-8b59-815bda60f399) [No such file or directory] >[2016-04-19 07:24:50.152733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:495bf25f-de32-4620-8b59-815bda60f399> (495bf25f-de32-4620-8b59-815bda60f399) [No such file or directory] >[2016-04-19 07:24:50.152767] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:495bf25f-de32-4620-8b59-815bda60f399> (495bf25f-de32-4620-8b59-815bda60f399) [No such file or directory] >[2016-04-19 07:24:50.152943] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:495bf25f-de32-4620-8b59-815bda60f399>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.162000] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.162803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e> (a5238c03-d06a-4ad1-bf5e-d137cc49464e) [No such file or directory] >[2016-04-19 07:24:50.162979] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e> (a5238c03-d06a-4ad1-bf5e-d137cc49464e) [No such file or directory] >[2016-04-19 07:24:50.164055] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a5238c03-d06a-4ad1-bf5e-d137cc49464e. (Possible split-brain) >[2016-04-19 07:24:50.164756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e> (a5238c03-d06a-4ad1-bf5e-d137cc49464e) [No such file or directory] >[2016-04-19 07:24:50.165100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e> (a5238c03-d06a-4ad1-bf5e-d137cc49464e) [No such file or directory] >[2016-04-19 07:24:50.166240] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e> (a5238c03-d06a-4ad1-bf5e-d137cc49464e) [No such file or directory] >[2016-04-19 07:24:50.166333] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e> (a5238c03-d06a-4ad1-bf5e-d137cc49464e) [No such file or directory] >[2016-04-19 07:24:50.167356] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.170108] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a5238c03-d06a-4ad1-bf5e-d137cc49464e. (Possible split-brain) >[2016-04-19 07:24:50.170985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e> (a5238c03-d06a-4ad1-bf5e-d137cc49464e) [No such file or directory] >[2016-04-19 07:24:50.171083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e> (a5238c03-d06a-4ad1-bf5e-d137cc49464e) [No such file or directory] >[2016-04-19 07:24:50.173782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e> (a5238c03-d06a-4ad1-bf5e-d137cc49464e) [No such file or directory] >[2016-04-19 07:24:50.174266] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e> (a5238c03-d06a-4ad1-bf5e-d137cc49464e) [No such file or directory] >[2016-04-19 07:24:50.174477] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a5238c03-d06a-4ad1-bf5e-d137cc49464e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.181998] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.182797] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96595cb0-dea2-4458-9624-d21239f75358> (96595cb0-dea2-4458-9624-d21239f75358) [No such file or directory] >[2016-04-19 07:24:50.182870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96595cb0-dea2-4458-9624-d21239f75358> (96595cb0-dea2-4458-9624-d21239f75358) [No such file or directory] >[2016-04-19 07:24:50.185244] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 96595cb0-dea2-4458-9624-d21239f75358. (Possible split-brain) >[2016-04-19 07:24:50.185991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96595cb0-dea2-4458-9624-d21239f75358> (96595cb0-dea2-4458-9624-d21239f75358) [No such file or directory] >[2016-04-19 07:24:50.186128] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96595cb0-dea2-4458-9624-d21239f75358> (96595cb0-dea2-4458-9624-d21239f75358) [No such file or directory] >[2016-04-19 07:24:50.187301] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96595cb0-dea2-4458-9624-d21239f75358> (96595cb0-dea2-4458-9624-d21239f75358) [No such file or directory] >[2016-04-19 07:24:50.187489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96595cb0-dea2-4458-9624-d21239f75358> (96595cb0-dea2-4458-9624-d21239f75358) [No such file or directory] >[2016-04-19 07:24:50.187645] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:96595cb0-dea2-4458-9624-d21239f75358>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.190029] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 96595cb0-dea2-4458-9624-d21239f75358. (Possible split-brain) >[2016-04-19 07:24:50.190837] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96595cb0-dea2-4458-9624-d21239f75358> (96595cb0-dea2-4458-9624-d21239f75358) [No such file or directory] >[2016-04-19 07:24:50.190943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96595cb0-dea2-4458-9624-d21239f75358> (96595cb0-dea2-4458-9624-d21239f75358) [No such file or directory] >[2016-04-19 07:24:50.193070] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:96595cb0-dea2-4458-9624-d21239f75358> (96595cb0-dea2-4458-9624-d21239f75358) [No such file or directory] >[2016-04-19 07:24:50.193170] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:96595cb0-dea2-4458-9624-d21239f75358> (96595cb0-dea2-4458-9624-d21239f75358) [No such file or directory] >[2016-04-19 07:24:50.193353] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:96595cb0-dea2-4458-9624-d21239f75358>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.201349] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.202117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb> (f1b25f36-2d1a-4854-961d-690d60272eeb) [No such file or directory] >[2016-04-19 07:24:50.202300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb> (f1b25f36-2d1a-4854-961d-690d60272eeb) [No such file or directory] >[2016-04-19 07:24:50.203236] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f1b25f36-2d1a-4854-961d-690d60272eeb. (Possible split-brain) >[2016-04-19 07:24:50.203919] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb> (f1b25f36-2d1a-4854-961d-690d60272eeb) [No such file or directory] >[2016-04-19 07:24:50.204068] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb> (f1b25f36-2d1a-4854-961d-690d60272eeb) [No such file or directory] >[2016-04-19 07:24:50.204998] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb> (f1b25f36-2d1a-4854-961d-690d60272eeb) [No such file or directory] >[2016-04-19 07:24:50.205107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb> (f1b25f36-2d1a-4854-961d-690d60272eeb) [No such file or directory] >[2016-04-19 07:24:50.205257] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.208592] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f1b25f36-2d1a-4854-961d-690d60272eeb. (Possible split-brain) >[2016-04-19 07:24:50.209548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb> (f1b25f36-2d1a-4854-961d-690d60272eeb) [No such file or directory] >[2016-04-19 07:24:50.209675] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb> (f1b25f36-2d1a-4854-961d-690d60272eeb) [No such file or directory] >[2016-04-19 07:24:50.211061] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb> (f1b25f36-2d1a-4854-961d-690d60272eeb) [No such file or directory] >[2016-04-19 07:24:50.211127] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb> (f1b25f36-2d1a-4854-961d-690d60272eeb) [No such file or directory] >[2016-04-19 07:24:50.211296] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f1b25f36-2d1a-4854-961d-690d60272eeb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.219094] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.220105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9> (4a061732-fbc6-465b-8eec-e1704c733ed9) [No such file or directory] >[2016-04-19 07:24:50.220271] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9> (4a061732-fbc6-465b-8eec-e1704c733ed9) [No such file or directory] >[2016-04-19 07:24:50.221554] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4a061732-fbc6-465b-8eec-e1704c733ed9. (Possible split-brain) >[2016-04-19 07:24:50.222454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9> (4a061732-fbc6-465b-8eec-e1704c733ed9) [No such file or directory] >[2016-04-19 07:24:50.222519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9> (4a061732-fbc6-465b-8eec-e1704c733ed9) [No such file or directory] >[2016-04-19 07:24:50.223308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9> (4a061732-fbc6-465b-8eec-e1704c733ed9) [No such file or directory] >[2016-04-19 07:24:50.223540] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9> (4a061732-fbc6-465b-8eec-e1704c733ed9) [No such file or directory] >[2016-04-19 07:24:50.223650] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.226303] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4a061732-fbc6-465b-8eec-e1704c733ed9. (Possible split-brain) >[2016-04-19 07:24:50.227182] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9> (4a061732-fbc6-465b-8eec-e1704c733ed9) [No such file or directory] >[2016-04-19 07:24:50.227231] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9> (4a061732-fbc6-465b-8eec-e1704c733ed9) [No such file or directory] >[2016-04-19 07:24:50.229923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9> (4a061732-fbc6-465b-8eec-e1704c733ed9) [No such file or directory] >[2016-04-19 07:24:50.230154] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9> (4a061732-fbc6-465b-8eec-e1704c733ed9) [No such file or directory] >[2016-04-19 07:24:50.230285] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4a061732-fbc6-465b-8eec-e1704c733ed9>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.238817] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.239570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436> (60c3b35f-e0cd-471f-92db-8bbc0219b436) [No such file or directory] >[2016-04-19 07:24:50.239921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436> (60c3b35f-e0cd-471f-92db-8bbc0219b436) [No such file or directory] >[2016-04-19 07:24:50.242713] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 60c3b35f-e0cd-471f-92db-8bbc0219b436. (Possible split-brain) >[2016-04-19 07:24:50.243388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436> (60c3b35f-e0cd-471f-92db-8bbc0219b436) [No such file or directory] >[2016-04-19 07:24:50.243657] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436> (60c3b35f-e0cd-471f-92db-8bbc0219b436) [No such file or directory] >[2016-04-19 07:24:50.244781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436> (60c3b35f-e0cd-471f-92db-8bbc0219b436) [No such file or directory] >[2016-04-19 07:24:50.244971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436> (60c3b35f-e0cd-471f-92db-8bbc0219b436) [No such file or directory] >[2016-04-19 07:24:50.245103] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.247680] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 60c3b35f-e0cd-471f-92db-8bbc0219b436. (Possible split-brain) >[2016-04-19 07:24:50.248479] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436> (60c3b35f-e0cd-471f-92db-8bbc0219b436) [No such file or directory] >[2016-04-19 07:24:50.248586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436> (60c3b35f-e0cd-471f-92db-8bbc0219b436) [No such file or directory] >[2016-04-19 07:24:50.251410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436> (60c3b35f-e0cd-471f-92db-8bbc0219b436) [No such file or directory] >[2016-04-19 07:24:50.251444] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436> (60c3b35f-e0cd-471f-92db-8bbc0219b436) [No such file or directory] >[2016-04-19 07:24:50.251634] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:60c3b35f-e0cd-471f-92db-8bbc0219b436>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.259077] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.259817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dc38924f-334f-4968-9364-497806f1d988> (dc38924f-334f-4968-9364-497806f1d988) [No such file or directory] >[2016-04-19 07:24:50.260159] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dc38924f-334f-4968-9364-497806f1d988> (dc38924f-334f-4968-9364-497806f1d988) [No such file or directory] >[2016-04-19 07:24:50.262973] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid dc38924f-334f-4968-9364-497806f1d988. (Possible split-brain) >[2016-04-19 07:24:50.263894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dc38924f-334f-4968-9364-497806f1d988> (dc38924f-334f-4968-9364-497806f1d988) [No such file or directory] >[2016-04-19 07:24:50.263925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dc38924f-334f-4968-9364-497806f1d988> (dc38924f-334f-4968-9364-497806f1d988) [No such file or directory] >[2016-04-19 07:24:50.264961] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dc38924f-334f-4968-9364-497806f1d988> (dc38924f-334f-4968-9364-497806f1d988) [No such file or directory] >[2016-04-19 07:24:50.265082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dc38924f-334f-4968-9364-497806f1d988> (dc38924f-334f-4968-9364-497806f1d988) [No such file or directory] >[2016-04-19 07:24:50.265240] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:dc38924f-334f-4968-9364-497806f1d988>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.267823] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid dc38924f-334f-4968-9364-497806f1d988. (Possible split-brain) >[2016-04-19 07:24:50.268585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dc38924f-334f-4968-9364-497806f1d988> (dc38924f-334f-4968-9364-497806f1d988) [No such file or directory] >[2016-04-19 07:24:50.268594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dc38924f-334f-4968-9364-497806f1d988> (dc38924f-334f-4968-9364-497806f1d988) [No such file or directory] >[2016-04-19 07:24:50.271379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:dc38924f-334f-4968-9364-497806f1d988> (dc38924f-334f-4968-9364-497806f1d988) [No such file or directory] >[2016-04-19 07:24:50.271510] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:dc38924f-334f-4968-9364-497806f1d988> (dc38924f-334f-4968-9364-497806f1d988) [No such file or directory] >[2016-04-19 07:24:50.271655] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:dc38924f-334f-4968-9364-497806f1d988>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.280148] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.280845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410> (c864ce13-eeea-4c66-9297-02dd4c704410) [No such file or directory] >[2016-04-19 07:24:50.281146] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410> (c864ce13-eeea-4c66-9297-02dd4c704410) [No such file or directory] >[2016-04-19 07:24:50.283960] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c864ce13-eeea-4c66-9297-02dd4c704410. (Possible split-brain) >[2016-04-19 07:24:50.284697] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410> (c864ce13-eeea-4c66-9297-02dd4c704410) [No such file or directory] >[2016-04-19 07:24:50.284977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410> (c864ce13-eeea-4c66-9297-02dd4c704410) [No such file or directory] >[2016-04-19 07:24:50.286001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410> (c864ce13-eeea-4c66-9297-02dd4c704410) [No such file or directory] >[2016-04-19 07:24:50.286368] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410> (c864ce13-eeea-4c66-9297-02dd4c704410) [No such file or directory] >[2016-04-19 07:24:50.286509] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.289083] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c864ce13-eeea-4c66-9297-02dd4c704410. (Possible split-brain) >[2016-04-19 07:24:50.289757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410> (c864ce13-eeea-4c66-9297-02dd4c704410) [No such file or directory] >[2016-04-19 07:24:50.290033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410> (c864ce13-eeea-4c66-9297-02dd4c704410) [No such file or directory] >[2016-04-19 07:24:50.292373] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410> (c864ce13-eeea-4c66-9297-02dd4c704410) [No such file or directory] >[2016-04-19 07:24:50.292760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410> (c864ce13-eeea-4c66-9297-02dd4c704410) [No such file or directory] >[2016-04-19 07:24:50.292882] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c864ce13-eeea-4c66-9297-02dd4c704410>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.301769] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.302990] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542> (35870d02-50e3-45e2-bc32-92f7aacf3542) [No such file or directory] >[2016-04-19 07:24:50.303018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542> (35870d02-50e3-45e2-bc32-92f7aacf3542) [No such file or directory] >[2016-04-19 07:24:50.305915] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 35870d02-50e3-45e2-bc32-92f7aacf3542. (Possible split-brain) >[2016-04-19 07:24:50.307010] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542> (35870d02-50e3-45e2-bc32-92f7aacf3542) [No such file or directory] >[2016-04-19 07:24:50.307084] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542> (35870d02-50e3-45e2-bc32-92f7aacf3542) [No such file or directory] >[2016-04-19 07:24:50.308270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542> (35870d02-50e3-45e2-bc32-92f7aacf3542) [No such file or directory] >[2016-04-19 07:24:50.308294] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542> (35870d02-50e3-45e2-bc32-92f7aacf3542) [No such file or directory] >[2016-04-19 07:24:50.308473] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.310996] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 35870d02-50e3-45e2-bc32-92f7aacf3542. (Possible split-brain) >[2016-04-19 07:24:50.311936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542> (35870d02-50e3-45e2-bc32-92f7aacf3542) [No such file or directory] >[2016-04-19 07:24:50.312186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542> (35870d02-50e3-45e2-bc32-92f7aacf3542) [No such file or directory] >[2016-04-19 07:24:50.314759] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542> (35870d02-50e3-45e2-bc32-92f7aacf3542) [No such file or directory] >[2016-04-19 07:24:50.314875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542> (35870d02-50e3-45e2-bc32-92f7aacf3542) [No such file or directory] >[2016-04-19 07:24:50.314982] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:35870d02-50e3-45e2-bc32-92f7aacf3542>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.323543] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.324228] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0539ff2b-cf00-455a-90a1-45792db96696> (0539ff2b-cf00-455a-90a1-45792db96696) [No such file or directory] >[2016-04-19 07:24:50.324551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0539ff2b-cf00-455a-90a1-45792db96696> (0539ff2b-cf00-455a-90a1-45792db96696) [No such file or directory] >[2016-04-19 07:24:50.325674] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0539ff2b-cf00-455a-90a1-45792db96696. (Possible split-brain) >[2016-04-19 07:24:50.326300] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0539ff2b-cf00-455a-90a1-45792db96696> (0539ff2b-cf00-455a-90a1-45792db96696) [No such file or directory] >[2016-04-19 07:24:50.326650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0539ff2b-cf00-455a-90a1-45792db96696> (0539ff2b-cf00-455a-90a1-45792db96696) [No such file or directory] >[2016-04-19 07:24:50.327688] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0539ff2b-cf00-455a-90a1-45792db96696> (0539ff2b-cf00-455a-90a1-45792db96696) [No such file or directory] >[2016-04-19 07:24:50.327963] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0539ff2b-cf00-455a-90a1-45792db96696> (0539ff2b-cf00-455a-90a1-45792db96696) [No such file or directory] >[2016-04-19 07:24:50.328114] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0539ff2b-cf00-455a-90a1-45792db96696>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.330723] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 0539ff2b-cf00-455a-90a1-45792db96696. (Possible split-brain) >[2016-04-19 07:24:50.331639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0539ff2b-cf00-455a-90a1-45792db96696> (0539ff2b-cf00-455a-90a1-45792db96696) [No such file or directory] >[2016-04-19 07:24:50.331733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0539ff2b-cf00-455a-90a1-45792db96696> (0539ff2b-cf00-455a-90a1-45792db96696) [No such file or directory] >[2016-04-19 07:24:50.334190] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:0539ff2b-cf00-455a-90a1-45792db96696> (0539ff2b-cf00-455a-90a1-45792db96696) [No such file or directory] >[2016-04-19 07:24:50.334361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:0539ff2b-cf00-455a-90a1-45792db96696> (0539ff2b-cf00-455a-90a1-45792db96696) [No such file or directory] >[2016-04-19 07:24:50.334504] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0539ff2b-cf00-455a-90a1-45792db96696>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.343801] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.344913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b> (b5f5111d-109b-4998-a17a-1f21d35fc75b) [No such file or directory] >[2016-04-19 07:24:50.344919] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b> (b5f5111d-109b-4998-a17a-1f21d35fc75b) [No such file or directory] >[2016-04-19 07:24:50.347825] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b5f5111d-109b-4998-a17a-1f21d35fc75b. (Possible split-brain) >[2016-04-19 07:24:50.348947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b> (b5f5111d-109b-4998-a17a-1f21d35fc75b) [No such file or directory] >[2016-04-19 07:24:50.348973] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b> (b5f5111d-109b-4998-a17a-1f21d35fc75b) [No such file or directory] >[2016-04-19 07:24:50.350104] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b> (b5f5111d-109b-4998-a17a-1f21d35fc75b) [No such file or directory] >[2016-04-19 07:24:50.350141] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b> (b5f5111d-109b-4998-a17a-1f21d35fc75b) [No such file or directory] >[2016-04-19 07:24:50.350362] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.353104] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b5f5111d-109b-4998-a17a-1f21d35fc75b. (Possible split-brain) >[2016-04-19 07:24:50.354158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b> (b5f5111d-109b-4998-a17a-1f21d35fc75b) [No such file or directory] >[2016-04-19 07:24:50.354242] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b> (b5f5111d-109b-4998-a17a-1f21d35fc75b) [No such file or directory] >[2016-04-19 07:24:50.356567] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b> (b5f5111d-109b-4998-a17a-1f21d35fc75b) [No such file or directory] >[2016-04-19 07:24:50.356859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b> (b5f5111d-109b-4998-a17a-1f21d35fc75b) [No such file or directory] >[2016-04-19 07:24:50.357010] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b5f5111d-109b-4998-a17a-1f21d35fc75b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.366345] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.367423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b> (d6755e00-3015-4a2d-9621-74ba61df096b) [No such file or directory] >[2016-04-19 07:24:50.367434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b> (d6755e00-3015-4a2d-9621-74ba61df096b) [No such file or directory] >[2016-04-19 07:24:50.370345] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d6755e00-3015-4a2d-9621-74ba61df096b. (Possible split-brain) >[2016-04-19 07:24:50.371125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b> (d6755e00-3015-4a2d-9621-74ba61df096b) [No such file or directory] >[2016-04-19 07:24:50.371405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b> (d6755e00-3015-4a2d-9621-74ba61df096b) [No such file or directory] >[2016-04-19 07:24:50.372912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b> (d6755e00-3015-4a2d-9621-74ba61df096b) [No such file or directory] >[2016-04-19 07:24:50.373261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b> (d6755e00-3015-4a2d-9621-74ba61df096b) [No such file or directory] >[2016-04-19 07:24:50.373455] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.376192] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d6755e00-3015-4a2d-9621-74ba61df096b. (Possible split-brain) >[2016-04-19 07:24:50.377008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b> (d6755e00-3015-4a2d-9621-74ba61df096b) [No such file or directory] >[2016-04-19 07:24:50.377274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b> (d6755e00-3015-4a2d-9621-74ba61df096b) [No such file or directory] >[2016-04-19 07:24:50.379774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b> (d6755e00-3015-4a2d-9621-74ba61df096b) [No such file or directory] >[2016-04-19 07:24:50.379896] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b> (d6755e00-3015-4a2d-9621-74ba61df096b) [No such file or directory] >[2016-04-19 07:24:50.380067] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d6755e00-3015-4a2d-9621-74ba61df096b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.390132] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.391166] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf> (ea7fca31-bfc4-4946-9821-4813fd844ecf) [No such file or directory] >[2016-04-19 07:24:50.391176] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf> (ea7fca31-bfc4-4946-9821-4813fd844ecf) [No such file or directory] >[2016-04-19 07:24:50.392369] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ea7fca31-bfc4-4946-9821-4813fd844ecf. (Possible split-brain) >[2016-04-19 07:24:50.393443] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf> (ea7fca31-bfc4-4946-9821-4813fd844ecf) [No such file or directory] >[2016-04-19 07:24:50.393452] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf> (ea7fca31-bfc4-4946-9821-4813fd844ecf) [No such file or directory] >[2016-04-19 07:24:50.394872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf> (ea7fca31-bfc4-4946-9821-4813fd844ecf) [No such file or directory] >[2016-04-19 07:24:50.394985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf> (ea7fca31-bfc4-4946-9821-4813fd844ecf) [No such file or directory] >[2016-04-19 07:24:50.395112] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.397849] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ea7fca31-bfc4-4946-9821-4813fd844ecf. (Possible split-brain) >[2016-04-19 07:24:50.398876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf> (ea7fca31-bfc4-4946-9821-4813fd844ecf) [No such file or directory] >[2016-04-19 07:24:50.398970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf> (ea7fca31-bfc4-4946-9821-4813fd844ecf) [No such file or directory] >[2016-04-19 07:24:50.401520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf> (ea7fca31-bfc4-4946-9821-4813fd844ecf) [No such file or directory] >[2016-04-19 07:24:50.401626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf> (ea7fca31-bfc4-4946-9821-4813fd844ecf) [No such file or directory] >[2016-04-19 07:24:50.401856] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ea7fca31-bfc4-4946-9821-4813fd844ecf>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:50.411836] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.413042] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2> (8c11f18e-ce99-46e1-8a75-86269e5cc6b2) [No such file or directory] >[2016-04-19 07:24:50.413270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2> (8c11f18e-ce99-46e1-8a75-86269e5cc6b2) [No such file or directory] >[2016-04-19 07:24:50.414385] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8c11f18e-ce99-46e1-8a75-86269e5cc6b2. (Possible split-brain) >[2016-04-19 07:24:50.415453] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2> (8c11f18e-ce99-46e1-8a75-86269e5cc6b2) [No such file or directory] >[2016-04-19 07:24:50.415534] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2> (8c11f18e-ce99-46e1-8a75-86269e5cc6b2) [No such file or directory] >[2016-04-19 07:24:50.416664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2> (8c11f18e-ce99-46e1-8a75-86269e5cc6b2) [No such file or directory] >[2016-04-19 07:24:50.416737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2> (8c11f18e-ce99-46e1-8a75-86269e5cc6b2) [No such file or directory] >[2016-04-19 07:24:50.417142] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.419854] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8c11f18e-ce99-46e1-8a75-86269e5cc6b2. (Possible split-brain) >[2016-04-19 07:24:50.421117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2> (8c11f18e-ce99-46e1-8a75-86269e5cc6b2) [No such file or directory] >[2016-04-19 07:24:50.421132] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2> (8c11f18e-ce99-46e1-8a75-86269e5cc6b2) [No such file or directory] >[2016-04-19 07:24:50.424133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2> (8c11f18e-ce99-46e1-8a75-86269e5cc6b2) [No such file or directory] >[2016-04-19 07:24:50.424155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2> (8c11f18e-ce99-46e1-8a75-86269e5cc6b2) [No such file or directory] >[2016-04-19 07:24:50.424564] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8c11f18e-ce99-46e1-8a75-86269e5cc6b2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:50.433410] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.434085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8f64c19-3097-472c-8468-397989f656c6> (f8f64c19-3097-472c-8468-397989f656c6) [No such file or directory] >[2016-04-19 07:24:50.434475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8f64c19-3097-472c-8468-397989f656c6> (f8f64c19-3097-472c-8468-397989f656c6) [No such file or directory] >[2016-04-19 07:24:50.437367] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f8f64c19-3097-472c-8468-397989f656c6. (Possible split-brain) >[2016-04-19 07:24:50.438100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8f64c19-3097-472c-8468-397989f656c6> (f8f64c19-3097-472c-8468-397989f656c6) [No such file or directory] >[2016-04-19 07:24:50.438544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8f64c19-3097-472c-8468-397989f656c6> (f8f64c19-3097-472c-8468-397989f656c6) [No such file or directory] >[2016-04-19 07:24:50.439689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8f64c19-3097-472c-8468-397989f656c6> (f8f64c19-3097-472c-8468-397989f656c6) [No such file or directory] >[2016-04-19 07:24:50.440122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8f64c19-3097-472c-8468-397989f656c6> (f8f64c19-3097-472c-8468-397989f656c6) [No such file or directory] >[2016-04-19 07:24:50.440249] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f8f64c19-3097-472c-8468-397989f656c6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.443021] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f8f64c19-3097-472c-8468-397989f656c6. (Possible split-brain) >[2016-04-19 07:24:50.443802] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8f64c19-3097-472c-8468-397989f656c6> (f8f64c19-3097-472c-8468-397989f656c6) [No such file or directory] >[2016-04-19 07:24:50.444096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8f64c19-3097-472c-8468-397989f656c6> (f8f64c19-3097-472c-8468-397989f656c6) [No such file or directory] >[2016-04-19 07:24:50.447047] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f8f64c19-3097-472c-8468-397989f656c6> (f8f64c19-3097-472c-8468-397989f656c6) [No such file or directory] >[2016-04-19 07:24:50.447353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f8f64c19-3097-472c-8468-397989f656c6> (f8f64c19-3097-472c-8468-397989f656c6) [No such file or directory] >[2016-04-19 07:24:50.447502] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f8f64c19-3097-472c-8468-397989f656c6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.457655] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.458610] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da> (1d01b1db-61f8-4298-b5d7-a0b123a111da) [No such file or directory] >[2016-04-19 07:24:50.458891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da> (1d01b1db-61f8-4298-b5d7-a0b123a111da) [No such file or directory] >[2016-04-19 07:24:50.460026] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1d01b1db-61f8-4298-b5d7-a0b123a111da. (Possible split-brain) >[2016-04-19 07:24:50.461224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da> (1d01b1db-61f8-4298-b5d7-a0b123a111da) [No such file or directory] >[2016-04-19 07:24:50.461302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da> (1d01b1db-61f8-4298-b5d7-a0b123a111da) [No such file or directory] >[2016-04-19 07:24:50.462556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da> (1d01b1db-61f8-4298-b5d7-a0b123a111da) [No such file or directory] >[2016-04-19 07:24:50.462692] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da> (1d01b1db-61f8-4298-b5d7-a0b123a111da) [No such file or directory] >[2016-04-19 07:24:50.462887] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.465584] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1d01b1db-61f8-4298-b5d7-a0b123a111da. (Possible split-brain) >[2016-04-19 07:24:50.466598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da> (1d01b1db-61f8-4298-b5d7-a0b123a111da) [No such file or directory] >[2016-04-19 07:24:50.466671] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da> (1d01b1db-61f8-4298-b5d7-a0b123a111da) [No such file or directory] >[2016-04-19 07:24:50.469258] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da> (1d01b1db-61f8-4298-b5d7-a0b123a111da) [No such file or directory] >[2016-04-19 07:24:50.469263] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da> (1d01b1db-61f8-4298-b5d7-a0b123a111da) [No such file or directory] >[2016-04-19 07:24:50.469440] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1d01b1db-61f8-4298-b5d7-a0b123a111da>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.478150] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.479057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce> (7b26a95b-4ccf-4794-a1ae-6eac391146ce) [No such file or directory] >[2016-04-19 07:24:50.479114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce> (7b26a95b-4ccf-4794-a1ae-6eac391146ce) [No such file or directory] >[2016-04-19 07:24:50.480295] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7b26a95b-4ccf-4794-a1ae-6eac391146ce. (Possible split-brain) >[2016-04-19 07:24:50.481293] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce> (7b26a95b-4ccf-4794-a1ae-6eac391146ce) [No such file or directory] >[2016-04-19 07:24:50.481576] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce> (7b26a95b-4ccf-4794-a1ae-6eac391146ce) [No such file or directory] >[2016-04-19 07:24:50.483046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce> (7b26a95b-4ccf-4794-a1ae-6eac391146ce) [No such file or directory] >[2016-04-19 07:24:50.483064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce> (7b26a95b-4ccf-4794-a1ae-6eac391146ce) [No such file or directory] >[2016-04-19 07:24:50.483264] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.485864] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7b26a95b-4ccf-4794-a1ae-6eac391146ce. (Possible split-brain) >[2016-04-19 07:24:50.486681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce> (7b26a95b-4ccf-4794-a1ae-6eac391146ce) [No such file or directory] >[2016-04-19 07:24:50.486929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce> (7b26a95b-4ccf-4794-a1ae-6eac391146ce) [No such file or directory] >[2016-04-19 07:24:50.489209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce> (7b26a95b-4ccf-4794-a1ae-6eac391146ce) [No such file or directory] >[2016-04-19 07:24:50.489412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce> (7b26a95b-4ccf-4794-a1ae-6eac391146ce) [No such file or directory] >[2016-04-19 07:24:50.489617] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7b26a95b-4ccf-4794-a1ae-6eac391146ce>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.498931] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.499857] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:80102506-2d54-4c76-9c9d-76043081d75a> (80102506-2d54-4c76-9c9d-76043081d75a) [No such file or directory] >[2016-04-19 07:24:50.499936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:80102506-2d54-4c76-9c9d-76043081d75a> (80102506-2d54-4c76-9c9d-76043081d75a) [No such file or directory] >[2016-04-19 07:24:50.502784] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 80102506-2d54-4c76-9c9d-76043081d75a. (Possible split-brain) >[2016-04-19 07:24:50.503541] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:80102506-2d54-4c76-9c9d-76043081d75a> (80102506-2d54-4c76-9c9d-76043081d75a) [No such file or directory] >[2016-04-19 07:24:50.503785] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:80102506-2d54-4c76-9c9d-76043081d75a> (80102506-2d54-4c76-9c9d-76043081d75a) [No such file or directory] >[2016-04-19 07:24:50.505053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:80102506-2d54-4c76-9c9d-76043081d75a> (80102506-2d54-4c76-9c9d-76043081d75a) [No such file or directory] >[2016-04-19 07:24:50.505533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:80102506-2d54-4c76-9c9d-76043081d75a> (80102506-2d54-4c76-9c9d-76043081d75a) [No such file or directory] >[2016-04-19 07:24:50.505689] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:80102506-2d54-4c76-9c9d-76043081d75a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.508447] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 80102506-2d54-4c76-9c9d-76043081d75a. (Possible split-brain) >[2016-04-19 07:24:50.509197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:80102506-2d54-4c76-9c9d-76043081d75a> (80102506-2d54-4c76-9c9d-76043081d75a) [No such file or directory] >[2016-04-19 07:24:50.509597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:80102506-2d54-4c76-9c9d-76043081d75a> (80102506-2d54-4c76-9c9d-76043081d75a) [No such file or directory] >[2016-04-19 07:24:50.512125] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:80102506-2d54-4c76-9c9d-76043081d75a> (80102506-2d54-4c76-9c9d-76043081d75a) [No such file or directory] >[2016-04-19 07:24:50.512138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:80102506-2d54-4c76-9c9d-76043081d75a> (80102506-2d54-4c76-9c9d-76043081d75a) [No such file or directory] >[2016-04-19 07:24:50.512283] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:80102506-2d54-4c76-9c9d-76043081d75a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.521056] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.521752] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2> (997e9339-3413-40dd-9e58-8e1d8c9164c2) [No such file or directory] >[2016-04-19 07:24:50.522060] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2> (997e9339-3413-40dd-9e58-8e1d8c9164c2) [No such file or directory] >[2016-04-19 07:24:50.524924] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 997e9339-3413-40dd-9e58-8e1d8c9164c2. (Possible split-brain) >[2016-04-19 07:24:50.525628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2> (997e9339-3413-40dd-9e58-8e1d8c9164c2) [No such file or directory] >[2016-04-19 07:24:50.525964] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2> (997e9339-3413-40dd-9e58-8e1d8c9164c2) [No such file or directory] >[2016-04-19 07:24:50.527185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2> (997e9339-3413-40dd-9e58-8e1d8c9164c2) [No such file or directory] >[2016-04-19 07:24:50.527515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2> (997e9339-3413-40dd-9e58-8e1d8c9164c2) [No such file or directory] >[2016-04-19 07:24:50.527707] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.530552] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 997e9339-3413-40dd-9e58-8e1d8c9164c2. (Possible split-brain) >[2016-04-19 07:24:50.531827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2> (997e9339-3413-40dd-9e58-8e1d8c9164c2) [No such file or directory] >[2016-04-19 07:24:50.531903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2> (997e9339-3413-40dd-9e58-8e1d8c9164c2) [No such file or directory] >[2016-04-19 07:24:50.534488] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2> (997e9339-3413-40dd-9e58-8e1d8c9164c2) [No such file or directory] >[2016-04-19 07:24:50.534620] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2> (997e9339-3413-40dd-9e58-8e1d8c9164c2) [No such file or directory] >[2016-04-19 07:24:50.534750] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:997e9339-3413-40dd-9e58-8e1d8c9164c2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.544562] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.545304] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2> (46128cc6-529e-4c44-8c06-59fbb8314be2) [No such file or directory] >[2016-04-19 07:24:50.545560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2> (46128cc6-529e-4c44-8c06-59fbb8314be2) [No such file or directory] >[2016-04-19 07:24:50.548456] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 46128cc6-529e-4c44-8c06-59fbb8314be2. (Possible split-brain) >[2016-04-19 07:24:50.549563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2> (46128cc6-529e-4c44-8c06-59fbb8314be2) [No such file or directory] >[2016-04-19 07:24:50.549656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2> (46128cc6-529e-4c44-8c06-59fbb8314be2) [No such file or directory] >[2016-04-19 07:24:50.550923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2> (46128cc6-529e-4c44-8c06-59fbb8314be2) [No such file or directory] >[2016-04-19 07:24:50.551385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2> (46128cc6-529e-4c44-8c06-59fbb8314be2) [No such file or directory] >[2016-04-19 07:24:50.551523] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.554276] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 46128cc6-529e-4c44-8c06-59fbb8314be2. (Possible split-brain) >[2016-04-19 07:24:50.555116] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2> (46128cc6-529e-4c44-8c06-59fbb8314be2) [No such file or directory] >[2016-04-19 07:24:50.555531] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2> (46128cc6-529e-4c44-8c06-59fbb8314be2) [No such file or directory] >[2016-04-19 07:24:50.558535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2> (46128cc6-529e-4c44-8c06-59fbb8314be2) [No such file or directory] >[2016-04-19 07:24:50.558564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2> (46128cc6-529e-4c44-8c06-59fbb8314be2) [No such file or directory] >[2016-04-19 07:24:50.558727] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:46128cc6-529e-4c44-8c06-59fbb8314be2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.567214] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.568226] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1> (e5221e48-a94d-4ba7-85c8-6f472a51e6b1) [No such file or directory] >[2016-04-19 07:24:50.568243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1> (e5221e48-a94d-4ba7-85c8-6f472a51e6b1) [No such file or directory] >[2016-04-19 07:24:50.571008] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e5221e48-a94d-4ba7-85c8-6f472a51e6b1. (Possible split-brain) >[2016-04-19 07:24:50.571969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1> (e5221e48-a94d-4ba7-85c8-6f472a51e6b1) [No such file or directory] >[2016-04-19 07:24:50.572074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1> (e5221e48-a94d-4ba7-85c8-6f472a51e6b1) [No such file or directory] >[2016-04-19 07:24:50.573439] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1> (e5221e48-a94d-4ba7-85c8-6f472a51e6b1) [No such file or directory] >[2016-04-19 07:24:50.573533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1> (e5221e48-a94d-4ba7-85c8-6f472a51e6b1) [No such file or directory] >[2016-04-19 07:24:50.573687] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.576480] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e5221e48-a94d-4ba7-85c8-6f472a51e6b1. (Possible split-brain) >[2016-04-19 07:24:50.577227] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1> (e5221e48-a94d-4ba7-85c8-6f472a51e6b1) [No such file or directory] >[2016-04-19 07:24:50.577536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1> (e5221e48-a94d-4ba7-85c8-6f472a51e6b1) [No such file or directory] >[2016-04-19 07:24:50.580934] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1> (e5221e48-a94d-4ba7-85c8-6f472a51e6b1) [No such file or directory] >[2016-04-19 07:24:50.580958] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1> (e5221e48-a94d-4ba7-85c8-6f472a51e6b1) [No such file or directory] >[2016-04-19 07:24:50.581115] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e5221e48-a94d-4ba7-85c8-6f472a51e6b1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.590796] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.591626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852> (119a4aef-ee3e-4d9c-a088-c8744ab2f852) [No such file or directory] >[2016-04-19 07:24:50.591652] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852> (119a4aef-ee3e-4d9c-a088-c8744ab2f852) [No such file or directory] >[2016-04-19 07:24:50.594523] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 119a4aef-ee3e-4d9c-a088-c8744ab2f852. (Possible split-brain) >[2016-04-19 07:24:50.595670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852> (119a4aef-ee3e-4d9c-a088-c8744ab2f852) [No such file or directory] >[2016-04-19 07:24:50.596000] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852> (119a4aef-ee3e-4d9c-a088-c8744ab2f852) [No such file or directory] >[2016-04-19 07:24:50.597425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852> (119a4aef-ee3e-4d9c-a088-c8744ab2f852) [No such file or directory] >[2016-04-19 07:24:50.597787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852> (119a4aef-ee3e-4d9c-a088-c8744ab2f852) [No such file or directory] >[2016-04-19 07:24:50.597913] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.600708] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 119a4aef-ee3e-4d9c-a088-c8744ab2f852. (Possible split-brain) >[2016-04-19 07:24:50.601763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852> (119a4aef-ee3e-4d9c-a088-c8744ab2f852) [No such file or directory] >[2016-04-19 07:24:50.602123] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852> (119a4aef-ee3e-4d9c-a088-c8744ab2f852) [No such file or directory] >[2016-04-19 07:24:50.605409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852> (119a4aef-ee3e-4d9c-a088-c8744ab2f852) [No such file or directory] >[2016-04-19 07:24:50.605487] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852> (119a4aef-ee3e-4d9c-a088-c8744ab2f852) [No such file or directory] >[2016-04-19 07:24:50.605636] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:119a4aef-ee3e-4d9c-a088-c8744ab2f852>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.615699] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.616648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97> (e213cccc-292c-439a-bfcf-38ff462bde97) [No such file or directory] >[2016-04-19 07:24:50.616887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97> (e213cccc-292c-439a-bfcf-38ff462bde97) [No such file or directory] >[2016-04-19 07:24:50.617767] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e213cccc-292c-439a-bfcf-38ff462bde97. (Possible split-brain) >[2016-04-19 07:24:50.618885] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97> (e213cccc-292c-439a-bfcf-38ff462bde97) [No such file or directory] >[2016-04-19 07:24:50.618963] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97> (e213cccc-292c-439a-bfcf-38ff462bde97) [No such file or directory] >[2016-04-19 07:24:50.619988] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97> (e213cccc-292c-439a-bfcf-38ff462bde97) [No such file or directory] >[2016-04-19 07:24:50.620230] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97> (e213cccc-292c-439a-bfcf-38ff462bde97) [No such file or directory] >[2016-04-19 07:24:50.620735] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.623477] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e213cccc-292c-439a-bfcf-38ff462bde97. (Possible split-brain) >[2016-04-19 07:24:50.624416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97> (e213cccc-292c-439a-bfcf-38ff462bde97) [No such file or directory] >[2016-04-19 07:24:50.624492] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97> (e213cccc-292c-439a-bfcf-38ff462bde97) [No such file or directory] >[2016-04-19 07:24:50.627110] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97> (e213cccc-292c-439a-bfcf-38ff462bde97) [No such file or directory] >[2016-04-19 07:24:50.627413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97> (e213cccc-292c-439a-bfcf-38ff462bde97) [No such file or directory] >[2016-04-19 07:24:50.627632] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e213cccc-292c-439a-bfcf-38ff462bde97>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:50.637441] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.638396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c340d628-c50b-4030-83eb-640169b61ee5> (c340d628-c50b-4030-83eb-640169b61ee5) [No such file or directory] >[2016-04-19 07:24:50.638408] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c340d628-c50b-4030-83eb-640169b61ee5> (c340d628-c50b-4030-83eb-640169b61ee5) [No such file or directory] >[2016-04-19 07:24:50.641107] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c340d628-c50b-4030-83eb-640169b61ee5. (Possible split-brain) >[2016-04-19 07:24:50.641986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c340d628-c50b-4030-83eb-640169b61ee5> (c340d628-c50b-4030-83eb-640169b61ee5) [No such file or directory] >[2016-04-19 07:24:50.642011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c340d628-c50b-4030-83eb-640169b61ee5> (c340d628-c50b-4030-83eb-640169b61ee5) [No such file or directory] >[2016-04-19 07:24:50.643386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c340d628-c50b-4030-83eb-640169b61ee5> (c340d628-c50b-4030-83eb-640169b61ee5) [No such file or directory] >[2016-04-19 07:24:50.643446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c340d628-c50b-4030-83eb-640169b61ee5> (c340d628-c50b-4030-83eb-640169b61ee5) [No such file or directory] >[2016-04-19 07:24:50.643606] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c340d628-c50b-4030-83eb-640169b61ee5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.646272] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid c340d628-c50b-4030-83eb-640169b61ee5. (Possible split-brain) >[2016-04-19 07:24:50.647239] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c340d628-c50b-4030-83eb-640169b61ee5> (c340d628-c50b-4030-83eb-640169b61ee5) [No such file or directory] >[2016-04-19 07:24:50.647259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c340d628-c50b-4030-83eb-640169b61ee5> (c340d628-c50b-4030-83eb-640169b61ee5) [No such file or directory] >[2016-04-19 07:24:50.650580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:c340d628-c50b-4030-83eb-640169b61ee5> (c340d628-c50b-4030-83eb-640169b61ee5) [No such file or directory] >[2016-04-19 07:24:50.650633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:c340d628-c50b-4030-83eb-640169b61ee5> (c340d628-c50b-4030-83eb-640169b61ee5) [No such file or directory] >[2016-04-19 07:24:50.650816] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c340d628-c50b-4030-83eb-640169b61ee5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.660061] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.660800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587> (5c1b61f6-7422-48ce-8afe-9e70cc843587) [No such file or directory] >[2016-04-19 07:24:50.660829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587> (5c1b61f6-7422-48ce-8afe-9e70cc843587) [No such file or directory] >[2016-04-19 07:24:50.663536] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5c1b61f6-7422-48ce-8afe-9e70cc843587. (Possible split-brain) >[2016-04-19 07:24:50.664291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587> (5c1b61f6-7422-48ce-8afe-9e70cc843587) [No such file or directory] >[2016-04-19 07:24:50.664402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587> (5c1b61f6-7422-48ce-8afe-9e70cc843587) [No such file or directory] >[2016-04-19 07:24:50.665214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587> (5c1b61f6-7422-48ce-8afe-9e70cc843587) [No such file or directory] >[2016-04-19 07:24:50.665522] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587> (5c1b61f6-7422-48ce-8afe-9e70cc843587) [No such file or directory] >[2016-04-19 07:24:50.665758] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.668374] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5c1b61f6-7422-48ce-8afe-9e70cc843587. (Possible split-brain) >[2016-04-19 07:24:50.669117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587> (5c1b61f6-7422-48ce-8afe-9e70cc843587) [No such file or directory] >[2016-04-19 07:24:50.669174] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587> (5c1b61f6-7422-48ce-8afe-9e70cc843587) [No such file or directory] >[2016-04-19 07:24:50.671543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587> (5c1b61f6-7422-48ce-8afe-9e70cc843587) [No such file or directory] >[2016-04-19 07:24:50.671811] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587> (5c1b61f6-7422-48ce-8afe-9e70cc843587) [No such file or directory] >[2016-04-19 07:24:50.672378] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5c1b61f6-7422-48ce-8afe-9e70cc843587>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:50.681600] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.682369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:affb2af1-f61d-46f0-a316-882b8d910915> (affb2af1-f61d-46f0-a316-882b8d910915) [No such file or directory] >[2016-04-19 07:24:50.682489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:affb2af1-f61d-46f0-a316-882b8d910915> (affb2af1-f61d-46f0-a316-882b8d910915) [No such file or directory] >[2016-04-19 07:24:50.683420] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid affb2af1-f61d-46f0-a316-882b8d910915. (Possible split-brain) >[2016-04-19 07:24:50.684399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:affb2af1-f61d-46f0-a316-882b8d910915> (affb2af1-f61d-46f0-a316-882b8d910915) [No such file or directory] >[2016-04-19 07:24:50.684450] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:affb2af1-f61d-46f0-a316-882b8d910915> (affb2af1-f61d-46f0-a316-882b8d910915) [No such file or directory] >[2016-04-19 07:24:50.685544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:affb2af1-f61d-46f0-a316-882b8d910915> (affb2af1-f61d-46f0-a316-882b8d910915) [No such file or directory] >[2016-04-19 07:24:50.685699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:affb2af1-f61d-46f0-a316-882b8d910915> (affb2af1-f61d-46f0-a316-882b8d910915) [No such file or directory] >[2016-04-19 07:24:50.685874] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:affb2af1-f61d-46f0-a316-882b8d910915>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.688733] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid affb2af1-f61d-46f0-a316-882b8d910915. (Possible split-brain) >[2016-04-19 07:24:50.689654] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:affb2af1-f61d-46f0-a316-882b8d910915> (affb2af1-f61d-46f0-a316-882b8d910915) [No such file or directory] >[2016-04-19 07:24:50.689674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:affb2af1-f61d-46f0-a316-882b8d910915> (affb2af1-f61d-46f0-a316-882b8d910915) [No such file or directory] >[2016-04-19 07:24:50.692177] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:affb2af1-f61d-46f0-a316-882b8d910915> (affb2af1-f61d-46f0-a316-882b8d910915) [No such file or directory] >[2016-04-19 07:24:50.692360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:affb2af1-f61d-46f0-a316-882b8d910915> (affb2af1-f61d-46f0-a316-882b8d910915) [No such file or directory] >[2016-04-19 07:24:50.692755] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:affb2af1-f61d-46f0-a316-882b8d910915>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:50.701283] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.702081] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a> (bc2c9f2f-4268-4dc8-a00f-1fae85cb978a) [No such file or directory] >[2016-04-19 07:24:50.702391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a> (bc2c9f2f-4268-4dc8-a00f-1fae85cb978a) [No such file or directory] >[2016-04-19 07:24:50.705194] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bc2c9f2f-4268-4dc8-a00f-1fae85cb978a. (Possible split-brain) >[2016-04-19 07:24:50.706262] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a> (bc2c9f2f-4268-4dc8-a00f-1fae85cb978a) [No such file or directory] >[2016-04-19 07:24:50.706466] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a> (bc2c9f2f-4268-4dc8-a00f-1fae85cb978a) [No such file or directory] >[2016-04-19 07:24:50.707735] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a> (bc2c9f2f-4268-4dc8-a00f-1fae85cb978a) [No such file or directory] >[2016-04-19 07:24:50.707861] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a> (bc2c9f2f-4268-4dc8-a00f-1fae85cb978a) [No such file or directory] >[2016-04-19 07:24:50.708009] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.710591] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid bc2c9f2f-4268-4dc8-a00f-1fae85cb978a. (Possible split-brain) >[2016-04-19 07:24:50.711641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a> (bc2c9f2f-4268-4dc8-a00f-1fae85cb978a) [No such file or directory] >[2016-04-19 07:24:50.711730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a> (bc2c9f2f-4268-4dc8-a00f-1fae85cb978a) [No such file or directory] >[2016-04-19 07:24:50.714542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a> (bc2c9f2f-4268-4dc8-a00f-1fae85cb978a) [No such file or directory] >[2016-04-19 07:24:50.714588] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a> (bc2c9f2f-4268-4dc8-a00f-1fae85cb978a) [No such file or directory] >[2016-04-19 07:24:50.714761] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bc2c9f2f-4268-4dc8-a00f-1fae85cb978a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.725088] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.726088] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d> (03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d) [No such file or directory] >[2016-04-19 07:24:50.726145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d> (03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d) [No such file or directory] >[2016-04-19 07:24:50.729016] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d. (Possible split-brain) >[2016-04-19 07:24:50.730126] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d> (03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d) [No such file or directory] >[2016-04-19 07:24:50.730220] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d> (03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d) [No such file or directory] >[2016-04-19 07:24:50.731593] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d> (03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d) [No such file or directory] >[2016-04-19 07:24:50.731663] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d> (03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d) [No such file or directory] >[2016-04-19 07:24:50.731788] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.734294] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d. (Possible split-brain) >[2016-04-19 07:24:50.735470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d> (03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d) [No such file or directory] >[2016-04-19 07:24:50.735542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d> (03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d) [No such file or directory] >[2016-04-19 07:24:50.738282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d> (03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d) [No such file or directory] >[2016-04-19 07:24:50.738310] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d> (03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d) [No such file or directory] >[2016-04-19 07:24:50.738557] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:03f6013c-9cf8-4b5a-b028-dfa8f1f1af7d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.747774] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.748805] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:65eb5b04-5628-405d-bb50-119b531026d0> (65eb5b04-5628-405d-bb50-119b531026d0) [No such file or directory] >[2016-04-19 07:24:50.748892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:65eb5b04-5628-405d-bb50-119b531026d0> (65eb5b04-5628-405d-bb50-119b531026d0) [No such file or directory] >[2016-04-19 07:24:50.750072] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 65eb5b04-5628-405d-bb50-119b531026d0. (Possible split-brain) >[2016-04-19 07:24:50.751120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:65eb5b04-5628-405d-bb50-119b531026d0> (65eb5b04-5628-405d-bb50-119b531026d0) [No such file or directory] >[2016-04-19 07:24:50.751150] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:65eb5b04-5628-405d-bb50-119b531026d0> (65eb5b04-5628-405d-bb50-119b531026d0) [No such file or directory] >[2016-04-19 07:24:50.752449] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:65eb5b04-5628-405d-bb50-119b531026d0> (65eb5b04-5628-405d-bb50-119b531026d0) [No such file or directory] >[2016-04-19 07:24:50.752453] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:65eb5b04-5628-405d-bb50-119b531026d0> (65eb5b04-5628-405d-bb50-119b531026d0) [No such file or directory] >[2016-04-19 07:24:50.752611] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:65eb5b04-5628-405d-bb50-119b531026d0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.755357] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 65eb5b04-5628-405d-bb50-119b531026d0. (Possible split-brain) >[2016-04-19 07:24:50.756369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:65eb5b04-5628-405d-bb50-119b531026d0> (65eb5b04-5628-405d-bb50-119b531026d0) [No such file or directory] >[2016-04-19 07:24:50.756470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:65eb5b04-5628-405d-bb50-119b531026d0> (65eb5b04-5628-405d-bb50-119b531026d0) [No such file or directory] >[2016-04-19 07:24:50.758853] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:65eb5b04-5628-405d-bb50-119b531026d0> (65eb5b04-5628-405d-bb50-119b531026d0) [No such file or directory] >[2016-04-19 07:24:50.759187] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:65eb5b04-5628-405d-bb50-119b531026d0> (65eb5b04-5628-405d-bb50-119b531026d0) [No such file or directory] >[2016-04-19 07:24:50.759362] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:65eb5b04-5628-405d-bb50-119b531026d0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.768574] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.769563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2> (de612f09-b6d8-42be-97e3-1b200f2a59c2) [No such file or directory] >[2016-04-19 07:24:50.769592] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2> (de612f09-b6d8-42be-97e3-1b200f2a59c2) [No such file or directory] >[2016-04-19 07:24:50.770690] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid de612f09-b6d8-42be-97e3-1b200f2a59c2. (Possible split-brain) >[2016-04-19 07:24:50.771662] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2> (de612f09-b6d8-42be-97e3-1b200f2a59c2) [No such file or directory] >[2016-04-19 07:24:50.771679] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2> (de612f09-b6d8-42be-97e3-1b200f2a59c2) [No such file or directory] >[2016-04-19 07:24:50.773192] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2> (de612f09-b6d8-42be-97e3-1b200f2a59c2) [No such file or directory] >[2016-04-19 07:24:50.773377] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2> (de612f09-b6d8-42be-97e3-1b200f2a59c2) [No such file or directory] >[2016-04-19 07:24:50.773525] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.776094] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid de612f09-b6d8-42be-97e3-1b200f2a59c2. (Possible split-brain) >[2016-04-19 07:24:50.777051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2> (de612f09-b6d8-42be-97e3-1b200f2a59c2) [No such file or directory] >[2016-04-19 07:24:50.777053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2> (de612f09-b6d8-42be-97e3-1b200f2a59c2) [No such file or directory] >[2016-04-19 07:24:50.780268] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2> (de612f09-b6d8-42be-97e3-1b200f2a59c2) [No such file or directory] >[2016-04-19 07:24:50.780445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2> (de612f09-b6d8-42be-97e3-1b200f2a59c2) [No such file or directory] >[2016-04-19 07:24:50.780632] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:de612f09-b6d8-42be-97e3-1b200f2a59c2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.788885] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.789659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717> (f7ecc35f-3ceb-44e5-8962-451da2641717) [No such file or directory] >[2016-04-19 07:24:50.789729] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717> (f7ecc35f-3ceb-44e5-8962-451da2641717) [No such file or directory] >[2016-04-19 07:24:50.790760] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f7ecc35f-3ceb-44e5-8962-451da2641717. (Possible split-brain) >[2016-04-19 07:24:50.791570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717> (f7ecc35f-3ceb-44e5-8962-451da2641717) [No such file or directory] >[2016-04-19 07:24:50.791744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717> (f7ecc35f-3ceb-44e5-8962-451da2641717) [No such file or directory] >[2016-04-19 07:24:50.792938] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717> (f7ecc35f-3ceb-44e5-8962-451da2641717) [No such file or directory] >[2016-04-19 07:24:50.793003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717> (f7ecc35f-3ceb-44e5-8962-451da2641717) [No such file or directory] >[2016-04-19 07:24:50.793175] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.795646] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f7ecc35f-3ceb-44e5-8962-451da2641717. (Possible split-brain) >[2016-04-19 07:24:50.796639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717> (f7ecc35f-3ceb-44e5-8962-451da2641717) [No such file or directory] >[2016-04-19 07:24:50.796663] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717> (f7ecc35f-3ceb-44e5-8962-451da2641717) [No such file or directory] >[2016-04-19 07:24:50.799613] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717> (f7ecc35f-3ceb-44e5-8962-451da2641717) [No such file or directory] >[2016-04-19 07:24:50.799634] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717> (f7ecc35f-3ceb-44e5-8962-451da2641717) [No such file or directory] >[2016-04-19 07:24:50.799802] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f7ecc35f-3ceb-44e5-8962-451da2641717>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.808602] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.809464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca> (e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca) [No such file or directory] >[2016-04-19 07:24:50.809489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca> (e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca) [No such file or directory] >[2016-04-19 07:24:50.812402] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca. (Possible split-brain) >[2016-04-19 07:24:50.813255] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca> (e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca) [No such file or directory] >[2016-04-19 07:24:50.813528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca> (e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca) [No such file or directory] >[2016-04-19 07:24:50.814725] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca> (e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca) [No such file or directory] >[2016-04-19 07:24:50.815085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca> (e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca) [No such file or directory] >[2016-04-19 07:24:50.815208] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.817909] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca. (Possible split-brain) >[2016-04-19 07:24:50.818681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca> (e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca) [No such file or directory] >[2016-04-19 07:24:50.819066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca> (e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca) [No such file or directory] >[2016-04-19 07:24:50.822355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca> (e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca) [No such file or directory] >[2016-04-19 07:24:50.822542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca> (e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca) [No such file or directory] >[2016-04-19 07:24:50.822667] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e2b64de1-9c5f-43cb-b1dd-eab9cd2d79ca>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.831290] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.832303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b> (f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b) [No such file or directory] >[2016-04-19 07:24:50.832412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b> (f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b) [No such file or directory] >[2016-04-19 07:24:50.835200] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b. (Possible split-brain) >[2016-04-19 07:24:50.836209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b> (f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b) [No such file or directory] >[2016-04-19 07:24:50.836221] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b> (f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b) [No such file or directory] >[2016-04-19 07:24:50.837396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b> (f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b) [No such file or directory] >[2016-04-19 07:24:50.837542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b> (f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b) [No such file or directory] >[2016-04-19 07:24:50.837746] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:50.840618] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b. (Possible split-brain) >[2016-04-19 07:24:50.841620] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b> (f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b) [No such file or directory] >[2016-04-19 07:24:50.841717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b> (f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b) [No such file or directory] >[2016-04-19 07:24:50.844763] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b> (f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b) [No such file or directory] >[2016-04-19 07:24:50.845048] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b> (f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b) [No such file or directory] >[2016-04-19 07:24:50.845241] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f7c9d9fc-459e-4e9e-bf48-d3f8d139b80b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.854076] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.854801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f> (6fcf4530-9777-4910-b6fa-4aadf614c36f) [No such file or directory] >[2016-04-19 07:24:50.855089] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f> (6fcf4530-9777-4910-b6fa-4aadf614c36f) [No such file or directory] >[2016-04-19 07:24:50.857932] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6fcf4530-9777-4910-b6fa-4aadf614c36f. (Possible split-brain) >[2016-04-19 07:24:50.858826] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f> (6fcf4530-9777-4910-b6fa-4aadf614c36f) [No such file or directory] >[2016-04-19 07:24:50.858891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f> (6fcf4530-9777-4910-b6fa-4aadf614c36f) [No such file or directory] >[2016-04-19 07:24:50.860013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f> (6fcf4530-9777-4910-b6fa-4aadf614c36f) [No such file or directory] >[2016-04-19 07:24:50.860054] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f> (6fcf4530-9777-4910-b6fa-4aadf614c36f) [No such file or directory] >[2016-04-19 07:24:50.860221] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.862811] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6fcf4530-9777-4910-b6fa-4aadf614c36f. (Possible split-brain) >[2016-04-19 07:24:50.863284] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f> (6fcf4530-9777-4910-b6fa-4aadf614c36f) [No such file or directory] >[2016-04-19 07:24:50.863383] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f> (6fcf4530-9777-4910-b6fa-4aadf614c36f) [No such file or directory] >[2016-04-19 07:24:50.866379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f> (6fcf4530-9777-4910-b6fa-4aadf614c36f) [No such file or directory] >[2016-04-19 07:24:50.866687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f> (6fcf4530-9777-4910-b6fa-4aadf614c36f) [No such file or directory] >[2016-04-19 07:24:50.866888] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6fcf4530-9777-4910-b6fa-4aadf614c36f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.874778] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.875774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d> (cc47a063-361d-4c70-85e4-36ac19f0b21d) [No such file or directory] >[2016-04-19 07:24:50.875867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d> (cc47a063-361d-4c70-85e4-36ac19f0b21d) [No such file or directory] >[2016-04-19 07:24:50.876999] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cc47a063-361d-4c70-85e4-36ac19f0b21d. (Possible split-brain) >[2016-04-19 07:24:50.877937] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d> (cc47a063-361d-4c70-85e4-36ac19f0b21d) [No such file or directory] >[2016-04-19 07:24:50.878256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d> (cc47a063-361d-4c70-85e4-36ac19f0b21d) [No such file or directory] >[2016-04-19 07:24:50.879282] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d> (cc47a063-361d-4c70-85e4-36ac19f0b21d) [No such file or directory] >[2016-04-19 07:24:50.879841] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d> (cc47a063-361d-4c70-85e4-36ac19f0b21d) [No such file or directory] >[2016-04-19 07:24:50.879969] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.882563] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cc47a063-361d-4c70-85e4-36ac19f0b21d. (Possible split-brain) >[2016-04-19 07:24:50.883395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d> (cc47a063-361d-4c70-85e4-36ac19f0b21d) [No such file or directory] >[2016-04-19 07:24:50.883531] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d> (cc47a063-361d-4c70-85e4-36ac19f0b21d) [No such file or directory] >[2016-04-19 07:24:50.886956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d> (cc47a063-361d-4c70-85e4-36ac19f0b21d) [No such file or directory] >[2016-04-19 07:24:50.887135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d> (cc47a063-361d-4c70-85e4-36ac19f0b21d) [No such file or directory] >[2016-04-19 07:24:50.887308] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cc47a063-361d-4c70-85e4-36ac19f0b21d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.896853] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.897675] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e> (326da56e-eb9f-494a-b33c-a763b21ffd4e) [No such file or directory] >[2016-04-19 07:24:50.897888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e> (326da56e-eb9f-494a-b33c-a763b21ffd4e) [No such file or directory] >[2016-04-19 07:24:50.898995] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 326da56e-eb9f-494a-b33c-a763b21ffd4e. (Possible split-brain) >[2016-04-19 07:24:50.899959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e> (326da56e-eb9f-494a-b33c-a763b21ffd4e) [No such file or directory] >[2016-04-19 07:24:50.900042] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e> (326da56e-eb9f-494a-b33c-a763b21ffd4e) [No such file or directory] >[2016-04-19 07:24:50.901484] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e> (326da56e-eb9f-494a-b33c-a763b21ffd4e) [No such file or directory] >[2016-04-19 07:24:50.901753] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e> (326da56e-eb9f-494a-b33c-a763b21ffd4e) [No such file or directory] >[2016-04-19 07:24:50.901909] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.904600] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 326da56e-eb9f-494a-b33c-a763b21ffd4e. (Possible split-brain) >[2016-04-19 07:24:50.905558] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e> (326da56e-eb9f-494a-b33c-a763b21ffd4e) [No such file or directory] >[2016-04-19 07:24:50.905629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e> (326da56e-eb9f-494a-b33c-a763b21ffd4e) [No such file or directory] >[2016-04-19 07:24:50.908461] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e> (326da56e-eb9f-494a-b33c-a763b21ffd4e) [No such file or directory] >[2016-04-19 07:24:50.908647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e> (326da56e-eb9f-494a-b33c-a763b21ffd4e) [No such file or directory] >[2016-04-19 07:24:50.908778] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:326da56e-eb9f-494a-b33c-a763b21ffd4e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.916428] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.917411] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3> (7d63c418-f654-4178-81ed-c79e1c6040a3) [No such file or directory] >[2016-04-19 07:24:50.917433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3> (7d63c418-f654-4178-81ed-c79e1c6040a3) [No such file or directory] >[2016-04-19 07:24:50.918523] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7d63c418-f654-4178-81ed-c79e1c6040a3. (Possible split-brain) >[2016-04-19 07:24:50.919562] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3> (7d63c418-f654-4178-81ed-c79e1c6040a3) [No such file or directory] >[2016-04-19 07:24:50.919645] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3> (7d63c418-f654-4178-81ed-c79e1c6040a3) [No such file or directory] >[2016-04-19 07:24:50.920857] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3> (7d63c418-f654-4178-81ed-c79e1c6040a3) [No such file or directory] >[2016-04-19 07:24:50.920984] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3> (7d63c418-f654-4178-81ed-c79e1c6040a3) [No such file or directory] >[2016-04-19 07:24:50.921108] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.923646] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7d63c418-f654-4178-81ed-c79e1c6040a3. (Possible split-brain) >[2016-04-19 07:24:50.924530] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3> (7d63c418-f654-4178-81ed-c79e1c6040a3) [No such file or directory] >[2016-04-19 07:24:50.924712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3> (7d63c418-f654-4178-81ed-c79e1c6040a3) [No such file or directory] >[2016-04-19 07:24:50.927532] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3> (7d63c418-f654-4178-81ed-c79e1c6040a3) [No such file or directory] >[2016-04-19 07:24:50.927855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3> (7d63c418-f654-4178-81ed-c79e1c6040a3) [No such file or directory] >[2016-04-19 07:24:50.928004] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7d63c418-f654-4178-81ed-c79e1c6040a3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.937372] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.938381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf> (d02e1e44-870f-44c5-963a-f70a1d1034bf) [No such file or directory] >[2016-04-19 07:24:50.938485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf> (d02e1e44-870f-44c5-963a-f70a1d1034bf) [No such file or directory] >[2016-04-19 07:24:50.939588] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d02e1e44-870f-44c5-963a-f70a1d1034bf. (Possible split-brain) >[2016-04-19 07:24:50.940390] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf> (d02e1e44-870f-44c5-963a-f70a1d1034bf) [No such file or directory] >[2016-04-19 07:24:50.940708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf> (d02e1e44-870f-44c5-963a-f70a1d1034bf) [No such file or directory] >[2016-04-19 07:24:50.941878] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf> (d02e1e44-870f-44c5-963a-f70a1d1034bf) [No such file or directory] >[2016-04-19 07:24:50.941944] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf> (d02e1e44-870f-44c5-963a-f70a1d1034bf) [No such file or directory] >[2016-04-19 07:24:50.942124] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.944916] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d02e1e44-870f-44c5-963a-f70a1d1034bf. (Possible split-brain) >[2016-04-19 07:24:50.945847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf> (d02e1e44-870f-44c5-963a-f70a1d1034bf) [No such file or directory] >[2016-04-19 07:24:50.946090] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf> (d02e1e44-870f-44c5-963a-f70a1d1034bf) [No such file or directory] >[2016-04-19 07:24:50.948402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf> (d02e1e44-870f-44c5-963a-f70a1d1034bf) [No such file or directory] >[2016-04-19 07:24:50.948737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf> (d02e1e44-870f-44c5-963a-f70a1d1034bf) [No such file or directory] >[2016-04-19 07:24:50.948877] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d02e1e44-870f-44c5-963a-f70a1d1034bf>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.956985] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.957814] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655> (d19e25e5-582b-4ad1-a7be-fda73e213655) [No such file or directory] >[2016-04-19 07:24:50.958015] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655> (d19e25e5-582b-4ad1-a7be-fda73e213655) [No such file or directory] >[2016-04-19 07:24:50.958847] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d19e25e5-582b-4ad1-a7be-fda73e213655. (Possible split-brain) >[2016-04-19 07:24:50.959708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655> (d19e25e5-582b-4ad1-a7be-fda73e213655) [No such file or directory] >[2016-04-19 07:24:50.960040] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655> (d19e25e5-582b-4ad1-a7be-fda73e213655) [No such file or directory] >[2016-04-19 07:24:50.961238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655> (d19e25e5-582b-4ad1-a7be-fda73e213655) [No such file or directory] >[2016-04-19 07:24:50.961382] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655> (d19e25e5-582b-4ad1-a7be-fda73e213655) [No such file or directory] >[2016-04-19 07:24:50.961610] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.964180] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d19e25e5-582b-4ad1-a7be-fda73e213655. (Possible split-brain) >[2016-04-19 07:24:50.965189] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655> (d19e25e5-582b-4ad1-a7be-fda73e213655) [No such file or directory] >[2016-04-19 07:24:50.965361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655> (d19e25e5-582b-4ad1-a7be-fda73e213655) [No such file or directory] >[2016-04-19 07:24:50.968640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655> (d19e25e5-582b-4ad1-a7be-fda73e213655) [No such file or directory] >[2016-04-19 07:24:50.968703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655> (d19e25e5-582b-4ad1-a7be-fda73e213655) [No such file or directory] >[2016-04-19 07:24:50.968877] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d19e25e5-582b-4ad1-a7be-fda73e213655>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:50.978074] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:50.978853] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609> (6b0bfa36-81ae-42c1-89d4-8d2040dc5609) [No such file or directory] >[2016-04-19 07:24:50.979097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609> (6b0bfa36-81ae-42c1-89d4-8d2040dc5609) [No such file or directory] >[2016-04-19 07:24:50.982041] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6b0bfa36-81ae-42c1-89d4-8d2040dc5609. (Possible split-brain) >[2016-04-19 07:24:50.983129] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609> (6b0bfa36-81ae-42c1-89d4-8d2040dc5609) [No such file or directory] >[2016-04-19 07:24:50.983367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609> (6b0bfa36-81ae-42c1-89d4-8d2040dc5609) [No such file or directory] >[2016-04-19 07:24:50.984602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609> (6b0bfa36-81ae-42c1-89d4-8d2040dc5609) [No such file or directory] >[2016-04-19 07:24:50.984852] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609> (6b0bfa36-81ae-42c1-89d4-8d2040dc5609) [No such file or directory] >[2016-04-19 07:24:50.985020] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:50.987790] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6b0bfa36-81ae-42c1-89d4-8d2040dc5609. (Possible split-brain) >[2016-04-19 07:24:50.988586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609> (6b0bfa36-81ae-42c1-89d4-8d2040dc5609) [No such file or directory] >[2016-04-19 07:24:50.988693] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609> (6b0bfa36-81ae-42c1-89d4-8d2040dc5609) [No such file or directory] >[2016-04-19 07:24:50.992036] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609> (6b0bfa36-81ae-42c1-89d4-8d2040dc5609) [No such file or directory] >[2016-04-19 07:24:50.992185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609> (6b0bfa36-81ae-42c1-89d4-8d2040dc5609) [No such file or directory] >[2016-04-19 07:24:50.992410] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6b0bfa36-81ae-42c1-89d4-8d2040dc5609>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.002432] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.003385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070> (db028763-a3fc-4cbb-b5dd-a096ef9a6070) [No such file or directory] >[2016-04-19 07:24:51.003412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070> (db028763-a3fc-4cbb-b5dd-a096ef9a6070) [No such file or directory] >[2016-04-19 07:24:51.004613] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid db028763-a3fc-4cbb-b5dd-a096ef9a6070. (Possible split-brain) >[2016-04-19 07:24:51.005489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070> (db028763-a3fc-4cbb-b5dd-a096ef9a6070) [No such file or directory] >[2016-04-19 07:24:51.005769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070> (db028763-a3fc-4cbb-b5dd-a096ef9a6070) [No such file or directory] >[2016-04-19 07:24:51.007014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070> (db028763-a3fc-4cbb-b5dd-a096ef9a6070) [No such file or directory] >[2016-04-19 07:24:51.007064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070> (db028763-a3fc-4cbb-b5dd-a096ef9a6070) [No such file or directory] >[2016-04-19 07:24:51.007244] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.010098] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid db028763-a3fc-4cbb-b5dd-a096ef9a6070. (Possible split-brain) >[2016-04-19 07:24:51.011036] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070> (db028763-a3fc-4cbb-b5dd-a096ef9a6070) [No such file or directory] >[2016-04-19 07:24:51.011253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070> (db028763-a3fc-4cbb-b5dd-a096ef9a6070) [No such file or directory] >[2016-04-19 07:24:51.014091] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070> (db028763-a3fc-4cbb-b5dd-a096ef9a6070) [No such file or directory] >[2016-04-19 07:24:51.014157] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070> (db028763-a3fc-4cbb-b5dd-a096ef9a6070) [No such file or directory] >[2016-04-19 07:24:51.014394] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:db028763-a3fc-4cbb-b5dd-a096ef9a6070>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.023855] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.024626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6> (edfc815c-5689-4130-97b9-87d458f8aed6) [No such file or directory] >[2016-04-19 07:24:51.024752] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6> (edfc815c-5689-4130-97b9-87d458f8aed6) [No such file or directory] >[2016-04-19 07:24:51.027660] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid edfc815c-5689-4130-97b9-87d458f8aed6. (Possible split-brain) >[2016-04-19 07:24:51.028391] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6> (edfc815c-5689-4130-97b9-87d458f8aed6) [No such file or directory] >[2016-04-19 07:24:51.028714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6> (edfc815c-5689-4130-97b9-87d458f8aed6) [No such file or directory] >[2016-04-19 07:24:51.030081] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6> (edfc815c-5689-4130-97b9-87d458f8aed6) [No such file or directory] >[2016-04-19 07:24:51.030116] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6> (edfc815c-5689-4130-97b9-87d458f8aed6) [No such file or directory] >[2016-04-19 07:24:51.030350] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.032918] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid edfc815c-5689-4130-97b9-87d458f8aed6. (Possible split-brain) >[2016-04-19 07:24:51.033671] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6> (edfc815c-5689-4130-97b9-87d458f8aed6) [No such file or directory] >[2016-04-19 07:24:51.033828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6> (edfc815c-5689-4130-97b9-87d458f8aed6) [No such file or directory] >[2016-04-19 07:24:51.036714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6> (edfc815c-5689-4130-97b9-87d458f8aed6) [No such file or directory] >[2016-04-19 07:24:51.037019] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6> (edfc815c-5689-4130-97b9-87d458f8aed6) [No such file or directory] >[2016-04-19 07:24:51.037196] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:edfc815c-5689-4130-97b9-87d458f8aed6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.047100] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.048218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696> (5b7d89a5-f67c-400e-99d8-3e0b04ca2696) [No such file or directory] >[2016-04-19 07:24:51.048232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696> (5b7d89a5-f67c-400e-99d8-3e0b04ca2696) [No such file or directory] >[2016-04-19 07:24:51.050649] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5b7d89a5-f67c-400e-99d8-3e0b04ca2696. (Possible split-brain) >[2016-04-19 07:24:51.051681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696> (5b7d89a5-f67c-400e-99d8-3e0b04ca2696) [No such file or directory] >[2016-04-19 07:24:51.051730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696> (5b7d89a5-f67c-400e-99d8-3e0b04ca2696) [No such file or directory] >[2016-04-19 07:24:51.052884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696> (5b7d89a5-f67c-400e-99d8-3e0b04ca2696) [No such file or directory] >[2016-04-19 07:24:51.052909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696> (5b7d89a5-f67c-400e-99d8-3e0b04ca2696) [No such file or directory] >[2016-04-19 07:24:51.053559] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.055946] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5b7d89a5-f67c-400e-99d8-3e0b04ca2696. (Possible split-brain) >[2016-04-19 07:24:51.056814] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696> (5b7d89a5-f67c-400e-99d8-3e0b04ca2696) [No such file or directory] >[2016-04-19 07:24:51.056921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696> (5b7d89a5-f67c-400e-99d8-3e0b04ca2696) [No such file or directory] >[2016-04-19 07:24:51.059168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696> (5b7d89a5-f67c-400e-99d8-3e0b04ca2696) [No such file or directory] >[2016-04-19 07:24:51.059565] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696> (5b7d89a5-f67c-400e-99d8-3e0b04ca2696) [No such file or directory] >[2016-04-19 07:24:51.059695] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5b7d89a5-f67c-400e-99d8-3e0b04ca2696>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.068963] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.069656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327> (b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327) [No such file or directory] >[2016-04-19 07:24:51.069760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327> (b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327) [No such file or directory] >[2016-04-19 07:24:51.071654] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327. (Possible split-brain) >[2016-04-19 07:24:51.072267] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327> (b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327) [No such file or directory] >[2016-04-19 07:24:51.072311] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327> (b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327) [No such file or directory] >[2016-04-19 07:24:51.073332] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327> (b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327) [No such file or directory] >[2016-04-19 07:24:51.073363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327> (b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327) [No such file or directory] >[2016-04-19 07:24:51.073549] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.075972] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327. (Possible split-brain) >[2016-04-19 07:24:51.076503] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327> (b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327) [No such file or directory] >[2016-04-19 07:24:51.076580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327> (b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327) [No such file or directory] >[2016-04-19 07:24:51.078786] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327> (b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327) [No such file or directory] >[2016-04-19 07:24:51.078927] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327> (b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327) [No such file or directory] >[2016-04-19 07:24:51.079030] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b1bf0666-dadd-4e7d-a1bf-f2bcb41c6327>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.086118] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.086861] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62> (7a0d1f6d-a840-45ed-8015-b9af5baafe62) [No such file or directory] >[2016-04-19 07:24:51.087024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62> (7a0d1f6d-a840-45ed-8015-b9af5baafe62) [No such file or directory] >[2016-04-19 07:24:51.087960] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7a0d1f6d-a840-45ed-8015-b9af5baafe62. (Possible split-brain) >[2016-04-19 07:24:51.089251] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62> (7a0d1f6d-a840-45ed-8015-b9af5baafe62) [No such file or directory] >[2016-04-19 07:24:51.089252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62> (7a0d1f6d-a840-45ed-8015-b9af5baafe62) [No such file or directory] >[2016-04-19 07:24:51.090573] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62> (7a0d1f6d-a840-45ed-8015-b9af5baafe62) [No such file or directory] >[2016-04-19 07:24:51.090634] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62> (7a0d1f6d-a840-45ed-8015-b9af5baafe62) [No such file or directory] >[2016-04-19 07:24:51.091058] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.093662] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7a0d1f6d-a840-45ed-8015-b9af5baafe62. (Possible split-brain) >[2016-04-19 07:24:51.094821] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62> (7a0d1f6d-a840-45ed-8015-b9af5baafe62) [No such file or directory] >[2016-04-19 07:24:51.094846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62> (7a0d1f6d-a840-45ed-8015-b9af5baafe62) [No such file or directory] >[2016-04-19 07:24:51.098532] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62> (7a0d1f6d-a840-45ed-8015-b9af5baafe62) [No such file or directory] >[2016-04-19 07:24:51.098769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62> (7a0d1f6d-a840-45ed-8015-b9af5baafe62) [No such file or directory] >[2016-04-19 07:24:51.099053] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7a0d1f6d-a840-45ed-8015-b9af5baafe62>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.109709] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.110703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e> (2a09f441-db7e-4062-bb90-c0e3a077f15e) [No such file or directory] >[2016-04-19 07:24:51.110872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e> (2a09f441-db7e-4062-bb90-c0e3a077f15e) [No such file or directory] >[2016-04-19 07:24:51.113789] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2a09f441-db7e-4062-bb90-c0e3a077f15e. (Possible split-brain) >[2016-04-19 07:24:51.114854] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e> (2a09f441-db7e-4062-bb90-c0e3a077f15e) [No such file or directory] >[2016-04-19 07:24:51.115037] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e> (2a09f441-db7e-4062-bb90-c0e3a077f15e) [No such file or directory] >[2016-04-19 07:24:51.116290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e> (2a09f441-db7e-4062-bb90-c0e3a077f15e) [No such file or directory] >[2016-04-19 07:24:51.116291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e> (2a09f441-db7e-4062-bb90-c0e3a077f15e) [No such file or directory] >[2016-04-19 07:24:51.116769] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.119577] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2a09f441-db7e-4062-bb90-c0e3a077f15e. (Possible split-brain) >[2016-04-19 07:24:51.120544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e> (2a09f441-db7e-4062-bb90-c0e3a077f15e) [No such file or directory] >[2016-04-19 07:24:51.120925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e> (2a09f441-db7e-4062-bb90-c0e3a077f15e) [No such file or directory] >[2016-04-19 07:24:51.123247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e> (2a09f441-db7e-4062-bb90-c0e3a077f15e) [No such file or directory] >[2016-04-19 07:24:51.123332] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e> (2a09f441-db7e-4062-bb90-c0e3a077f15e) [No such file or directory] >[2016-04-19 07:24:51.123450] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2a09f441-db7e-4062-bb90-c0e3a077f15e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.131763] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.132550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959> (e3dc6a83-f3ea-485c-b150-57e3460e6959) [No such file or directory] >[2016-04-19 07:24:51.132550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959> (e3dc6a83-f3ea-485c-b150-57e3460e6959) [No such file or directory] >[2016-04-19 07:24:51.135445] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e3dc6a83-f3ea-485c-b150-57e3460e6959. (Possible split-brain) >[2016-04-19 07:24:51.136244] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959> (e3dc6a83-f3ea-485c-b150-57e3460e6959) [No such file or directory] >[2016-04-19 07:24:51.136405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959> (e3dc6a83-f3ea-485c-b150-57e3460e6959) [No such file or directory] >[2016-04-19 07:24:51.137650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959> (e3dc6a83-f3ea-485c-b150-57e3460e6959) [No such file or directory] >[2016-04-19 07:24:51.137724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959> (e3dc6a83-f3ea-485c-b150-57e3460e6959) [No such file or directory] >[2016-04-19 07:24:51.137871] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.140624] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e3dc6a83-f3ea-485c-b150-57e3460e6959. (Possible split-brain) >[2016-04-19 07:24:51.141525] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959> (e3dc6a83-f3ea-485c-b150-57e3460e6959) [No such file or directory] >[2016-04-19 07:24:51.141664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959> (e3dc6a83-f3ea-485c-b150-57e3460e6959) [No such file or directory] >[2016-04-19 07:24:51.145626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959> (e3dc6a83-f3ea-485c-b150-57e3460e6959) [No such file or directory] >[2016-04-19 07:24:51.145736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959> (e3dc6a83-f3ea-485c-b150-57e3460e6959) [No such file or directory] >[2016-04-19 07:24:51.145958] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e3dc6a83-f3ea-485c-b150-57e3460e6959>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.153997] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.154778] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a> (291b0ad6-70e6-42a8-bcee-2339fe2bcf5a) [No such file or directory] >[2016-04-19 07:24:51.154869] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a> (291b0ad6-70e6-42a8-bcee-2339fe2bcf5a) [No such file or directory] >[2016-04-19 07:24:51.156042] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 291b0ad6-70e6-42a8-bcee-2339fe2bcf5a. (Possible split-brain) >[2016-04-19 07:24:51.157066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a> (291b0ad6-70e6-42a8-bcee-2339fe2bcf5a) [No such file or directory] >[2016-04-19 07:24:51.157389] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a> (291b0ad6-70e6-42a8-bcee-2339fe2bcf5a) [No such file or directory] >[2016-04-19 07:24:51.158749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a> (291b0ad6-70e6-42a8-bcee-2339fe2bcf5a) [No such file or directory] >[2016-04-19 07:24:51.158839] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a> (291b0ad6-70e6-42a8-bcee-2339fe2bcf5a) [No such file or directory] >[2016-04-19 07:24:51.159254] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.161967] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 291b0ad6-70e6-42a8-bcee-2339fe2bcf5a. (Possible split-brain) >[2016-04-19 07:24:51.162866] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a> (291b0ad6-70e6-42a8-bcee-2339fe2bcf5a) [No such file or directory] >[2016-04-19 07:24:51.162909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a> (291b0ad6-70e6-42a8-bcee-2339fe2bcf5a) [No such file or directory] >[2016-04-19 07:24:51.165736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a> (291b0ad6-70e6-42a8-bcee-2339fe2bcf5a) [No such file or directory] >[2016-04-19 07:24:51.165799] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a> (291b0ad6-70e6-42a8-bcee-2339fe2bcf5a) [No such file or directory] >[2016-04-19 07:24:51.165997] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:291b0ad6-70e6-42a8-bcee-2339fe2bcf5a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.176226] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.177307] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85> (d452cd2d-3339-4dce-a469-ffd4fed9bd85) [No such file or directory] >[2016-04-19 07:24:51.177497] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85> (d452cd2d-3339-4dce-a469-ffd4fed9bd85) [No such file or directory] >[2016-04-19 07:24:51.180383] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d452cd2d-3339-4dce-a469-ffd4fed9bd85. (Possible split-brain) >[2016-04-19 07:24:51.181546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85> (d452cd2d-3339-4dce-a469-ffd4fed9bd85) [No such file or directory] >[2016-04-19 07:24:51.181543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85> (d452cd2d-3339-4dce-a469-ffd4fed9bd85) [No such file or directory] >[2016-04-19 07:24:51.182810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85> (d452cd2d-3339-4dce-a469-ffd4fed9bd85) [No such file or directory] >[2016-04-19 07:24:51.183086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85> (d452cd2d-3339-4dce-a469-ffd4fed9bd85) [No such file or directory] >[2016-04-19 07:24:51.183384] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.186108] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d452cd2d-3339-4dce-a469-ffd4fed9bd85. (Possible split-brain) >[2016-04-19 07:24:51.187353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85> (d452cd2d-3339-4dce-a469-ffd4fed9bd85) [No such file or directory] >[2016-04-19 07:24:51.187378] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85> (d452cd2d-3339-4dce-a469-ffd4fed9bd85) [No such file or directory] >[2016-04-19 07:24:51.191180] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85> (d452cd2d-3339-4dce-a469-ffd4fed9bd85) [No such file or directory] >[2016-04-19 07:24:51.191294] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85> (d452cd2d-3339-4dce-a469-ffd4fed9bd85) [No such file or directory] >[2016-04-19 07:24:51.192006] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d452cd2d-3339-4dce-a469-ffd4fed9bd85>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.201025] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.201877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee> (fead6223-29b1-46cc-bd3d-7a917cf005ee) [No such file or directory] >[2016-04-19 07:24:51.201906] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee> (fead6223-29b1-46cc-bd3d-7a917cf005ee) [No such file or directory] >[2016-04-19 07:24:51.202771] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fead6223-29b1-46cc-bd3d-7a917cf005ee. (Possible split-brain) >[2016-04-19 07:24:51.203634] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee> (fead6223-29b1-46cc-bd3d-7a917cf005ee) [No such file or directory] >[2016-04-19 07:24:51.203778] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee> (fead6223-29b1-46cc-bd3d-7a917cf005ee) [No such file or directory] >[2016-04-19 07:24:51.205127] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee> (fead6223-29b1-46cc-bd3d-7a917cf005ee) [No such file or directory] >[2016-04-19 07:24:51.205149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee> (fead6223-29b1-46cc-bd3d-7a917cf005ee) [No such file or directory] >[2016-04-19 07:24:51.205522] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.208182] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid fead6223-29b1-46cc-bd3d-7a917cf005ee. (Possible split-brain) >[2016-04-19 07:24:51.209059] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee> (fead6223-29b1-46cc-bd3d-7a917cf005ee) [No such file or directory] >[2016-04-19 07:24:51.209410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee> (fead6223-29b1-46cc-bd3d-7a917cf005ee) [No such file or directory] >[2016-04-19 07:24:51.211931] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee> (fead6223-29b1-46cc-bd3d-7a917cf005ee) [No such file or directory] >[2016-04-19 07:24:51.211995] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee> (fead6223-29b1-46cc-bd3d-7a917cf005ee) [No such file or directory] >[2016-04-19 07:24:51.212120] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fead6223-29b1-46cc-bd3d-7a917cf005ee>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.219194] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.220228] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7dd64734-e988-429e-a404-8211150b30ff> (7dd64734-e988-429e-a404-8211150b30ff) [No such file or directory] >[2016-04-19 07:24:51.220272] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7dd64734-e988-429e-a404-8211150b30ff> (7dd64734-e988-429e-a404-8211150b30ff) [No such file or directory] >[2016-04-19 07:24:51.221255] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7dd64734-e988-429e-a404-8211150b30ff. (Possible split-brain) >[2016-04-19 07:24:51.222244] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7dd64734-e988-429e-a404-8211150b30ff> (7dd64734-e988-429e-a404-8211150b30ff) [No such file or directory] >[2016-04-19 07:24:51.222481] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7dd64734-e988-429e-a404-8211150b30ff> (7dd64734-e988-429e-a404-8211150b30ff) [No such file or directory] >[2016-04-19 07:24:51.223617] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7dd64734-e988-429e-a404-8211150b30ff> (7dd64734-e988-429e-a404-8211150b30ff) [No such file or directory] >[2016-04-19 07:24:51.223983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7dd64734-e988-429e-a404-8211150b30ff> (7dd64734-e988-429e-a404-8211150b30ff) [No such file or directory] >[2016-04-19 07:24:51.224103] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7dd64734-e988-429e-a404-8211150b30ff>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.226669] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7dd64734-e988-429e-a404-8211150b30ff. (Possible split-brain) >[2016-04-19 07:24:51.227649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7dd64734-e988-429e-a404-8211150b30ff> (7dd64734-e988-429e-a404-8211150b30ff) [No such file or directory] >[2016-04-19 07:24:51.227745] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7dd64734-e988-429e-a404-8211150b30ff> (7dd64734-e988-429e-a404-8211150b30ff) [No such file or directory] >[2016-04-19 07:24:51.230492] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7dd64734-e988-429e-a404-8211150b30ff> (7dd64734-e988-429e-a404-8211150b30ff) [No such file or directory] >[2016-04-19 07:24:51.230570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7dd64734-e988-429e-a404-8211150b30ff> (7dd64734-e988-429e-a404-8211150b30ff) [No such file or directory] >[2016-04-19 07:24:51.230703] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7dd64734-e988-429e-a404-8211150b30ff>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.240879] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.242054] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958> (e6a38213-7f17-4af1-be17-07fb5c360958) [No such file or directory] >[2016-04-19 07:24:51.242139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958> (e6a38213-7f17-4af1-be17-07fb5c360958) [No such file or directory] >[2016-04-19 07:24:51.243279] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e6a38213-7f17-4af1-be17-07fb5c360958. (Possible split-brain) >[2016-04-19 07:24:51.244416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958> (e6a38213-7f17-4af1-be17-07fb5c360958) [No such file or directory] >[2016-04-19 07:24:51.244437] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958> (e6a38213-7f17-4af1-be17-07fb5c360958) [No such file or directory] >[2016-04-19 07:24:51.245595] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958> (e6a38213-7f17-4af1-be17-07fb5c360958) [No such file or directory] >[2016-04-19 07:24:51.245690] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958> (e6a38213-7f17-4af1-be17-07fb5c360958) [No such file or directory] >[2016-04-19 07:24:51.246141] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.248837] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e6a38213-7f17-4af1-be17-07fb5c360958. (Possible split-brain) >[2016-04-19 07:24:51.249946] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958> (e6a38213-7f17-4af1-be17-07fb5c360958) [No such file or directory] >[2016-04-19 07:24:51.250044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958> (e6a38213-7f17-4af1-be17-07fb5c360958) [No such file or directory] >[2016-04-19 07:24:51.252708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958> (e6a38213-7f17-4af1-be17-07fb5c360958) [No such file or directory] >[2016-04-19 07:24:51.252744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958> (e6a38213-7f17-4af1-be17-07fb5c360958) [No such file or directory] >[2016-04-19 07:24:51.252980] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e6a38213-7f17-4af1-be17-07fb5c360958>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.263063] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.264085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392> (d027ebef-0a0e-4608-b1c8-0bcc417d1392) [No such file or directory] >[2016-04-19 07:24:51.264097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392> (d027ebef-0a0e-4608-b1c8-0bcc417d1392) [No such file or directory] >[2016-04-19 07:24:51.265343] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d027ebef-0a0e-4608-b1c8-0bcc417d1392. (Possible split-brain) >[2016-04-19 07:24:51.266625] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392> (d027ebef-0a0e-4608-b1c8-0bcc417d1392) [No such file or directory] >[2016-04-19 07:24:51.266723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392> (d027ebef-0a0e-4608-b1c8-0bcc417d1392) [No such file or directory] >[2016-04-19 07:24:51.267944] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392> (d027ebef-0a0e-4608-b1c8-0bcc417d1392) [No such file or directory] >[2016-04-19 07:24:51.268058] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392> (d027ebef-0a0e-4608-b1c8-0bcc417d1392) [No such file or directory] >[2016-04-19 07:24:51.268389] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.271075] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d027ebef-0a0e-4608-b1c8-0bcc417d1392. (Possible split-brain) >[2016-04-19 07:24:51.272082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392> (d027ebef-0a0e-4608-b1c8-0bcc417d1392) [No such file or directory] >[2016-04-19 07:24:51.272075] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392> (d027ebef-0a0e-4608-b1c8-0bcc417d1392) [No such file or directory] >[2016-04-19 07:24:51.274668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392> (d027ebef-0a0e-4608-b1c8-0bcc417d1392) [No such file or directory] >[2016-04-19 07:24:51.274739] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392> (d027ebef-0a0e-4608-b1c8-0bcc417d1392) [No such file or directory] >[2016-04-19 07:24:51.275164] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d027ebef-0a0e-4608-b1c8-0bcc417d1392>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.285582] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.286424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:297538e2-0390-4870-add7-1052efa28486> (297538e2-0390-4870-add7-1052efa28486) [No such file or directory] >[2016-04-19 07:24:51.286799] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:297538e2-0390-4870-add7-1052efa28486> (297538e2-0390-4870-add7-1052efa28486) [No such file or directory] >[2016-04-19 07:24:51.289647] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 297538e2-0390-4870-add7-1052efa28486. (Possible split-brain) >[2016-04-19 07:24:51.290685] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:297538e2-0390-4870-add7-1052efa28486> (297538e2-0390-4870-add7-1052efa28486) [No such file or directory] >[2016-04-19 07:24:51.290715] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:297538e2-0390-4870-add7-1052efa28486> (297538e2-0390-4870-add7-1052efa28486) [No such file or directory] >[2016-04-19 07:24:51.291774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:297538e2-0390-4870-add7-1052efa28486> (297538e2-0390-4870-add7-1052efa28486) [No such file or directory] >[2016-04-19 07:24:51.292028] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:297538e2-0390-4870-add7-1052efa28486> (297538e2-0390-4870-add7-1052efa28486) [No such file or directory] >[2016-04-19 07:24:51.292424] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:297538e2-0390-4870-add7-1052efa28486>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.295379] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 297538e2-0390-4870-add7-1052efa28486. (Possible split-brain) >[2016-04-19 07:24:51.296400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:297538e2-0390-4870-add7-1052efa28486> (297538e2-0390-4870-add7-1052efa28486) [No such file or directory] >[2016-04-19 07:24:51.296421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:297538e2-0390-4870-add7-1052efa28486> (297538e2-0390-4870-add7-1052efa28486) [No such file or directory] >[2016-04-19 07:24:51.299790] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:297538e2-0390-4870-add7-1052efa28486> (297538e2-0390-4870-add7-1052efa28486) [No such file or directory] >[2016-04-19 07:24:51.300432] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:297538e2-0390-4870-add7-1052efa28486> (297538e2-0390-4870-add7-1052efa28486) [No such file or directory] >[2016-04-19 07:24:51.300995] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:297538e2-0390-4870-add7-1052efa28486>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.309716] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.310674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11> (b0aa9009-b818-43f6-8893-1cda84c24d11) [No such file or directory] >[2016-04-19 07:24:51.310677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11> (b0aa9009-b818-43f6-8893-1cda84c24d11) [No such file or directory] >[2016-04-19 07:24:51.313472] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b0aa9009-b818-43f6-8893-1cda84c24d11. (Possible split-brain) >[2016-04-19 07:24:51.314479] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11> (b0aa9009-b818-43f6-8893-1cda84c24d11) [No such file or directory] >[2016-04-19 07:24:51.314680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11> (b0aa9009-b818-43f6-8893-1cda84c24d11) [No such file or directory] >[2016-04-19 07:24:51.315904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11> (b0aa9009-b818-43f6-8893-1cda84c24d11) [No such file or directory] >[2016-04-19 07:24:51.316164] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11> (b0aa9009-b818-43f6-8893-1cda84c24d11) [No such file or directory] >[2016-04-19 07:24:51.316418] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.319019] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b0aa9009-b818-43f6-8893-1cda84c24d11. (Possible split-brain) >[2016-04-19 07:24:51.319879] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11> (b0aa9009-b818-43f6-8893-1cda84c24d11) [No such file or directory] >[2016-04-19 07:24:51.320018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11> (b0aa9009-b818-43f6-8893-1cda84c24d11) [No such file or directory] >[2016-04-19 07:24:51.324155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11> (b0aa9009-b818-43f6-8893-1cda84c24d11) [No such file or directory] >[2016-04-19 07:24:51.324246] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11> (b0aa9009-b818-43f6-8893-1cda84c24d11) [No such file or directory] >[2016-04-19 07:24:51.324464] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b0aa9009-b818-43f6-8893-1cda84c24d11>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.334273] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.335030] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133> (772b9bc2-bbce-416e-b8f6-8ef9bebb5133) [No such file or directory] >[2016-04-19 07:24:51.335369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133> (772b9bc2-bbce-416e-b8f6-8ef9bebb5133) [No such file or directory] >[2016-04-19 07:24:51.338202] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 772b9bc2-bbce-416e-b8f6-8ef9bebb5133. (Possible split-brain) >[2016-04-19 07:24:51.339119] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133> (772b9bc2-bbce-416e-b8f6-8ef9bebb5133) [No such file or directory] >[2016-04-19 07:24:51.339135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133> (772b9bc2-bbce-416e-b8f6-8ef9bebb5133) [No such file or directory] >[2016-04-19 07:24:51.340418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133> (772b9bc2-bbce-416e-b8f6-8ef9bebb5133) [No such file or directory] >[2016-04-19 07:24:51.340533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133> (772b9bc2-bbce-416e-b8f6-8ef9bebb5133) [No such file or directory] >[2016-04-19 07:24:51.340888] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.343632] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 772b9bc2-bbce-416e-b8f6-8ef9bebb5133. (Possible split-brain) >[2016-04-19 07:24:51.344415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133> (772b9bc2-bbce-416e-b8f6-8ef9bebb5133) [No such file or directory] >[2016-04-19 07:24:51.344767] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133> (772b9bc2-bbce-416e-b8f6-8ef9bebb5133) [No such file or directory] >[2016-04-19 07:24:51.348837] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133> (772b9bc2-bbce-416e-b8f6-8ef9bebb5133) [No such file or directory] >[2016-04-19 07:24:51.349050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133> (772b9bc2-bbce-416e-b8f6-8ef9bebb5133) [No such file or directory] >[2016-04-19 07:24:51.349229] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:772b9bc2-bbce-416e-b8f6-8ef9bebb5133>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.358172] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.359096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6549de37-948f-47de-bb73-400e6eb300eb> (6549de37-948f-47de-bb73-400e6eb300eb) [No such file or directory] >[2016-04-19 07:24:51.359110] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6549de37-948f-47de-bb73-400e6eb300eb> (6549de37-948f-47de-bb73-400e6eb300eb) [No such file or directory] >[2016-04-19 07:24:51.361992] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6549de37-948f-47de-bb73-400e6eb300eb. (Possible split-brain) >[2016-04-19 07:24:51.363012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6549de37-948f-47de-bb73-400e6eb300eb> (6549de37-948f-47de-bb73-400e6eb300eb) [No such file or directory] >[2016-04-19 07:24:51.363014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6549de37-948f-47de-bb73-400e6eb300eb> (6549de37-948f-47de-bb73-400e6eb300eb) [No such file or directory] >[2016-04-19 07:24:51.364229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6549de37-948f-47de-bb73-400e6eb300eb> (6549de37-948f-47de-bb73-400e6eb300eb) [No such file or directory] >[2016-04-19 07:24:51.364500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6549de37-948f-47de-bb73-400e6eb300eb> (6549de37-948f-47de-bb73-400e6eb300eb) [No such file or directory] >[2016-04-19 07:24:51.364767] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6549de37-948f-47de-bb73-400e6eb300eb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.367551] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 6549de37-948f-47de-bb73-400e6eb300eb. (Possible split-brain) >[2016-04-19 07:24:51.368453] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6549de37-948f-47de-bb73-400e6eb300eb> (6549de37-948f-47de-bb73-400e6eb300eb) [No such file or directory] >[2016-04-19 07:24:51.368460] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6549de37-948f-47de-bb73-400e6eb300eb> (6549de37-948f-47de-bb73-400e6eb300eb) [No such file or directory] >[2016-04-19 07:24:51.372622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:6549de37-948f-47de-bb73-400e6eb300eb> (6549de37-948f-47de-bb73-400e6eb300eb) [No such file or directory] >[2016-04-19 07:24:51.372622] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:6549de37-948f-47de-bb73-400e6eb300eb> (6549de37-948f-47de-bb73-400e6eb300eb) [No such file or directory] >[2016-04-19 07:24:51.372983] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6549de37-948f-47de-bb73-400e6eb300eb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.382171] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.383112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:21256498-80a7-4068-8a1e-d62de340fb60> (21256498-80a7-4068-8a1e-d62de340fb60) [No such file or directory] >[2016-04-19 07:24:51.383131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:21256498-80a7-4068-8a1e-d62de340fb60> (21256498-80a7-4068-8a1e-d62de340fb60) [No such file or directory] >[2016-04-19 07:24:51.384354] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 21256498-80a7-4068-8a1e-d62de340fb60. (Possible split-brain) >[2016-04-19 07:24:51.385169] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:21256498-80a7-4068-8a1e-d62de340fb60> (21256498-80a7-4068-8a1e-d62de340fb60) [No such file or directory] >[2016-04-19 07:24:51.385188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:21256498-80a7-4068-8a1e-d62de340fb60> (21256498-80a7-4068-8a1e-d62de340fb60) [No such file or directory] >[2016-04-19 07:24:51.386744] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:21256498-80a7-4068-8a1e-d62de340fb60> (21256498-80a7-4068-8a1e-d62de340fb60) [No such file or directory] >[2016-04-19 07:24:51.386892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:21256498-80a7-4068-8a1e-d62de340fb60> (21256498-80a7-4068-8a1e-d62de340fb60) [No such file or directory] >[2016-04-19 07:24:51.387042] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:21256498-80a7-4068-8a1e-d62de340fb60>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.389751] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 21256498-80a7-4068-8a1e-d62de340fb60. (Possible split-brain) >[2016-04-19 07:24:51.390677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:21256498-80a7-4068-8a1e-d62de340fb60> (21256498-80a7-4068-8a1e-d62de340fb60) [No such file or directory] >[2016-04-19 07:24:51.390750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:21256498-80a7-4068-8a1e-d62de340fb60> (21256498-80a7-4068-8a1e-d62de340fb60) [No such file or directory] >[2016-04-19 07:24:51.393296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:21256498-80a7-4068-8a1e-d62de340fb60> (21256498-80a7-4068-8a1e-d62de340fb60) [No such file or directory] >[2016-04-19 07:24:51.393392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:21256498-80a7-4068-8a1e-d62de340fb60> (21256498-80a7-4068-8a1e-d62de340fb60) [No such file or directory] >[2016-04-19 07:24:51.393573] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:21256498-80a7-4068-8a1e-d62de340fb60>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.401031] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.401902] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40> (3afebaff-a92b-4283-bf86-7ed1f4610f40) [No such file or directory] >[2016-04-19 07:24:51.401936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40> (3afebaff-a92b-4283-bf86-7ed1f4610f40) [No such file or directory] >[2016-04-19 07:24:51.404521] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3afebaff-a92b-4283-bf86-7ed1f4610f40. (Possible split-brain) >[2016-04-19 07:24:51.405360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40> (3afebaff-a92b-4283-bf86-7ed1f4610f40) [No such file or directory] >[2016-04-19 07:24:51.405388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40> (3afebaff-a92b-4283-bf86-7ed1f4610f40) [No such file or directory] >[2016-04-19 07:24:51.406651] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40> (3afebaff-a92b-4283-bf86-7ed1f4610f40) [No such file or directory] >[2016-04-19 07:24:51.406875] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40> (3afebaff-a92b-4283-bf86-7ed1f4610f40) [No such file or directory] >[2016-04-19 07:24:51.407045] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.409804] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3afebaff-a92b-4283-bf86-7ed1f4610f40. (Possible split-brain) >[2016-04-19 07:24:51.410619] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40> (3afebaff-a92b-4283-bf86-7ed1f4610f40) [No such file or directory] >[2016-04-19 07:24:51.410901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40> (3afebaff-a92b-4283-bf86-7ed1f4610f40) [No such file or directory] >[2016-04-19 07:24:51.415161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40> (3afebaff-a92b-4283-bf86-7ed1f4610f40) [No such file or directory] >[2016-04-19 07:24:51.415208] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40> (3afebaff-a92b-4283-bf86-7ed1f4610f40) [No such file or directory] >[2016-04-19 07:24:51.415537] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3afebaff-a92b-4283-bf86-7ed1f4610f40>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.425677] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.426541] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d> (3eb8400b-a1b8-4f4d-8b2f-69673da9478d) [No such file or directory] >[2016-04-19 07:24:51.426557] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d> (3eb8400b-a1b8-4f4d-8b2f-69673da9478d) [No such file or directory] >[2016-04-19 07:24:51.427654] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3eb8400b-a1b8-4f4d-8b2f-69673da9478d. (Possible split-brain) >[2016-04-19 07:24:51.428433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d> (3eb8400b-a1b8-4f4d-8b2f-69673da9478d) [No such file or directory] >[2016-04-19 07:24:51.428511] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d> (3eb8400b-a1b8-4f4d-8b2f-69673da9478d) [No such file or directory] >[2016-04-19 07:24:51.429782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d> (3eb8400b-a1b8-4f4d-8b2f-69673da9478d) [No such file or directory] >[2016-04-19 07:24:51.429900] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d> (3eb8400b-a1b8-4f4d-8b2f-69673da9478d) [No such file or directory] >[2016-04-19 07:24:51.430215] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.432892] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 3eb8400b-a1b8-4f4d-8b2f-69673da9478d. (Possible split-brain) >[2016-04-19 07:24:51.433776] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d> (3eb8400b-a1b8-4f4d-8b2f-69673da9478d) [No such file or directory] >[2016-04-19 07:24:51.433897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d> (3eb8400b-a1b8-4f4d-8b2f-69673da9478d) [No such file or directory] >[2016-04-19 07:24:51.438687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d> (3eb8400b-a1b8-4f4d-8b2f-69673da9478d) [No such file or directory] >[2016-04-19 07:24:51.438757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d> (3eb8400b-a1b8-4f4d-8b2f-69673da9478d) [No such file or directory] >[2016-04-19 07:24:51.439048] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3eb8400b-a1b8-4f4d-8b2f-69673da9478d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.446532] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.447107] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c> (a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c) [No such file or directory] >[2016-04-19 07:24:51.447146] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c> (a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c) [No such file or directory] >[2016-04-19 07:24:51.448395] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c. (Possible split-brain) >[2016-04-19 07:24:51.449354] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c> (a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c) [No such file or directory] >[2016-04-19 07:24:51.449409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c> (a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c) [No such file or directory] >[2016-04-19 07:24:51.450528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c> (a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c) [No such file or directory] >[2016-04-19 07:24:51.450559] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c> (a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c) [No such file or directory] >[2016-04-19 07:24:51.450871] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.453541] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c. (Possible split-brain) >[2016-04-19 07:24:51.454456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c> (a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c) [No such file or directory] >[2016-04-19 07:24:51.454658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c> (a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c) [No such file or directory] >[2016-04-19 07:24:51.457279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c> (a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c) [No such file or directory] >[2016-04-19 07:24:51.457390] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c> (a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c) [No such file or directory] >[2016-04-19 07:24:51.457550] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a6bfbb26-e983-4ac6-ac77-6d55fc28eb2c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.468044] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.469236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b> (1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b) [No such file or directory] >[2016-04-19 07:24:51.469265] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b> (1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b) [No such file or directory] >[2016-04-19 07:24:51.470506] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b. (Possible split-brain) >[2016-04-19 07:24:51.471600] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b> (1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b) [No such file or directory] >[2016-04-19 07:24:51.471630] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b> (1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b) [No such file or directory] >[2016-04-19 07:24:51.472816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b> (1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b) [No such file or directory] >[2016-04-19 07:24:51.472846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b> (1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b) [No such file or directory] >[2016-04-19 07:24:51.473183] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.475872] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b. (Possible split-brain) >[2016-04-19 07:24:51.476969] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b> (1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b) [No such file or directory] >[2016-04-19 07:24:51.477354] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b> (1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b) [No such file or directory] >[2016-04-19 07:24:51.481241] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b> (1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b) [No such file or directory] >[2016-04-19 07:24:51.481401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b> (1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b) [No such file or directory] >[2016-04-19 07:24:51.481649] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1fdf8f7c-87d1-4e28-a2a5-bb92e5f66f0b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.491223] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.492471] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dad28ee3-6d15-4147-813e-c482873df32f> (dad28ee3-6d15-4147-813e-c482873df32f) [No such file or directory] >[2016-04-19 07:24:51.492571] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dad28ee3-6d15-4147-813e-c482873df32f> (dad28ee3-6d15-4147-813e-c482873df32f) [No such file or directory] >[2016-04-19 07:24:51.493710] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dad28ee3-6d15-4147-813e-c482873df32f. (Possible split-brain) >[2016-04-19 07:24:51.494947] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dad28ee3-6d15-4147-813e-c482873df32f> (dad28ee3-6d15-4147-813e-c482873df32f) [No such file or directory] >[2016-04-19 07:24:51.494949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dad28ee3-6d15-4147-813e-c482873df32f> (dad28ee3-6d15-4147-813e-c482873df32f) [No such file or directory] >[2016-04-19 07:24:51.496163] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dad28ee3-6d15-4147-813e-c482873df32f> (dad28ee3-6d15-4147-813e-c482873df32f) [No such file or directory] >[2016-04-19 07:24:51.496267] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dad28ee3-6d15-4147-813e-c482873df32f> (dad28ee3-6d15-4147-813e-c482873df32f) [No such file or directory] >[2016-04-19 07:24:51.496834] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:dad28ee3-6d15-4147-813e-c482873df32f>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.499488] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dad28ee3-6d15-4147-813e-c482873df32f. (Possible split-brain) >[2016-04-19 07:24:51.500551] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dad28ee3-6d15-4147-813e-c482873df32f> (dad28ee3-6d15-4147-813e-c482873df32f) [No such file or directory] >[2016-04-19 07:24:51.500560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dad28ee3-6d15-4147-813e-c482873df32f> (dad28ee3-6d15-4147-813e-c482873df32f) [No such file or directory] >[2016-04-19 07:24:51.503479] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dad28ee3-6d15-4147-813e-c482873df32f> (dad28ee3-6d15-4147-813e-c482873df32f) [No such file or directory] >[2016-04-19 07:24:51.503513] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dad28ee3-6d15-4147-813e-c482873df32f> (dad28ee3-6d15-4147-813e-c482873df32f) [No such file or directory] >[2016-04-19 07:24:51.503676] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:dad28ee3-6d15-4147-813e-c482873df32f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.513493] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.514177] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f> (b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f) [No such file or directory] >[2016-04-19 07:24:51.514366] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f> (b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f) [No such file or directory] >[2016-04-19 07:24:51.517207] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f. (Possible split-brain) >[2016-04-19 07:24:51.518262] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f> (b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f) [No such file or directory] >[2016-04-19 07:24:51.518411] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f> (b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f) [No such file or directory] >[2016-04-19 07:24:51.519601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f> (b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f) [No such file or directory] >[2016-04-19 07:24:51.519686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f> (b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f) [No such file or directory] >[2016-04-19 07:24:51.520077] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.523079] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f. (Possible split-brain) >[2016-04-19 07:24:51.523999] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f> (b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f) [No such file or directory] >[2016-04-19 07:24:51.524105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f> (b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f) [No such file or directory] >[2016-04-19 07:24:51.527820] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f> (b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f) [No such file or directory] >[2016-04-19 07:24:51.528135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f> (b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f) [No such file or directory] >[2016-04-19 07:24:51.528309] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b91888b0-7d4d-4f6c-9aff-b1abc2b4eb2f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.536925] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.537742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a> (ec0137dc-2e82-45cd-973f-2a535cf3293a) [No such file or directory] >[2016-04-19 07:24:51.537801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a> (ec0137dc-2e82-45cd-973f-2a535cf3293a) [No such file or directory] >[2016-04-19 07:24:51.540715] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ec0137dc-2e82-45cd-973f-2a535cf3293a. (Possible split-brain) >[2016-04-19 07:24:51.541588] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a> (ec0137dc-2e82-45cd-973f-2a535cf3293a) [No such file or directory] >[2016-04-19 07:24:51.541788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a> (ec0137dc-2e82-45cd-973f-2a535cf3293a) [No such file or directory] >[2016-04-19 07:24:51.543035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a> (ec0137dc-2e82-45cd-973f-2a535cf3293a) [No such file or directory] >[2016-04-19 07:24:51.543162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a> (ec0137dc-2e82-45cd-973f-2a535cf3293a) [No such file or directory] >[2016-04-19 07:24:51.543458] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.546159] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ec0137dc-2e82-45cd-973f-2a535cf3293a. (Possible split-brain) >[2016-04-19 07:24:51.547089] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a> (ec0137dc-2e82-45cd-973f-2a535cf3293a) [No such file or directory] >[2016-04-19 07:24:51.547095] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a> (ec0137dc-2e82-45cd-973f-2a535cf3293a) [No such file or directory] >[2016-04-19 07:24:51.551850] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a> (ec0137dc-2e82-45cd-973f-2a535cf3293a) [No such file or directory] >[2016-04-19 07:24:51.551883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a> (ec0137dc-2e82-45cd-973f-2a535cf3293a) [No such file or directory] >[2016-04-19 07:24:51.552107] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ec0137dc-2e82-45cd-973f-2a535cf3293a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.562251] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.563297] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349> (2223de29-3e78-47d6-9f6f-d01e68791349) [No such file or directory] >[2016-04-19 07:24:51.563353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349> (2223de29-3e78-47d6-9f6f-d01e68791349) [No such file or directory] >[2016-04-19 07:24:51.566120] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2223de29-3e78-47d6-9f6f-d01e68791349. (Possible split-brain) >[2016-04-19 07:24:51.567044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349> (2223de29-3e78-47d6-9f6f-d01e68791349) [No such file or directory] >[2016-04-19 07:24:51.567143] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349> (2223de29-3e78-47d6-9f6f-d01e68791349) [No such file or directory] >[2016-04-19 07:24:51.568218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349> (2223de29-3e78-47d6-9f6f-d01e68791349) [No such file or directory] >[2016-04-19 07:24:51.568270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349> (2223de29-3e78-47d6-9f6f-d01e68791349) [No such file or directory] >[2016-04-19 07:24:51.568790] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.571522] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2223de29-3e78-47d6-9f6f-d01e68791349. (Possible split-brain) >[2016-04-19 07:24:51.572629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349> (2223de29-3e78-47d6-9f6f-d01e68791349) [No such file or directory] >[2016-04-19 07:24:51.572703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349> (2223de29-3e78-47d6-9f6f-d01e68791349) [No such file or directory] >[2016-04-19 07:24:51.575765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349> (2223de29-3e78-47d6-9f6f-d01e68791349) [No such file or directory] >[2016-04-19 07:24:51.576525] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349> (2223de29-3e78-47d6-9f6f-d01e68791349) [No such file or directory] >[2016-04-19 07:24:51.576806] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2223de29-3e78-47d6-9f6f-d01e68791349>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.585415] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.586384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2> (d2e59838-2fa8-4096-a954-7a94d911ebf2) [No such file or directory] >[2016-04-19 07:24:51.586386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2> (d2e59838-2fa8-4096-a954-7a94d911ebf2) [No such file or directory] >[2016-04-19 07:24:51.587519] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d2e59838-2fa8-4096-a954-7a94d911ebf2. (Possible split-brain) >[2016-04-19 07:24:51.588438] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2> (d2e59838-2fa8-4096-a954-7a94d911ebf2) [No such file or directory] >[2016-04-19 07:24:51.588465] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2> (d2e59838-2fa8-4096-a954-7a94d911ebf2) [No such file or directory] >[2016-04-19 07:24:51.589699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2> (d2e59838-2fa8-4096-a954-7a94d911ebf2) [No such file or directory] >[2016-04-19 07:24:51.590024] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2> (d2e59838-2fa8-4096-a954-7a94d911ebf2) [No such file or directory] >[2016-04-19 07:24:51.590207] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.592865] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d2e59838-2fa8-4096-a954-7a94d911ebf2. (Possible split-brain) >[2016-04-19 07:24:51.593735] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2> (d2e59838-2fa8-4096-a954-7a94d911ebf2) [No such file or directory] >[2016-04-19 07:24:51.593944] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2> (d2e59838-2fa8-4096-a954-7a94d911ebf2) [No such file or directory] >[2016-04-19 07:24:51.596667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2> (d2e59838-2fa8-4096-a954-7a94d911ebf2) [No such file or directory] >[2016-04-19 07:24:51.596716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2> (d2e59838-2fa8-4096-a954-7a94d911ebf2) [No such file or directory] >[2016-04-19 07:24:51.596879] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d2e59838-2fa8-4096-a954-7a94d911ebf2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.606048] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.606931] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:506578fa-f32d-4427-a052-c703f54ff43f> (506578fa-f32d-4427-a052-c703f54ff43f) [No such file or directory] >[2016-04-19 07:24:51.606959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:506578fa-f32d-4427-a052-c703f54ff43f> (506578fa-f32d-4427-a052-c703f54ff43f) [No such file or directory] >[2016-04-19 07:24:51.609574] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 506578fa-f32d-4427-a052-c703f54ff43f. (Possible split-brain) >[2016-04-19 07:24:51.610442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:506578fa-f32d-4427-a052-c703f54ff43f> (506578fa-f32d-4427-a052-c703f54ff43f) [No such file or directory] >[2016-04-19 07:24:51.610560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:506578fa-f32d-4427-a052-c703f54ff43f> (506578fa-f32d-4427-a052-c703f54ff43f) [No such file or directory] >[2016-04-19 07:24:51.611871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:506578fa-f32d-4427-a052-c703f54ff43f> (506578fa-f32d-4427-a052-c703f54ff43f) [No such file or directory] >[2016-04-19 07:24:51.611916] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:506578fa-f32d-4427-a052-c703f54ff43f> (506578fa-f32d-4427-a052-c703f54ff43f) [No such file or directory] >[2016-04-19 07:24:51.612080] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:506578fa-f32d-4427-a052-c703f54ff43f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.614809] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 506578fa-f32d-4427-a052-c703f54ff43f. (Possible split-brain) >[2016-04-19 07:24:51.615712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:506578fa-f32d-4427-a052-c703f54ff43f> (506578fa-f32d-4427-a052-c703f54ff43f) [No such file or directory] >[2016-04-19 07:24:51.615823] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:506578fa-f32d-4427-a052-c703f54ff43f> (506578fa-f32d-4427-a052-c703f54ff43f) [No such file or directory] >[2016-04-19 07:24:51.619747] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:506578fa-f32d-4427-a052-c703f54ff43f> (506578fa-f32d-4427-a052-c703f54ff43f) [No such file or directory] >[2016-04-19 07:24:51.619891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:506578fa-f32d-4427-a052-c703f54ff43f> (506578fa-f32d-4427-a052-c703f54ff43f) [No such file or directory] >[2016-04-19 07:24:51.620131] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:506578fa-f32d-4427-a052-c703f54ff43f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.628350] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.629189] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa> (a983acd4-3fe4-447c-bf92-2c01eb813afa) [No such file or directory] >[2016-04-19 07:24:51.629195] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa> (a983acd4-3fe4-447c-bf92-2c01eb813afa) [No such file or directory] >[2016-04-19 07:24:51.630374] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a983acd4-3fe4-447c-bf92-2c01eb813afa. (Possible split-brain) >[2016-04-19 07:24:51.631161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa> (a983acd4-3fe4-447c-bf92-2c01eb813afa) [No such file or directory] >[2016-04-19 07:24:51.631385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa> (a983acd4-3fe4-447c-bf92-2c01eb813afa) [No such file or directory] >[2016-04-19 07:24:51.632749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa> (a983acd4-3fe4-447c-bf92-2c01eb813afa) [No such file or directory] >[2016-04-19 07:24:51.632772] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa> (a983acd4-3fe4-447c-bf92-2c01eb813afa) [No such file or directory] >[2016-04-19 07:24:51.633047] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.635754] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid a983acd4-3fe4-447c-bf92-2c01eb813afa. (Possible split-brain) >[2016-04-19 07:24:51.636594] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa> (a983acd4-3fe4-447c-bf92-2c01eb813afa) [No such file or directory] >[2016-04-19 07:24:51.636680] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa> (a983acd4-3fe4-447c-bf92-2c01eb813afa) [No such file or directory] >[2016-04-19 07:24:51.640263] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa> (a983acd4-3fe4-447c-bf92-2c01eb813afa) [No such file or directory] >[2016-04-19 07:24:51.640288] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa> (a983acd4-3fe4-447c-bf92-2c01eb813afa) [No such file or directory] >[2016-04-19 07:24:51.640457] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a983acd4-3fe4-447c-bf92-2c01eb813afa>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.647442] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.648019] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff> (b3a7b929-4282-41c1-b342-cf76623a44ff) [No such file or directory] >[2016-04-19 07:24:51.648049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff> (b3a7b929-4282-41c1-b342-cf76623a44ff) [No such file or directory] >[2016-04-19 07:24:51.649197] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b3a7b929-4282-41c1-b342-cf76623a44ff. (Possible split-brain) >[2016-04-19 07:24:51.650082] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff> (b3a7b929-4282-41c1-b342-cf76623a44ff) [No such file or directory] >[2016-04-19 07:24:51.650085] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff> (b3a7b929-4282-41c1-b342-cf76623a44ff) [No such file or directory] >[2016-04-19 07:24:51.651393] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff> (b3a7b929-4282-41c1-b342-cf76623a44ff) [No such file or directory] >[2016-04-19 07:24:51.651536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff> (b3a7b929-4282-41c1-b342-cf76623a44ff) [No such file or directory] >[2016-04-19 07:24:51.651833] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.654529] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid b3a7b929-4282-41c1-b342-cf76623a44ff. (Possible split-brain) >[2016-04-19 07:24:51.655292] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff> (b3a7b929-4282-41c1-b342-cf76623a44ff) [No such file or directory] >[2016-04-19 07:24:51.655506] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff> (b3a7b929-4282-41c1-b342-cf76623a44ff) [No such file or directory] >[2016-04-19 07:24:51.658168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff> (b3a7b929-4282-41c1-b342-cf76623a44ff) [No such file or directory] >[2016-04-19 07:24:51.658202] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff> (b3a7b929-4282-41c1-b342-cf76623a44ff) [No such file or directory] >[2016-04-19 07:24:51.658424] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b3a7b929-4282-41c1-b342-cf76623a44ff>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.667666] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.668621] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6> (8f3e4b8a-845b-451a-8693-3228fd2404a6) [No such file or directory] >[2016-04-19 07:24:51.668720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6> (8f3e4b8a-845b-451a-8693-3228fd2404a6) [No such file or directory] >[2016-04-19 07:24:51.669934] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8f3e4b8a-845b-451a-8693-3228fd2404a6. (Possible split-brain) >[2016-04-19 07:24:51.671074] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6> (8f3e4b8a-845b-451a-8693-3228fd2404a6) [No such file or directory] >[2016-04-19 07:24:51.671130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6> (8f3e4b8a-845b-451a-8693-3228fd2404a6) [No such file or directory] >[2016-04-19 07:24:51.672295] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6> (8f3e4b8a-845b-451a-8693-3228fd2404a6) [No such file or directory] >[2016-04-19 07:24:51.672375] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6> (8f3e4b8a-845b-451a-8693-3228fd2404a6) [No such file or directory] >[2016-04-19 07:24:51.672695] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.675383] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8f3e4b8a-845b-451a-8693-3228fd2404a6. (Possible split-brain) >[2016-04-19 07:24:51.676344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6> (8f3e4b8a-845b-451a-8693-3228fd2404a6) [No such file or directory] >[2016-04-19 07:24:51.676450] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6> (8f3e4b8a-845b-451a-8693-3228fd2404a6) [No such file or directory] >[2016-04-19 07:24:51.680424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6> (8f3e4b8a-845b-451a-8693-3228fd2404a6) [No such file or directory] >[2016-04-19 07:24:51.680459] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6> (8f3e4b8a-845b-451a-8693-3228fd2404a6) [No such file or directory] >[2016-04-19 07:24:51.681060] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8f3e4b8a-845b-451a-8693-3228fd2404a6>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.691042] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.691989] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226> (464f6899-9d6f-42b9-a62f-791a465d8226) [No such file or directory] >[2016-04-19 07:24:51.692088] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226> (464f6899-9d6f-42b9-a62f-791a465d8226) [No such file or directory] >[2016-04-19 07:24:51.693192] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 464f6899-9d6f-42b9-a62f-791a465d8226. (Possible split-brain) >[2016-04-19 07:24:51.694140] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226> (464f6899-9d6f-42b9-a62f-791a465d8226) [No such file or directory] >[2016-04-19 07:24:51.694209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226> (464f6899-9d6f-42b9-a62f-791a465d8226) [No such file or directory] >[2016-04-19 07:24:51.695306] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226> (464f6899-9d6f-42b9-a62f-791a465d8226) [No such file or directory] >[2016-04-19 07:24:51.695427] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226> (464f6899-9d6f-42b9-a62f-791a465d8226) [No such file or directory] >[2016-04-19 07:24:51.695913] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.698615] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 464f6899-9d6f-42b9-a62f-791a465d8226. (Possible split-brain) >[2016-04-19 07:24:51.699554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226> (464f6899-9d6f-42b9-a62f-791a465d8226) [No such file or directory] >[2016-04-19 07:24:51.699663] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226> (464f6899-9d6f-42b9-a62f-791a465d8226) [No such file or directory] >[2016-04-19 07:24:51.703431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226> (464f6899-9d6f-42b9-a62f-791a465d8226) [No such file or directory] >[2016-04-19 07:24:51.703461] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226> (464f6899-9d6f-42b9-a62f-791a465d8226) [No such file or directory] >[2016-04-19 07:24:51.704167] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:464f6899-9d6f-42b9-a62f-791a465d8226>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.712399] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.713208] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc> (22ec3c6a-b822-49a1-aaec-d32de4a1ccbc) [No such file or directory] >[2016-04-19 07:24:51.713262] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc> (22ec3c6a-b822-49a1-aaec-d32de4a1ccbc) [No such file or directory] >[2016-04-19 07:24:51.714441] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 22ec3c6a-b822-49a1-aaec-d32de4a1ccbc. (Possible split-brain) >[2016-04-19 07:24:51.715266] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc> (22ec3c6a-b822-49a1-aaec-d32de4a1ccbc) [No such file or directory] >[2016-04-19 07:24:51.715424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc> (22ec3c6a-b822-49a1-aaec-d32de4a1ccbc) [No such file or directory] >[2016-04-19 07:24:51.716671] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc> (22ec3c6a-b822-49a1-aaec-d32de4a1ccbc) [No such file or directory] >[2016-04-19 07:24:51.716718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc> (22ec3c6a-b822-49a1-aaec-d32de4a1ccbc) [No such file or directory] >[2016-04-19 07:24:51.716973] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.719682] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 22ec3c6a-b822-49a1-aaec-d32de4a1ccbc. (Possible split-brain) >[2016-04-19 07:24:51.720652] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc> (22ec3c6a-b822-49a1-aaec-d32de4a1ccbc) [No such file or directory] >[2016-04-19 07:24:51.720749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc> (22ec3c6a-b822-49a1-aaec-d32de4a1ccbc) [No such file or directory] >[2016-04-19 07:24:51.723354] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc> (22ec3c6a-b822-49a1-aaec-d32de4a1ccbc) [No such file or directory] >[2016-04-19 07:24:51.723376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc> (22ec3c6a-b822-49a1-aaec-d32de4a1ccbc) [No such file or directory] >[2016-04-19 07:24:51.723569] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:22ec3c6a-b822-49a1-aaec-d32de4a1ccbc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.732570] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.733519] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5027b94b-7696-4b1b-a047-8440c4675013> (5027b94b-7696-4b1b-a047-8440c4675013) [No such file or directory] >[2016-04-19 07:24:51.733539] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5027b94b-7696-4b1b-a047-8440c4675013> (5027b94b-7696-4b1b-a047-8440c4675013) [No such file or directory] >[2016-04-19 07:24:51.736362] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5027b94b-7696-4b1b-a047-8440c4675013. (Possible split-brain) >[2016-04-19 07:24:51.737359] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5027b94b-7696-4b1b-a047-8440c4675013> (5027b94b-7696-4b1b-a047-8440c4675013) [No such file or directory] >[2016-04-19 07:24:51.737352] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5027b94b-7696-4b1b-a047-8440c4675013> (5027b94b-7696-4b1b-a047-8440c4675013) [No such file or directory] >[2016-04-19 07:24:51.738787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5027b94b-7696-4b1b-a047-8440c4675013> (5027b94b-7696-4b1b-a047-8440c4675013) [No such file or directory] >[2016-04-19 07:24:51.739011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5027b94b-7696-4b1b-a047-8440c4675013> (5027b94b-7696-4b1b-a047-8440c4675013) [No such file or directory] >[2016-04-19 07:24:51.739477] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5027b94b-7696-4b1b-a047-8440c4675013>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.742265] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5027b94b-7696-4b1b-a047-8440c4675013. (Possible split-brain) >[2016-04-19 07:24:51.743147] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5027b94b-7696-4b1b-a047-8440c4675013> (5027b94b-7696-4b1b-a047-8440c4675013) [No such file or directory] >[2016-04-19 07:24:51.743219] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5027b94b-7696-4b1b-a047-8440c4675013> (5027b94b-7696-4b1b-a047-8440c4675013) [No such file or directory] >[2016-04-19 07:24:51.747654] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5027b94b-7696-4b1b-a047-8440c4675013> (5027b94b-7696-4b1b-a047-8440c4675013) [No such file or directory] >[2016-04-19 07:24:51.747653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5027b94b-7696-4b1b-a047-8440c4675013> (5027b94b-7696-4b1b-a047-8440c4675013) [No such file or directory] >[2016-04-19 07:24:51.747899] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5027b94b-7696-4b1b-a047-8440c4675013>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.757340] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.758291] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e938d1d0-0ca6-4948-8719-16927d321178> (e938d1d0-0ca6-4948-8719-16927d321178) [No such file or directory] >[2016-04-19 07:24:51.758341] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e938d1d0-0ca6-4948-8719-16927d321178> (e938d1d0-0ca6-4948-8719-16927d321178) [No such file or directory] >[2016-04-19 07:24:51.761117] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e938d1d0-0ca6-4948-8719-16927d321178. (Possible split-brain) >[2016-04-19 07:24:51.762209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e938d1d0-0ca6-4948-8719-16927d321178> (e938d1d0-0ca6-4948-8719-16927d321178) [No such file or directory] >[2016-04-19 07:24:51.762353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e938d1d0-0ca6-4948-8719-16927d321178> (e938d1d0-0ca6-4948-8719-16927d321178) [No such file or directory] >[2016-04-19 07:24:51.763596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e938d1d0-0ca6-4948-8719-16927d321178> (e938d1d0-0ca6-4948-8719-16927d321178) [No such file or directory] >[2016-04-19 07:24:51.763766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e938d1d0-0ca6-4948-8719-16927d321178> (e938d1d0-0ca6-4948-8719-16927d321178) [No such file or directory] >[2016-04-19 07:24:51.763932] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e938d1d0-0ca6-4948-8719-16927d321178>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.766741] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e938d1d0-0ca6-4948-8719-16927d321178. (Possible split-brain) >[2016-04-19 07:24:51.767754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e938d1d0-0ca6-4948-8719-16927d321178> (e938d1d0-0ca6-4948-8719-16927d321178) [No such file or directory] >[2016-04-19 07:24:51.767847] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e938d1d0-0ca6-4948-8719-16927d321178> (e938d1d0-0ca6-4948-8719-16927d321178) [No such file or directory] >[2016-04-19 07:24:51.772055] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e938d1d0-0ca6-4948-8719-16927d321178> (e938d1d0-0ca6-4948-8719-16927d321178) [No such file or directory] >[2016-04-19 07:24:51.772083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e938d1d0-0ca6-4948-8719-16927d321178> (e938d1d0-0ca6-4948-8719-16927d321178) [No such file or directory] >[2016-04-19 07:24:51.772460] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e938d1d0-0ca6-4948-8719-16927d321178>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.782032] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.782871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6> (4a4fdaac-8a1a-447d-87df-27ca57d4c5c6) [No such file or directory] >[2016-04-19 07:24:51.783105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6> (4a4fdaac-8a1a-447d-87df-27ca57d4c5c6) [No such file or directory] >[2016-04-19 07:24:51.784267] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4a4fdaac-8a1a-447d-87df-27ca57d4c5c6. (Possible split-brain) >[2016-04-19 07:24:51.785091] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6> (4a4fdaac-8a1a-447d-87df-27ca57d4c5c6) [No such file or directory] >[2016-04-19 07:24:51.785412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6> (4a4fdaac-8a1a-447d-87df-27ca57d4c5c6) [No such file or directory] >[2016-04-19 07:24:51.786646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6> (4a4fdaac-8a1a-447d-87df-27ca57d4c5c6) [No such file or directory] >[2016-04-19 07:24:51.786751] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6> (4a4fdaac-8a1a-447d-87df-27ca57d4c5c6) [No such file or directory] >[2016-04-19 07:24:51.787092] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.789812] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4a4fdaac-8a1a-447d-87df-27ca57d4c5c6. (Possible split-brain) >[2016-04-19 07:24:51.790581] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6> (4a4fdaac-8a1a-447d-87df-27ca57d4c5c6) [No such file or directory] >[2016-04-19 07:24:51.790761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6> (4a4fdaac-8a1a-447d-87df-27ca57d4c5c6) [No such file or directory] >[2016-04-19 07:24:51.794919] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6> (4a4fdaac-8a1a-447d-87df-27ca57d4c5c6) [No such file or directory] >[2016-04-19 07:24:51.794950] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6> (4a4fdaac-8a1a-447d-87df-27ca57d4c5c6) [No such file or directory] >[2016-04-19 07:24:51.795236] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4a4fdaac-8a1a-447d-87df-27ca57d4c5c6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.803741] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.804499] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393> (e0e81482-5587-4d29-990a-d5ddcc5cf393) [No such file or directory] >[2016-04-19 07:24:51.804650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393> (e0e81482-5587-4d29-990a-d5ddcc5cf393) [No such file or directory] >[2016-04-19 07:24:51.807205] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e0e81482-5587-4d29-990a-d5ddcc5cf393. (Possible split-brain) >[2016-04-19 07:24:51.807970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393> (e0e81482-5587-4d29-990a-d5ddcc5cf393) [No such file or directory] >[2016-04-19 07:24:51.808160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393> (e0e81482-5587-4d29-990a-d5ddcc5cf393) [No such file or directory] >[2016-04-19 07:24:51.809398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393> (e0e81482-5587-4d29-990a-d5ddcc5cf393) [No such file or directory] >[2016-04-19 07:24:51.809758] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393> (e0e81482-5587-4d29-990a-d5ddcc5cf393) [No such file or directory] >[2016-04-19 07:24:51.809891] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.812701] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e0e81482-5587-4d29-990a-d5ddcc5cf393. (Possible split-brain) >[2016-04-19 07:24:51.813517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393> (e0e81482-5587-4d29-990a-d5ddcc5cf393) [No such file or directory] >[2016-04-19 07:24:51.813750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393> (e0e81482-5587-4d29-990a-d5ddcc5cf393) [No such file or directory] >[2016-04-19 07:24:51.818075] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393> (e0e81482-5587-4d29-990a-d5ddcc5cf393) [No such file or directory] >[2016-04-19 07:24:51.818200] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393> (e0e81482-5587-4d29-990a-d5ddcc5cf393) [No such file or directory] >[2016-04-19 07:24:51.818393] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e0e81482-5587-4d29-990a-d5ddcc5cf393>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.827600] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.828359] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e> (30c2e405-9f63-40cf-8ac0-2eec6a5da92e) [No such file or directory] >[2016-04-19 07:24:51.828651] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e> (30c2e405-9f63-40cf-8ac0-2eec6a5da92e) [No such file or directory] >[2016-04-19 07:24:51.829798] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 30c2e405-9f63-40cf-8ac0-2eec6a5da92e. (Possible split-brain) >[2016-04-19 07:24:51.830664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e> (30c2e405-9f63-40cf-8ac0-2eec6a5da92e) [No such file or directory] >[2016-04-19 07:24:51.830748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e> (30c2e405-9f63-40cf-8ac0-2eec6a5da92e) [No such file or directory] >[2016-04-19 07:24:51.831972] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e> (30c2e405-9f63-40cf-8ac0-2eec6a5da92e) [No such file or directory] >[2016-04-19 07:24:51.832168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e> (30c2e405-9f63-40cf-8ac0-2eec6a5da92e) [No such file or directory] >[2016-04-19 07:24:51.832633] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.835338] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 30c2e405-9f63-40cf-8ac0-2eec6a5da92e. (Possible split-brain) >[2016-04-19 07:24:51.836141] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e> (30c2e405-9f63-40cf-8ac0-2eec6a5da92e) [No such file or directory] >[2016-04-19 07:24:51.836253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e> (30c2e405-9f63-40cf-8ac0-2eec6a5da92e) [No such file or directory] >[2016-04-19 07:24:51.840046] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e> (30c2e405-9f63-40cf-8ac0-2eec6a5da92e) [No such file or directory] >[2016-04-19 07:24:51.840066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e> (30c2e405-9f63-40cf-8ac0-2eec6a5da92e) [No such file or directory] >[2016-04-19 07:24:51.840194] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:30c2e405-9f63-40cf-8ac0-2eec6a5da92e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.847568] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.848156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555> (16875c1b-5cdb-44ee-9cf4-d54b9f446555) [No such file or directory] >[2016-04-19 07:24:51.848161] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555> (16875c1b-5cdb-44ee-9cf4-d54b9f446555) [No such file or directory] >[2016-04-19 07:24:51.850090] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 16875c1b-5cdb-44ee-9cf4-d54b9f446555. (Possible split-brain) >[2016-04-19 07:24:51.851021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555> (16875c1b-5cdb-44ee-9cf4-d54b9f446555) [No such file or directory] >[2016-04-19 07:24:51.851509] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555> (16875c1b-5cdb-44ee-9cf4-d54b9f446555) [No such file or directory] >[2016-04-19 07:24:51.852208] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555> (16875c1b-5cdb-44ee-9cf4-d54b9f446555) [No such file or directory] >[2016-04-19 07:24:51.852235] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555> (16875c1b-5cdb-44ee-9cf4-d54b9f446555) [No such file or directory] >[2016-04-19 07:24:51.852574] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.855146] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 16875c1b-5cdb-44ee-9cf4-d54b9f446555. (Possible split-brain) >[2016-04-19 07:24:51.855591] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555> (16875c1b-5cdb-44ee-9cf4-d54b9f446555) [No such file or directory] >[2016-04-19 07:24:51.855647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555> (16875c1b-5cdb-44ee-9cf4-d54b9f446555) [No such file or directory] >[2016-04-19 07:24:51.858748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555> (16875c1b-5cdb-44ee-9cf4-d54b9f446555) [No such file or directory] >[2016-04-19 07:24:51.858842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555> (16875c1b-5cdb-44ee-9cf4-d54b9f446555) [No such file or directory] >[2016-04-19 07:24:51.859079] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:16875c1b-5cdb-44ee-9cf4-d54b9f446555>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.867510] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.868535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3> (9186cdb4-d4e6-49b1-8789-b7c046bab9e3) [No such file or directory] >[2016-04-19 07:24:51.868633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3> (9186cdb4-d4e6-49b1-8789-b7c046bab9e3) [No such file or directory] >[2016-04-19 07:24:51.869598] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9186cdb4-d4e6-49b1-8789-b7c046bab9e3. (Possible split-brain) >[2016-04-19 07:24:51.870388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3> (9186cdb4-d4e6-49b1-8789-b7c046bab9e3) [No such file or directory] >[2016-04-19 07:24:51.870865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3> (9186cdb4-d4e6-49b1-8789-b7c046bab9e3) [No such file or directory] >[2016-04-19 07:24:51.872266] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3> (9186cdb4-d4e6-49b1-8789-b7c046bab9e3) [No such file or directory] >[2016-04-19 07:24:51.872446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3> (9186cdb4-d4e6-49b1-8789-b7c046bab9e3) [No such file or directory] >[2016-04-19 07:24:51.873270] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.875358] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9186cdb4-d4e6-49b1-8789-b7c046bab9e3. (Possible split-brain) >[2016-04-19 07:24:51.875846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3> (9186cdb4-d4e6-49b1-8789-b7c046bab9e3) [No such file or directory] >[2016-04-19 07:24:51.875918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3> (9186cdb4-d4e6-49b1-8789-b7c046bab9e3) [No such file or directory] >[2016-04-19 07:24:51.879360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3> (9186cdb4-d4e6-49b1-8789-b7c046bab9e3) [No such file or directory] >[2016-04-19 07:24:51.879524] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3> (9186cdb4-d4e6-49b1-8789-b7c046bab9e3) [No such file or directory] >[2016-04-19 07:24:51.879694] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9186cdb4-d4e6-49b1-8789-b7c046bab9e3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:51.887712] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.888785] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a> (e9e3d91e-ca62-4d61-88e5-ffd8e99d878a) [No such file or directory] >[2016-04-19 07:24:51.888851] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a> (e9e3d91e-ca62-4d61-88e5-ffd8e99d878a) [No such file or directory] >[2016-04-19 07:24:51.891770] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e9e3d91e-ca62-4d61-88e5-ffd8e99d878a. (Possible split-brain) >[2016-04-19 07:24:51.892762] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a> (e9e3d91e-ca62-4d61-88e5-ffd8e99d878a) [No such file or directory] >[2016-04-19 07:24:51.892855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a> (e9e3d91e-ca62-4d61-88e5-ffd8e99d878a) [No such file or directory] >[2016-04-19 07:24:51.894083] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a> (e9e3d91e-ca62-4d61-88e5-ffd8e99d878a) [No such file or directory] >[2016-04-19 07:24:51.894101] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a> (e9e3d91e-ca62-4d61-88e5-ffd8e99d878a) [No such file or directory] >[2016-04-19 07:24:51.894708] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.897485] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e9e3d91e-ca62-4d61-88e5-ffd8e99d878a. (Possible split-brain) >[2016-04-19 07:24:51.898536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a> (e9e3d91e-ca62-4d61-88e5-ffd8e99d878a) [No such file or directory] >[2016-04-19 07:24:51.898816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a> (e9e3d91e-ca62-4d61-88e5-ffd8e99d878a) [No such file or directory] >[2016-04-19 07:24:51.902696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a> (e9e3d91e-ca62-4d61-88e5-ffd8e99d878a) [No such file or directory] >[2016-04-19 07:24:51.903144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a> (e9e3d91e-ca62-4d61-88e5-ffd8e99d878a) [No such file or directory] >[2016-04-19 07:24:51.903704] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e9e3d91e-ca62-4d61-88e5-ffd8e99d878a>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.914278] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.915380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4> (0f38f962-f1f0-4c6e-9764-f3efc3ab85b4) [No such file or directory] >[2016-04-19 07:24:51.915402] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4> (0f38f962-f1f0-4c6e-9764-f3efc3ab85b4) [No such file or directory] >[2016-04-19 07:24:51.918170] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0f38f962-f1f0-4c6e-9764-f3efc3ab85b4. (Possible split-brain) >[2016-04-19 07:24:51.919270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4> (0f38f962-f1f0-4c6e-9764-f3efc3ab85b4) [No such file or directory] >[2016-04-19 07:24:51.919273] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4> (0f38f962-f1f0-4c6e-9764-f3efc3ab85b4) [No such file or directory] >[2016-04-19 07:24:51.920467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4> (0f38f962-f1f0-4c6e-9764-f3efc3ab85b4) [No such file or directory] >[2016-04-19 07:24:51.920533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4> (0f38f962-f1f0-4c6e-9764-f3efc3ab85b4) [No such file or directory] >[2016-04-19 07:24:51.921262] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.923960] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0f38f962-f1f0-4c6e-9764-f3efc3ab85b4. (Possible split-brain) >[2016-04-19 07:24:51.924931] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4> (0f38f962-f1f0-4c6e-9764-f3efc3ab85b4) [No such file or directory] >[2016-04-19 07:24:51.924959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4> (0f38f962-f1f0-4c6e-9764-f3efc3ab85b4) [No such file or directory] >[2016-04-19 07:24:51.929120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4> (0f38f962-f1f0-4c6e-9764-f3efc3ab85b4) [No such file or directory] >[2016-04-19 07:24:51.929367] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4> (0f38f962-f1f0-4c6e-9764-f3efc3ab85b4) [No such file or directory] >[2016-04-19 07:24:51.930040] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:0f38f962-f1f0-4c6e-9764-f3efc3ab85b4>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.938991] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.939896] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2> (5b1b2c84-c445-46e9-9d5c-cf15686d36a2) [No such file or directory] >[2016-04-19 07:24:51.940212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2> (5b1b2c84-c445-46e9-9d5c-cf15686d36a2) [No such file or directory] >[2016-04-19 07:24:51.942987] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5b1b2c84-c445-46e9-9d5c-cf15686d36a2. (Possible split-brain) >[2016-04-19 07:24:51.944002] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2> (5b1b2c84-c445-46e9-9d5c-cf15686d36a2) [No such file or directory] >[2016-04-19 07:24:51.944008] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2> (5b1b2c84-c445-46e9-9d5c-cf15686d36a2) [No such file or directory] >[2016-04-19 07:24:51.945426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2> (5b1b2c84-c445-46e9-9d5c-cf15686d36a2) [No such file or directory] >[2016-04-19 07:24:51.945545] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2> (5b1b2c84-c445-46e9-9d5c-cf15686d36a2) [No such file or directory] >[2016-04-19 07:24:51.945935] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.948700] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5b1b2c84-c445-46e9-9d5c-cf15686d36a2. (Possible split-brain) >[2016-04-19 07:24:51.949924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2> (5b1b2c84-c445-46e9-9d5c-cf15686d36a2) [No such file or directory] >[2016-04-19 07:24:51.950023] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2> (5b1b2c84-c445-46e9-9d5c-cf15686d36a2) [No such file or directory] >[2016-04-19 07:24:51.954590] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2> (5b1b2c84-c445-46e9-9d5c-cf15686d36a2) [No such file or directory] >[2016-04-19 07:24:51.954968] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2> (5b1b2c84-c445-46e9-9d5c-cf15686d36a2) [No such file or directory] >[2016-04-19 07:24:51.955632] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5b1b2c84-c445-46e9-9d5c-cf15686d36a2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.965002] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.966099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4> (a2cf1afe-fe8b-4b27-b849-b72842651da4) [No such file or directory] >[2016-04-19 07:24:51.966113] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4> (a2cf1afe-fe8b-4b27-b849-b72842651da4) [No such file or directory] >[2016-04-19 07:24:51.968910] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a2cf1afe-fe8b-4b27-b849-b72842651da4. (Possible split-brain) >[2016-04-19 07:24:51.969845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4> (a2cf1afe-fe8b-4b27-b849-b72842651da4) [No such file or directory] >[2016-04-19 07:24:51.970044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4> (a2cf1afe-fe8b-4b27-b849-b72842651da4) [No such file or directory] >[2016-04-19 07:24:51.971252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4> (a2cf1afe-fe8b-4b27-b849-b72842651da4) [No such file or directory] >[2016-04-19 07:24:51.971280] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4> (a2cf1afe-fe8b-4b27-b849-b72842651da4) [No such file or directory] >[2016-04-19 07:24:51.971874] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:51.974551] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a2cf1afe-fe8b-4b27-b849-b72842651da4. (Possible split-brain) >[2016-04-19 07:24:51.975558] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4> (a2cf1afe-fe8b-4b27-b849-b72842651da4) [No such file or directory] >[2016-04-19 07:24:51.975690] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4> (a2cf1afe-fe8b-4b27-b849-b72842651da4) [No such file or directory] >[2016-04-19 07:24:51.979173] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4> (a2cf1afe-fe8b-4b27-b849-b72842651da4) [No such file or directory] >[2016-04-19 07:24:51.979621] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4> (a2cf1afe-fe8b-4b27-b849-b72842651da4) [No such file or directory] >[2016-04-19 07:24:51.980046] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a2cf1afe-fe8b-4b27-b849-b72842651da4>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:51.988587] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:51.989405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71> (12ce3041-9f7d-4380-91fc-3a0ffeba5a71) [No such file or directory] >[2016-04-19 07:24:51.989725] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71> (12ce3041-9f7d-4380-91fc-3a0ffeba5a71) [No such file or directory] >[2016-04-19 07:24:51.992589] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 12ce3041-9f7d-4380-91fc-3a0ffeba5a71. (Possible split-brain) >[2016-04-19 07:24:51.993379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71> (12ce3041-9f7d-4380-91fc-3a0ffeba5a71) [No such file or directory] >[2016-04-19 07:24:51.993672] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71> (12ce3041-9f7d-4380-91fc-3a0ffeba5a71) [No such file or directory] >[2016-04-19 07:24:51.994711] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71> (12ce3041-9f7d-4380-91fc-3a0ffeba5a71) [No such file or directory] >[2016-04-19 07:24:51.995050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71> (12ce3041-9f7d-4380-91fc-3a0ffeba5a71) [No such file or directory] >[2016-04-19 07:24:51.995429] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:51.998189] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 12ce3041-9f7d-4380-91fc-3a0ffeba5a71. (Possible split-brain) >[2016-04-19 07:24:51.999049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71> (12ce3041-9f7d-4380-91fc-3a0ffeba5a71) [No such file or directory] >[2016-04-19 07:24:51.999437] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71> (12ce3041-9f7d-4380-91fc-3a0ffeba5a71) [No such file or directory] >[2016-04-19 07:24:52.008585] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71> (12ce3041-9f7d-4380-91fc-3a0ffeba5a71) [No such file or directory] >[2016-04-19 07:24:52.008981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71> (12ce3041-9f7d-4380-91fc-3a0ffeba5a71) [No such file or directory] >[2016-04-19 07:24:52.009622] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:12ce3041-9f7d-4380-91fc-3a0ffeba5a71>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.018546] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.019253] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c> (d825add7-ba84-4f27-816a-2cac0d45ef2c) [No such file or directory] >[2016-04-19 07:24:52.019491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c> (d825add7-ba84-4f27-816a-2cac0d45ef2c) [No such file or directory] >[2016-04-19 07:24:52.020614] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d825add7-ba84-4f27-816a-2cac0d45ef2c. (Possible split-brain) >[2016-04-19 07:24:52.021355] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c> (d825add7-ba84-4f27-816a-2cac0d45ef2c) [No such file or directory] >[2016-04-19 07:24:52.021626] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c> (d825add7-ba84-4f27-816a-2cac0d45ef2c) [No such file or directory] >[2016-04-19 07:24:52.023015] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c> (d825add7-ba84-4f27-816a-2cac0d45ef2c) [No such file or directory] >[2016-04-19 07:24:52.023032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c> (d825add7-ba84-4f27-816a-2cac0d45ef2c) [No such file or directory] >[2016-04-19 07:24:52.023502] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.026151] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d825add7-ba84-4f27-816a-2cac0d45ef2c. (Possible split-brain) >[2016-04-19 07:24:52.026927] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c> (d825add7-ba84-4f27-816a-2cac0d45ef2c) [No such file or directory] >[2016-04-19 07:24:52.027097] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c> (d825add7-ba84-4f27-816a-2cac0d45ef2c) [No such file or directory] >[2016-04-19 07:24:52.030434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c> (d825add7-ba84-4f27-816a-2cac0d45ef2c) [No such file or directory] >[2016-04-19 07:24:52.030434] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c> (d825add7-ba84-4f27-816a-2cac0d45ef2c) [No such file or directory] >[2016-04-19 07:24:52.030719] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d825add7-ba84-4f27-816a-2cac0d45ef2c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.038422] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.039223] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b> (b9235aac-32ef-43e8-a76f-aab266f4551b) [No such file or directory] >[2016-04-19 07:24:52.039343] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b> (b9235aac-32ef-43e8-a76f-aab266f4551b) [No such file or directory] >[2016-04-19 07:24:52.042156] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b9235aac-32ef-43e8-a76f-aab266f4551b. (Possible split-brain) >[2016-04-19 07:24:52.043284] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b> (b9235aac-32ef-43e8-a76f-aab266f4551b) [No such file or directory] >[2016-04-19 07:24:52.043454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b> (b9235aac-32ef-43e8-a76f-aab266f4551b) [No such file or directory] >[2016-04-19 07:24:52.044650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b> (b9235aac-32ef-43e8-a76f-aab266f4551b) [No such file or directory] >[2016-04-19 07:24:52.044662] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b> (b9235aac-32ef-43e8-a76f-aab266f4551b) [No such file or directory] >[2016-04-19 07:24:52.045039] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.048644] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b9235aac-32ef-43e8-a76f-aab266f4551b. (Possible split-brain) >[2016-04-19 07:24:52.049714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b> (b9235aac-32ef-43e8-a76f-aab266f4551b) [No such file or directory] >[2016-04-19 07:24:52.049770] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b> (b9235aac-32ef-43e8-a76f-aab266f4551b) [No such file or directory] >[2016-04-19 07:24:52.052608] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b> (b9235aac-32ef-43e8-a76f-aab266f4551b) [No such file or directory] >[2016-04-19 07:24:52.053063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b> (b9235aac-32ef-43e8-a76f-aab266f4551b) [No such file or directory] >[2016-04-19 07:24:52.053975] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b9235aac-32ef-43e8-a76f-aab266f4551b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.064341] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.065277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243> (d4c7e7b5-e025-4865-9ee4-be508580a243) [No such file or directory] >[2016-04-19 07:24:52.065306] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243> (d4c7e7b5-e025-4865-9ee4-be508580a243) [No such file or directory] >[2016-04-19 07:24:52.066424] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d4c7e7b5-e025-4865-9ee4-be508580a243. (Possible split-brain) >[2016-04-19 07:24:52.067404] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243> (d4c7e7b5-e025-4865-9ee4-be508580a243) [No such file or directory] >[2016-04-19 07:24:52.067416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243> (d4c7e7b5-e025-4865-9ee4-be508580a243) [No such file or directory] >[2016-04-19 07:24:52.068718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243> (d4c7e7b5-e025-4865-9ee4-be508580a243) [No such file or directory] >[2016-04-19 07:24:52.068743] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243> (d4c7e7b5-e025-4865-9ee4-be508580a243) [No such file or directory] >[2016-04-19 07:24:52.069086] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.071838] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d4c7e7b5-e025-4865-9ee4-be508580a243. (Possible split-brain) >[2016-04-19 07:24:52.072726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243> (d4c7e7b5-e025-4865-9ee4-be508580a243) [No such file or directory] >[2016-04-19 07:24:52.072985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243> (d4c7e7b5-e025-4865-9ee4-be508580a243) [No such file or directory] >[2016-04-19 07:24:52.076688] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243> (d4c7e7b5-e025-4865-9ee4-be508580a243) [No such file or directory] >[2016-04-19 07:24:52.076782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243> (d4c7e7b5-e025-4865-9ee4-be508580a243) [No such file or directory] >[2016-04-19 07:24:52.077542] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d4c7e7b5-e025-4865-9ee4-be508580a243>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.085741] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.086449] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:def063de-add4-4e28-aef3-179a30eb40e7> (def063de-add4-4e28-aef3-179a30eb40e7) [No such file or directory] >[2016-04-19 07:24:52.086681] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:def063de-add4-4e28-aef3-179a30eb40e7> (def063de-add4-4e28-aef3-179a30eb40e7) [No such file or directory] >[2016-04-19 07:24:52.089497] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid def063de-add4-4e28-aef3-179a30eb40e7. (Possible split-brain) >[2016-04-19 07:24:52.090288] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:def063de-add4-4e28-aef3-179a30eb40e7> (def063de-add4-4e28-aef3-179a30eb40e7) [No such file or directory] >[2016-04-19 07:24:52.090542] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:def063de-add4-4e28-aef3-179a30eb40e7> (def063de-add4-4e28-aef3-179a30eb40e7) [No such file or directory] >[2016-04-19 07:24:52.091849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:def063de-add4-4e28-aef3-179a30eb40e7> (def063de-add4-4e28-aef3-179a30eb40e7) [No such file or directory] >[2016-04-19 07:24:52.092049] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:def063de-add4-4e28-aef3-179a30eb40e7> (def063de-add4-4e28-aef3-179a30eb40e7) [No such file or directory] >[2016-04-19 07:24:52.092217] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:def063de-add4-4e28-aef3-179a30eb40e7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.094912] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid def063de-add4-4e28-aef3-179a30eb40e7. (Possible split-brain) >[2016-04-19 07:24:52.095808] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:def063de-add4-4e28-aef3-179a30eb40e7> (def063de-add4-4e28-aef3-179a30eb40e7) [No such file or directory] >[2016-04-19 07:24:52.095838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:def063de-add4-4e28-aef3-179a30eb40e7> (def063de-add4-4e28-aef3-179a30eb40e7) [No such file or directory] >[2016-04-19 07:24:52.100290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:def063de-add4-4e28-aef3-179a30eb40e7> (def063de-add4-4e28-aef3-179a30eb40e7) [No such file or directory] >[2016-04-19 07:24:52.100461] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:def063de-add4-4e28-aef3-179a30eb40e7> (def063de-add4-4e28-aef3-179a30eb40e7) [No such file or directory] >[2016-04-19 07:24:52.100743] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:def063de-add4-4e28-aef3-179a30eb40e7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.109506] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.110388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55> (6f622f75-09b1-4232-9bf8-fe8a31fc3f55) [No such file or directory] >[2016-04-19 07:24:52.110643] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55> (6f622f75-09b1-4232-9bf8-fe8a31fc3f55) [No such file or directory] >[2016-04-19 07:24:52.111708] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6f622f75-09b1-4232-9bf8-fe8a31fc3f55. (Possible split-brain) >[2016-04-19 07:24:52.112634] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55> (6f622f75-09b1-4232-9bf8-fe8a31fc3f55) [No such file or directory] >[2016-04-19 07:24:52.112653] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55> (6f622f75-09b1-4232-9bf8-fe8a31fc3f55) [No such file or directory] >[2016-04-19 07:24:52.113750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55> (6f622f75-09b1-4232-9bf8-fe8a31fc3f55) [No such file or directory] >[2016-04-19 07:24:52.113882] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55> (6f622f75-09b1-4232-9bf8-fe8a31fc3f55) [No such file or directory] >[2016-04-19 07:24:52.114234] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.116881] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6f622f75-09b1-4232-9bf8-fe8a31fc3f55. (Possible split-brain) >[2016-04-19 07:24:52.117731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55> (6f622f75-09b1-4232-9bf8-fe8a31fc3f55) [No such file or directory] >[2016-04-19 07:24:52.118018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55> (6f622f75-09b1-4232-9bf8-fe8a31fc3f55) [No such file or directory] >[2016-04-19 07:24:52.121713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55> (6f622f75-09b1-4232-9bf8-fe8a31fc3f55) [No such file or directory] >[2016-04-19 07:24:52.121993] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55> (6f622f75-09b1-4232-9bf8-fe8a31fc3f55) [No such file or directory] >[2016-04-19 07:24:52.122718] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6f622f75-09b1-4232-9bf8-fe8a31fc3f55>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.130525] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.131277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:165cbe19-1194-4572-a68f-66479445da7e> (165cbe19-1194-4572-a68f-66479445da7e) [No such file or directory] >[2016-04-19 07:24:52.131472] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:165cbe19-1194-4572-a68f-66479445da7e> (165cbe19-1194-4572-a68f-66479445da7e) [No such file or directory] >[2016-04-19 07:24:52.132542] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 165cbe19-1194-4572-a68f-66479445da7e. (Possible split-brain) >[2016-04-19 07:24:52.133254] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:165cbe19-1194-4572-a68f-66479445da7e> (165cbe19-1194-4572-a68f-66479445da7e) [No such file or directory] >[2016-04-19 07:24:52.133469] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:165cbe19-1194-4572-a68f-66479445da7e> (165cbe19-1194-4572-a68f-66479445da7e) [No such file or directory] >[2016-04-19 07:24:52.134611] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:165cbe19-1194-4572-a68f-66479445da7e> (165cbe19-1194-4572-a68f-66479445da7e) [No such file or directory] >[2016-04-19 07:24:52.134887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:165cbe19-1194-4572-a68f-66479445da7e> (165cbe19-1194-4572-a68f-66479445da7e) [No such file or directory] >[2016-04-19 07:24:52.135178] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:165cbe19-1194-4572-a68f-66479445da7e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.137869] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 165cbe19-1194-4572-a68f-66479445da7e. (Possible split-brain) >[2016-04-19 07:24:52.138665] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:165cbe19-1194-4572-a68f-66479445da7e> (165cbe19-1194-4572-a68f-66479445da7e) [No such file or directory] >[2016-04-19 07:24:52.138846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:165cbe19-1194-4572-a68f-66479445da7e> (165cbe19-1194-4572-a68f-66479445da7e) [No such file or directory] >[2016-04-19 07:24:52.143162] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:165cbe19-1194-4572-a68f-66479445da7e> (165cbe19-1194-4572-a68f-66479445da7e) [No such file or directory] >[2016-04-19 07:24:52.143412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:165cbe19-1194-4572-a68f-66479445da7e> (165cbe19-1194-4572-a68f-66479445da7e) [No such file or directory] >[2016-04-19 07:24:52.143606] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:165cbe19-1194-4572-a68f-66479445da7e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.152911] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.153842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b189184-5e37-47ac-be45-568d0db792af> (8b189184-5e37-47ac-be45-568d0db792af) [No such file or directory] >[2016-04-19 07:24:52.154033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b189184-5e37-47ac-be45-568d0db792af> (8b189184-5e37-47ac-be45-568d0db792af) [No such file or directory] >[2016-04-19 07:24:52.156809] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8b189184-5e37-47ac-be45-568d0db792af. (Possible split-brain) >[2016-04-19 07:24:52.157733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b189184-5e37-47ac-be45-568d0db792af> (8b189184-5e37-47ac-be45-568d0db792af) [No such file or directory] >[2016-04-19 07:24:52.157761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b189184-5e37-47ac-be45-568d0db792af> (8b189184-5e37-47ac-be45-568d0db792af) [No such file or directory] >[2016-04-19 07:24:52.158880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b189184-5e37-47ac-be45-568d0db792af> (8b189184-5e37-47ac-be45-568d0db792af) [No such file or directory] >[2016-04-19 07:24:52.158936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b189184-5e37-47ac-be45-568d0db792af> (8b189184-5e37-47ac-be45-568d0db792af) [No such file or directory] >[2016-04-19 07:24:52.159548] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8b189184-5e37-47ac-be45-568d0db792af>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.162254] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8b189184-5e37-47ac-be45-568d0db792af. (Possible split-brain) >[2016-04-19 07:24:52.163340] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b189184-5e37-47ac-be45-568d0db792af> (8b189184-5e37-47ac-be45-568d0db792af) [No such file or directory] >[2016-04-19 07:24:52.163362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b189184-5e37-47ac-be45-568d0db792af> (8b189184-5e37-47ac-be45-568d0db792af) [No such file or directory] >[2016-04-19 07:24:52.167201] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8b189184-5e37-47ac-be45-568d0db792af> (8b189184-5e37-47ac-be45-568d0db792af) [No such file or directory] >[2016-04-19 07:24:52.167688] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8b189184-5e37-47ac-be45-568d0db792af> (8b189184-5e37-47ac-be45-568d0db792af) [No such file or directory] >[2016-04-19 07:24:52.168061] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8b189184-5e37-47ac-be45-568d0db792af>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.175396] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.176370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa> (fe77b655-3a97-4d33-a039-65af5b1ab0aa) [No such file or directory] >[2016-04-19 07:24:52.176464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa> (fe77b655-3a97-4d33-a039-65af5b1ab0aa) [No such file or directory] >[2016-04-19 07:24:52.177529] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fe77b655-3a97-4d33-a039-65af5b1ab0aa. (Possible split-brain) >[2016-04-19 07:24:52.178564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa> (fe77b655-3a97-4d33-a039-65af5b1ab0aa) [No such file or directory] >[2016-04-19 07:24:52.178754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa> (fe77b655-3a97-4d33-a039-65af5b1ab0aa) [No such file or directory] >[2016-04-19 07:24:52.179796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa> (fe77b655-3a97-4d33-a039-65af5b1ab0aa) [No such file or directory] >[2016-04-19 07:24:52.179865] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa> (fe77b655-3a97-4d33-a039-65af5b1ab0aa) [No such file or directory] >[2016-04-19 07:24:52.180525] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.183185] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fe77b655-3a97-4d33-a039-65af5b1ab0aa. (Possible split-brain) >[2016-04-19 07:24:52.184153] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa> (fe77b655-3a97-4d33-a039-65af5b1ab0aa) [No such file or directory] >[2016-04-19 07:24:52.184406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa> (fe77b655-3a97-4d33-a039-65af5b1ab0aa) [No such file or directory] >[2016-04-19 07:24:52.188043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa> (fe77b655-3a97-4d33-a039-65af5b1ab0aa) [No such file or directory] >[2016-04-19 07:24:52.188374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa> (fe77b655-3a97-4d33-a039-65af5b1ab0aa) [No such file or directory] >[2016-04-19 07:24:52.189026] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fe77b655-3a97-4d33-a039-65af5b1ab0aa>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.196303] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.196782] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8> (29080dfe-dcef-4c2f-b1ff-9bfe558664f8) [No such file or directory] >[2016-04-19 07:24:52.196883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8> (29080dfe-dcef-4c2f-b1ff-9bfe558664f8) [No such file or directory] >[2016-04-19 07:24:52.197979] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 29080dfe-dcef-4c2f-b1ff-9bfe558664f8. (Possible split-brain) >[2016-04-19 07:24:52.198726] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8> (29080dfe-dcef-4c2f-b1ff-9bfe558664f8) [No such file or directory] >[2016-04-19 07:24:52.198838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8> (29080dfe-dcef-4c2f-b1ff-9bfe558664f8) [No such file or directory] >[2016-04-19 07:24:52.199520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8> (29080dfe-dcef-4c2f-b1ff-9bfe558664f8) [No such file or directory] >[2016-04-19 07:24:52.199659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8> (29080dfe-dcef-4c2f-b1ff-9bfe558664f8) [No such file or directory] >[2016-04-19 07:24:52.199789] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.202644] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 29080dfe-dcef-4c2f-b1ff-9bfe558664f8. (Possible split-brain) >[2016-04-19 07:24:52.203384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8> (29080dfe-dcef-4c2f-b1ff-9bfe558664f8) [No such file or directory] >[2016-04-19 07:24:52.203592] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8> (29080dfe-dcef-4c2f-b1ff-9bfe558664f8) [No such file or directory] >[2016-04-19 07:24:52.207922] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8> (29080dfe-dcef-4c2f-b1ff-9bfe558664f8) [No such file or directory] >[2016-04-19 07:24:52.207950] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8> (29080dfe-dcef-4c2f-b1ff-9bfe558664f8) [No such file or directory] >[2016-04-19 07:24:52.208225] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:29080dfe-dcef-4c2f-b1ff-9bfe558664f8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.216432] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.217178] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe> (13f0361e-677a-47e4-b653-3b860b934bbe) [No such file or directory] >[2016-04-19 07:24:52.217488] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe> (13f0361e-677a-47e4-b653-3b860b934bbe) [No such file or directory] >[2016-04-19 07:24:52.218563] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 13f0361e-677a-47e4-b653-3b860b934bbe. (Possible split-brain) >[2016-04-19 07:24:52.219313] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe> (13f0361e-677a-47e4-b653-3b860b934bbe) [No such file or directory] >[2016-04-19 07:24:52.219456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe> (13f0361e-677a-47e4-b653-3b860b934bbe) [No such file or directory] >[2016-04-19 07:24:52.220687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe> (13f0361e-677a-47e4-b653-3b860b934bbe) [No such file or directory] >[2016-04-19 07:24:52.220877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe> (13f0361e-677a-47e4-b653-3b860b934bbe) [No such file or directory] >[2016-04-19 07:24:52.221146] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.223812] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 13f0361e-677a-47e4-b653-3b860b934bbe. (Possible split-brain) >[2016-04-19 07:24:52.224525] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe> (13f0361e-677a-47e4-b653-3b860b934bbe) [No such file or directory] >[2016-04-19 07:24:52.224780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe> (13f0361e-677a-47e4-b653-3b860b934bbe) [No such file or directory] >[2016-04-19 07:24:52.229071] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe> (13f0361e-677a-47e4-b653-3b860b934bbe) [No such file or directory] >[2016-04-19 07:24:52.229156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe> (13f0361e-677a-47e4-b653-3b860b934bbe) [No such file or directory] >[2016-04-19 07:24:52.229602] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:13f0361e-677a-47e4-b653-3b860b934bbe>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.237052] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.237769] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d> (2e9a4172-af18-437d-9a9b-ce2acc8b4c1d) [No such file or directory] >[2016-04-19 07:24:52.237983] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d> (2e9a4172-af18-437d-9a9b-ce2acc8b4c1d) [No such file or directory] >[2016-04-19 07:24:52.239838] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e9a4172-af18-437d-9a9b-ce2acc8b4c1d. (Possible split-brain) >[2016-04-19 07:24:52.240792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d> (2e9a4172-af18-437d-9a9b-ce2acc8b4c1d) [No such file or directory] >[2016-04-19 07:24:52.240820] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d> (2e9a4172-af18-437d-9a9b-ce2acc8b4c1d) [No such file or directory] >[2016-04-19 07:24:52.241984] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d> (2e9a4172-af18-437d-9a9b-ce2acc8b4c1d) [No such file or directory] >[2016-04-19 07:24:52.242100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d> (2e9a4172-af18-437d-9a9b-ce2acc8b4c1d) [No such file or directory] >[2016-04-19 07:24:52.242300] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.244841] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 2e9a4172-af18-437d-9a9b-ce2acc8b4c1d. (Possible split-brain) >[2016-04-19 07:24:52.245629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d> (2e9a4172-af18-437d-9a9b-ce2acc8b4c1d) [No such file or directory] >[2016-04-19 07:24:52.245716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d> (2e9a4172-af18-437d-9a9b-ce2acc8b4c1d) [No such file or directory] >[2016-04-19 07:24:52.249761] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d> (2e9a4172-af18-437d-9a9b-ce2acc8b4c1d) [No such file or directory] >[2016-04-19 07:24:52.249869] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d> (2e9a4172-af18-437d-9a9b-ce2acc8b4c1d) [No such file or directory] >[2016-04-19 07:24:52.250059] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2e9a4172-af18-437d-9a9b-ce2acc8b4c1d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.258192] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.259118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:907609d6-5517-4419-9da4-28d422032fb2> (907609d6-5517-4419-9da4-28d422032fb2) [No such file or directory] >[2016-04-19 07:24:52.259146] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:907609d6-5517-4419-9da4-28d422032fb2> (907609d6-5517-4419-9da4-28d422032fb2) [No such file or directory] >[2016-04-19 07:24:52.261984] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 907609d6-5517-4419-9da4-28d422032fb2. (Possible split-brain) >[2016-04-19 07:24:52.262863] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:907609d6-5517-4419-9da4-28d422032fb2> (907609d6-5517-4419-9da4-28d422032fb2) [No such file or directory] >[2016-04-19 07:24:52.262948] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:907609d6-5517-4419-9da4-28d422032fb2> (907609d6-5517-4419-9da4-28d422032fb2) [No such file or directory] >[2016-04-19 07:24:52.264031] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:907609d6-5517-4419-9da4-28d422032fb2> (907609d6-5517-4419-9da4-28d422032fb2) [No such file or directory] >[2016-04-19 07:24:52.264268] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:907609d6-5517-4419-9da4-28d422032fb2> (907609d6-5517-4419-9da4-28d422032fb2) [No such file or directory] >[2016-04-19 07:24:52.264668] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:907609d6-5517-4419-9da4-28d422032fb2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.267366] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 907609d6-5517-4419-9da4-28d422032fb2. (Possible split-brain) >[2016-04-19 07:24:52.268099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:907609d6-5517-4419-9da4-28d422032fb2> (907609d6-5517-4419-9da4-28d422032fb2) [No such file or directory] >[2016-04-19 07:24:52.268404] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:907609d6-5517-4419-9da4-28d422032fb2> (907609d6-5517-4419-9da4-28d422032fb2) [No such file or directory] >[2016-04-19 07:24:52.272183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:907609d6-5517-4419-9da4-28d422032fb2> (907609d6-5517-4419-9da4-28d422032fb2) [No such file or directory] >[2016-04-19 07:24:52.272266] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:907609d6-5517-4419-9da4-28d422032fb2> (907609d6-5517-4419-9da4-28d422032fb2) [No such file or directory] >[2016-04-19 07:24:52.272611] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:907609d6-5517-4419-9da4-28d422032fb2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.282040] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.283197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603> (740d7c17-a980-45c4-813d-f3ef11d05603) [No such file or directory] >[2016-04-19 07:24:52.283276] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603> (740d7c17-a980-45c4-813d-f3ef11d05603) [No such file or directory] >[2016-04-19 07:24:52.284375] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 740d7c17-a980-45c4-813d-f3ef11d05603. (Possible split-brain) >[2016-04-19 07:24:52.285549] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603> (740d7c17-a980-45c4-813d-f3ef11d05603) [No such file or directory] >[2016-04-19 07:24:52.285628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603> (740d7c17-a980-45c4-813d-f3ef11d05603) [No such file or directory] >[2016-04-19 07:24:52.286773] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603> (740d7c17-a980-45c4-813d-f3ef11d05603) [No such file or directory] >[2016-04-19 07:24:52.286838] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603> (740d7c17-a980-45c4-813d-f3ef11d05603) [No such file or directory] >[2016-04-19 07:24:52.287101] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.289802] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 740d7c17-a980-45c4-813d-f3ef11d05603. (Possible split-brain) >[2016-04-19 07:24:52.290717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603> (740d7c17-a980-45c4-813d-f3ef11d05603) [No such file or directory] >[2016-04-19 07:24:52.291044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603> (740d7c17-a980-45c4-813d-f3ef11d05603) [No such file or directory] >[2016-04-19 07:24:52.293887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603> (740d7c17-a980-45c4-813d-f3ef11d05603) [No such file or directory] >[2016-04-19 07:24:52.293965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603> (740d7c17-a980-45c4-813d-f3ef11d05603) [No such file or directory] >[2016-04-19 07:24:52.294091] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:740d7c17-a980-45c4-813d-f3ef11d05603>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.303524] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.304590] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d> (3d478df5-b5d1-4936-be6b-aabe066b171d) [No such file or directory] >[2016-04-19 07:24:52.304604] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d> (3d478df5-b5d1-4936-be6b-aabe066b171d) [No such file or directory] >[2016-04-19 07:24:52.305678] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3d478df5-b5d1-4936-be6b-aabe066b171d. (Possible split-brain) >[2016-04-19 07:24:52.306807] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d> (3d478df5-b5d1-4936-be6b-aabe066b171d) [No such file or directory] >[2016-04-19 07:24:52.306884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d> (3d478df5-b5d1-4936-be6b-aabe066b171d) [No such file or directory] >[2016-04-19 07:24:52.308028] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d> (3d478df5-b5d1-4936-be6b-aabe066b171d) [No such file or directory] >[2016-04-19 07:24:52.308096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d> (3d478df5-b5d1-4936-be6b-aabe066b171d) [No such file or directory] >[2016-04-19 07:24:52.308491] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.311176] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3d478df5-b5d1-4936-be6b-aabe066b171d. (Possible split-brain) >[2016-04-19 07:24:52.312372] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d> (3d478df5-b5d1-4936-be6b-aabe066b171d) [No such file or directory] >[2016-04-19 07:24:52.312396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d> (3d478df5-b5d1-4936-be6b-aabe066b171d) [No such file or directory] >[2016-04-19 07:24:52.314850] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d> (3d478df5-b5d1-4936-be6b-aabe066b171d) [No such file or directory] >[2016-04-19 07:24:52.315042] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d> (3d478df5-b5d1-4936-be6b-aabe066b171d) [No such file or directory] >[2016-04-19 07:24:52.315167] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3d478df5-b5d1-4936-be6b-aabe066b171d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.324185] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.324948] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116> (1d4bba37-dbce-4f7b-bc6d-f155c87a5116) [No such file or directory] >[2016-04-19 07:24:52.325149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116> (1d4bba37-dbce-4f7b-bc6d-f155c87a5116) [No such file or directory] >[2016-04-19 07:24:52.326245] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1d4bba37-dbce-4f7b-bc6d-f155c87a5116. (Possible split-brain) >[2016-04-19 07:24:52.326978] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116> (1d4bba37-dbce-4f7b-bc6d-f155c87a5116) [No such file or directory] >[2016-04-19 07:24:52.327261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116> (1d4bba37-dbce-4f7b-bc6d-f155c87a5116) [No such file or directory] >[2016-04-19 07:24:52.328397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116> (1d4bba37-dbce-4f7b-bc6d-f155c87a5116) [No such file or directory] >[2016-04-19 07:24:52.328696] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116> (1d4bba37-dbce-4f7b-bc6d-f155c87a5116) [No such file or directory] >[2016-04-19 07:24:52.328927] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.331601] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1d4bba37-dbce-4f7b-bc6d-f155c87a5116. (Possible split-brain) >[2016-04-19 07:24:52.332290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116> (1d4bba37-dbce-4f7b-bc6d-f155c87a5116) [No such file or directory] >[2016-04-19 07:24:52.332638] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116> (1d4bba37-dbce-4f7b-bc6d-f155c87a5116) [No such file or directory] >[2016-04-19 07:24:52.335241] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116> (1d4bba37-dbce-4f7b-bc6d-f155c87a5116) [No such file or directory] >[2016-04-19 07:24:52.335405] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116> (1d4bba37-dbce-4f7b-bc6d-f155c87a5116) [No such file or directory] >[2016-04-19 07:24:52.335522] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1d4bba37-dbce-4f7b-bc6d-f155c87a5116>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.344937] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.346026] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2> (7ca2eccb-f592-443b-895f-c0c54eceb5c2) [No such file or directory] >[2016-04-19 07:24:52.346105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2> (7ca2eccb-f592-443b-895f-c0c54eceb5c2) [No such file or directory] >[2016-04-19 07:24:52.347171] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7ca2eccb-f592-443b-895f-c0c54eceb5c2. (Possible split-brain) >[2016-04-19 07:24:52.348176] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2> (7ca2eccb-f592-443b-895f-c0c54eceb5c2) [No such file or directory] >[2016-04-19 07:24:52.348197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2> (7ca2eccb-f592-443b-895f-c0c54eceb5c2) [No such file or directory] >[2016-04-19 07:24:52.349409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2> (7ca2eccb-f592-443b-895f-c0c54eceb5c2) [No such file or directory] >[2016-04-19 07:24:52.349418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2> (7ca2eccb-f592-443b-895f-c0c54eceb5c2) [No such file or directory] >[2016-04-19 07:24:52.350077] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.352734] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7ca2eccb-f592-443b-895f-c0c54eceb5c2. (Possible split-brain) >[2016-04-19 07:24:52.353579] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2> (7ca2eccb-f592-443b-895f-c0c54eceb5c2) [No such file or directory] >[2016-04-19 07:24:52.353867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2> (7ca2eccb-f592-443b-895f-c0c54eceb5c2) [No such file or directory] >[2016-04-19 07:24:52.357930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2> (7ca2eccb-f592-443b-895f-c0c54eceb5c2) [No such file or directory] >[2016-04-19 07:24:52.357943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2> (7ca2eccb-f592-443b-895f-c0c54eceb5c2) [No such file or directory] >[2016-04-19 07:24:52.358407] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7ca2eccb-f592-443b-895f-c0c54eceb5c2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.368139] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.369153] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667> (b71d40f2-2fa5-49b8-b203-7317acc4c667) [No such file or directory] >[2016-04-19 07:24:52.369225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667> (b71d40f2-2fa5-49b8-b203-7317acc4c667) [No such file or directory] >[2016-04-19 07:24:52.371981] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b71d40f2-2fa5-49b8-b203-7317acc4c667. (Possible split-brain) >[2016-04-19 07:24:52.373142] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667> (b71d40f2-2fa5-49b8-b203-7317acc4c667) [No such file or directory] >[2016-04-19 07:24:52.373149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667> (b71d40f2-2fa5-49b8-b203-7317acc4c667) [No such file or directory] >[2016-04-19 07:24:52.374308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667> (b71d40f2-2fa5-49b8-b203-7317acc4c667) [No such file or directory] >[2016-04-19 07:24:52.374362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667> (b71d40f2-2fa5-49b8-b203-7317acc4c667) [No such file or directory] >[2016-04-19 07:24:52.374860] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.377529] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b71d40f2-2fa5-49b8-b203-7317acc4c667. (Possible split-brain) >[2016-04-19 07:24:52.378646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667> (b71d40f2-2fa5-49b8-b203-7317acc4c667) [No such file or directory] >[2016-04-19 07:24:52.378642] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667> (b71d40f2-2fa5-49b8-b203-7317acc4c667) [No such file or directory] >[2016-04-19 07:24:52.382042] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667> (b71d40f2-2fa5-49b8-b203-7317acc4c667) [No such file or directory] >[2016-04-19 07:24:52.382550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667> (b71d40f2-2fa5-49b8-b203-7317acc4c667) [No such file or directory] >[2016-04-19 07:24:52.382989] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b71d40f2-2fa5-49b8-b203-7317acc4c667>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.392771] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.393603] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b> (70bdc6a0-fd81-4a39-b4a8-358aafd7b82b) [No such file or directory] >[2016-04-19 07:24:52.393933] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b> (70bdc6a0-fd81-4a39-b4a8-358aafd7b82b) [No such file or directory] >[2016-04-19 07:24:52.395167] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 70bdc6a0-fd81-4a39-b4a8-358aafd7b82b. (Possible split-brain) >[2016-04-19 07:24:52.396216] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b> (70bdc6a0-fd81-4a39-b4a8-358aafd7b82b) [No such file or directory] >[2016-04-19 07:24:52.396290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b> (70bdc6a0-fd81-4a39-b4a8-358aafd7b82b) [No such file or directory] >[2016-04-19 07:24:52.397609] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b> (70bdc6a0-fd81-4a39-b4a8-358aafd7b82b) [No such file or directory] >[2016-04-19 07:24:52.397700] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b> (70bdc6a0-fd81-4a39-b4a8-358aafd7b82b) [No such file or directory] >[2016-04-19 07:24:52.397881] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.400655] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 70bdc6a0-fd81-4a39-b4a8-358aafd7b82b. (Possible split-brain) >[2016-04-19 07:24:52.401759] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b> (70bdc6a0-fd81-4a39-b4a8-358aafd7b82b) [No such file or directory] >[2016-04-19 07:24:52.401717] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b> (70bdc6a0-fd81-4a39-b4a8-358aafd7b82b) [No such file or directory] >[2016-04-19 07:24:52.404606] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b> (70bdc6a0-fd81-4a39-b4a8-358aafd7b82b) [No such file or directory] >[2016-04-19 07:24:52.404628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b> (70bdc6a0-fd81-4a39-b4a8-358aafd7b82b) [No such file or directory] >[2016-04-19 07:24:52.404826] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:70bdc6a0-fd81-4a39-b4a8-358aafd7b82b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.413871] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.414659] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf> (391da5a0-425d-4776-a6b9-94d0c10a5fcf) [No such file or directory] >[2016-04-19 07:24:52.414928] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf> (391da5a0-425d-4776-a6b9-94d0c10a5fcf) [No such file or directory] >[2016-04-19 07:24:52.416031] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 391da5a0-425d-4776-a6b9-94d0c10a5fcf. (Possible split-brain) >[2016-04-19 07:24:52.416746] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf> (391da5a0-425d-4776-a6b9-94d0c10a5fcf) [No such file or directory] >[2016-04-19 07:24:52.417060] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf> (391da5a0-425d-4776-a6b9-94d0c10a5fcf) [No such file or directory] >[2016-04-19 07:24:52.418254] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf> (391da5a0-425d-4776-a6b9-94d0c10a5fcf) [No such file or directory] >[2016-04-19 07:24:52.418536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf> (391da5a0-425d-4776-a6b9-94d0c10a5fcf) [No such file or directory] >[2016-04-19 07:24:52.418656] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.421429] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 391da5a0-425d-4776-a6b9-94d0c10a5fcf. (Possible split-brain) >[2016-04-19 07:24:52.422137] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf> (391da5a0-425d-4776-a6b9-94d0c10a5fcf) [No such file or directory] >[2016-04-19 07:24:52.422605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf> (391da5a0-425d-4776-a6b9-94d0c10a5fcf) [No such file or directory] >[2016-04-19 07:24:52.425188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf> (391da5a0-425d-4776-a6b9-94d0c10a5fcf) [No such file or directory] >[2016-04-19 07:24:52.425473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf> (391da5a0-425d-4776-a6b9-94d0c10a5fcf) [No such file or directory] >[2016-04-19 07:24:52.425600] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:391da5a0-425d-4776-a6b9-94d0c10a5fcf>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.433675] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.434387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a> (080042c4-6b4b-44e9-9085-c8259691bb5a) [No such file or directory] >[2016-04-19 07:24:52.434764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a> (080042c4-6b4b-44e9-9085-c8259691bb5a) [No such file or directory] >[2016-04-19 07:24:52.437583] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 080042c4-6b4b-44e9-9085-c8259691bb5a. (Possible split-brain) >[2016-04-19 07:24:52.438679] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a> (080042c4-6b4b-44e9-9085-c8259691bb5a) [No such file or directory] >[2016-04-19 07:24:52.438707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a> (080042c4-6b4b-44e9-9085-c8259691bb5a) [No such file or directory] >[2016-04-19 07:24:52.440086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a> (080042c4-6b4b-44e9-9085-c8259691bb5a) [No such file or directory] >[2016-04-19 07:24:52.440141] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a> (080042c4-6b4b-44e9-9085-c8259691bb5a) [No such file or directory] >[2016-04-19 07:24:52.440263] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.443153] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 080042c4-6b4b-44e9-9085-c8259691bb5a. (Possible split-brain) >[2016-04-19 07:24:52.443902] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a> (080042c4-6b4b-44e9-9085-c8259691bb5a) [No such file or directory] >[2016-04-19 07:24:52.444221] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a> (080042c4-6b4b-44e9-9085-c8259691bb5a) [No such file or directory] >[2016-04-19 07:24:52.446718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a> (080042c4-6b4b-44e9-9085-c8259691bb5a) [No such file or directory] >[2016-04-19 07:24:52.447053] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a> (080042c4-6b4b-44e9-9085-c8259691bb5a) [No such file or directory] >[2016-04-19 07:24:52.447235] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:080042c4-6b4b-44e9-9085-c8259691bb5a>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.457732] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.458977] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9> (9c9e491f-9beb-46b4-bfc9-7825feb667e9) [No such file or directory] >[2016-04-19 07:24:52.459057] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9> (9c9e491f-9beb-46b4-bfc9-7825feb667e9) [No such file or directory] >[2016-04-19 07:24:52.461821] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9c9e491f-9beb-46b4-bfc9-7825feb667e9. (Possible split-brain) >[2016-04-19 07:24:52.462912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9> (9c9e491f-9beb-46b4-bfc9-7825feb667e9) [No such file or directory] >[2016-04-19 07:24:52.462925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9> (9c9e491f-9beb-46b4-bfc9-7825feb667e9) [No such file or directory] >[2016-04-19 07:24:52.464385] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9> (9c9e491f-9beb-46b4-bfc9-7825feb667e9) [No such file or directory] >[2016-04-19 07:24:52.464413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9> (9c9e491f-9beb-46b4-bfc9-7825feb667e9) [No such file or directory] >[2016-04-19 07:24:52.464605] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.467402] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9c9e491f-9beb-46b4-bfc9-7825feb667e9. (Possible split-brain) >[2016-04-19 07:24:52.468302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9> (9c9e491f-9beb-46b4-bfc9-7825feb667e9) [No such file or directory] >[2016-04-19 07:24:52.468781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9> (9c9e491f-9beb-46b4-bfc9-7825feb667e9) [No such file or directory] >[2016-04-19 07:24:52.471417] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9> (9c9e491f-9beb-46b4-bfc9-7825feb667e9) [No such file or directory] >[2016-04-19 07:24:52.471517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9> (9c9e491f-9beb-46b4-bfc9-7825feb667e9) [No such file or directory] >[2016-04-19 07:24:52.471656] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9c9e491f-9beb-46b4-bfc9-7825feb667e9>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.479797] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.480522] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1> (24f401cc-239c-46c8-a066-0452179dc2a1) [No such file or directory] >[2016-04-19 07:24:52.480892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1> (24f401cc-239c-46c8-a066-0452179dc2a1) [No such file or directory] >[2016-04-19 07:24:52.481992] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 24f401cc-239c-46c8-a066-0452179dc2a1. (Possible split-brain) >[2016-04-19 07:24:52.482737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1> (24f401cc-239c-46c8-a066-0452179dc2a1) [No such file or directory] >[2016-04-19 07:24:52.483133] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1> (24f401cc-239c-46c8-a066-0452179dc2a1) [No such file or directory] >[2016-04-19 07:24:52.484225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1> (24f401cc-239c-46c8-a066-0452179dc2a1) [No such file or directory] >[2016-04-19 07:24:52.484570] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1> (24f401cc-239c-46c8-a066-0452179dc2a1) [No such file or directory] >[2016-04-19 07:24:52.484720] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.487404] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 24f401cc-239c-46c8-a066-0452179dc2a1. (Possible split-brain) >[2016-04-19 07:24:52.488088] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1> (24f401cc-239c-46c8-a066-0452179dc2a1) [No such file or directory] >[2016-04-19 07:24:52.488486] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1> (24f401cc-239c-46c8-a066-0452179dc2a1) [No such file or directory] >[2016-04-19 07:24:52.491210] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1> (24f401cc-239c-46c8-a066-0452179dc2a1) [No such file or directory] >[2016-04-19 07:24:52.491400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1> (24f401cc-239c-46c8-a066-0452179dc2a1) [No such file or directory] >[2016-04-19 07:24:52.491558] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:24f401cc-239c-46c8-a066-0452179dc2a1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.500559] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.501224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:053ed250-3a37-4331-9e8d-00729e90703f> (053ed250-3a37-4331-9e8d-00729e90703f) [No such file or directory] >[2016-04-19 07:24:52.501533] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:053ed250-3a37-4331-9e8d-00729e90703f> (053ed250-3a37-4331-9e8d-00729e90703f) [No such file or directory] >[2016-04-19 07:24:52.502618] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 053ed250-3a37-4331-9e8d-00729e90703f. (Possible split-brain) >[2016-04-19 07:24:52.503511] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:053ed250-3a37-4331-9e8d-00729e90703f> (053ed250-3a37-4331-9e8d-00729e90703f) [No such file or directory] >[2016-04-19 07:24:52.503525] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:053ed250-3a37-4331-9e8d-00729e90703f> (053ed250-3a37-4331-9e8d-00729e90703f) [No such file or directory] >[2016-04-19 07:24:52.504687] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:053ed250-3a37-4331-9e8d-00729e90703f> (053ed250-3a37-4331-9e8d-00729e90703f) [No such file or directory] >[2016-04-19 07:24:52.504981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:053ed250-3a37-4331-9e8d-00729e90703f> (053ed250-3a37-4331-9e8d-00729e90703f) [No such file or directory] >[2016-04-19 07:24:52.505084] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:053ed250-3a37-4331-9e8d-00729e90703f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.507772] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 053ed250-3a37-4331-9e8d-00729e90703f. (Possible split-brain) >[2016-04-19 07:24:52.508470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:053ed250-3a37-4331-9e8d-00729e90703f> (053ed250-3a37-4331-9e8d-00729e90703f) [No such file or directory] >[2016-04-19 07:24:52.508803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:053ed250-3a37-4331-9e8d-00729e90703f> (053ed250-3a37-4331-9e8d-00729e90703f) [No such file or directory] >[2016-04-19 07:24:52.511878] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:053ed250-3a37-4331-9e8d-00729e90703f> (053ed250-3a37-4331-9e8d-00729e90703f) [No such file or directory] >[2016-04-19 07:24:52.511991] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:053ed250-3a37-4331-9e8d-00729e90703f> (053ed250-3a37-4331-9e8d-00729e90703f) [No such file or directory] >[2016-04-19 07:24:52.512155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:053ed250-3a37-4331-9e8d-00729e90703f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.522108] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.523264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40> (e6c8f3be-ec61-4cbf-ba2e-583da78e2a40) [No such file or directory] >[2016-04-19 07:24:52.523390] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40> (e6c8f3be-ec61-4cbf-ba2e-583da78e2a40) [No such file or directory] >[2016-04-19 07:24:52.526133] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e6c8f3be-ec61-4cbf-ba2e-583da78e2a40. (Possible split-brain) >[2016-04-19 07:24:52.527129] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40> (e6c8f3be-ec61-4cbf-ba2e-583da78e2a40) [No such file or directory] >[2016-04-19 07:24:52.527158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40> (e6c8f3be-ec61-4cbf-ba2e-583da78e2a40) [No such file or directory] >[2016-04-19 07:24:52.528382] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40> (e6c8f3be-ec61-4cbf-ba2e-583da78e2a40) [No such file or directory] >[2016-04-19 07:24:52.528409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40> (e6c8f3be-ec61-4cbf-ba2e-583da78e2a40) [No such file or directory] >[2016-04-19 07:24:52.528667] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.530856] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e6c8f3be-ec61-4cbf-ba2e-583da78e2a40. (Possible split-brain) >[2016-04-19 07:24:52.531801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40> (e6c8f3be-ec61-4cbf-ba2e-583da78e2a40) [No such file or directory] >[2016-04-19 07:24:52.531907] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40> (e6c8f3be-ec61-4cbf-ba2e-583da78e2a40) [No such file or directory] >[2016-04-19 07:24:52.534076] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40> (e6c8f3be-ec61-4cbf-ba2e-583da78e2a40) [No such file or directory] >[2016-04-19 07:24:52.534158] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40> (e6c8f3be-ec61-4cbf-ba2e-583da78e2a40) [No such file or directory] >[2016-04-19 07:24:52.534279] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e6c8f3be-ec61-4cbf-ba2e-583da78e2a40>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.544228] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.545273] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2> (bcfb3acd-c7c9-422a-8092-b6eed57332e2) [No such file or directory] >[2016-04-19 07:24:52.545394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2> (bcfb3acd-c7c9-422a-8092-b6eed57332e2) [No such file or directory] >[2016-04-19 07:24:52.548136] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bcfb3acd-c7c9-422a-8092-b6eed57332e2. (Possible split-brain) >[2016-04-19 07:24:52.549006] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2> (bcfb3acd-c7c9-422a-8092-b6eed57332e2) [No such file or directory] >[2016-04-19 07:24:52.549069] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2> (bcfb3acd-c7c9-422a-8092-b6eed57332e2) [No such file or directory] >[2016-04-19 07:24:52.550208] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2> (bcfb3acd-c7c9-422a-8092-b6eed57332e2) [No such file or directory] >[2016-04-19 07:24:52.550232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2> (bcfb3acd-c7c9-422a-8092-b6eed57332e2) [No such file or directory] >[2016-04-19 07:24:52.550621] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.553361] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bcfb3acd-c7c9-422a-8092-b6eed57332e2. (Possible split-brain) >[2016-04-19 07:24:52.554290] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2> (bcfb3acd-c7c9-422a-8092-b6eed57332e2) [No such file or directory] >[2016-04-19 07:24:52.554409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2> (bcfb3acd-c7c9-422a-8092-b6eed57332e2) [No such file or directory] >[2016-04-19 07:24:52.557556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2> (bcfb3acd-c7c9-422a-8092-b6eed57332e2) [No such file or directory] >[2016-04-19 07:24:52.557656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2> (bcfb3acd-c7c9-422a-8092-b6eed57332e2) [No such file or directory] >[2016-04-19 07:24:52.557938] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bcfb3acd-c7c9-422a-8092-b6eed57332e2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.566160] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.566893] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55> (e16baeb5-23a4-45a8-8d9c-f9acdd262c55) [No such file or directory] >[2016-04-19 07:24:52.567242] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55> (e16baeb5-23a4-45a8-8d9c-f9acdd262c55) [No such file or directory] >[2016-04-19 07:24:52.568360] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e16baeb5-23a4-45a8-8d9c-f9acdd262c55. (Possible split-brain) >[2016-04-19 07:24:52.569051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55> (e16baeb5-23a4-45a8-8d9c-f9acdd262c55) [No such file or directory] >[2016-04-19 07:24:52.569442] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55> (e16baeb5-23a4-45a8-8d9c-f9acdd262c55) [No such file or directory] >[2016-04-19 07:24:52.570695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55> (e16baeb5-23a4-45a8-8d9c-f9acdd262c55) [No such file or directory] >[2016-04-19 07:24:52.570812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55> (e16baeb5-23a4-45a8-8d9c-f9acdd262c55) [No such file or directory] >[2016-04-19 07:24:52.570927] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.573720] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e16baeb5-23a4-45a8-8d9c-f9acdd262c55. (Possible split-brain) >[2016-04-19 07:24:52.574507] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55> (e16baeb5-23a4-45a8-8d9c-f9acdd262c55) [No such file or directory] >[2016-04-19 07:24:52.574855] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55> (e16baeb5-23a4-45a8-8d9c-f9acdd262c55) [No such file or directory] >[2016-04-19 07:24:52.577293] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55> (e16baeb5-23a4-45a8-8d9c-f9acdd262c55) [No such file or directory] >[2016-04-19 07:24:52.577425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55> (e16baeb5-23a4-45a8-8d9c-f9acdd262c55) [No such file or directory] >[2016-04-19 07:24:52.577598] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e16baeb5-23a4-45a8-8d9c-f9acdd262c55>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.587426] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.588493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f> (f90e2b83-a475-4798-9493-22b1fdbb976f) [No such file or directory] >[2016-04-19 07:24:52.588580] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f> (f90e2b83-a475-4798-9493-22b1fdbb976f) [No such file or directory] >[2016-04-19 07:24:52.591385] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f90e2b83-a475-4798-9493-22b1fdbb976f. (Possible split-brain) >[2016-04-19 07:24:52.592296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f> (f90e2b83-a475-4798-9493-22b1fdbb976f) [No such file or directory] >[2016-04-19 07:24:52.592350] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f> (f90e2b83-a475-4798-9493-22b1fdbb976f) [No such file or directory] >[2016-04-19 07:24:52.593628] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f> (f90e2b83-a475-4798-9493-22b1fdbb976f) [No such file or directory] >[2016-04-19 07:24:52.593733] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f> (f90e2b83-a475-4798-9493-22b1fdbb976f) [No such file or directory] >[2016-04-19 07:24:52.593890] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.596651] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f90e2b83-a475-4798-9493-22b1fdbb976f. (Possible split-brain) >[2016-04-19 07:24:52.597810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f> (f90e2b83-a475-4798-9493-22b1fdbb976f) [No such file or directory] >[2016-04-19 07:24:52.597839] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f> (f90e2b83-a475-4798-9493-22b1fdbb976f) [No such file or directory] >[2016-04-19 07:24:52.600892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f> (f90e2b83-a475-4798-9493-22b1fdbb976f) [No such file or directory] >[2016-04-19 07:24:52.600930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f> (f90e2b83-a475-4798-9493-22b1fdbb976f) [No such file or directory] >[2016-04-19 07:24:52.601250] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f90e2b83-a475-4798-9493-22b1fdbb976f>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.609991] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.611187] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0> (ffecdc73-1a99-463a-83cb-1e226f89b9b0) [No such file or directory] >[2016-04-19 07:24:52.611188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0> (ffecdc73-1a99-463a-83cb-1e226f89b9b0) [No such file or directory] >[2016-04-19 07:24:52.612340] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ffecdc73-1a99-463a-83cb-1e226f89b9b0. (Possible split-brain) >[2016-04-19 07:24:52.613359] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0> (ffecdc73-1a99-463a-83cb-1e226f89b9b0) [No such file or directory] >[2016-04-19 07:24:52.613431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0> (ffecdc73-1a99-463a-83cb-1e226f89b9b0) [No such file or directory] >[2016-04-19 07:24:52.614550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0> (ffecdc73-1a99-463a-83cb-1e226f89b9b0) [No such file or directory] >[2016-04-19 07:24:52.614632] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0> (ffecdc73-1a99-463a-83cb-1e226f89b9b0) [No such file or directory] >[2016-04-19 07:24:52.616796] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.619504] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ffecdc73-1a99-463a-83cb-1e226f89b9b0. (Possible split-brain) >[2016-04-19 07:24:52.620479] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0> (ffecdc73-1a99-463a-83cb-1e226f89b9b0) [No such file or directory] >[2016-04-19 07:24:52.620613] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0> (ffecdc73-1a99-463a-83cb-1e226f89b9b0) [No such file or directory] >[2016-04-19 07:24:52.623190] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0> (ffecdc73-1a99-463a-83cb-1e226f89b9b0) [No such file or directory] >[2016-04-19 07:24:52.623275] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0> (ffecdc73-1a99-463a-83cb-1e226f89b9b0) [No such file or directory] >[2016-04-19 07:24:52.623525] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ffecdc73-1a99-463a-83cb-1e226f89b9b0>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.633176] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.634376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479> (91ab63a5-0da8-4831-bf6f-bead63815479) [No such file or directory] >[2016-04-19 07:24:52.634489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479> (91ab63a5-0da8-4831-bf6f-bead63815479) [No such file or directory] >[2016-04-19 07:24:52.635564] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 91ab63a5-0da8-4831-bf6f-bead63815479. (Possible split-brain) >[2016-04-19 07:24:52.636546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479> (91ab63a5-0da8-4831-bf6f-bead63815479) [No such file or directory] >[2016-04-19 07:24:52.636566] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479> (91ab63a5-0da8-4831-bf6f-bead63815479) [No such file or directory] >[2016-04-19 07:24:52.637826] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479> (91ab63a5-0da8-4831-bf6f-bead63815479) [No such file or directory] >[2016-04-19 07:24:52.637924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479> (91ab63a5-0da8-4831-bf6f-bead63815479) [No such file or directory] >[2016-04-19 07:24:52.638042] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.640357] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 91ab63a5-0da8-4831-bf6f-bead63815479. (Possible split-brain) >[2016-04-19 07:24:52.641144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479> (91ab63a5-0da8-4831-bf6f-bead63815479) [No such file or directory] >[2016-04-19 07:24:52.641152] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479> (91ab63a5-0da8-4831-bf6f-bead63815479) [No such file or directory] >[2016-04-19 07:24:52.643138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479> (91ab63a5-0da8-4831-bf6f-bead63815479) [No such file or directory] >[2016-04-19 07:24:52.643160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479> (91ab63a5-0da8-4831-bf6f-bead63815479) [No such file or directory] >[2016-04-19 07:24:52.643358] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:91ab63a5-0da8-4831-bf6f-bead63815479>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.651216] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.652274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ea25317f-579c-4d57-8c94-2486eb717331> (ea25317f-579c-4d57-8c94-2486eb717331) [No such file or directory] >[2016-04-19 07:24:52.652418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ea25317f-579c-4d57-8c94-2486eb717331> (ea25317f-579c-4d57-8c94-2486eb717331) [No such file or directory] >[2016-04-19 07:24:52.653492] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ea25317f-579c-4d57-8c94-2486eb717331. (Possible split-brain) >[2016-04-19 07:24:52.654573] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ea25317f-579c-4d57-8c94-2486eb717331> (ea25317f-579c-4d57-8c94-2486eb717331) [No such file or directory] >[2016-04-19 07:24:52.654656] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ea25317f-579c-4d57-8c94-2486eb717331> (ea25317f-579c-4d57-8c94-2486eb717331) [No such file or directory] >[2016-04-19 07:24:52.655670] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ea25317f-579c-4d57-8c94-2486eb717331> (ea25317f-579c-4d57-8c94-2486eb717331) [No such file or directory] >[2016-04-19 07:24:52.655862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ea25317f-579c-4d57-8c94-2486eb717331> (ea25317f-579c-4d57-8c94-2486eb717331) [No such file or directory] >[2016-04-19 07:24:52.656035] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ea25317f-579c-4d57-8c94-2486eb717331>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.658759] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ea25317f-579c-4d57-8c94-2486eb717331. (Possible split-brain) >[2016-04-19 07:24:52.659723] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ea25317f-579c-4d57-8c94-2486eb717331> (ea25317f-579c-4d57-8c94-2486eb717331) [No such file or directory] >[2016-04-19 07:24:52.659768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ea25317f-579c-4d57-8c94-2486eb717331> (ea25317f-579c-4d57-8c94-2486eb717331) [No such file or directory] >[2016-04-19 07:24:52.661459] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ea25317f-579c-4d57-8c94-2486eb717331> (ea25317f-579c-4d57-8c94-2486eb717331) [No such file or directory] >[2016-04-19 07:24:52.661703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ea25317f-579c-4d57-8c94-2486eb717331> (ea25317f-579c-4d57-8c94-2486eb717331) [No such file or directory] >[2016-04-19 07:24:52.661808] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ea25317f-579c-4d57-8c94-2486eb717331>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.669441] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.670210] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6b877460-d496-485a-9e56-f58867d9e164> (6b877460-d496-485a-9e56-f58867d9e164) [No such file or directory] >[2016-04-19 07:24:52.670247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6b877460-d496-485a-9e56-f58867d9e164> (6b877460-d496-485a-9e56-f58867d9e164) [No such file or directory] >[2016-04-19 07:24:52.672160] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6b877460-d496-485a-9e56-f58867d9e164. (Possible split-brain) >[2016-04-19 07:24:52.673040] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6b877460-d496-485a-9e56-f58867d9e164> (6b877460-d496-485a-9e56-f58867d9e164) [No such file or directory] >[2016-04-19 07:24:52.673092] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6b877460-d496-485a-9e56-f58867d9e164> (6b877460-d496-485a-9e56-f58867d9e164) [No such file or directory] >[2016-04-19 07:24:52.674041] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6b877460-d496-485a-9e56-f58867d9e164> (6b877460-d496-485a-9e56-f58867d9e164) [No such file or directory] >[2016-04-19 07:24:52.674150] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6b877460-d496-485a-9e56-f58867d9e164> (6b877460-d496-485a-9e56-f58867d9e164) [No such file or directory] >[2016-04-19 07:24:52.674226] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:6b877460-d496-485a-9e56-f58867d9e164>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.676368] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 6b877460-d496-485a-9e56-f58867d9e164. (Possible split-brain) >[2016-04-19 07:24:52.677352] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6b877460-d496-485a-9e56-f58867d9e164> (6b877460-d496-485a-9e56-f58867d9e164) [No such file or directory] >[2016-04-19 07:24:52.677401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6b877460-d496-485a-9e56-f58867d9e164> (6b877460-d496-485a-9e56-f58867d9e164) [No such file or directory] >[2016-04-19 07:24:52.678971] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:6b877460-d496-485a-9e56-f58867d9e164> (6b877460-d496-485a-9e56-f58867d9e164) [No such file or directory] >[2016-04-19 07:24:52.679185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:6b877460-d496-485a-9e56-f58867d9e164> (6b877460-d496-485a-9e56-f58867d9e164) [No such file or directory] >[2016-04-19 07:24:52.679257] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:6b877460-d496-485a-9e56-f58867d9e164>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.686568] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.687605] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5> (93a64363-cf2b-4058-9dc1-99638caaddd5) [No such file or directory] >[2016-04-19 07:24:52.687678] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5> (93a64363-cf2b-4058-9dc1-99638caaddd5) [No such file or directory] >[2016-04-19 07:24:52.692232] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 93a64363-cf2b-4058-9dc1-99638caaddd5. (Possible split-brain) >[2016-04-19 07:24:52.693218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5> (93a64363-cf2b-4058-9dc1-99638caaddd5) [No such file or directory] >[2016-04-19 07:24:52.692956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5> (93a64363-cf2b-4058-9dc1-99638caaddd5) [No such file or directory] >[2016-04-19 07:24:52.694399] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5> (93a64363-cf2b-4058-9dc1-99638caaddd5) [No such file or directory] >[2016-04-19 07:24:52.694668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5> (93a64363-cf2b-4058-9dc1-99638caaddd5) [No such file or directory] >[2016-04-19 07:24:52.694777] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.697485] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 93a64363-cf2b-4058-9dc1-99638caaddd5. (Possible split-brain) >[2016-04-19 07:24:52.698160] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5> (93a64363-cf2b-4058-9dc1-99638caaddd5) [No such file or directory] >[2016-04-19 07:24:52.698535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5> (93a64363-cf2b-4058-9dc1-99638caaddd5) [No such file or directory] >[2016-04-19 07:24:52.700912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5> (93a64363-cf2b-4058-9dc1-99638caaddd5) [No such file or directory] >[2016-04-19 07:24:52.700993] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5> (93a64363-cf2b-4058-9dc1-99638caaddd5) [No such file or directory] >[2016-04-19 07:24:52.701102] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:93a64363-cf2b-4058-9dc1-99638caaddd5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.710360] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.711123] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac> (f36e27f8-da3a-4e26-9823-93d0ceeba5ac) [No such file or directory] >[2016-04-19 07:24:52.711409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac> (f36e27f8-da3a-4e26-9823-93d0ceeba5ac) [No such file or directory] >[2016-04-19 07:24:52.712478] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f36e27f8-da3a-4e26-9823-93d0ceeba5ac. (Possible split-brain) >[2016-04-19 07:24:52.713212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac> (f36e27f8-da3a-4e26-9823-93d0ceeba5ac) [No such file or directory] >[2016-04-19 07:24:52.714157] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac> (f36e27f8-da3a-4e26-9823-93d0ceeba5ac) [No such file or directory] >[2016-04-19 07:24:52.715800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac> (f36e27f8-da3a-4e26-9823-93d0ceeba5ac) [No such file or directory] >[2016-04-19 07:24:52.715818] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac> (f36e27f8-da3a-4e26-9823-93d0ceeba5ac) [No such file or directory] >[2016-04-19 07:24:52.715972] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.718724] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f36e27f8-da3a-4e26-9823-93d0ceeba5ac. (Possible split-brain) >[2016-04-19 07:24:52.719560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac> (f36e27f8-da3a-4e26-9823-93d0ceeba5ac) [No such file or directory] >[2016-04-19 07:24:52.719736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac> (f36e27f8-da3a-4e26-9823-93d0ceeba5ac) [No such file or directory] >[2016-04-19 07:24:52.722351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac> (f36e27f8-da3a-4e26-9823-93d0ceeba5ac) [No such file or directory] >[2016-04-19 07:24:52.722540] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac> (f36e27f8-da3a-4e26-9823-93d0ceeba5ac) [No such file or directory] >[2016-04-19 07:24:52.722681] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f36e27f8-da3a-4e26-9823-93d0ceeba5ac>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.731335] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.732035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6> (1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6) [No such file or directory] >[2016-04-19 07:24:52.732369] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6> (1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6) [No such file or directory] >[2016-04-19 07:24:52.733447] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6. (Possible split-brain) >[2016-04-19 07:24:52.734296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6> (1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6) [No such file or directory] >[2016-04-19 07:24:52.734643] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6> (1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6) [No such file or directory] >[2016-04-19 07:24:52.735846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6> (1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6) [No such file or directory] >[2016-04-19 07:24:52.735870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6> (1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6) [No such file or directory] >[2016-04-19 07:24:52.736416] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.739125] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6. (Possible split-brain) >[2016-04-19 07:24:52.740278] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6> (1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6) [No such file or directory] >[2016-04-19 07:24:52.740394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6> (1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6) [No such file or directory] >[2016-04-19 07:24:52.742713] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6> (1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6) [No such file or directory] >[2016-04-19 07:24:52.742956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6> (1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6) [No such file or directory] >[2016-04-19 07:24:52.743070] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1ebdd7e2-e42f-4fff-a859-bf34f27bd4d6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.757105] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.757918] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28> (b47e08c7-3ee5-4acd-883d-e0fcd6d75b28) [No such file or directory] >[2016-04-19 07:24:52.757979] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28> (b47e08c7-3ee5-4acd-883d-e0fcd6d75b28) [No such file or directory] >[2016-04-19 07:24:52.759813] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b47e08c7-3ee5-4acd-883d-e0fcd6d75b28. (Possible split-brain) >[2016-04-19 07:24:52.760810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28> (b47e08c7-3ee5-4acd-883d-e0fcd6d75b28) [No such file or directory] >[2016-04-19 07:24:52.760867] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28> (b47e08c7-3ee5-4acd-883d-e0fcd6d75b28) [No such file or directory] >[2016-04-19 07:24:52.761746] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28> (b47e08c7-3ee5-4acd-883d-e0fcd6d75b28) [No such file or directory] >[2016-04-19 07:24:52.761941] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28> (b47e08c7-3ee5-4acd-883d-e0fcd6d75b28) [No such file or directory] >[2016-04-19 07:24:52.762019] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.764102] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b47e08c7-3ee5-4acd-883d-e0fcd6d75b28. (Possible split-brain) >[2016-04-19 07:24:52.765003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28> (b47e08c7-3ee5-4acd-883d-e0fcd6d75b28) [No such file or directory] >[2016-04-19 07:24:52.765066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28> (b47e08c7-3ee5-4acd-883d-e0fcd6d75b28) [No such file or directory] >[2016-04-19 07:24:52.766731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28> (b47e08c7-3ee5-4acd-883d-e0fcd6d75b28) [No such file or directory] >[2016-04-19 07:24:52.766913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28> (b47e08c7-3ee5-4acd-883d-e0fcd6d75b28) [No such file or directory] >[2016-04-19 07:24:52.767010] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b47e08c7-3ee5-4acd-883d-e0fcd6d75b28>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.774881] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.775598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08e9782c-526a-470d-9c22-7b4a48613673> (08e9782c-526a-470d-9c22-7b4a48613673) [No such file or directory] >[2016-04-19 07:24:52.775816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08e9782c-526a-470d-9c22-7b4a48613673> (08e9782c-526a-470d-9c22-7b4a48613673) [No such file or directory] >[2016-04-19 07:24:52.777767] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 08e9782c-526a-470d-9c22-7b4a48613673. (Possible split-brain) >[2016-04-19 07:24:52.778561] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08e9782c-526a-470d-9c22-7b4a48613673> (08e9782c-526a-470d-9c22-7b4a48613673) [No such file or directory] >[2016-04-19 07:24:52.778735] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08e9782c-526a-470d-9c22-7b4a48613673> (08e9782c-526a-470d-9c22-7b4a48613673) [No such file or directory] >[2016-04-19 07:24:52.779592] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08e9782c-526a-470d-9c22-7b4a48613673> (08e9782c-526a-470d-9c22-7b4a48613673) [No such file or directory] >[2016-04-19 07:24:52.779719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08e9782c-526a-470d-9c22-7b4a48613673> (08e9782c-526a-470d-9c22-7b4a48613673) [No such file or directory] >[2016-04-19 07:24:52.779776] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:08e9782c-526a-470d-9c22-7b4a48613673>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.781618] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 08e9782c-526a-470d-9c22-7b4a48613673. (Possible split-brain) >[2016-04-19 07:24:52.782413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08e9782c-526a-470d-9c22-7b4a48613673> (08e9782c-526a-470d-9c22-7b4a48613673) [No such file or directory] >[2016-04-19 07:24:52.782800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08e9782c-526a-470d-9c22-7b4a48613673> (08e9782c-526a-470d-9c22-7b4a48613673) [No such file or directory] >[2016-04-19 07:24:52.784637] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:08e9782c-526a-470d-9c22-7b4a48613673> (08e9782c-526a-470d-9c22-7b4a48613673) [No such file or directory] >[2016-04-19 07:24:52.784650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:08e9782c-526a-470d-9c22-7b4a48613673> (08e9782c-526a-470d-9c22-7b4a48613673) [No such file or directory] >[2016-04-19 07:24:52.785022] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:08e9782c-526a-470d-9c22-7b4a48613673>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.794634] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.795630] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7> (44db7811-89c6-42f5-9ce5-c4f5470529b7) [No such file or directory] >[2016-04-19 07:24:52.795678] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7> (44db7811-89c6-42f5-9ce5-c4f5470529b7) [No such file or directory] >[2016-04-19 07:24:52.796615] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 44db7811-89c6-42f5-9ce5-c4f5470529b7. (Possible split-brain) >[2016-04-19 07:24:52.797390] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7> (44db7811-89c6-42f5-9ce5-c4f5470529b7) [No such file or directory] >[2016-04-19 07:24:52.797480] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7> (44db7811-89c6-42f5-9ce5-c4f5470529b7) [No such file or directory] >[2016-04-19 07:24:52.798281] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7> (44db7811-89c6-42f5-9ce5-c4f5470529b7) [No such file or directory] >[2016-04-19 07:24:52.798500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7> (44db7811-89c6-42f5-9ce5-c4f5470529b7) [No such file or directory] >[2016-04-19 07:24:52.798577] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.800729] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 44db7811-89c6-42f5-9ce5-c4f5470529b7. (Possible split-brain) >[2016-04-19 07:24:52.801667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7> (44db7811-89c6-42f5-9ce5-c4f5470529b7) [No such file or directory] >[2016-04-19 07:24:52.801719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7> (44db7811-89c6-42f5-9ce5-c4f5470529b7) [No such file or directory] >[2016-04-19 07:24:52.803296] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7> (44db7811-89c6-42f5-9ce5-c4f5470529b7) [No such file or directory] >[2016-04-19 07:24:52.803523] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7> (44db7811-89c6-42f5-9ce5-c4f5470529b7) [No such file or directory] >[2016-04-19 07:24:52.803746] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:44db7811-89c6-42f5-9ce5-c4f5470529b7>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.812818] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.813705] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c> (e7368752-cddf-46ea-91f0-01629c02c22c) [No such file or directory] >[2016-04-19 07:24:52.813901] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c> (e7368752-cddf-46ea-91f0-01629c02c22c) [No such file or directory] >[2016-04-19 07:24:52.814949] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e7368752-cddf-46ea-91f0-01629c02c22c. (Possible split-brain) >[2016-04-19 07:24:52.815808] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c> (e7368752-cddf-46ea-91f0-01629c02c22c) [No such file or directory] >[2016-04-19 07:24:52.815893] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c> (e7368752-cddf-46ea-91f0-01629c02c22c) [No such file or directory] >[2016-04-19 07:24:52.817032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c> (e7368752-cddf-46ea-91f0-01629c02c22c) [No such file or directory] >[2016-04-19 07:24:52.817212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c> (e7368752-cddf-46ea-91f0-01629c02c22c) [No such file or directory] >[2016-04-19 07:24:52.817430] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.820135] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e7368752-cddf-46ea-91f0-01629c02c22c. (Possible split-brain) >[2016-04-19 07:24:52.820906] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c> (e7368752-cddf-46ea-91f0-01629c02c22c) [No such file or directory] >[2016-04-19 07:24:52.821077] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c> (e7368752-cddf-46ea-91f0-01629c02c22c) [No such file or directory] >[2016-04-19 07:24:52.823614] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c> (e7368752-cddf-46ea-91f0-01629c02c22c) [No such file or directory] >[2016-04-19 07:24:52.823709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c> (e7368752-cddf-46ea-91f0-01629c02c22c) [No such file or directory] >[2016-04-19 07:24:52.823849] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e7368752-cddf-46ea-91f0-01629c02c22c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.832732] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.833450] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49> (40398fc2-0d81-4909-a1dc-e14ece2c2b49) [No such file or directory] >[2016-04-19 07:24:52.833741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49> (40398fc2-0d81-4909-a1dc-e14ece2c2b49) [No such file or directory] >[2016-04-19 07:24:52.836496] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 40398fc2-0d81-4909-a1dc-e14ece2c2b49. (Possible split-brain) >[2016-04-19 07:24:52.837285] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49> (40398fc2-0d81-4909-a1dc-e14ece2c2b49) [No such file or directory] >[2016-04-19 07:24:52.837426] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49> (40398fc2-0d81-4909-a1dc-e14ece2c2b49) [No such file or directory] >[2016-04-19 07:24:52.838597] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49> (40398fc2-0d81-4909-a1dc-e14ece2c2b49) [No such file or directory] >[2016-04-19 07:24:52.838737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49> (40398fc2-0d81-4909-a1dc-e14ece2c2b49) [No such file or directory] >[2016-04-19 07:24:52.838844] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.841608] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 40398fc2-0d81-4909-a1dc-e14ece2c2b49. (Possible split-brain) >[2016-04-19 07:24:52.842357] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49> (40398fc2-0d81-4909-a1dc-e14ece2c2b49) [No such file or directory] >[2016-04-19 07:24:52.842667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49> (40398fc2-0d81-4909-a1dc-e14ece2c2b49) [No such file or directory] >[2016-04-19 07:24:52.845146] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49> (40398fc2-0d81-4909-a1dc-e14ece2c2b49) [No such file or directory] >[2016-04-19 07:24:52.845500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49> (40398fc2-0d81-4909-a1dc-e14ece2c2b49) [No such file or directory] >[2016-04-19 07:24:52.845627] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:40398fc2-0d81-4909-a1dc-e14ece2c2b49>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.855312] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.856268] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9152d741-61ce-4277-bd59-4599374fca31> (9152d741-61ce-4277-bd59-4599374fca31) [No such file or directory] >[2016-04-19 07:24:52.856571] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9152d741-61ce-4277-bd59-4599374fca31> (9152d741-61ce-4277-bd59-4599374fca31) [No such file or directory] >[2016-04-19 07:24:52.859306] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9152d741-61ce-4277-bd59-4599374fca31. (Possible split-brain) >[2016-04-19 07:24:52.860190] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9152d741-61ce-4277-bd59-4599374fca31> (9152d741-61ce-4277-bd59-4599374fca31) [No such file or directory] >[2016-04-19 07:24:52.860477] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9152d741-61ce-4277-bd59-4599374fca31> (9152d741-61ce-4277-bd59-4599374fca31) [No such file or directory] >[2016-04-19 07:24:52.861676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9152d741-61ce-4277-bd59-4599374fca31> (9152d741-61ce-4277-bd59-4599374fca31) [No such file or directory] >[2016-04-19 07:24:52.861757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9152d741-61ce-4277-bd59-4599374fca31> (9152d741-61ce-4277-bd59-4599374fca31) [No such file or directory] >[2016-04-19 07:24:52.861886] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9152d741-61ce-4277-bd59-4599374fca31>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.864696] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9152d741-61ce-4277-bd59-4599374fca31. (Possible split-brain) >[2016-04-19 07:24:52.865676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9152d741-61ce-4277-bd59-4599374fca31> (9152d741-61ce-4277-bd59-4599374fca31) [No such file or directory] >[2016-04-19 07:24:52.865979] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9152d741-61ce-4277-bd59-4599374fca31> (9152d741-61ce-4277-bd59-4599374fca31) [No such file or directory] >[2016-04-19 07:24:52.868781] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9152d741-61ce-4277-bd59-4599374fca31> (9152d741-61ce-4277-bd59-4599374fca31) [No such file or directory] >[2016-04-19 07:24:52.869344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9152d741-61ce-4277-bd59-4599374fca31> (9152d741-61ce-4277-bd59-4599374fca31) [No such file or directory] >[2016-04-19 07:24:52.869544] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9152d741-61ce-4277-bd59-4599374fca31>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.879451] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.880445] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef> (5707e772-b12a-4fcf-8d06-923b4f5950ef) [No such file or directory] >[2016-04-19 07:24:52.880638] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef> (5707e772-b12a-4fcf-8d06-923b4f5950ef) [No such file or directory] >[2016-04-19 07:24:52.883511] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5707e772-b12a-4fcf-8d06-923b4f5950ef. (Possible split-brain) >[2016-04-19 07:24:52.884718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef> (5707e772-b12a-4fcf-8d06-923b4f5950ef) [No such file or directory] >[2016-04-19 07:24:52.884791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef> (5707e772-b12a-4fcf-8d06-923b4f5950ef) [No such file or directory] >[2016-04-19 07:24:52.886247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef> (5707e772-b12a-4fcf-8d06-923b4f5950ef) [No such file or directory] >[2016-04-19 07:24:52.885955] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef> (5707e772-b12a-4fcf-8d06-923b4f5950ef) [No such file or directory] >[2016-04-19 07:24:52.886476] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.889218] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 5707e772-b12a-4fcf-8d06-923b4f5950ef. (Possible split-brain) >[2016-04-19 07:24:52.890436] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef> (5707e772-b12a-4fcf-8d06-923b4f5950ef) [No such file or directory] >[2016-04-19 07:24:52.890498] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef> (5707e772-b12a-4fcf-8d06-923b4f5950ef) [No such file or directory] >[2016-04-19 07:24:52.893071] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef> (5707e772-b12a-4fcf-8d06-923b4f5950ef) [No such file or directory] >[2016-04-19 07:24:52.893362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef> (5707e772-b12a-4fcf-8d06-923b4f5950ef) [No such file or directory] >[2016-04-19 07:24:52.893848] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5707e772-b12a-4fcf-8d06-923b4f5950ef>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.904782] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.905787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614> (ece4b714-977c-4b5d-99f6-b70eb8f11614) [No such file or directory] >[2016-04-19 07:24:52.905794] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614> (ece4b714-977c-4b5d-99f6-b70eb8f11614) [No such file or directory] >[2016-04-19 07:24:52.906964] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ece4b714-977c-4b5d-99f6-b70eb8f11614. (Possible split-brain) >[2016-04-19 07:24:52.907780] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614> (ece4b714-977c-4b5d-99f6-b70eb8f11614) [No such file or directory] >[2016-04-19 07:24:52.908274] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614> (ece4b714-977c-4b5d-99f6-b70eb8f11614) [No such file or directory] >[2016-04-19 07:24:52.909633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614> (ece4b714-977c-4b5d-99f6-b70eb8f11614) [No such file or directory] >[2016-04-19 07:24:52.909724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614> (ece4b714-977c-4b5d-99f6-b70eb8f11614) [No such file or directory] >[2016-04-19 07:24:52.909854] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.912611] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ece4b714-977c-4b5d-99f6-b70eb8f11614. (Possible split-brain) >[2016-04-19 07:24:52.913537] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614> (ece4b714-977c-4b5d-99f6-b70eb8f11614) [No such file or directory] >[2016-04-19 07:24:52.913774] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614> (ece4b714-977c-4b5d-99f6-b70eb8f11614) [No such file or directory] >[2016-04-19 07:24:52.916795] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614> (ece4b714-977c-4b5d-99f6-b70eb8f11614) [No such file or directory] >[2016-04-19 07:24:52.916834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614> (ece4b714-977c-4b5d-99f6-b70eb8f11614) [No such file or directory] >[2016-04-19 07:24:52.917335] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ece4b714-977c-4b5d-99f6-b70eb8f11614>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.925864] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.926815] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2> (cfee4a73-8269-4024-bfb2-26c0ec60aaa2) [No such file or directory] >[2016-04-19 07:24:52.926816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2> (cfee4a73-8269-4024-bfb2-26c0ec60aaa2) [No such file or directory] >[2016-04-19 07:24:52.929667] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cfee4a73-8269-4024-bfb2-26c0ec60aaa2. (Possible split-brain) >[2016-04-19 07:24:52.930473] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2> (cfee4a73-8269-4024-bfb2-26c0ec60aaa2) [No such file or directory] >[2016-04-19 07:24:52.930712] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2> (cfee4a73-8269-4024-bfb2-26c0ec60aaa2) [No such file or directory] >[2016-04-19 07:24:52.931960] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2> (cfee4a73-8269-4024-bfb2-26c0ec60aaa2) [No such file or directory] >[2016-04-19 07:24:52.932423] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2> (cfee4a73-8269-4024-bfb2-26c0ec60aaa2) [No such file or directory] >[2016-04-19 07:24:52.932604] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:52.935286] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid cfee4a73-8269-4024-bfb2-26c0ec60aaa2. (Possible split-brain) >[2016-04-19 07:24:52.936145] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2> (cfee4a73-8269-4024-bfb2-26c0ec60aaa2) [No such file or directory] >[2016-04-19 07:24:52.936202] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2> (cfee4a73-8269-4024-bfb2-26c0ec60aaa2) [No such file or directory] >[2016-04-19 07:24:52.939499] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2> (cfee4a73-8269-4024-bfb2-26c0ec60aaa2) [No such file or directory] >[2016-04-19 07:24:52.940003] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2> (cfee4a73-8269-4024-bfb2-26c0ec60aaa2) [No such file or directory] >[2016-04-19 07:24:52.940155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cfee4a73-8269-4024-bfb2-26c0ec60aaa2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.949445] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.950412] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e> (061c0a41-900e-46e3-ab53-ee492da3025e) [No such file or directory] >[2016-04-19 07:24:52.950528] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e> (061c0a41-900e-46e3-ab53-ee492da3025e) [No such file or directory] >[2016-04-19 07:24:52.951631] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 061c0a41-900e-46e3-ab53-ee492da3025e. (Possible split-brain) >[2016-04-19 07:24:52.952856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e> (061c0a41-900e-46e3-ab53-ee492da3025e) [No such file or directory] >[2016-04-19 07:24:52.952921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e> (061c0a41-900e-46e3-ab53-ee492da3025e) [No such file or directory] >[2016-04-19 07:24:52.954139] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e> (061c0a41-900e-46e3-ab53-ee492da3025e) [No such file or directory] >[2016-04-19 07:24:52.954157] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e> (061c0a41-900e-46e3-ab53-ee492da3025e) [No such file or directory] >[2016-04-19 07:24:52.954297] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.956961] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 061c0a41-900e-46e3-ab53-ee492da3025e. (Possible split-brain) >[2016-04-19 07:24:52.958018] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e> (061c0a41-900e-46e3-ab53-ee492da3025e) [No such file or directory] >[2016-04-19 07:24:52.958103] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e> (061c0a41-900e-46e3-ab53-ee492da3025e) [No such file or directory] >[2016-04-19 07:24:52.960620] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e> (061c0a41-900e-46e3-ab53-ee492da3025e) [No such file or directory] >[2016-04-19 07:24:52.960748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e> (061c0a41-900e-46e3-ab53-ee492da3025e) [No such file or directory] >[2016-04-19 07:24:52.960881] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:061c0a41-900e-46e3-ab53-ee492da3025e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:52.971971] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.972871] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2> (011f8130-f38d-4427-91dc-92cd954f25b2) [No such file or directory] >[2016-04-19 07:24:52.973185] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2> (011f8130-f38d-4427-91dc-92cd954f25b2) [No such file or directory] >[2016-04-19 07:24:52.974270] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 011f8130-f38d-4427-91dc-92cd954f25b2. (Possible split-brain) >[2016-04-19 07:24:52.975096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2> (011f8130-f38d-4427-91dc-92cd954f25b2) [No such file or directory] >[2016-04-19 07:24:52.975439] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2> (011f8130-f38d-4427-91dc-92cd954f25b2) [No such file or directory] >[2016-04-19 07:24:52.976642] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2> (011f8130-f38d-4427-91dc-92cd954f25b2) [No such file or directory] >[2016-04-19 07:24:52.976749] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2> (011f8130-f38d-4427-91dc-92cd954f25b2) [No such file or directory] >[2016-04-19 07:24:52.977306] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:52.980099] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 011f8130-f38d-4427-91dc-92cd954f25b2. (Possible split-brain) >[2016-04-19 07:24:52.981119] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2> (011f8130-f38d-4427-91dc-92cd954f25b2) [No such file or directory] >[2016-04-19 07:24:52.981271] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2> (011f8130-f38d-4427-91dc-92cd954f25b2) [No such file or directory] >[2016-04-19 07:24:52.984183] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2> (011f8130-f38d-4427-91dc-92cd954f25b2) [No such file or directory] >[2016-04-19 07:24:52.984286] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2> (011f8130-f38d-4427-91dc-92cd954f25b2) [No such file or directory] >[2016-04-19 07:24:52.984960] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:011f8130-f38d-4427-91dc-92cd954f25b2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:52.994160] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:52.995219] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4> (4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4) [No such file or directory] >[2016-04-19 07:24:52.995467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4> (4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4) [No such file or directory] >[2016-04-19 07:24:52.996556] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4. (Possible split-brain) >[2016-04-19 07:24:52.997725] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4> (4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4) [No such file or directory] >[2016-04-19 07:24:52.997978] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4> (4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4) [No such file or directory] >[2016-04-19 07:24:52.999054] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4> (4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4) [No such file or directory] >[2016-04-19 07:24:52.999267] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4> (4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4) [No such file or directory] >[2016-04-19 07:24:52.999404] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.002843] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4. (Possible split-brain) >[2016-04-19 07:24:53.003950] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4> (4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4) [No such file or directory] >[2016-04-19 07:24:53.004079] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4> (4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4) [No such file or directory] >[2016-04-19 07:24:53.006801] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4> (4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4) [No such file or directory] >[2016-04-19 07:24:53.006892] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4> (4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4) [No such file or directory] >[2016-04-19 07:24:53.007000] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4d6e2e0a-a5da-4dea-b1e8-1c71efec3ed4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.016648] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.017446] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70> (e57828d9-fd50-4ce1-91f3-e9f221a7fc70) [No such file or directory] >[2016-04-19 07:24:53.017538] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70> (e57828d9-fd50-4ce1-91f3-e9f221a7fc70) [No such file or directory] >[2016-04-19 07:24:53.018633] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e57828d9-fd50-4ce1-91f3-e9f221a7fc70. (Possible split-brain) >[2016-04-19 07:24:53.019287] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70> (e57828d9-fd50-4ce1-91f3-e9f221a7fc70) [No such file or directory] >[2016-04-19 07:24:53.019645] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70> (e57828d9-fd50-4ce1-91f3-e9f221a7fc70) [No such file or directory] >[2016-04-19 07:24:53.020915] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70> (e57828d9-fd50-4ce1-91f3-e9f221a7fc70) [No such file or directory] >[2016-04-19 07:24:53.021032] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70> (e57828d9-fd50-4ce1-91f3-e9f221a7fc70) [No such file or directory] >[2016-04-19 07:24:53.021134] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.023858] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid e57828d9-fd50-4ce1-91f3-e9f221a7fc70. (Possible split-brain) >[2016-04-19 07:24:53.024648] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70> (e57828d9-fd50-4ce1-91f3-e9f221a7fc70) [No such file or directory] >[2016-04-19 07:24:53.024721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70> (e57828d9-fd50-4ce1-91f3-e9f221a7fc70) [No such file or directory] >[2016-04-19 07:24:53.027268] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70> (e57828d9-fd50-4ce1-91f3-e9f221a7fc70) [No such file or directory] >[2016-04-19 07:24:53.027734] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70> (e57828d9-fd50-4ce1-91f3-e9f221a7fc70) [No such file or directory] >[2016-04-19 07:24:53.027922] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e57828d9-fd50-4ce1-91f3-e9f221a7fc70>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.035818] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.036668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b> (ec3ed9a6-210c-47b5-bf22-94231185480b) [No such file or directory] >[2016-04-19 07:24:53.036773] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b> (ec3ed9a6-210c-47b5-bf22-94231185480b) [No such file or directory] >[2016-04-19 07:24:53.037836] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ec3ed9a6-210c-47b5-bf22-94231185480b. (Possible split-brain) >[2016-04-19 07:24:53.038683] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b> (ec3ed9a6-210c-47b5-bf22-94231185480b) [No such file or directory] >[2016-04-19 07:24:53.038816] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b> (ec3ed9a6-210c-47b5-bf22-94231185480b) [No such file or directory] >[2016-04-19 07:24:53.039980] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b> (ec3ed9a6-210c-47b5-bf22-94231185480b) [No such file or directory] >[2016-04-19 07:24:53.040122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b> (ec3ed9a6-210c-47b5-bf22-94231185480b) [No such file or directory] >[2016-04-19 07:24:53.040240] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:53.042929] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ec3ed9a6-210c-47b5-bf22-94231185480b. (Possible split-brain) >[2016-04-19 07:24:53.043647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b> (ec3ed9a6-210c-47b5-bf22-94231185480b) [No such file or directory] >[2016-04-19 07:24:53.043909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b> (ec3ed9a6-210c-47b5-bf22-94231185480b) [No such file or directory] >[2016-04-19 07:24:53.046601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b> (ec3ed9a6-210c-47b5-bf22-94231185480b) [No such file or directory] >[2016-04-19 07:24:53.046724] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b> (ec3ed9a6-210c-47b5-bf22-94231185480b) [No such file or directory] >[2016-04-19 07:24:53.046893] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ec3ed9a6-210c-47b5-bf22-94231185480b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.055703] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.056457] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c> (ba3de733-f344-4106-9dbc-a27647d72b7c) [No such file or directory] >[2016-04-19 07:24:53.056651] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c> (ba3de733-f344-4106-9dbc-a27647d72b7c) [No such file or directory] >[2016-04-19 07:24:53.059390] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ba3de733-f344-4106-9dbc-a27647d72b7c. (Possible split-brain) >[2016-04-19 07:24:53.060099] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c> (ba3de733-f344-4106-9dbc-a27647d72b7c) [No such file or directory] >[2016-04-19 07:24:53.060309] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c> (ba3de733-f344-4106-9dbc-a27647d72b7c) [No such file or directory] >[2016-04-19 07:24:53.061616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c> (ba3de733-f344-4106-9dbc-a27647d72b7c) [No such file or directory] >[2016-04-19 07:24:53.061647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c> (ba3de733-f344-4106-9dbc-a27647d72b7c) [No such file or directory] >[2016-04-19 07:24:53.061830] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.064840] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ba3de733-f344-4106-9dbc-a27647d72b7c. (Possible split-brain) >[2016-04-19 07:24:53.065586] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c> (ba3de733-f344-4106-9dbc-a27647d72b7c) [No such file or directory] >[2016-04-19 07:24:53.065869] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c> (ba3de733-f344-4106-9dbc-a27647d72b7c) [No such file or directory] >[2016-04-19 07:24:53.069170] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c> (ba3de733-f344-4106-9dbc-a27647d72b7c) [No such file or directory] >[2016-04-19 07:24:53.069292] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c> (ba3de733-f344-4106-9dbc-a27647d72b7c) [No such file or directory] >[2016-04-19 07:24:53.069606] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ba3de733-f344-4106-9dbc-a27647d72b7c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.078129] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.078870] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b> (f7a38af7-7297-4871-bcf9-3624adbf2c5b) [No such file or directory] >[2016-04-19 07:24:53.079167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b> (f7a38af7-7297-4871-bcf9-3624adbf2c5b) [No such file or directory] >[2016-04-19 07:24:53.082008] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f7a38af7-7297-4871-bcf9-3624adbf2c5b. (Possible split-brain) >[2016-04-19 07:24:53.082720] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b> (f7a38af7-7297-4871-bcf9-3624adbf2c5b) [No such file or directory] >[2016-04-19 07:24:53.083188] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b> (f7a38af7-7297-4871-bcf9-3624adbf2c5b) [No such file or directory] >[2016-04-19 07:24:53.084470] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b> (f7a38af7-7297-4871-bcf9-3624adbf2c5b) [No such file or directory] >[2016-04-19 07:24:53.084936] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b> (f7a38af7-7297-4871-bcf9-3624adbf2c5b) [No such file or directory] >[2016-04-19 07:24:53.085049] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.087861] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f7a38af7-7297-4871-bcf9-3624adbf2c5b. (Possible split-brain) >[2016-04-19 07:24:53.088607] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b> (f7a38af7-7297-4871-bcf9-3624adbf2c5b) [No such file or directory] >[2016-04-19 07:24:53.089016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b> (f7a38af7-7297-4871-bcf9-3624adbf2c5b) [No such file or directory] >[2016-04-19 07:24:53.091963] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b> (f7a38af7-7297-4871-bcf9-3624adbf2c5b) [No such file or directory] >[2016-04-19 07:24:53.092006] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b> (f7a38af7-7297-4871-bcf9-3624adbf2c5b) [No such file or directory] >[2016-04-19 07:24:53.092232] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f7a38af7-7297-4871-bcf9-3624adbf2c5b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.102541] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.103516] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8> (16540c7e-a491-44fb-a0cc-9323355647f8) [No such file or directory] >[2016-04-19 07:24:53.103694] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8> (16540c7e-a491-44fb-a0cc-9323355647f8) [No such file or directory] >[2016-04-19 07:24:53.104787] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 16540c7e-a491-44fb-a0cc-9323355647f8. (Possible split-brain) >[2016-04-19 07:24:53.105824] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8> (16540c7e-a491-44fb-a0cc-9323355647f8) [No such file or directory] >[2016-04-19 07:24:53.105930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8> (16540c7e-a491-44fb-a0cc-9323355647f8) [No such file or directory] >[2016-04-19 07:24:53.107217] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8> (16540c7e-a491-44fb-a0cc-9323355647f8) [No such file or directory] >[2016-04-19 07:24:53.107361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8> (16540c7e-a491-44fb-a0cc-9323355647f8) [No such file or directory] >[2016-04-19 07:24:53.107661] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:53.110388] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 16540c7e-a491-44fb-a0cc-9323355647f8. (Possible split-brain) >[2016-04-19 07:24:53.111703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8> (16540c7e-a491-44fb-a0cc-9323355647f8) [No such file or directory] >[2016-04-19 07:24:53.111799] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8> (16540c7e-a491-44fb-a0cc-9323355647f8) [No such file or directory] >[2016-04-19 07:24:53.114462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8> (16540c7e-a491-44fb-a0cc-9323355647f8) [No such file or directory] >[2016-04-19 07:24:53.114556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8> (16540c7e-a491-44fb-a0cc-9323355647f8) [No such file or directory] >[2016-04-19 07:24:53.114666] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:16540c7e-a491-44fb-a0cc-9323355647f8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.122577] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.123486] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede> (7f44e04a-4ae4-48a9-a569-588068390ede) [No such file or directory] >[2016-04-19 07:24:53.123502] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede> (7f44e04a-4ae4-48a9-a569-588068390ede) [No such file or directory] >[2016-04-19 07:24:53.126258] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7f44e04a-4ae4-48a9-a569-588068390ede. (Possible split-brain) >[2016-04-19 07:24:53.127134] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede> (7f44e04a-4ae4-48a9-a569-588068390ede) [No such file or directory] >[2016-04-19 07:24:53.127247] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede> (7f44e04a-4ae4-48a9-a569-588068390ede) [No such file or directory] >[2016-04-19 07:24:53.128515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede> (7f44e04a-4ae4-48a9-a569-588068390ede) [No such file or directory] >[2016-04-19 07:24:53.128714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede> (7f44e04a-4ae4-48a9-a569-588068390ede) [No such file or directory] >[2016-04-19 07:24:53.128840] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.131587] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7f44e04a-4ae4-48a9-a569-588068390ede. (Possible split-brain) >[2016-04-19 07:24:53.132302] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede> (7f44e04a-4ae4-48a9-a569-588068390ede) [No such file or directory] >[2016-04-19 07:24:53.132467] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede> (7f44e04a-4ae4-48a9-a569-588068390ede) [No such file or directory] >[2016-04-19 07:24:53.135415] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede> (7f44e04a-4ae4-48a9-a569-588068390ede) [No such file or directory] >[2016-04-19 07:24:53.135986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede> (7f44e04a-4ae4-48a9-a569-588068390ede) [No such file or directory] >[2016-04-19 07:24:53.136108] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7f44e04a-4ae4-48a9-a569-588068390ede>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.144702] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.145464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3> (00307d3c-e252-47f9-afe1-edcbc83eb7d3) [No such file or directory] >[2016-04-19 07:24:53.145719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3> (00307d3c-e252-47f9-afe1-edcbc83eb7d3) [No such file or directory] >[2016-04-19 07:24:53.146834] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 00307d3c-e252-47f9-afe1-edcbc83eb7d3. (Possible split-brain) >[2016-04-19 07:24:53.147588] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3> (00307d3c-e252-47f9-afe1-edcbc83eb7d3) [No such file or directory] >[2016-04-19 07:24:53.147677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3> (00307d3c-e252-47f9-afe1-edcbc83eb7d3) [No such file or directory] >[2016-04-19 07:24:53.148776] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3> (00307d3c-e252-47f9-afe1-edcbc83eb7d3) [No such file or directory] >[2016-04-19 07:24:53.148879] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3> (00307d3c-e252-47f9-afe1-edcbc83eb7d3) [No such file or directory] >[2016-04-19 07:24:53.148988] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.151671] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 00307d3c-e252-47f9-afe1-edcbc83eb7d3. (Possible split-brain) >[2016-04-19 07:24:53.152427] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3> (00307d3c-e252-47f9-afe1-edcbc83eb7d3) [No such file or directory] >[2016-04-19 07:24:53.152910] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3> (00307d3c-e252-47f9-afe1-edcbc83eb7d3) [No such file or directory] >[2016-04-19 07:24:53.155541] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3> (00307d3c-e252-47f9-afe1-edcbc83eb7d3) [No such file or directory] >[2016-04-19 07:24:53.155612] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3> (00307d3c-e252-47f9-afe1-edcbc83eb7d3) [No such file or directory] >[2016-04-19 07:24:53.155749] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:00307d3c-e252-47f9-afe1-edcbc83eb7d3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.164797] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.165858] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b> (075f34ee-cdc2-49c8-8156-f8b499ba7a0b) [No such file or directory] >[2016-04-19 07:24:53.165884] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b> (075f34ee-cdc2-49c8-8156-f8b499ba7a0b) [No such file or directory] >[2016-04-19 07:24:53.168682] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 075f34ee-cdc2-49c8-8156-f8b499ba7a0b. (Possible split-brain) >[2016-04-19 07:24:53.169792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b> (075f34ee-cdc2-49c8-8156-f8b499ba7a0b) [No such file or directory] >[2016-04-19 07:24:53.169792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b> (075f34ee-cdc2-49c8-8156-f8b499ba7a0b) [No such file or directory] >[2016-04-19 07:24:53.171033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b> (075f34ee-cdc2-49c8-8156-f8b499ba7a0b) [No such file or directory] >[2016-04-19 07:24:53.171092] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b> (075f34ee-cdc2-49c8-8156-f8b499ba7a0b) [No such file or directory] >[2016-04-19 07:24:53.171262] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.173043] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 075f34ee-cdc2-49c8-8156-f8b499ba7a0b. (Possible split-brain) >[2016-04-19 07:24:53.174114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b> (075f34ee-cdc2-49c8-8156-f8b499ba7a0b) [No such file or directory] >[2016-04-19 07:24:53.174171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b> (075f34ee-cdc2-49c8-8156-f8b499ba7a0b) [No such file or directory] >[2016-04-19 07:24:53.175807] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b> (075f34ee-cdc2-49c8-8156-f8b499ba7a0b) [No such file or directory] >[2016-04-19 07:24:53.175848] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b> (075f34ee-cdc2-49c8-8156-f8b499ba7a0b) [No such file or directory] >[2016-04-19 07:24:53.176154] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:075f34ee-cdc2-49c8-8156-f8b499ba7a0b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.185735] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.186639] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32> (e8e22322-ca60-4ac2-bea6-37caef0b4e32) [No such file or directory] >[2016-04-19 07:24:53.187011] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32> (e8e22322-ca60-4ac2-bea6-37caef0b4e32) [No such file or directory] >[2016-04-19 07:24:53.189798] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e8e22322-ca60-4ac2-bea6-37caef0b4e32. (Possible split-brain) >[2016-04-19 07:24:53.190822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32> (e8e22322-ca60-4ac2-bea6-37caef0b4e32) [No such file or directory] >[2016-04-19 07:24:53.190887] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32> (e8e22322-ca60-4ac2-bea6-37caef0b4e32) [No such file or directory] >[2016-04-19 07:24:53.192130] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32> (e8e22322-ca60-4ac2-bea6-37caef0b4e32) [No such file or directory] >[2016-04-19 07:24:53.192206] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32> (e8e22322-ca60-4ac2-bea6-37caef0b4e32) [No such file or directory] >[2016-04-19 07:24:53.192339] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:53.195068] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e8e22322-ca60-4ac2-bea6-37caef0b4e32. (Possible split-brain) >[2016-04-19 07:24:53.196197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32> (e8e22322-ca60-4ac2-bea6-37caef0b4e32) [No such file or directory] >[2016-04-19 07:24:53.196261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32> (e8e22322-ca60-4ac2-bea6-37caef0b4e32) [No such file or directory] >[2016-04-19 07:24:53.199697] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32> (e8e22322-ca60-4ac2-bea6-37caef0b4e32) [No such file or directory] >[2016-04-19 07:24:53.199727] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32> (e8e22322-ca60-4ac2-bea6-37caef0b4e32) [No such file or directory] >[2016-04-19 07:24:53.199907] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e8e22322-ca60-4ac2-bea6-37caef0b4e32>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.208577] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.209264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1> (4395a897-5245-4279-8f54-c00e6b6d69a1) [No such file or directory] >[2016-04-19 07:24:53.209690] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1> (4395a897-5245-4279-8f54-c00e6b6d69a1) [No such file or directory] >[2016-04-19 07:24:53.212642] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4395a897-5245-4279-8f54-c00e6b6d69a1. (Possible split-brain) >[2016-04-19 07:24:53.213544] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1> (4395a897-5245-4279-8f54-c00e6b6d69a1) [No such file or directory] >[2016-04-19 07:24:53.213750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1> (4395a897-5245-4279-8f54-c00e6b6d69a1) [No such file or directory] >[2016-04-19 07:24:53.215379] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1> (4395a897-5245-4279-8f54-c00e6b6d69a1) [No such file or directory] >[2016-04-19 07:24:53.215397] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1> (4395a897-5245-4279-8f54-c00e6b6d69a1) [No such file or directory] >[2016-04-19 07:24:53.215553] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.218255] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4395a897-5245-4279-8f54-c00e6b6d69a1. (Possible split-brain) >[2016-04-19 07:24:53.219100] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1> (4395a897-5245-4279-8f54-c00e6b6d69a1) [No such file or directory] >[2016-04-19 07:24:53.219376] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1> (4395a897-5245-4279-8f54-c00e6b6d69a1) [No such file or directory] >[2016-04-19 07:24:53.222020] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1> (4395a897-5245-4279-8f54-c00e6b6d69a1) [No such file or directory] >[2016-04-19 07:24:53.222351] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1> (4395a897-5245-4279-8f54-c00e6b6d69a1) [No such file or directory] >[2016-04-19 07:24:53.222517] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4395a897-5245-4279-8f54-c00e6b6d69a1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.232229] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.233039] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5> (5f936d04-6912-4efa-9e79-3dbc560890e5) [No such file or directory] >[2016-04-19 07:24:53.233377] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5> (5f936d04-6912-4efa-9e79-3dbc560890e5) [No such file or directory] >[2016-04-19 07:24:53.236130] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5f936d04-6912-4efa-9e79-3dbc560890e5. (Possible split-brain) >[2016-04-19 07:24:53.236817] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5> (5f936d04-6912-4efa-9e79-3dbc560890e5) [No such file or directory] >[2016-04-19 07:24:53.237398] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5> (5f936d04-6912-4efa-9e79-3dbc560890e5) [No such file or directory] >[2016-04-19 07:24:53.238556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5> (5f936d04-6912-4efa-9e79-3dbc560890e5) [No such file or directory] >[2016-04-19 07:24:53.239001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5> (5f936d04-6912-4efa-9e79-3dbc560890e5) [No such file or directory] >[2016-04-19 07:24:53.239109] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.241867] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5f936d04-6912-4efa-9e79-3dbc560890e5. (Possible split-brain) >[2016-04-19 07:24:53.242614] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5> (5f936d04-6912-4efa-9e79-3dbc560890e5) [No such file or directory] >[2016-04-19 07:24:53.242862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5> (5f936d04-6912-4efa-9e79-3dbc560890e5) [No such file or directory] >[2016-04-19 07:24:53.245502] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5> (5f936d04-6912-4efa-9e79-3dbc560890e5) [No such file or directory] >[2016-04-19 07:24:53.245767] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5> (5f936d04-6912-4efa-9e79-3dbc560890e5) [No such file or directory] >[2016-04-19 07:24:53.245897] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5f936d04-6912-4efa-9e79-3dbc560890e5>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.255439] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.256482] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb> (f770aff7-75b5-4b7c-8570-b3f1cb526beb) [No such file or directory] >[2016-04-19 07:24:53.256745] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb> (f770aff7-75b5-4b7c-8570-b3f1cb526beb) [No such file or directory] >[2016-04-19 07:24:53.259573] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f770aff7-75b5-4b7c-8570-b3f1cb526beb. (Possible split-brain) >[2016-04-19 07:24:53.260695] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb> (f770aff7-75b5-4b7c-8570-b3f1cb526beb) [No such file or directory] >[2016-04-19 07:24:53.260806] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb> (f770aff7-75b5-4b7c-8570-b3f1cb526beb) [No such file or directory] >[2016-04-19 07:24:53.262135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb> (f770aff7-75b5-4b7c-8570-b3f1cb526beb) [No such file or directory] >[2016-04-19 07:24:53.262257] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb> (f770aff7-75b5-4b7c-8570-b3f1cb526beb) [No such file or directory] >[2016-04-19 07:24:53.262399] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.265177] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid f770aff7-75b5-4b7c-8570-b3f1cb526beb. (Possible split-brain) >[2016-04-19 07:24:53.266307] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb> (f770aff7-75b5-4b7c-8570-b3f1cb526beb) [No such file or directory] >[2016-04-19 07:24:53.266346] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb> (f770aff7-75b5-4b7c-8570-b3f1cb526beb) [No such file or directory] >[2016-04-19 07:24:53.269425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb> (f770aff7-75b5-4b7c-8570-b3f1cb526beb) [No such file or directory] >[2016-04-19 07:24:53.269563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb> (f770aff7-75b5-4b7c-8570-b3f1cb526beb) [No such file or directory] >[2016-04-19 07:24:53.269725] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f770aff7-75b5-4b7c-8570-b3f1cb526beb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.278928] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.279641] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:56a23cae-564c-461e-904f-a1b395281136> (56a23cae-564c-461e-904f-a1b395281136) [No such file or directory] >[2016-04-19 07:24:53.279902] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:56a23cae-564c-461e-904f-a1b395281136> (56a23cae-564c-461e-904f-a1b395281136) [No such file or directory] >[2016-04-19 07:24:53.281011] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 56a23cae-564c-461e-904f-a1b395281136. (Possible split-brain) >[2016-04-19 07:24:53.281691] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:56a23cae-564c-461e-904f-a1b395281136> (56a23cae-564c-461e-904f-a1b395281136) [No such file or directory] >[2016-04-19 07:24:53.282047] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:56a23cae-564c-461e-904f-a1b395281136> (56a23cae-564c-461e-904f-a1b395281136) [No such file or directory] >[2016-04-19 07:24:53.283232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:56a23cae-564c-461e-904f-a1b395281136> (56a23cae-564c-461e-904f-a1b395281136) [No such file or directory] >[2016-04-19 07:24:53.283690] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:56a23cae-564c-461e-904f-a1b395281136> (56a23cae-564c-461e-904f-a1b395281136) [No such file or directory] >[2016-04-19 07:24:53.283819] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:56a23cae-564c-461e-904f-a1b395281136>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.286499] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 56a23cae-564c-461e-904f-a1b395281136. (Possible split-brain) >[2016-04-19 07:24:53.287279] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:56a23cae-564c-461e-904f-a1b395281136> (56a23cae-564c-461e-904f-a1b395281136) [No such file or directory] >[2016-04-19 07:24:53.287568] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:56a23cae-564c-461e-904f-a1b395281136> (56a23cae-564c-461e-904f-a1b395281136) [No such file or directory] >[2016-04-19 07:24:53.290360] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:56a23cae-564c-461e-904f-a1b395281136> (56a23cae-564c-461e-904f-a1b395281136) [No such file or directory] >[2016-04-19 07:24:53.290636] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:56a23cae-564c-461e-904f-a1b395281136> (56a23cae-564c-461e-904f-a1b395281136) [No such file or directory] >[2016-04-19 07:24:53.290795] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:56a23cae-564c-461e-904f-a1b395281136>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.299970] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.301048] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:233f909f-c650-4d26-b063-64158b874353> (233f909f-c650-4d26-b063-64158b874353) [No such file or directory] >[2016-04-19 07:24:53.301142] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:233f909f-c650-4d26-b063-64158b874353> (233f909f-c650-4d26-b063-64158b874353) [No such file or directory] >[2016-04-19 07:24:53.302248] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 233f909f-c650-4d26-b063-64158b874353. (Possible split-brain) >[2016-04-19 07:24:53.303373] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:233f909f-c650-4d26-b063-64158b874353> (233f909f-c650-4d26-b063-64158b874353) [No such file or directory] >[2016-04-19 07:24:53.303428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:233f909f-c650-4d26-b063-64158b874353> (233f909f-c650-4d26-b063-64158b874353) [No such file or directory] >[2016-04-19 07:24:53.304718] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:233f909f-c650-4d26-b063-64158b874353> (233f909f-c650-4d26-b063-64158b874353) [No such file or directory] >[2016-04-19 07:24:53.304792] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:233f909f-c650-4d26-b063-64158b874353> (233f909f-c650-4d26-b063-64158b874353) [No such file or directory] >[2016-04-19 07:24:53.304914] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:233f909f-c650-4d26-b063-64158b874353>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.307591] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 233f909f-c650-4d26-b063-64158b874353. (Possible split-brain) >[2016-04-19 07:24:53.308493] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:233f909f-c650-4d26-b063-64158b874353> (233f909f-c650-4d26-b063-64158b874353) [No such file or directory] >[2016-04-19 07:24:53.308803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:233f909f-c650-4d26-b063-64158b874353> (233f909f-c650-4d26-b063-64158b874353) [No such file or directory] >[2016-04-19 07:24:53.311411] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:233f909f-c650-4d26-b063-64158b874353> (233f909f-c650-4d26-b063-64158b874353) [No such file or directory] >[2016-04-19 07:24:53.311543] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:233f909f-c650-4d26-b063-64158b874353> (233f909f-c650-4d26-b063-64158b874353) [No such file or directory] >[2016-04-19 07:24:53.311672] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:233f909f-c650-4d26-b063-64158b874353>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.322160] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.323270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503> (b1911bea-430f-47cb-a2e6-9eb2c2995503) [No such file or directory] >[2016-04-19 07:24:53.323395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503> (b1911bea-430f-47cb-a2e6-9eb2c2995503) [No such file or directory] >[2016-04-19 07:24:53.324481] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b1911bea-430f-47cb-a2e6-9eb2c2995503. (Possible split-brain) >[2016-04-19 07:24:53.325650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503> (b1911bea-430f-47cb-a2e6-9eb2c2995503) [No such file or directory] >[2016-04-19 07:24:53.325736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503> (b1911bea-430f-47cb-a2e6-9eb2c2995503) [No such file or directory] >[2016-04-19 07:24:53.327144] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503> (b1911bea-430f-47cb-a2e6-9eb2c2995503) [No such file or directory] >[2016-04-19 07:24:53.327172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503> (b1911bea-430f-47cb-a2e6-9eb2c2995503) [No such file or directory] >[2016-04-19 07:24:53.327339] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.330116] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid b1911bea-430f-47cb-a2e6-9eb2c2995503. (Possible split-brain) >[2016-04-19 07:24:53.331284] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503> (b1911bea-430f-47cb-a2e6-9eb2c2995503) [No such file or directory] >[2016-04-19 07:24:53.331401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503> (b1911bea-430f-47cb-a2e6-9eb2c2995503) [No such file or directory] >[2016-04-19 07:24:53.334234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503> (b1911bea-430f-47cb-a2e6-9eb2c2995503) [No such file or directory] >[2016-04-19 07:24:53.334384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503> (b1911bea-430f-47cb-a2e6-9eb2c2995503) [No such file or directory] >[2016-04-19 07:24:53.334503] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:b1911bea-430f-47cb-a2e6-9eb2c2995503>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.344062] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.345186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20> (c823018a-73be-4191-aa35-a2ab5bd58e20) [No such file or directory] >[2016-04-19 07:24:53.345264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20> (c823018a-73be-4191-aa35-a2ab5bd58e20) [No such file or directory] >[2016-04-19 07:24:53.348104] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c823018a-73be-4191-aa35-a2ab5bd58e20. (Possible split-brain) >[2016-04-19 07:24:53.349363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20> (c823018a-73be-4191-aa35-a2ab5bd58e20) [No such file or directory] >[2016-04-19 07:24:53.349472] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20> (c823018a-73be-4191-aa35-a2ab5bd58e20) [No such file or directory] >[2016-04-19 07:24:53.350846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20> (c823018a-73be-4191-aa35-a2ab5bd58e20) [No such file or directory] >[2016-04-19 07:24:53.350923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20> (c823018a-73be-4191-aa35-a2ab5bd58e20) [No such file or directory] >[2016-04-19 07:24:53.351083] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.353818] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c823018a-73be-4191-aa35-a2ab5bd58e20. (Possible split-brain) >[2016-04-19 07:24:53.354877] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20> (c823018a-73be-4191-aa35-a2ab5bd58e20) [No such file or directory] >[2016-04-19 07:24:53.355124] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20> (c823018a-73be-4191-aa35-a2ab5bd58e20) [No such file or directory] >[2016-04-19 07:24:53.357799] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20> (c823018a-73be-4191-aa35-a2ab5bd58e20) [No such file or directory] >[2016-04-19 07:24:53.358066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20> (c823018a-73be-4191-aa35-a2ab5bd58e20) [No such file or directory] >[2016-04-19 07:24:53.358262] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c823018a-73be-4191-aa35-a2ab5bd58e20>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.367774] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.368756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:241c9845-c51f-403d-b150-4451e7ef5554> (241c9845-c51f-403d-b150-4451e7ef5554) [No such file or directory] >[2016-04-19 07:24:53.368771] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:241c9845-c51f-403d-b150-4451e7ef5554> (241c9845-c51f-403d-b150-4451e7ef5554) [No such file or directory] >[2016-04-19 07:24:53.369922] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 241c9845-c51f-403d-b150-4451e7ef5554. (Possible split-brain) >[2016-04-19 07:24:53.370784] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:241c9845-c51f-403d-b150-4451e7ef5554> (241c9845-c51f-403d-b150-4451e7ef5554) [No such file or directory] >[2016-04-19 07:24:53.370864] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:241c9845-c51f-403d-b150-4451e7ef5554> (241c9845-c51f-403d-b150-4451e7ef5554) [No such file or directory] >[2016-04-19 07:24:53.372105] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:241c9845-c51f-403d-b150-4451e7ef5554> (241c9845-c51f-403d-b150-4451e7ef5554) [No such file or directory] >[2016-04-19 07:24:53.372171] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:241c9845-c51f-403d-b150-4451e7ef5554> (241c9845-c51f-403d-b150-4451e7ef5554) [No such file or directory] >[2016-04-19 07:24:53.372312] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:241c9845-c51f-403d-b150-4451e7ef5554>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.375054] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 241c9845-c51f-403d-b150-4451e7ef5554. (Possible split-brain) >[2016-04-19 07:24:53.375705] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:241c9845-c51f-403d-b150-4451e7ef5554> (241c9845-c51f-403d-b150-4451e7ef5554) [No such file or directory] >[2016-04-19 07:24:53.376086] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:241c9845-c51f-403d-b150-4451e7ef5554> (241c9845-c51f-403d-b150-4451e7ef5554) [No such file or directory] >[2016-04-19 07:24:53.379019] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:241c9845-c51f-403d-b150-4451e7ef5554> (241c9845-c51f-403d-b150-4451e7ef5554) [No such file or directory] >[2016-04-19 07:24:53.379121] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:241c9845-c51f-403d-b150-4451e7ef5554> (241c9845-c51f-403d-b150-4451e7ef5554) [No such file or directory] >[2016-04-19 07:24:53.379287] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:241c9845-c51f-403d-b150-4451e7ef5554>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.388872] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.389829] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa05b88d-e057-487c-afba-8439d5148a90> (fa05b88d-e057-487c-afba-8439d5148a90) [No such file or directory] >[2016-04-19 07:24:53.390131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa05b88d-e057-487c-afba-8439d5148a90> (fa05b88d-e057-487c-afba-8439d5148a90) [No such file or directory] >[2016-04-19 07:24:53.392927] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fa05b88d-e057-487c-afba-8439d5148a90. (Possible split-brain) >[2016-04-19 07:24:53.393777] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa05b88d-e057-487c-afba-8439d5148a90> (fa05b88d-e057-487c-afba-8439d5148a90) [No such file or directory] >[2016-04-19 07:24:53.394194] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa05b88d-e057-487c-afba-8439d5148a90> (fa05b88d-e057-487c-afba-8439d5148a90) [No such file or directory] >[2016-04-19 07:24:53.395199] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa05b88d-e057-487c-afba-8439d5148a90> (fa05b88d-e057-487c-afba-8439d5148a90) [No such file or directory] >[2016-04-19 07:24:53.395589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa05b88d-e057-487c-afba-8439d5148a90> (fa05b88d-e057-487c-afba-8439d5148a90) [No such file or directory] >[2016-04-19 07:24:53.395758] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:fa05b88d-e057-487c-afba-8439d5148a90>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.398475] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid fa05b88d-e057-487c-afba-8439d5148a90. (Possible split-brain) >[2016-04-19 07:24:53.399599] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa05b88d-e057-487c-afba-8439d5148a90> (fa05b88d-e057-487c-afba-8439d5148a90) [No such file or directory] >[2016-04-19 07:24:53.399674] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa05b88d-e057-487c-afba-8439d5148a90> (fa05b88d-e057-487c-afba-8439d5148a90) [No such file or directory] >[2016-04-19 07:24:53.402478] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:fa05b88d-e057-487c-afba-8439d5148a90> (fa05b88d-e057-487c-afba-8439d5148a90) [No such file or directory] >[2016-04-19 07:24:53.402742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:fa05b88d-e057-487c-afba-8439d5148a90> (fa05b88d-e057-487c-afba-8439d5148a90) [No such file or directory] >[2016-04-19 07:24:53.402858] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:fa05b88d-e057-487c-afba-8439d5148a90>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.412688] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.413796] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc> (921a1b7e-d895-43b3-83f3-9c25dc31fbdc) [No such file or directory] >[2016-04-19 07:24:53.413815] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc> (921a1b7e-d895-43b3-83f3-9c25dc31fbdc) [No such file or directory] >[2016-04-19 07:24:53.416601] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 921a1b7e-d895-43b3-83f3-9c25dc31fbdc. (Possible split-brain) >[2016-04-19 07:24:53.417697] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc> (921a1b7e-d895-43b3-83f3-9c25dc31fbdc) [No such file or directory] >[2016-04-19 07:24:53.417773] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc> (921a1b7e-d895-43b3-83f3-9c25dc31fbdc) [No such file or directory] >[2016-04-19 07:24:53.419114] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc> (921a1b7e-d895-43b3-83f3-9c25dc31fbdc) [No such file or directory] >[2016-04-19 07:24:53.419179] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc> (921a1b7e-d895-43b3-83f3-9c25dc31fbdc) [No such file or directory] >[2016-04-19 07:24:53.419298] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.422050] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 921a1b7e-d895-43b3-83f3-9c25dc31fbdc. (Possible split-brain) >[2016-04-19 07:24:53.422986] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc> (921a1b7e-d895-43b3-83f3-9c25dc31fbdc) [No such file or directory] >[2016-04-19 07:24:53.423238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc> (921a1b7e-d895-43b3-83f3-9c25dc31fbdc) [No such file or directory] >[2016-04-19 07:24:53.426419] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc> (921a1b7e-d895-43b3-83f3-9c25dc31fbdc) [No such file or directory] >[2016-04-19 07:24:53.426546] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc> (921a1b7e-d895-43b3-83f3-9c25dc31fbdc) [No such file or directory] >[2016-04-19 07:24:53.426669] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:921a1b7e-d895-43b3-83f3-9c25dc31fbdc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.436565] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.437383] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c> (1d4c531c-5626-479f-b844-d095a0b1a45c) [No such file or directory] >[2016-04-19 07:24:53.437929] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c> (1d4c531c-5626-479f-b844-d095a0b1a45c) [No such file or directory] >[2016-04-19 07:24:53.440632] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1d4c531c-5626-479f-b844-d095a0b1a45c. (Possible split-brain) >[2016-04-19 07:24:53.441306] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c> (1d4c531c-5626-479f-b844-d095a0b1a45c) [No such file or directory] >[2016-04-19 07:24:53.441602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c> (1d4c531c-5626-479f-b844-d095a0b1a45c) [No such file or directory] >[2016-04-19 07:24:53.442731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c> (1d4c531c-5626-479f-b844-d095a0b1a45c) [No such file or directory] >[2016-04-19 07:24:53.442809] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c> (1d4c531c-5626-479f-b844-d095a0b1a45c) [No such file or directory] >[2016-04-19 07:24:53.442935] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.445667] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 1d4c531c-5626-479f-b844-d095a0b1a45c. (Possible split-brain) >[2016-04-19 07:24:53.446344] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c> (1d4c531c-5626-479f-b844-d095a0b1a45c) [No such file or directory] >[2016-04-19 07:24:53.446629] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c> (1d4c531c-5626-479f-b844-d095a0b1a45c) [No such file or directory] >[2016-04-19 07:24:53.448985] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c> (1d4c531c-5626-479f-b844-d095a0b1a45c) [No such file or directory] >[2016-04-19 07:24:53.449080] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c> (1d4c531c-5626-479f-b844-d095a0b1a45c) [No such file or directory] >[2016-04-19 07:24:53.449225] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1d4c531c-5626-479f-b844-d095a0b1a45c>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.458983] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.459906] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963> (cb310f2e-0d5c-4563-8220-0062efab1963) [No such file or directory] >[2016-04-19 07:24:53.460172] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963> (cb310f2e-0d5c-4563-8220-0062efab1963) [No such file or directory] >[2016-04-19 07:24:53.461361] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cb310f2e-0d5c-4563-8220-0062efab1963. (Possible split-brain) >[2016-04-19 07:24:53.462380] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963> (cb310f2e-0d5c-4563-8220-0062efab1963) [No such file or directory] >[2016-04-19 07:24:53.462453] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963> (cb310f2e-0d5c-4563-8220-0062efab1963) [No such file or directory] >[2016-04-19 07:24:53.463822] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963> (cb310f2e-0d5c-4563-8220-0062efab1963) [No such file or directory] >[2016-04-19 07:24:53.463842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963> (cb310f2e-0d5c-4563-8220-0062efab1963) [No such file or directory] >[2016-04-19 07:24:53.463997] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.466714] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid cb310f2e-0d5c-4563-8220-0062efab1963. (Possible split-brain) >[2016-04-19 07:24:53.467517] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963> (cb310f2e-0d5c-4563-8220-0062efab1963) [No such file or directory] >[2016-04-19 07:24:53.467891] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963> (cb310f2e-0d5c-4563-8220-0062efab1963) [No such file or directory] >[2016-04-19 07:24:53.470349] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963> (cb310f2e-0d5c-4563-8220-0062efab1963) [No such file or directory] >[2016-04-19 07:24:53.470777] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963> (cb310f2e-0d5c-4563-8220-0062efab1963) [No such file or directory] >[2016-04-19 07:24:53.470951] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:cb310f2e-0d5c-4563-8220-0062efab1963>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.479963] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.480809] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549> (2689e690-4777-46cd-9dd2-70ab3b084549) [No such file or directory] >[2016-04-19 07:24:53.481127] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549> (2689e690-4777-46cd-9dd2-70ab3b084549) [No such file or directory] >[2016-04-19 07:24:53.482189] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2689e690-4777-46cd-9dd2-70ab3b084549. (Possible split-brain) >[2016-04-19 07:24:53.483081] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549> (2689e690-4777-46cd-9dd2-70ab3b084549) [No such file or directory] >[2016-04-19 07:24:53.483424] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549> (2689e690-4777-46cd-9dd2-70ab3b084549) [No such file or directory] >[2016-04-19 07:24:53.484944] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549> (2689e690-4777-46cd-9dd2-70ab3b084549) [No such file or directory] >[2016-04-19 07:24:53.484955] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549> (2689e690-4777-46cd-9dd2-70ab3b084549) [No such file or directory] >[2016-04-19 07:24:53.485093] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.487779] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 2689e690-4777-46cd-9dd2-70ab3b084549. (Possible split-brain) >[2016-04-19 07:24:53.488602] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549> (2689e690-4777-46cd-9dd2-70ab3b084549) [No such file or directory] >[2016-04-19 07:24:53.489012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549> (2689e690-4777-46cd-9dd2-70ab3b084549) [No such file or directory] >[2016-04-19 07:24:53.491468] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549> (2689e690-4777-46cd-9dd2-70ab3b084549) [No such file or directory] >[2016-04-19 07:24:53.491849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549> (2689e690-4777-46cd-9dd2-70ab3b084549) [No such file or directory] >[2016-04-19 07:24:53.492037] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:2689e690-4777-46cd-9dd2-70ab3b084549>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.501344] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.502211] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68> (dfa113af-5684-41bd-9180-99e01cea1f68) [No such file or directory] >[2016-04-19 07:24:53.502491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68> (dfa113af-5684-41bd-9180-99e01cea1f68) [No such file or directory] >[2016-04-19 07:24:53.505246] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dfa113af-5684-41bd-9180-99e01cea1f68. (Possible split-brain) >[2016-04-19 07:24:53.506167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68> (dfa113af-5684-41bd-9180-99e01cea1f68) [No such file or directory] >[2016-04-19 07:24:53.506454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68> (dfa113af-5684-41bd-9180-99e01cea1f68) [No such file or directory] >[2016-04-19 07:24:53.507709] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68> (dfa113af-5684-41bd-9180-99e01cea1f68) [No such file or directory] >[2016-04-19 07:24:53.507787] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68> (dfa113af-5684-41bd-9180-99e01cea1f68) [No such file or directory] >[2016-04-19 07:24:53.507952] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.510844] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid dfa113af-5684-41bd-9180-99e01cea1f68. (Possible split-brain) >[2016-04-19 07:24:53.511730] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68> (dfa113af-5684-41bd-9180-99e01cea1f68) [No such file or directory] >[2016-04-19 07:24:53.512044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68> (dfa113af-5684-41bd-9180-99e01cea1f68) [No such file or directory] >[2016-04-19 07:24:53.514684] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68> (dfa113af-5684-41bd-9180-99e01cea1f68) [No such file or directory] >[2016-04-19 07:24:53.514800] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68> (dfa113af-5684-41bd-9180-99e01cea1f68) [No such file or directory] >[2016-04-19 07:24:53.514983] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:dfa113af-5684-41bd-9180-99e01cea1f68>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.525162] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.525994] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:532de646-3fed-49dc-9545-78e89a4d769b> (532de646-3fed-49dc-9545-78e89a4d769b) [No such file or directory] >[2016-04-19 07:24:53.526392] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:532de646-3fed-49dc-9545-78e89a4d769b> (532de646-3fed-49dc-9545-78e89a4d769b) [No such file or directory] >[2016-04-19 07:24:53.529360] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 532de646-3fed-49dc-9545-78e89a4d769b. (Possible split-brain) >[2016-04-19 07:24:53.530433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:532de646-3fed-49dc-9545-78e89a4d769b> (532de646-3fed-49dc-9545-78e89a4d769b) [No such file or directory] >[2016-04-19 07:24:53.530435] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:532de646-3fed-49dc-9545-78e89a4d769b> (532de646-3fed-49dc-9545-78e89a4d769b) [No such file or directory] >[2016-04-19 07:24:53.531685] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:532de646-3fed-49dc-9545-78e89a4d769b> (532de646-3fed-49dc-9545-78e89a4d769b) [No such file or directory] >[2016-04-19 07:24:53.531693] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:532de646-3fed-49dc-9545-78e89a4d769b> (532de646-3fed-49dc-9545-78e89a4d769b) [No such file or directory] >[2016-04-19 07:24:53.531901] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:532de646-3fed-49dc-9545-78e89a4d769b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.534597] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 532de646-3fed-49dc-9545-78e89a4d769b. (Possible split-brain) >[2016-04-19 07:24:53.535671] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:532de646-3fed-49dc-9545-78e89a4d769b> (532de646-3fed-49dc-9545-78e89a4d769b) [No such file or directory] >[2016-04-19 07:24:53.535737] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:532de646-3fed-49dc-9545-78e89a4d769b> (532de646-3fed-49dc-9545-78e89a4d769b) [No such file or directory] >[2016-04-19 07:24:53.538560] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:532de646-3fed-49dc-9545-78e89a4d769b> (532de646-3fed-49dc-9545-78e89a4d769b) [No such file or directory] >[2016-04-19 07:24:53.538658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:532de646-3fed-49dc-9545-78e89a4d769b> (532de646-3fed-49dc-9545-78e89a4d769b) [No such file or directory] >[2016-04-19 07:24:53.538785] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:532de646-3fed-49dc-9545-78e89a4d769b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.549454] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.550496] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bba3d935-1957-4264-885c-bd37f860cce1> (bba3d935-1957-4264-885c-bd37f860cce1) [No such file or directory] >[2016-04-19 07:24:53.550846] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bba3d935-1957-4264-885c-bd37f860cce1> (bba3d935-1957-4264-885c-bd37f860cce1) [No such file or directory] >[2016-04-19 07:24:53.553645] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bba3d935-1957-4264-885c-bd37f860cce1. (Possible split-brain) >[2016-04-19 07:24:53.554903] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bba3d935-1957-4264-885c-bd37f860cce1> (bba3d935-1957-4264-885c-bd37f860cce1) [No such file or directory] >[2016-04-19 07:24:53.554992] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bba3d935-1957-4264-885c-bd37f860cce1> (bba3d935-1957-4264-885c-bd37f860cce1) [No such file or directory] >[2016-04-19 07:24:53.556234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bba3d935-1957-4264-885c-bd37f860cce1> (bba3d935-1957-4264-885c-bd37f860cce1) [No such file or directory] >[2016-04-19 07:24:53.556364] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bba3d935-1957-4264-885c-bd37f860cce1> (bba3d935-1957-4264-885c-bd37f860cce1) [No such file or directory] >[2016-04-19 07:24:53.556490] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:bba3d935-1957-4264-885c-bd37f860cce1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.559291] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid bba3d935-1957-4264-885c-bd37f860cce1. (Possible split-brain) >[2016-04-19 07:24:53.560393] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bba3d935-1957-4264-885c-bd37f860cce1> (bba3d935-1957-4264-885c-bd37f860cce1) [No such file or directory] >[2016-04-19 07:24:53.560459] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bba3d935-1957-4264-885c-bd37f860cce1> (bba3d935-1957-4264-885c-bd37f860cce1) [No such file or directory] >[2016-04-19 07:24:53.563308] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:bba3d935-1957-4264-885c-bd37f860cce1> (bba3d935-1957-4264-885c-bd37f860cce1) [No such file or directory] >[2016-04-19 07:24:53.563455] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:bba3d935-1957-4264-885c-bd37f860cce1> (bba3d935-1957-4264-885c-bd37f860cce1) [No such file or directory] >[2016-04-19 07:24:53.563611] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:bba3d935-1957-4264-885c-bd37f860cce1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.572778] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.573900] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a2817cde-bffe-4e67-950c-1978221c9233> (a2817cde-bffe-4e67-950c-1978221c9233) [No such file or directory] >[2016-04-19 07:24:53.573908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a2817cde-bffe-4e67-950c-1978221c9233> (a2817cde-bffe-4e67-950c-1978221c9233) [No such file or directory] >[2016-04-19 07:24:53.576741] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a2817cde-bffe-4e67-950c-1978221c9233. (Possible split-brain) >[2016-04-19 07:24:53.577818] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a2817cde-bffe-4e67-950c-1978221c9233> (a2817cde-bffe-4e67-950c-1978221c9233) [No such file or directory] >[2016-04-19 07:24:53.577896] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a2817cde-bffe-4e67-950c-1978221c9233> (a2817cde-bffe-4e67-950c-1978221c9233) [No such file or directory] >[2016-04-19 07:24:53.579013] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a2817cde-bffe-4e67-950c-1978221c9233> (a2817cde-bffe-4e67-950c-1978221c9233) [No such file or directory] >[2016-04-19 07:24:53.579043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a2817cde-bffe-4e67-950c-1978221c9233> (a2817cde-bffe-4e67-950c-1978221c9233) [No such file or directory] >[2016-04-19 07:24:53.579177] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a2817cde-bffe-4e67-950c-1978221c9233>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:53.581929] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a2817cde-bffe-4e67-950c-1978221c9233. (Possible split-brain) >[2016-04-19 07:24:53.582897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a2817cde-bffe-4e67-950c-1978221c9233> (a2817cde-bffe-4e67-950c-1978221c9233) [No such file or directory] >[2016-04-19 07:24:53.583149] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a2817cde-bffe-4e67-950c-1978221c9233> (a2817cde-bffe-4e67-950c-1978221c9233) [No such file or directory] >[2016-04-19 07:24:53.586033] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a2817cde-bffe-4e67-950c-1978221c9233> (a2817cde-bffe-4e67-950c-1978221c9233) [No such file or directory] >[2016-04-19 07:24:53.586131] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a2817cde-bffe-4e67-950c-1978221c9233> (a2817cde-bffe-4e67-950c-1978221c9233) [No such file or directory] >[2016-04-19 07:24:53.586240] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a2817cde-bffe-4e67-950c-1978221c9233>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.595240] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.596373] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc> (775e3792-07d7-432e-82ff-846fd5c5dcfc) [No such file or directory] >[2016-04-19 07:24:53.596374] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc> (775e3792-07d7-432e-82ff-846fd5c5dcfc) [No such file or directory] >[2016-04-19 07:24:53.599163] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 775e3792-07d7-432e-82ff-846fd5c5dcfc. (Possible split-brain) >[2016-04-19 07:24:53.600363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc> (775e3792-07d7-432e-82ff-846fd5c5dcfc) [No such file or directory] >[2016-04-19 07:24:53.600462] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc> (775e3792-07d7-432e-82ff-846fd5c5dcfc) [No such file or directory] >[2016-04-19 07:24:53.601777] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc> (775e3792-07d7-432e-82ff-846fd5c5dcfc) [No such file or directory] >[2016-04-19 07:24:53.601791] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc> (775e3792-07d7-432e-82ff-846fd5c5dcfc) [No such file or directory] >[2016-04-19 07:24:53.601974] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.604735] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 775e3792-07d7-432e-82ff-846fd5c5dcfc. (Possible split-brain) >[2016-04-19 07:24:53.605736] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc> (775e3792-07d7-432e-82ff-846fd5c5dcfc) [No such file or directory] >[2016-04-19 07:24:53.605812] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc> (775e3792-07d7-432e-82ff-846fd5c5dcfc) [No such file or directory] >[2016-04-19 07:24:53.608522] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc> (775e3792-07d7-432e-82ff-846fd5c5dcfc) [No such file or directory] >[2016-04-19 07:24:53.608589] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc> (775e3792-07d7-432e-82ff-846fd5c5dcfc) [No such file or directory] >[2016-04-19 07:24:53.608734] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:775e3792-07d7-432e-82ff-846fd5c5dcfc>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.616281] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.617146] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0> (7061e69c-10ac-4061-86b4-908853ed45e0) [No such file or directory] >[2016-04-19 07:24:53.617307] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0> (7061e69c-10ac-4061-86b4-908853ed45e0) [No such file or directory] >[2016-04-19 07:24:53.620136] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7061e69c-10ac-4061-86b4-908853ed45e0. (Possible split-brain) >[2016-04-19 07:24:53.621095] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0> (7061e69c-10ac-4061-86b4-908853ed45e0) [No such file or directory] >[2016-04-19 07:24:53.621109] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0> (7061e69c-10ac-4061-86b4-908853ed45e0) [No such file or directory] >[2016-04-19 07:24:53.622212] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0> (7061e69c-10ac-4061-86b4-908853ed45e0) [No such file or directory] >[2016-04-19 07:24:53.622388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0> (7061e69c-10ac-4061-86b4-908853ed45e0) [No such file or directory] >[2016-04-19 07:24:53.622503] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.625226] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7061e69c-10ac-4061-86b4-908853ed45e0. (Possible split-brain) >[2016-04-19 07:24:53.626055] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0> (7061e69c-10ac-4061-86b4-908853ed45e0) [No such file or directory] >[2016-04-19 07:24:53.626263] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0> (7061e69c-10ac-4061-86b4-908853ed45e0) [No such file or directory] >[2016-04-19 07:24:53.629229] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0> (7061e69c-10ac-4061-86b4-908853ed45e0) [No such file or directory] >[2016-04-19 07:24:53.629431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0> (7061e69c-10ac-4061-86b4-908853ed45e0) [No such file or directory] >[2016-04-19 07:24:53.629557] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7061e69c-10ac-4061-86b4-908853ed45e0>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.639698] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.640664] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7> (d1b57476-939c-4166-8239-d6ee00f198d7) [No such file or directory] >[2016-04-19 07:24:53.640689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7> (d1b57476-939c-4166-8239-d6ee00f198d7) [No such file or directory] >[2016-04-19 07:24:53.641809] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d1b57476-939c-4166-8239-d6ee00f198d7. (Possible split-brain) >[2016-04-19 07:24:53.642856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7> (d1b57476-939c-4166-8239-d6ee00f198d7) [No such file or directory] >[2016-04-19 07:24:53.642889] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7> (d1b57476-939c-4166-8239-d6ee00f198d7) [No such file or directory] >[2016-04-19 07:24:53.644167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7> (d1b57476-939c-4166-8239-d6ee00f198d7) [No such file or directory] >[2016-04-19 07:24:53.644261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7> (d1b57476-939c-4166-8239-d6ee00f198d7) [No such file or directory] >[2016-04-19 07:24:53.644442] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.647215] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d1b57476-939c-4166-8239-d6ee00f198d7. (Possible split-brain) >[2016-04-19 07:24:53.648361] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7> (d1b57476-939c-4166-8239-d6ee00f198d7) [No such file or directory] >[2016-04-19 07:24:53.648381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7> (d1b57476-939c-4166-8239-d6ee00f198d7) [No such file or directory] >[2016-04-19 07:24:53.650904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7> (d1b57476-939c-4166-8239-d6ee00f198d7) [No such file or directory] >[2016-04-19 07:24:53.651084] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7> (d1b57476-939c-4166-8239-d6ee00f198d7) [No such file or directory] >[2016-04-19 07:24:53.651251] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d1b57476-939c-4166-8239-d6ee00f198d7>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.658794] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.659564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6> (51aa35ed-d9dd-40ac-8801-951d5cf167a6) [No such file or directory] >[2016-04-19 07:24:53.659826] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6> (51aa35ed-d9dd-40ac-8801-951d5cf167a6) [No such file or directory] >[2016-04-19 07:24:53.662598] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 51aa35ed-d9dd-40ac-8801-951d5cf167a6. (Possible split-brain) >[2016-04-19 07:24:53.663277] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6> (51aa35ed-d9dd-40ac-8801-951d5cf167a6) [No such file or directory] >[2016-04-19 07:24:53.663765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6> (51aa35ed-d9dd-40ac-8801-951d5cf167a6) [No such file or directory] >[2016-04-19 07:24:53.665102] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6> (51aa35ed-d9dd-40ac-8801-951d5cf167a6) [No such file or directory] >[2016-04-19 07:24:53.665120] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6> (51aa35ed-d9dd-40ac-8801-951d5cf167a6) [No such file or directory] >[2016-04-19 07:24:53.665257] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.667987] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 51aa35ed-d9dd-40ac-8801-951d5cf167a6. (Possible split-brain) >[2016-04-19 07:24:53.668979] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6> (51aa35ed-d9dd-40ac-8801-951d5cf167a6) [No such file or directory] >[2016-04-19 07:24:53.669193] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6> (51aa35ed-d9dd-40ac-8801-951d5cf167a6) [No such file or directory] >[2016-04-19 07:24:53.671768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6> (51aa35ed-d9dd-40ac-8801-951d5cf167a6) [No such file or directory] >[2016-04-19 07:24:53.672016] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6> (51aa35ed-d9dd-40ac-8801-951d5cf167a6) [No such file or directory] >[2016-04-19 07:24:53.672155] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:51aa35ed-d9dd-40ac-8801-951d5cf167a6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.680168] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.681155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67> (87f738bf-8789-4b51-aadc-fc19f15e3e67) [No such file or directory] >[2016-04-19 07:24:53.681178] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67> (87f738bf-8789-4b51-aadc-fc19f15e3e67) [No such file or directory] >[2016-04-19 07:24:53.684027] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 87f738bf-8789-4b51-aadc-fc19f15e3e67. (Possible split-brain) >[2016-04-19 07:24:53.684996] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67> (87f738bf-8789-4b51-aadc-fc19f15e3e67) [No such file or directory] >[2016-04-19 07:24:53.685235] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67> (87f738bf-8789-4b51-aadc-fc19f15e3e67) [No such file or directory] >[2016-04-19 07:24:53.686725] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67> (87f738bf-8789-4b51-aadc-fc19f15e3e67) [No such file or directory] >[2016-04-19 07:24:53.686908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67> (87f738bf-8789-4b51-aadc-fc19f15e3e67) [No such file or directory] >[2016-04-19 07:24:53.687116] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.689899] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 87f738bf-8789-4b51-aadc-fc19f15e3e67. (Possible split-brain) >[2016-04-19 07:24:53.690984] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67> (87f738bf-8789-4b51-aadc-fc19f15e3e67) [No such file or directory] >[2016-04-19 07:24:53.691014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67> (87f738bf-8789-4b51-aadc-fc19f15e3e67) [No such file or directory] >[2016-04-19 07:24:53.693924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67> (87f738bf-8789-4b51-aadc-fc19f15e3e67) [No such file or directory] >[2016-04-19 07:24:53.693925] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67> (87f738bf-8789-4b51-aadc-fc19f15e3e67) [No such file or directory] >[2016-04-19 07:24:53.694163] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:87f738bf-8789-4b51-aadc-fc19f15e3e67>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.703539] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.704352] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4> (7a3c4563-19d7-4e00-8ff4-80c35977b0a4) [No such file or directory] >[2016-04-19 07:24:53.704579] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4> (7a3c4563-19d7-4e00-8ff4-80c35977b0a4) [No such file or directory] >[2016-04-19 07:24:53.705665] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7a3c4563-19d7-4e00-8ff4-80c35977b0a4. (Possible split-brain) >[2016-04-19 07:24:53.706731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4> (7a3c4563-19d7-4e00-8ff4-80c35977b0a4) [No such file or directory] >[2016-04-19 07:24:53.706758] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4> (7a3c4563-19d7-4e00-8ff4-80c35977b0a4) [No such file or directory] >[2016-04-19 07:24:53.708138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4> (7a3c4563-19d7-4e00-8ff4-80c35977b0a4) [No such file or directory] >[2016-04-19 07:24:53.708236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4> (7a3c4563-19d7-4e00-8ff4-80c35977b0a4) [No such file or directory] >[2016-04-19 07:24:53.708375] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.711156] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7a3c4563-19d7-4e00-8ff4-80c35977b0a4. (Possible split-brain) >[2016-04-19 07:24:53.712028] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4> (7a3c4563-19d7-4e00-8ff4-80c35977b0a4) [No such file or directory] >[2016-04-19 07:24:53.712368] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4> (7a3c4563-19d7-4e00-8ff4-80c35977b0a4) [No such file or directory] >[2016-04-19 07:24:53.715065] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4> (7a3c4563-19d7-4e00-8ff4-80c35977b0a4) [No such file or directory] >[2016-04-19 07:24:53.715389] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4> (7a3c4563-19d7-4e00-8ff4-80c35977b0a4) [No such file or directory] >[2016-04-19 07:24:53.715534] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7a3c4563-19d7-4e00-8ff4-80c35977b0a4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.726265] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.727312] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de> (64d07034-0641-4e09-bd7d-940e0a1342de) [No such file or directory] >[2016-04-19 07:24:53.727458] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de> (64d07034-0641-4e09-bd7d-940e0a1342de) [No such file or directory] >[2016-04-19 07:24:53.728525] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 64d07034-0641-4e09-bd7d-940e0a1342de. (Possible split-brain) >[2016-04-19 07:24:53.729388] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de> (64d07034-0641-4e09-bd7d-940e0a1342de) [No such file or directory] >[2016-04-19 07:24:53.729468] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de> (64d07034-0641-4e09-bd7d-940e0a1342de) [No such file or directory] >[2016-04-19 07:24:53.730592] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de> (64d07034-0641-4e09-bd7d-940e0a1342de) [No such file or directory] >[2016-04-19 07:24:53.730630] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de> (64d07034-0641-4e09-bd7d-940e0a1342de) [No such file or directory] >[2016-04-19 07:24:53.730885] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:53.733651] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 64d07034-0641-4e09-bd7d-940e0a1342de. (Possible split-brain) >[2016-04-19 07:24:53.734708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de> (64d07034-0641-4e09-bd7d-940e0a1342de) [No such file or directory] >[2016-04-19 07:24:53.734824] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de> (64d07034-0641-4e09-bd7d-940e0a1342de) [No such file or directory] >[2016-04-19 07:24:53.737735] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de> (64d07034-0641-4e09-bd7d-940e0a1342de) [No such file or directory] >[2016-04-19 07:24:53.737862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de> (64d07034-0641-4e09-bd7d-940e0a1342de) [No such file or directory] >[2016-04-19 07:24:53.738016] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:64d07034-0641-4e09-bd7d-940e0a1342de>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.746171] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.747064] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2> (7c28adf0-957b-4f39-b6e8-da7b9ddf33b2) [No such file or directory] >[2016-04-19 07:24:53.747184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2> (7c28adf0-957b-4f39-b6e8-da7b9ddf33b2) [No such file or directory] >[2016-04-19 07:24:53.750008] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7c28adf0-957b-4f39-b6e8-da7b9ddf33b2. (Possible split-brain) >[2016-04-19 07:24:53.750845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2> (7c28adf0-957b-4f39-b6e8-da7b9ddf33b2) [No such file or directory] >[2016-04-19 07:24:53.751059] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2> (7c28adf0-957b-4f39-b6e8-da7b9ddf33b2) [No such file or directory] >[2016-04-19 07:24:53.752565] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2> (7c28adf0-957b-4f39-b6e8-da7b9ddf33b2) [No such file or directory] >[2016-04-19 07:24:53.752574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2> (7c28adf0-957b-4f39-b6e8-da7b9ddf33b2) [No such file or directory] >[2016-04-19 07:24:53.752764] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.755432] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7c28adf0-957b-4f39-b6e8-da7b9ddf33b2. (Possible split-brain) >[2016-04-19 07:24:53.756138] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2> (7c28adf0-957b-4f39-b6e8-da7b9ddf33b2) [No such file or directory] >[2016-04-19 07:24:53.756394] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2> (7c28adf0-957b-4f39-b6e8-da7b9ddf33b2) [No such file or directory] >[2016-04-19 07:24:53.759066] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2> (7c28adf0-957b-4f39-b6e8-da7b9ddf33b2) [No such file or directory] >[2016-04-19 07:24:53.759421] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2> (7c28adf0-957b-4f39-b6e8-da7b9ddf33b2) [No such file or directory] >[2016-04-19 07:24:53.759657] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7c28adf0-957b-4f39-b6e8-da7b9ddf33b2>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.770636] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.771649] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:20c636fc-aa05-4961-803c-103d213a3289> (20c636fc-aa05-4961-803c-103d213a3289) [No such file or directory] >[2016-04-19 07:24:53.772051] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:20c636fc-aa05-4961-803c-103d213a3289> (20c636fc-aa05-4961-803c-103d213a3289) [No such file or directory] >[2016-04-19 07:24:53.774848] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 20c636fc-aa05-4961-803c-103d213a3289. (Possible split-brain) >[2016-04-19 07:24:53.775922] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:20c636fc-aa05-4961-803c-103d213a3289> (20c636fc-aa05-4961-803c-103d213a3289) [No such file or directory] >[2016-04-19 07:24:53.775945] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:20c636fc-aa05-4961-803c-103d213a3289> (20c636fc-aa05-4961-803c-103d213a3289) [No such file or directory] >[2016-04-19 07:24:53.777103] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:20c636fc-aa05-4961-803c-103d213a3289> (20c636fc-aa05-4961-803c-103d213a3289) [No such file or directory] >[2016-04-19 07:24:53.777293] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:20c636fc-aa05-4961-803c-103d213a3289> (20c636fc-aa05-4961-803c-103d213a3289) [No such file or directory] >[2016-04-19 07:24:53.777596] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:20c636fc-aa05-4961-803c-103d213a3289>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:53.780425] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 20c636fc-aa05-4961-803c-103d213a3289. (Possible split-brain) >[2016-04-19 07:24:53.781631] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:20c636fc-aa05-4961-803c-103d213a3289> (20c636fc-aa05-4961-803c-103d213a3289) [No such file or directory] >[2016-04-19 07:24:53.781702] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:20c636fc-aa05-4961-803c-103d213a3289> (20c636fc-aa05-4961-803c-103d213a3289) [No such file or directory] >[2016-04-19 07:24:53.784699] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:20c636fc-aa05-4961-803c-103d213a3289> (20c636fc-aa05-4961-803c-103d213a3289) [No such file or directory] >[2016-04-19 07:24:53.784815] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:20c636fc-aa05-4961-803c-103d213a3289> (20c636fc-aa05-4961-803c-103d213a3289) [No such file or directory] >[2016-04-19 07:24:53.784948] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:20c636fc-aa05-4961-803c-103d213a3289>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.796005] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.796828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3> (ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3) [No such file or directory] >[2016-04-19 07:24:53.796872] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3> (ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3) [No such file or directory] >[2016-04-19 07:24:53.798779] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3. (Possible split-brain) >[2016-04-19 07:24:53.799888] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3> (ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3) [No such file or directory] >[2016-04-19 07:24:53.799967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3> (ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3) [No such file or directory] >[2016-04-19 07:24:53.801239] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3> (ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3) [No such file or directory] >[2016-04-19 07:24:53.801297] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3> (ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3) [No such file or directory] >[2016-04-19 07:24:53.801426] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.804249] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3. (Possible split-brain) >[2016-04-19 07:24:53.805406] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3> (ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3) [No such file or directory] >[2016-04-19 07:24:53.805416] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3> (ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3) [No such file or directory] >[2016-04-19 07:24:53.808362] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3> (ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3) [No such file or directory] >[2016-04-19 07:24:53.808547] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3> (ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3) [No such file or directory] >[2016-04-19 07:24:53.808835] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ffe4e1e4-9732-49b1-b1ad-fdf7c477bbe3>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.818365] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.819441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b> (4b71fd41-1b32-4a28-903d-b8c1c8f8b94b) [No such file or directory] >[2016-04-19 07:24:53.819440] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b> (4b71fd41-1b32-4a28-903d-b8c1c8f8b94b) [No such file or directory] >[2016-04-19 07:24:53.822307] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4b71fd41-1b32-4a28-903d-b8c1c8f8b94b. (Possible split-brain) >[2016-04-19 07:24:53.823297] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b> (4b71fd41-1b32-4a28-903d-b8c1c8f8b94b) [No such file or directory] >[2016-04-19 07:24:53.823425] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b> (4b71fd41-1b32-4a28-903d-b8c1c8f8b94b) [No such file or directory] >[2016-04-19 07:24:53.824475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b> (4b71fd41-1b32-4a28-903d-b8c1c8f8b94b) [No such file or directory] >[2016-04-19 07:24:53.824668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b> (4b71fd41-1b32-4a28-903d-b8c1c8f8b94b) [No such file or directory] >[2016-04-19 07:24:53.824882] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:53.827631] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 4b71fd41-1b32-4a28-903d-b8c1c8f8b94b. (Possible split-brain) >[2016-04-19 07:24:53.828803] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b> (4b71fd41-1b32-4a28-903d-b8c1c8f8b94b) [No such file or directory] >[2016-04-19 07:24:53.828880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b> (4b71fd41-1b32-4a28-903d-b8c1c8f8b94b) [No such file or directory] >[2016-04-19 07:24:53.831530] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b> (4b71fd41-1b32-4a28-903d-b8c1c8f8b94b) [No such file or directory] >[2016-04-19 07:24:53.831553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b> (4b71fd41-1b32-4a28-903d-b8c1c8f8b94b) [No such file or directory] >[2016-04-19 07:24:53.832016] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4b71fd41-1b32-4a28-903d-b8c1c8f8b94b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.841681] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.842859] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43> (72a99e78-6990-40a2-b6e5-cfe3b0998c43) [No such file or directory] >[2016-04-19 07:24:53.842880] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43> (72a99e78-6990-40a2-b6e5-cfe3b0998c43) [No such file or directory] >[2016-04-19 07:24:53.845678] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 72a99e78-6990-40a2-b6e5-cfe3b0998c43. (Possible split-brain) >[2016-04-19 07:24:53.846861] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43> (72a99e78-6990-40a2-b6e5-cfe3b0998c43) [No such file or directory] >[2016-04-19 07:24:53.846862] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43> (72a99e78-6990-40a2-b6e5-cfe3b0998c43) [No such file or directory] >[2016-04-19 07:24:53.848256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43> (72a99e78-6990-40a2-b6e5-cfe3b0998c43) [No such file or directory] >[2016-04-19 07:24:53.848261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43> (72a99e78-6990-40a2-b6e5-cfe3b0998c43) [No such file or directory] >[2016-04-19 07:24:53.848440] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.851161] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 72a99e78-6990-40a2-b6e5-cfe3b0998c43. (Possible split-brain) >[2016-04-19 07:24:53.852181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43> (72a99e78-6990-40a2-b6e5-cfe3b0998c43) [No such file or directory] >[2016-04-19 07:24:53.852237] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43> (72a99e78-6990-40a2-b6e5-cfe3b0998c43) [No such file or directory] >[2016-04-19 07:24:53.855014] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43> (72a99e78-6990-40a2-b6e5-cfe3b0998c43) [No such file or directory] >[2016-04-19 07:24:53.855017] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43> (72a99e78-6990-40a2-b6e5-cfe3b0998c43) [No such file or directory] >[2016-04-19 07:24:53.855575] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:72a99e78-6990-40a2-b6e5-cfe3b0998c43>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.864405] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.865472] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b> (7e7e3995-cdb8-4e27-b96d-1e2702bd336b) [No such file or directory] >[2016-04-19 07:24:53.865571] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b> (7e7e3995-cdb8-4e27-b96d-1e2702bd336b) [No such file or directory] >[2016-04-19 07:24:53.866655] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7e7e3995-cdb8-4e27-b96d-1e2702bd336b. (Possible split-brain) >[2016-04-19 07:24:53.867684] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b> (7e7e3995-cdb8-4e27-b96d-1e2702bd336b) [No such file or directory] >[2016-04-19 07:24:53.867768] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b> (7e7e3995-cdb8-4e27-b96d-1e2702bd336b) [No such file or directory] >[2016-04-19 07:24:53.868897] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b> (7e7e3995-cdb8-4e27-b96d-1e2702bd336b) [No such file or directory] >[2016-04-19 07:24:53.869164] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b> (7e7e3995-cdb8-4e27-b96d-1e2702bd336b) [No such file or directory] >[2016-04-19 07:24:53.869419] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:53.872160] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 7e7e3995-cdb8-4e27-b96d-1e2702bd336b. (Possible split-brain) >[2016-04-19 07:24:53.873270] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b> (7e7e3995-cdb8-4e27-b96d-1e2702bd336b) [No such file or directory] >[2016-04-19 07:24:53.873422] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b> (7e7e3995-cdb8-4e27-b96d-1e2702bd336b) [No such file or directory] >[2016-04-19 07:24:53.875834] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b> (7e7e3995-cdb8-4e27-b96d-1e2702bd336b) [No such file or directory] >[2016-04-19 07:24:53.876004] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b> (7e7e3995-cdb8-4e27-b96d-1e2702bd336b) [No such file or directory] >[2016-04-19 07:24:53.876128] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7e7e3995-cdb8-4e27-b96d-1e2702bd336b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.885100] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.886255] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1> (1f8824f1-2e56-444e-bac1-0a97a4fb1ae1) [No such file or directory] >[2016-04-19 07:24:53.886395] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1> (1f8824f1-2e56-444e-bac1-0a97a4fb1ae1) [No such file or directory] >[2016-04-19 07:24:53.889156] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1f8824f1-2e56-444e-bac1-0a97a4fb1ae1. (Possible split-brain) >[2016-04-19 07:24:53.890248] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1> (1f8824f1-2e56-444e-bac1-0a97a4fb1ae1) [No such file or directory] >[2016-04-19 07:24:53.890271] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1> (1f8824f1-2e56-444e-bac1-0a97a4fb1ae1) [No such file or directory] >[2016-04-19 07:24:53.891410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1> (1f8824f1-2e56-444e-bac1-0a97a4fb1ae1) [No such file or directory] >[2016-04-19 07:24:53.891432] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1> (1f8824f1-2e56-444e-bac1-0a97a4fb1ae1) [No such file or directory] >[2016-04-19 07:24:53.891610] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:53.894368] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 1f8824f1-2e56-444e-bac1-0a97a4fb1ae1. (Possible split-brain) >[2016-04-19 07:24:53.895298] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1> (1f8824f1-2e56-444e-bac1-0a97a4fb1ae1) [No such file or directory] >[2016-04-19 07:24:53.895384] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1> (1f8824f1-2e56-444e-bac1-0a97a4fb1ae1) [No such file or directory] >[2016-04-19 07:24:53.898234] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1> (1f8824f1-2e56-444e-bac1-0a97a4fb1ae1) [No such file or directory] >[2016-04-19 07:24:53.898343] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1> (1f8824f1-2e56-444e-bac1-0a97a4fb1ae1) [No such file or directory] >[2016-04-19 07:24:53.898520] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:1f8824f1-2e56-444e-bac1-0a97a4fb1ae1>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.907840] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.909001] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb> (3bf770a8-7a6f-4225-b277-00fb4d7e08bb) [No such file or directory] >[2016-04-19 07:24:53.909096] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb> (3bf770a8-7a6f-4225-b277-00fb4d7e08bb) [No such file or directory] >[2016-04-19 07:24:53.910285] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3bf770a8-7a6f-4225-b277-00fb4d7e08bb. (Possible split-brain) >[2016-04-19 07:24:53.911409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb> (3bf770a8-7a6f-4225-b277-00fb4d7e08bb) [No such file or directory] >[2016-04-19 07:24:53.911616] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb> (3bf770a8-7a6f-4225-b277-00fb4d7e08bb) [No such file or directory] >[2016-04-19 07:24:53.912967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb> (3bf770a8-7a6f-4225-b277-00fb4d7e08bb) [No such file or directory] >[2016-04-19 07:24:53.913036] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb> (3bf770a8-7a6f-4225-b277-00fb4d7e08bb) [No such file or directory] >[2016-04-19 07:24:53.913168] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.915869] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 3bf770a8-7a6f-4225-b277-00fb4d7e08bb. (Possible split-brain) >[2016-04-19 07:24:53.917015] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb> (3bf770a8-7a6f-4225-b277-00fb4d7e08bb) [No such file or directory] >[2016-04-19 07:24:53.917039] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb> (3bf770a8-7a6f-4225-b277-00fb4d7e08bb) [No such file or directory] >[2016-04-19 07:24:53.919510] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb> (3bf770a8-7a6f-4225-b277-00fb4d7e08bb) [No such file or directory] >[2016-04-19 07:24:53.919866] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb> (3bf770a8-7a6f-4225-b277-00fb4d7e08bb) [No such file or directory] >[2016-04-19 07:24:53.919989] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:3bf770a8-7a6f-4225-b277-00fb4d7e08bb>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.929086] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.930236] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b> (9fccfc75-bd0a-4f2e-89c9-b8d314ad216b) [No such file or directory] >[2016-04-19 07:24:53.930248] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b> (9fccfc75-bd0a-4f2e-89c9-b8d314ad216b) [No such file or directory] >[2016-04-19 07:24:53.933088] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9fccfc75-bd0a-4f2e-89c9-b8d314ad216b. (Possible split-brain) >[2016-04-19 07:24:53.934165] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b> (9fccfc75-bd0a-4f2e-89c9-b8d314ad216b) [No such file or directory] >[2016-04-19 07:24:53.934260] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b> (9fccfc75-bd0a-4f2e-89c9-b8d314ad216b) [No such file or directory] >[2016-04-19 07:24:53.935556] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b> (9fccfc75-bd0a-4f2e-89c9-b8d314ad216b) [No such file or directory] >[2016-04-19 07:24:53.935607] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b> (9fccfc75-bd0a-4f2e-89c9-b8d314ad216b) [No such file or directory] >[2016-04-19 07:24:53.935735] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.938499] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9fccfc75-bd0a-4f2e-89c9-b8d314ad216b. (Possible split-brain) >[2016-04-19 07:24:53.939716] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b> (9fccfc75-bd0a-4f2e-89c9-b8d314ad216b) [No such file or directory] >[2016-04-19 07:24:53.939750] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b> (9fccfc75-bd0a-4f2e-89c9-b8d314ad216b) [No such file or directory] >[2016-04-19 07:24:53.942119] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b> (9fccfc75-bd0a-4f2e-89c9-b8d314ad216b) [No such file or directory] >[2016-04-19 07:24:53.942281] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b> (9fccfc75-bd0a-4f2e-89c9-b8d314ad216b) [No such file or directory] >[2016-04-19 07:24:53.942469] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9fccfc75-bd0a-4f2e-89c9-b8d314ad216b>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:53.951083] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.952025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c> (621d804f-9e5b-417c-a24f-d0597a86fe4c) [No such file or directory] >[2016-04-19 07:24:53.952400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c> (621d804f-9e5b-417c-a24f-d0597a86fe4c) [No such file or directory] >[2016-04-19 07:24:53.955240] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 621d804f-9e5b-417c-a24f-d0597a86fe4c. (Possible split-brain) >[2016-04-19 07:24:53.956036] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c> (621d804f-9e5b-417c-a24f-d0597a86fe4c) [No such file or directory] >[2016-04-19 07:24:53.956365] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c> (621d804f-9e5b-417c-a24f-d0597a86fe4c) [No such file or directory] >[2016-04-19 07:24:53.957668] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c> (621d804f-9e5b-417c-a24f-d0597a86fe4c) [No such file or directory] >[2016-04-19 07:24:53.957767] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c> (621d804f-9e5b-417c-a24f-d0597a86fe4c) [No such file or directory] >[2016-04-19 07:24:53.957894] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:53.960700] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 621d804f-9e5b-417c-a24f-d0597a86fe4c. (Possible split-brain) >[2016-04-19 07:24:53.961686] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c> (621d804f-9e5b-417c-a24f-d0597a86fe4c) [No such file or directory] >[2016-04-19 07:24:53.961765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c> (621d804f-9e5b-417c-a24f-d0597a86fe4c) [No such file or directory] >[2016-04-19 07:24:53.964275] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c> (621d804f-9e5b-417c-a24f-d0597a86fe4c) [No such file or directory] >[2016-04-19 07:24:53.964596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c> (621d804f-9e5b-417c-a24f-d0597a86fe4c) [No such file or directory] >[2016-04-19 07:24:53.964784] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:621d804f-9e5b-417c-a24f-d0597a86fe4c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.974579] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.975554] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631> (9d992acf-2004-4ba2-8951-f328e9ffb631) [No such file or directory] >[2016-04-19 07:24:53.975789] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631> (9d992acf-2004-4ba2-8951-f328e9ffb631) [No such file or directory] >[2016-04-19 07:24:53.976874] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9d992acf-2004-4ba2-8951-f328e9ffb631. (Possible split-brain) >[2016-04-19 07:24:53.977810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631> (9d992acf-2004-4ba2-8951-f328e9ffb631) [No such file or directory] >[2016-04-19 07:24:53.978058] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631> (9d992acf-2004-4ba2-8951-f328e9ffb631) [No such file or directory] >[2016-04-19 07:24:53.979112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631> (9d992acf-2004-4ba2-8951-f328e9ffb631) [No such file or directory] >[2016-04-19 07:24:53.979189] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631> (9d992acf-2004-4ba2-8951-f328e9ffb631) [No such file or directory] >[2016-04-19 07:24:53.979556] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:53.982263] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 9d992acf-2004-4ba2-8951-f328e9ffb631. (Possible split-brain) >[2016-04-19 07:24:53.983353] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631> (9d992acf-2004-4ba2-8951-f328e9ffb631) [No such file or directory] >[2016-04-19 07:24:53.983381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631> (9d992acf-2004-4ba2-8951-f328e9ffb631) [No such file or directory] >[2016-04-19 07:24:53.986063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631> (9d992acf-2004-4ba2-8951-f328e9ffb631) [No such file or directory] >[2016-04-19 07:24:53.986117] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631> (9d992acf-2004-4ba2-8951-f328e9ffb631) [No such file or directory] >[2016-04-19 07:24:53.986364] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9d992acf-2004-4ba2-8951-f328e9ffb631>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:53.995693] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:53.996756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4> (8a1c0eb3-8b7e-438e-b621-2d14801069c4) [No such file or directory] >[2016-04-19 07:24:53.996856] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4> (8a1c0eb3-8b7e-438e-b621-2d14801069c4) [No such file or directory] >[2016-04-19 07:24:53.999690] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8a1c0eb3-8b7e-438e-b621-2d14801069c4. (Possible split-brain) >[2016-04-19 07:24:54.000902] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4> (8a1c0eb3-8b7e-438e-b621-2d14801069c4) [No such file or directory] >[2016-04-19 07:24:54.000931] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4> (8a1c0eb3-8b7e-438e-b621-2d14801069c4) [No such file or directory] >[2016-04-19 07:24:54.002252] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4> (8a1c0eb3-8b7e-438e-b621-2d14801069c4) [No such file or directory] >[2016-04-19 07:24:54.002186] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4> (8a1c0eb3-8b7e-438e-b621-2d14801069c4) [No such file or directory] >[2016-04-19 07:24:54.002534] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.005216] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8a1c0eb3-8b7e-438e-b621-2d14801069c4. (Possible split-brain) >[2016-04-19 07:24:54.006536] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4> (8a1c0eb3-8b7e-438e-b621-2d14801069c4) [No such file or directory] >[2016-04-19 07:24:54.006548] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4> (8a1c0eb3-8b7e-438e-b621-2d14801069c4) [No such file or directory] >[2016-04-19 07:24:54.009418] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4> (8a1c0eb3-8b7e-438e-b621-2d14801069c4) [No such file or directory] >[2016-04-19 07:24:54.009486] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4> (8a1c0eb3-8b7e-438e-b621-2d14801069c4) [No such file or directory] >[2016-04-19 07:24:54.009717] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8a1c0eb3-8b7e-438e-b621-2d14801069c4>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.018792] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.019994] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097> (81872802-c7b4-4d8c-9447-7b920eadd097) [No such file or directory] >[2016-04-19 07:24:54.020068] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097> (81872802-c7b4-4d8c-9447-7b920eadd097) [No such file or directory] >[2016-04-19 07:24:54.021264] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 81872802-c7b4-4d8c-9447-7b920eadd097. (Possible split-brain) >[2016-04-19 07:24:54.022257] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097> (81872802-c7b4-4d8c-9447-7b920eadd097) [No such file or directory] >[2016-04-19 07:24:54.022494] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097> (81872802-c7b4-4d8c-9447-7b920eadd097) [No such file or directory] >[2016-04-19 07:24:54.023640] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097> (81872802-c7b4-4d8c-9447-7b920eadd097) [No such file or directory] >[2016-04-19 07:24:54.023756] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097> (81872802-c7b4-4d8c-9447-7b920eadd097) [No such file or directory] >[2016-04-19 07:24:54.023908] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:54.026569] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 81872802-c7b4-4d8c-9447-7b920eadd097. (Possible split-brain) >[2016-04-19 07:24:54.027583] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097> (81872802-c7b4-4d8c-9447-7b920eadd097) [No such file or directory] >[2016-04-19 07:24:54.027650] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097> (81872802-c7b4-4d8c-9447-7b920eadd097) [No such file or directory] >[2016-04-19 07:24:54.030219] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097> (81872802-c7b4-4d8c-9447-7b920eadd097) [No such file or directory] >[2016-04-19 07:24:54.030313] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097> (81872802-c7b4-4d8c-9447-7b920eadd097) [No such file or directory] >[2016-04-19 07:24:54.030495] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:81872802-c7b4-4d8c-9447-7b920eadd097>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:54.039909] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.040734] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6> (34364c28-d03c-4454-8d6b-89e36ada9aa6) [No such file or directory] >[2016-04-19 07:24:54.040813] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6> (34364c28-d03c-4454-8d6b-89e36ada9aa6) [No such file or directory] >[2016-04-19 07:24:54.043624] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 34364c28-d03c-4454-8d6b-89e36ada9aa6. (Possible split-brain) >[2016-04-19 07:24:54.044765] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6> (34364c28-d03c-4454-8d6b-89e36ada9aa6) [No such file or directory] >[2016-04-19 07:24:54.044779] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6> (34364c28-d03c-4454-8d6b-89e36ada9aa6) [No such file or directory] >[2016-04-19 07:24:54.045866] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6> (34364c28-d03c-4454-8d6b-89e36ada9aa6) [No such file or directory] >[2016-04-19 07:24:54.046150] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6> (34364c28-d03c-4454-8d6b-89e36ada9aa6) [No such file or directory] >[2016-04-19 07:24:54.046388] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.049437] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 34364c28-d03c-4454-8d6b-89e36ada9aa6. (Possible split-brain) >[2016-04-19 07:24:54.050238] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6> (34364c28-d03c-4454-8d6b-89e36ada9aa6) [No such file or directory] >[2016-04-19 07:24:54.050347] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6> (34364c28-d03c-4454-8d6b-89e36ada9aa6) [No such file or directory] >[2016-04-19 07:24:54.053219] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6> (34364c28-d03c-4454-8d6b-89e36ada9aa6) [No such file or directory] >[2016-04-19 07:24:54.053365] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6> (34364c28-d03c-4454-8d6b-89e36ada9aa6) [No such file or directory] >[2016-04-19 07:24:54.053952] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:34364c28-d03c-4454-8d6b-89e36ada9aa6>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:54.064101] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.064934] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6> (d4a57ed0-bbaf-482d-9f85-7fab1b0516e6) [No such file or directory] >[2016-04-19 07:24:54.065022] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6> (d4a57ed0-bbaf-482d-9f85-7fab1b0516e6) [No such file or directory] >[2016-04-19 07:24:54.068000] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d4a57ed0-bbaf-482d-9f85-7fab1b0516e6. (Possible split-brain) >[2016-04-19 07:24:54.068719] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6> (d4a57ed0-bbaf-482d-9f85-7fab1b0516e6) [No such file or directory] >[2016-04-19 07:24:54.069214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6> (d4a57ed0-bbaf-482d-9f85-7fab1b0516e6) [No such file or directory] >[2016-04-19 07:24:54.070256] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6> (d4a57ed0-bbaf-482d-9f85-7fab1b0516e6) [No such file or directory] >[2016-04-19 07:24:54.070741] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6> (d4a57ed0-bbaf-482d-9f85-7fab1b0516e6) [No such file or directory] >[2016-04-19 07:24:54.070901] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.073678] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid d4a57ed0-bbaf-482d-9f85-7fab1b0516e6. (Possible split-brain) >[2016-04-19 07:24:54.074878] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6> (d4a57ed0-bbaf-482d-9f85-7fab1b0516e6) [No such file or directory] >[2016-04-19 07:24:54.074981] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6> (d4a57ed0-bbaf-482d-9f85-7fab1b0516e6) [No such file or directory] >[2016-04-19 07:24:54.077760] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6> (d4a57ed0-bbaf-482d-9f85-7fab1b0516e6) [No such file or directory] >[2016-04-19 07:24:54.078214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6> (d4a57ed0-bbaf-482d-9f85-7fab1b0516e6) [No such file or directory] >[2016-04-19 07:24:54.078362] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d4a57ed0-bbaf-482d-9f85-7fab1b0516e6>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.093583] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.094491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d> (d025e796-9633-49dc-bcc1-b9a4e904778d) [No such file or directory] >[2016-04-19 07:24:54.094823] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d> (d025e796-9633-49dc-bcc1-b9a4e904778d) [No such file or directory] >[2016-04-19 07:24:54.097466] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d025e796-9633-49dc-bcc1-b9a4e904778d. (Possible split-brain) >[2016-04-19 07:24:54.098564] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d> (d025e796-9633-49dc-bcc1-b9a4e904778d) [No such file or directory] >[2016-04-19 07:24:54.098645] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d> (d025e796-9633-49dc-bcc1-b9a4e904778d) [No such file or directory] >[2016-04-19 07:24:54.099828] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d> (d025e796-9633-49dc-bcc1-b9a4e904778d) [No such file or directory] >[2016-04-19 07:24:54.099843] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d> (d025e796-9633-49dc-bcc1-b9a4e904778d) [No such file or directory] >[2016-04-19 07:24:54.100045] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:54.101819] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d025e796-9633-49dc-bcc1-b9a4e904778d. (Possible split-brain) >[2016-04-19 07:24:54.102667] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d> (d025e796-9633-49dc-bcc1-b9a4e904778d) [No such file or directory] >[2016-04-19 07:24:54.102721] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d> (d025e796-9633-49dc-bcc1-b9a4e904778d) [No such file or directory] >[2016-04-19 07:24:54.104280] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d> (d025e796-9633-49dc-bcc1-b9a4e904778d) [No such file or directory] >[2016-04-19 07:24:54.104464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d> (d025e796-9633-49dc-bcc1-b9a4e904778d) [No such file or directory] >[2016-04-19 07:24:54.105373] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d025e796-9633-49dc-bcc1-b9a4e904778d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:54.111568] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.112358] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27> (19d2d608-4bb3-445a-8d01-468b15058c27) [No such file or directory] >[2016-04-19 07:24:54.112563] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27> (19d2d608-4bb3-445a-8d01-468b15058c27) [No such file or directory] >[2016-04-19 07:24:54.114389] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 19d2d608-4bb3-445a-8d01-468b15058c27. (Possible split-brain) >[2016-04-19 07:24:54.115409] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27> (19d2d608-4bb3-445a-8d01-468b15058c27) [No such file or directory] >[2016-04-19 07:24:54.115410] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27> (19d2d608-4bb3-445a-8d01-468b15058c27) [No such file or directory] >[2016-04-19 07:24:54.116118] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27> (19d2d608-4bb3-445a-8d01-468b15058c27) [No such file or directory] >[2016-04-19 07:24:54.116372] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27> (19d2d608-4bb3-445a-8d01-468b15058c27) [No such file or directory] >[2016-04-19 07:24:54.116463] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.119116] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 19d2d608-4bb3-445a-8d01-468b15058c27. (Possible split-brain) >[2016-04-19 07:24:54.119904] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27> (19d2d608-4bb3-445a-8d01-468b15058c27) [No such file or directory] >[2016-04-19 07:24:54.119909] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27> (19d2d608-4bb3-445a-8d01-468b15058c27) [No such file or directory] >[2016-04-19 07:24:54.122112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27> (19d2d608-4bb3-445a-8d01-468b15058c27) [No such file or directory] >[2016-04-19 07:24:54.122295] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27> (19d2d608-4bb3-445a-8d01-468b15058c27) [No such file or directory] >[2016-04-19 07:24:54.122445] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:19d2d608-4bb3-445a-8d01-468b15058c27>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.131126] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.131952] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8> (303d3e2f-6403-4c34-a1e3-17ba677ddcd8) [No such file or directory] >[2016-04-19 07:24:54.132039] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8> (303d3e2f-6403-4c34-a1e3-17ba677ddcd8) [No such file or directory] >[2016-04-19 07:24:54.133122] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 303d3e2f-6403-4c34-a1e3-17ba677ddcd8. (Possible split-brain) >[2016-04-19 07:24:54.133956] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8> (303d3e2f-6403-4c34-a1e3-17ba677ddcd8) [No such file or directory] >[2016-04-19 07:24:54.134141] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8> (303d3e2f-6403-4c34-a1e3-17ba677ddcd8) [No such file or directory] >[2016-04-19 07:24:54.135431] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8> (303d3e2f-6403-4c34-a1e3-17ba677ddcd8) [No such file or directory] >[2016-04-19 07:24:54.135535] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8> (303d3e2f-6403-4c34-a1e3-17ba677ddcd8) [No such file or directory] >[2016-04-19 07:24:54.135869] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.138533] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 303d3e2f-6403-4c34-a1e3-17ba677ddcd8. (Possible split-brain) >[2016-04-19 07:24:54.139260] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8> (303d3e2f-6403-4c34-a1e3-17ba677ddcd8) [No such file or directory] >[2016-04-19 07:24:54.139596] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8> (303d3e2f-6403-4c34-a1e3-17ba677ddcd8) [No such file or directory] >[2016-04-19 07:24:54.142225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8> (303d3e2f-6403-4c34-a1e3-17ba677ddcd8) [No such file or directory] >[2016-04-19 07:24:54.142303] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8> (303d3e2f-6403-4c34-a1e3-17ba677ddcd8) [No such file or directory] >[2016-04-19 07:24:54.142446] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:303d3e2f-6403-4c34-a1e3-17ba677ddcd8>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.150147] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.150849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b> (29212b0b-fb7b-40ef-81c5-8d9ff328f05b) [No such file or directory] >[2016-04-19 07:24:54.151148] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b> (29212b0b-fb7b-40ef-81c5-8d9ff328f05b) [No such file or directory] >[2016-04-19 07:24:54.153881] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 29212b0b-fb7b-40ef-81c5-8d9ff328f05b. (Possible split-brain) >[2016-04-19 07:24:54.154662] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b> (29212b0b-fb7b-40ef-81c5-8d9ff328f05b) [No such file or directory] >[2016-04-19 07:24:54.155048] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b> (29212b0b-fb7b-40ef-81c5-8d9ff328f05b) [No such file or directory] >[2016-04-19 07:24:54.156135] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b> (29212b0b-fb7b-40ef-81c5-8d9ff328f05b) [No such file or directory] >[2016-04-19 07:24:54.156831] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b> (29212b0b-fb7b-40ef-81c5-8d9ff328f05b) [No such file or directory] >[2016-04-19 07:24:54.156958] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.159715] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 29212b0b-fb7b-40ef-81c5-8d9ff328f05b. (Possible split-brain) >[2016-04-19 07:24:54.160489] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b> (29212b0b-fb7b-40ef-81c5-8d9ff328f05b) [No such file or directory] >[2016-04-19 07:24:54.160821] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b> (29212b0b-fb7b-40ef-81c5-8d9ff328f05b) [No such file or directory] >[2016-04-19 07:24:54.163550] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b> (29212b0b-fb7b-40ef-81c5-8d9ff328f05b) [No such file or directory] >[2016-04-19 07:24:54.163691] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b> (29212b0b-fb7b-40ef-81c5-8d9ff328f05b) [No such file or directory] >[2016-04-19 07:24:54.163808] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:29212b0b-fb7b-40ef-81c5-8d9ff328f05b>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.172238] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.172949] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d> (863fde55-1f2e-446a-b741-298ebee83c8d) [No such file or directory] >[2016-04-19 07:24:54.173112] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d> (863fde55-1f2e-446a-b741-298ebee83c8d) [No such file or directory] >[2016-04-19 07:24:54.175888] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 863fde55-1f2e-446a-b741-298ebee83c8d. (Possible split-brain) >[2016-04-19 07:24:54.176577] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d> (863fde55-1f2e-446a-b741-298ebee83c8d) [No such file or directory] >[2016-04-19 07:24:54.176836] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d> (863fde55-1f2e-446a-b741-298ebee83c8d) [No such file or directory] >[2016-04-19 07:24:54.177998] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d> (863fde55-1f2e-446a-b741-298ebee83c8d) [No such file or directory] >[2016-04-19 07:24:54.178342] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d> (863fde55-1f2e-446a-b741-298ebee83c8d) [No such file or directory] >[2016-04-19 07:24:54.178575] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.181397] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 863fde55-1f2e-446a-b741-298ebee83c8d. (Possible split-brain) >[2016-04-19 07:24:54.182181] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d> (863fde55-1f2e-446a-b741-298ebee83c8d) [No such file or directory] >[2016-04-19 07:24:54.182483] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d> (863fde55-1f2e-446a-b741-298ebee83c8d) [No such file or directory] >[2016-04-19 07:24:54.186923] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d> (863fde55-1f2e-446a-b741-298ebee83c8d) [No such file or directory] >[2016-04-19 07:24:54.186945] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d> (863fde55-1f2e-446a-b741-298ebee83c8d) [No such file or directory] >[2016-04-19 07:24:54.187191] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:863fde55-1f2e-446a-b741-298ebee83c8d>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:54.195236] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.196075] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261> (5e0a7661-7bea-4bc6-a0d9-5625cdf44261) [No such file or directory] >[2016-04-19 07:24:54.196156] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261> (5e0a7661-7bea-4bc6-a0d9-5625cdf44261) [No such file or directory] >[2016-04-19 07:24:54.197224] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5e0a7661-7bea-4bc6-a0d9-5625cdf44261. (Possible split-brain) >[2016-04-19 07:24:54.197962] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261> (5e0a7661-7bea-4bc6-a0d9-5625cdf44261) [No such file or directory] >[2016-04-19 07:24:54.198261] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261> (5e0a7661-7bea-4bc6-a0d9-5625cdf44261) [No such file or directory] >[2016-04-19 07:24:54.199568] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261> (5e0a7661-7bea-4bc6-a0d9-5625cdf44261) [No such file or directory] >[2016-04-19 07:24:54.199766] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261> (5e0a7661-7bea-4bc6-a0d9-5625cdf44261) [No such file or directory] >[2016-04-19 07:24:54.200055] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.202755] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 5e0a7661-7bea-4bc6-a0d9-5625cdf44261. (Possible split-brain) >[2016-04-19 07:24:54.203476] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261> (5e0a7661-7bea-4bc6-a0d9-5625cdf44261) [No such file or directory] >[2016-04-19 07:24:54.203757] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261> (5e0a7661-7bea-4bc6-a0d9-5625cdf44261) [No such file or directory] >[2016-04-19 07:24:54.206731] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261> (5e0a7661-7bea-4bc6-a0d9-5625cdf44261) [No such file or directory] >[2016-04-19 07:24:54.206908] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261> (5e0a7661-7bea-4bc6-a0d9-5625cdf44261) [No such file or directory] >[2016-04-19 07:24:54.207059] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:5e0a7661-7bea-4bc6-a0d9-5625cdf44261>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.216913] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.217764] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3> (a00da612-3b97-4192-8ac3-e6c4837a91c3) [No such file or directory] >[2016-04-19 07:24:54.218203] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3> (a00da612-3b97-4192-8ac3-e6c4837a91c3) [No such file or directory] >[2016-04-19 07:24:54.221028] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a00da612-3b97-4192-8ac3-e6c4837a91c3. (Possible split-brain) >[2016-04-19 07:24:54.222214] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3> (a00da612-3b97-4192-8ac3-e6c4837a91c3) [No such file or directory] >[2016-04-19 07:24:54.222216] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3> (a00da612-3b97-4192-8ac3-e6c4837a91c3) [No such file or directory] >[2016-04-19 07:24:54.223456] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3> (a00da612-3b97-4192-8ac3-e6c4837a91c3) [No such file or directory] >[2016-04-19 07:24:54.223520] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3> (a00da612-3b97-4192-8ac3-e6c4837a91c3) [No such file or directory] >[2016-04-19 07:24:54.223880] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.226621] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid a00da612-3b97-4192-8ac3-e6c4837a91c3. (Possible split-brain) >[2016-04-19 07:24:54.227707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3> (a00da612-3b97-4192-8ac3-e6c4837a91c3) [No such file or directory] >[2016-04-19 07:24:54.227779] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3> (a00da612-3b97-4192-8ac3-e6c4837a91c3) [No such file or directory] >[2016-04-19 07:24:54.231301] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3> (a00da612-3b97-4192-8ac3-e6c4837a91c3) [No such file or directory] >[2016-04-19 07:24:54.231689] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3> (a00da612-3b97-4192-8ac3-e6c4837a91c3) [No such file or directory] >[2016-04-19 07:24:54.232475] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:a00da612-3b97-4192-8ac3-e6c4837a91c3>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:54.241010] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.241954] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492> (74f3ac92-66ae-42c6-ae78-7e8879bbb492) [No such file or directory] >[2016-04-19 07:24:54.242288] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492> (74f3ac92-66ae-42c6-ae78-7e8879bbb492) [No such file or directory] >[2016-04-19 07:24:54.245090] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 74f3ac92-66ae-42c6-ae78-7e8879bbb492. (Possible split-brain) >[2016-04-19 07:24:54.246029] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492> (74f3ac92-66ae-42c6-ae78-7e8879bbb492) [No such file or directory] >[2016-04-19 07:24:54.246115] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492> (74f3ac92-66ae-42c6-ae78-7e8879bbb492) [No such file or directory] >[2016-04-19 07:24:54.247264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492> (74f3ac92-66ae-42c6-ae78-7e8879bbb492) [No such file or directory] >[2016-04-19 07:24:54.247633] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492> (74f3ac92-66ae-42c6-ae78-7e8879bbb492) [No such file or directory] >[2016-04-19 07:24:54.248003] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.250801] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 74f3ac92-66ae-42c6-ae78-7e8879bbb492. (Possible split-brain) >[2016-04-19 07:24:54.251748] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492> (74f3ac92-66ae-42c6-ae78-7e8879bbb492) [No such file or directory] >[2016-04-19 07:24:54.251869] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492> (74f3ac92-66ae-42c6-ae78-7e8879bbb492) [No such file or directory] >[2016-04-19 07:24:54.256370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492> (74f3ac92-66ae-42c6-ae78-7e8879bbb492) [No such file or directory] >[2016-04-19 07:24:54.256464] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492> (74f3ac92-66ae-42c6-ae78-7e8879bbb492) [No such file or directory] >[2016-04-19 07:24:54.256789] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:74f3ac92-66ae-42c6-ae78-7e8879bbb492>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.267264] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.268566] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2> (e7065784-e078-4108-9a14-d6c156bacaf2) [No such file or directory] >[2016-04-19 07:24:54.268647] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2> (e7065784-e078-4108-9a14-d6c156bacaf2) [No such file or directory] >[2016-04-19 07:24:54.271367] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e7065784-e078-4108-9a14-d6c156bacaf2. (Possible split-brain) >[2016-04-19 07:24:54.272491] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2> (e7065784-e078-4108-9a14-d6c156bacaf2) [No such file or directory] >[2016-04-19 07:24:54.272598] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2> (e7065784-e078-4108-9a14-d6c156bacaf2) [No such file or directory] >[2016-04-19 07:24:54.273876] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2> (e7065784-e078-4108-9a14-d6c156bacaf2) [No such file or directory] >[2016-04-19 07:24:54.273993] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2> (e7065784-e078-4108-9a14-d6c156bacaf2) [No such file or directory] >[2016-04-19 07:24:54.274151] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.276902] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid e7065784-e078-4108-9a14-d6c156bacaf2. (Possible split-brain) >[2016-04-19 07:24:54.278012] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2> (e7065784-e078-4108-9a14-d6c156bacaf2) [No such file or directory] >[2016-04-19 07:24:54.278042] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2> (e7065784-e078-4108-9a14-d6c156bacaf2) [No such file or directory] >[2016-04-19 07:24:54.281827] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2> (e7065784-e078-4108-9a14-d6c156bacaf2) [No such file or directory] >[2016-04-19 07:24:54.282108] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2> (e7065784-e078-4108-9a14-d6c156bacaf2) [No such file or directory] >[2016-04-19 07:24:54.282723] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:e7065784-e078-4108-9a14-d6c156bacaf2>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:54.291104] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.292025] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81> (55403964-5f6c-4ffa-a64e-a539515b5e81) [No such file or directory] >[2016-04-19 07:24:54.292038] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81> (55403964-5f6c-4ffa-a64e-a539515b5e81) [No such file or directory] >[2016-04-19 07:24:54.294871] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 55403964-5f6c-4ffa-a64e-a539515b5e81. (Possible split-brain) >[2016-04-19 07:24:54.295788] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81> (55403964-5f6c-4ffa-a64e-a539515b5e81) [No such file or directory] >[2016-04-19 07:24:54.295809] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81> (55403964-5f6c-4ffa-a64e-a539515b5e81) [No such file or directory] >[2016-04-19 07:24:54.296967] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81> (55403964-5f6c-4ffa-a64e-a539515b5e81) [No such file or directory] >[2016-04-19 07:24:54.297501] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81> (55403964-5f6c-4ffa-a64e-a539515b5e81) [No such file or directory] >[2016-04-19 07:24:54.297582] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.300290] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 55403964-5f6c-4ffa-a64e-a539515b5e81. (Possible split-brain) >[2016-04-19 07:24:54.301170] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81> (55403964-5f6c-4ffa-a64e-a539515b5e81) [No such file or directory] >[2016-04-19 07:24:54.301500] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81> (55403964-5f6c-4ffa-a64e-a539515b5e81) [No such file or directory] >[2016-04-19 07:24:54.306239] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81> (55403964-5f6c-4ffa-a64e-a539515b5e81) [No such file or directory] >[2016-04-19 07:24:54.306264] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81> (55403964-5f6c-4ffa-a64e-a539515b5e81) [No such file or directory] >[2016-04-19 07:24:54.306515] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:55403964-5f6c-4ffa-a64e-a539515b5e81>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.316194] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.316975] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1> (ad1f119a-9415-43e0-8b54-0cebda3a1fa1) [No such file or directory] >[2016-04-19 07:24:54.317289] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1> (ad1f119a-9415-43e0-8b54-0cebda3a1fa1) [No such file or directory] >[2016-04-19 07:24:54.318402] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ad1f119a-9415-43e0-8b54-0cebda3a1fa1. (Possible split-brain) >[2016-04-19 07:24:54.319078] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1> (ad1f119a-9415-43e0-8b54-0cebda3a1fa1) [No such file or directory] >[2016-04-19 07:24:54.319494] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1> (ad1f119a-9415-43e0-8b54-0cebda3a1fa1) [No such file or directory] >[2016-04-19 07:24:54.320632] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1> (ad1f119a-9415-43e0-8b54-0cebda3a1fa1) [No such file or directory] >[2016-04-19 07:24:54.320910] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1> (ad1f119a-9415-43e0-8b54-0cebda3a1fa1) [No such file or directory] >[2016-04-19 07:24:54.321188] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.323893] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid ad1f119a-9415-43e0-8b54-0cebda3a1fa1. (Possible split-brain) >[2016-04-19 07:24:54.324789] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1> (ad1f119a-9415-43e0-8b54-0cebda3a1fa1) [No such file or directory] >[2016-04-19 07:24:54.324810] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1> (ad1f119a-9415-43e0-8b54-0cebda3a1fa1) [No such file or directory] >[2016-04-19 07:24:54.329044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1> (ad1f119a-9415-43e0-8b54-0cebda3a1fa1) [No such file or directory] >[2016-04-19 07:24:54.329404] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1> (ad1f119a-9415-43e0-8b54-0cebda3a1fa1) [No such file or directory] >[2016-04-19 07:24:54.329614] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:ad1f119a-9415-43e0-8b54-0cebda3a1fa1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.337679] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.338474] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269> (df7c01dc-e900-41ac-bc9d-09794afa0269) [No such file or directory] >[2016-04-19 07:24:54.338708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269> (df7c01dc-e900-41ac-bc9d-09794afa0269) [No such file or directory] >[2016-04-19 07:24:54.341092] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid df7c01dc-e900-41ac-bc9d-09794afa0269. (Possible split-brain) >[2016-04-19 07:24:54.342243] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269> (df7c01dc-e900-41ac-bc9d-09794afa0269) [No such file or directory] >[2016-04-19 07:24:54.342363] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269> (df7c01dc-e900-41ac-bc9d-09794afa0269) [No such file or directory] >[2016-04-19 07:24:54.343531] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269> (df7c01dc-e900-41ac-bc9d-09794afa0269) [No such file or directory] >[2016-04-19 07:24:54.343603] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269> (df7c01dc-e900-41ac-bc9d-09794afa0269) [No such file or directory] >[2016-04-19 07:24:54.343919] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.346670] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid df7c01dc-e900-41ac-bc9d-09794afa0269. (Possible split-brain) >[2016-04-19 07:24:54.347630] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269> (df7c01dc-e900-41ac-bc9d-09794afa0269) [No such file or directory] >[2016-04-19 07:24:54.347965] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269> (df7c01dc-e900-41ac-bc9d-09794afa0269) [No such file or directory] >[2016-04-19 07:24:54.351657] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269> (df7c01dc-e900-41ac-bc9d-09794afa0269) [No such file or directory] >[2016-04-19 07:24:54.352386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269> (df7c01dc-e900-41ac-bc9d-09794afa0269) [No such file or directory] >[2016-04-19 07:24:54.352906] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:df7c01dc-e900-41ac-bc9d-09794afa0269>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:54.361796] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.362926] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd> (4da31d08-5cd3-4bb7-a71d-3337c81cbbcd) [No such file or directory] >[2016-04-19 07:24:54.362950] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd> (4da31d08-5cd3-4bb7-a71d-3337c81cbbcd) [No such file or directory] >[2016-04-19 07:24:54.365724] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4da31d08-5cd3-4bb7-a71d-3337c81cbbcd. (Possible split-brain) >[2016-04-19 07:24:54.366612] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd> (4da31d08-5cd3-4bb7-a71d-3337c81cbbcd) [No such file or directory] >[2016-04-19 07:24:54.366707] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd> (4da31d08-5cd3-4bb7-a71d-3337c81cbbcd) [No such file or directory] >[2016-04-19 07:24:54.367942] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd> (4da31d08-5cd3-4bb7-a71d-3337c81cbbcd) [No such file or directory] >[2016-04-19 07:24:54.368021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd> (4da31d08-5cd3-4bb7-a71d-3337c81cbbcd) [No such file or directory] >[2016-04-19 07:24:54.368400] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.371238] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 4da31d08-5cd3-4bb7-a71d-3337c81cbbcd. (Possible split-brain) >[2016-04-19 07:24:54.372155] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd> (4da31d08-5cd3-4bb7-a71d-3337c81cbbcd) [No such file or directory] >[2016-04-19 07:24:54.372401] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd> (4da31d08-5cd3-4bb7-a71d-3337c81cbbcd) [No such file or directory] >[2016-04-19 07:24:54.377021] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd> (4da31d08-5cd3-4bb7-a71d-3337c81cbbcd) [No such file or directory] >[2016-04-19 07:24:54.377035] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd> (4da31d08-5cd3-4bb7-a71d-3337c81cbbcd) [No such file or directory] >[2016-04-19 07:24:54.377208] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:4da31d08-5cd3-4bb7-a71d-3337c81cbbcd>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.386240] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.387167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e> (287c4e1f-9262-4c34-87da-46c2c0df7f8e) [No such file or directory] >[2016-04-19 07:24:54.387396] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e> (287c4e1f-9262-4c34-87da-46c2c0df7f8e) [No such file or directory] >[2016-04-19 07:24:54.388479] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 287c4e1f-9262-4c34-87da-46c2c0df7f8e. (Possible split-brain) >[2016-04-19 07:24:54.389224] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e> (287c4e1f-9262-4c34-87da-46c2c0df7f8e) [No such file or directory] >[2016-04-19 07:24:54.389485] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e> (287c4e1f-9262-4c34-87da-46c2c0df7f8e) [No such file or directory] >[2016-04-19 07:24:54.390704] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e> (287c4e1f-9262-4c34-87da-46c2c0df7f8e) [No such file or directory] >[2016-04-19 07:24:54.390708] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e> (287c4e1f-9262-4c34-87da-46c2c0df7f8e) [No such file or directory] >[2016-04-19 07:24:54.391030] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.393759] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 287c4e1f-9262-4c34-87da-46c2c0df7f8e. (Possible split-brain) >[2016-04-19 07:24:54.394573] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e> (287c4e1f-9262-4c34-87da-46c2c0df7f8e) [No such file or directory] >[2016-04-19 07:24:54.394714] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e> (287c4e1f-9262-4c34-87da-46c2c0df7f8e) [No such file or directory] >[2016-04-19 07:24:54.399658] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e> (287c4e1f-9262-4c34-87da-46c2c0df7f8e) [No such file or directory] >[2016-04-19 07:24:54.399677] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e> (287c4e1f-9262-4c34-87da-46c2c0df7f8e) [No such file or directory] >[2016-04-19 07:24:54.399743] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:287c4e1f-9262-4c34-87da-46c2c0df7f8e>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.407783] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.408305] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d> (f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d) [No such file or directory] >[2016-04-19 07:24:54.408499] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d> (f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d) [No such file or directory] >[2016-04-19 07:24:54.409345] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d. (Possible split-brain) >[2016-04-19 07:24:54.409842] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d> (f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d) [No such file or directory] >[2016-04-19 07:24:54.410209] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d> (f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d) [No such file or directory] >[2016-04-19 07:24:54.411370] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d> (f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d) [No such file or directory] >[2016-04-19 07:24:54.411441] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d> (f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d) [No such file or directory] >[2016-04-19 07:24:54.411799] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.414514] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d. (Possible split-brain) >[2016-04-19 07:24:54.415381] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d> (f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d) [No such file or directory] >[2016-04-19 07:24:54.415387] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d> (f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d) [No such file or directory] >[2016-04-19 07:24:54.419849] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d> (f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d) [No such file or directory] >[2016-04-19 07:24:54.420036] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d> (f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d) [No such file or directory] >[2016-04-19 07:24:54.420168] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:f1d9bfa4-df31-4c5d-a4b6-ecdc4169489d>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.427918] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.428676] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3> (395d0b29-0d2f-43c7-b88f-b6dc081bb3c3) [No such file or directory] >[2016-04-19 07:24:54.428843] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3> (395d0b29-0d2f-43c7-b88f-b6dc081bb3c3) [No such file or directory] >[2016-04-19 07:24:54.429779] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 395d0b29-0d2f-43c7-b88f-b6dc081bb3c3. (Possible split-brain) >[2016-04-19 07:24:54.430958] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3> (395d0b29-0d2f-43c7-b88f-b6dc081bb3c3) [No such file or directory] >[2016-04-19 07:24:54.431072] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3> (395d0b29-0d2f-43c7-b88f-b6dc081bb3c3) [No such file or directory] >[2016-04-19 07:24:54.432257] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3> (395d0b29-0d2f-43c7-b88f-b6dc081bb3c3) [No such file or directory] >[2016-04-19 07:24:54.432386] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3> (395d0b29-0d2f-43c7-b88f-b6dc081bb3c3) [No such file or directory] >[2016-04-19 07:24:54.432538] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:54.435245] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 395d0b29-0d2f-43c7-b88f-b6dc081bb3c3. (Possible split-brain) >[2016-04-19 07:24:54.436417] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3> (395d0b29-0d2f-43c7-b88f-b6dc081bb3c3) [No such file or directory] >[2016-04-19 07:24:54.436495] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3> (395d0b29-0d2f-43c7-b88f-b6dc081bb3c3) [No such file or directory] >[2016-04-19 07:24:54.438841] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3> (395d0b29-0d2f-43c7-b88f-b6dc081bb3c3) [No such file or directory] >[2016-04-19 07:24:54.438912] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3> (395d0b29-0d2f-43c7-b88f-b6dc081bb3c3) [No such file or directory] >[2016-04-19 07:24:54.439256] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:395d0b29-0d2f-43c7-b88f-b6dc081bb3c3>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.448776] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.449729] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1> (82c6db94-6d3b-46ba-a573-f0b5e28c47e1) [No such file or directory] >[2016-04-19 07:24:54.449804] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1> (82c6db94-6d3b-46ba-a573-f0b5e28c47e1) [No such file or directory] >[2016-04-19 07:24:54.450898] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 82c6db94-6d3b-46ba-a573-f0b5e28c47e1. (Possible split-brain) >[2016-04-19 07:24:54.451911] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1> (82c6db94-6d3b-46ba-a573-f0b5e28c47e1) [No such file or directory] >[2016-04-19 07:24:54.451913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1> (82c6db94-6d3b-46ba-a573-f0b5e28c47e1) [No such file or directory] >[2016-04-19 07:24:54.453259] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1> (82c6db94-6d3b-46ba-a573-f0b5e28c47e1) [No such file or directory] >[2016-04-19 07:24:54.453574] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1> (82c6db94-6d3b-46ba-a573-f0b5e28c47e1) [No such file or directory] >[2016-04-19 07:24:54.454003] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.456756] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 82c6db94-6d3b-46ba-a573-f0b5e28c47e1. (Possible split-brain) >[2016-04-19 07:24:54.457857] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1> (82c6db94-6d3b-46ba-a573-f0b5e28c47e1) [No such file or directory] >[2016-04-19 07:24:54.457994] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1> (82c6db94-6d3b-46ba-a573-f0b5e28c47e1) [No such file or directory] >[2016-04-19 07:24:54.462913] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1> (82c6db94-6d3b-46ba-a573-f0b5e28c47e1) [No such file or directory] >[2016-04-19 07:24:54.463122] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1> (82c6db94-6d3b-46ba-a573-f0b5e28c47e1) [No such file or directory] >[2016-04-19 07:24:54.463352] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:82c6db94-6d3b-46ba-a573-f0b5e28c47e1>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.472939] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-15: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.473928] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c> (d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c) [No such file or directory] >[2016-04-19 07:24:54.473943] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c> (d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c) [No such file or directory] >[2016-04-19 07:24:54.475131] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c. (Possible split-brain) >[2016-04-19 07:24:54.476168] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c> (d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c) [No such file or directory] >[2016-04-19 07:24:54.476175] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c> (d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c) [No such file or directory] >[2016-04-19 07:24:54.477428] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c> (d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c) [No such file or directory] >[2016-04-19 07:24:54.477454] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c> (d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c) [No such file or directory] >[2016-04-19 07:24:54.478042] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:54.480808] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c. (Possible split-brain) >[2016-04-19 07:24:54.481970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c> (d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c) [No such file or directory] >[2016-04-19 07:24:54.482043] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c> (d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c) [No such file or directory] >[2016-04-19 07:24:54.484679] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c> (d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c) [No such file or directory] >[2016-04-19 07:24:54.484703] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c> (d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c) [No such file or directory] >[2016-04-19 07:24:54.484869] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:d038bec6-2ec5-4ef5-9986-3ffb99ba4d7c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.494198] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.495413] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864> (c3e9d54d-244d-4930-a153-0f613a9fd864) [No such file or directory] >[2016-04-19 07:24:54.495515] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864> (c3e9d54d-244d-4930-a153-0f613a9fd864) [No such file or directory] >[2016-04-19 07:24:54.496708] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c3e9d54d-244d-4930-a153-0f613a9fd864. (Possible split-brain) >[2016-04-19 07:24:54.497883] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864> (c3e9d54d-244d-4930-a153-0f613a9fd864) [No such file or directory] >[2016-04-19 07:24:54.497924] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864> (c3e9d54d-244d-4930-a153-0f613a9fd864) [No such file or directory] >[2016-04-19 07:24:54.499167] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864> (c3e9d54d-244d-4930-a153-0f613a9fd864) [No such file or directory] >[2016-04-19 07:24:54.499218] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864> (c3e9d54d-244d-4930-a153-0f613a9fd864) [No such file or directory] >[2016-04-19 07:24:54.499773] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.502765] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid c3e9d54d-244d-4930-a153-0f613a9fd864. (Possible split-brain) >[2016-04-19 07:24:54.503845] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864> (c3e9d54d-244d-4930-a153-0f613a9fd864) [No such file or directory] >[2016-04-19 07:24:54.503970] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864> (c3e9d54d-244d-4930-a153-0f613a9fd864) [No such file or directory] >[2016-04-19 07:24:54.506959] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864> (c3e9d54d-244d-4930-a153-0f613a9fd864) [No such file or directory] >[2016-04-19 07:24:54.506950] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864> (c3e9d54d-244d-4930-a153-0f613a9fd864) [No such file or directory] >[2016-04-19 07:24:54.507191] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:c3e9d54d-244d-4930-a153-0f613a9fd864>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.516255] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.517056] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f> (7762a019-8d54-48f5-a13b-88bc285bf50f) [No such file or directory] >[2016-04-19 07:24:54.517435] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f> (7762a019-8d54-48f5-a13b-88bc285bf50f) [No such file or directory] >[2016-04-19 07:24:54.520188] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7762a019-8d54-48f5-a13b-88bc285bf50f. (Possible split-brain) >[2016-04-19 07:24:54.521350] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f> (7762a019-8d54-48f5-a13b-88bc285bf50f) [No such file or directory] >[2016-04-19 07:24:54.521475] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f> (7762a019-8d54-48f5-a13b-88bc285bf50f) [No such file or directory] >[2016-04-19 07:24:54.522953] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f> (7762a019-8d54-48f5-a13b-88bc285bf50f) [No such file or directory] >[2016-04-19 07:24:54.523068] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f> (7762a019-8d54-48f5-a13b-88bc285bf50f) [No such file or directory] >[2016-04-19 07:24:54.523521] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.526149] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 7762a019-8d54-48f5-a13b-88bc285bf50f. (Possible split-brain) >[2016-04-19 07:24:54.526974] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f> (7762a019-8d54-48f5-a13b-88bc285bf50f) [No such file or directory] >[2016-04-19 07:24:54.527400] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f> (7762a019-8d54-48f5-a13b-88bc285bf50f) [No such file or directory] >[2016-04-19 07:24:54.533044] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f> (7762a019-8d54-48f5-a13b-88bc285bf50f) [No such file or directory] >[2016-04-19 07:24:54.533058] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f> (7762a019-8d54-48f5-a13b-88bc285bf50f) [No such file or directory] >[2016-04-19 07:24:54.533685] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:7762a019-8d54-48f5-a13b-88bc285bf50f>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:54.543155] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.544116] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda> (9abbb982-4a61-4339-a942-3b5120ecfbda) [No such file or directory] >[2016-04-19 07:24:54.544142] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda> (9abbb982-4a61-4339-a942-3b5120ecfbda) [No such file or directory] >[2016-04-19 07:24:54.545034] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9abbb982-4a61-4339-a942-3b5120ecfbda. (Possible split-brain) >[2016-04-19 07:24:54.546127] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda> (9abbb982-4a61-4339-a942-3b5120ecfbda) [No such file or directory] >[2016-04-19 07:24:54.546232] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda> (9abbb982-4a61-4339-a942-3b5120ecfbda) [No such file or directory] >[2016-04-19 07:24:54.547618] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda> (9abbb982-4a61-4339-a942-3b5120ecfbda) [No such file or directory] >[2016-04-19 07:24:54.547646] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda> (9abbb982-4a61-4339-a942-3b5120ecfbda) [No such file or directory] >[2016-04-19 07:24:54.547912] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.550521] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 9abbb982-4a61-4339-a942-3b5120ecfbda. (Possible split-brain) >[2016-04-19 07:24:54.551244] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda> (9abbb982-4a61-4339-a942-3b5120ecfbda) [No such file or directory] >[2016-04-19 07:24:54.551553] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda> (9abbb982-4a61-4339-a942-3b5120ecfbda) [No such file or directory] >[2016-04-19 07:24:54.554921] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda> (9abbb982-4a61-4339-a942-3b5120ecfbda) [No such file or directory] >[2016-04-19 07:24:54.555039] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda> (9abbb982-4a61-4339-a942-3b5120ecfbda) [No such file or directory] >[2016-04-19 07:24:54.555183] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:9abbb982-4a61-4339-a942-3b5120ecfbda>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:54.565470] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-14: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.566601] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3> (8503dff6-281c-4c57-8b09-314fdb09a9f3) [No such file or directory] >[2016-04-19 07:24:54.566615] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3> (8503dff6-281c-4c57-8b09-314fdb09a9f3) [No such file or directory] >[2016-04-19 07:24:54.569266] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8503dff6-281c-4c57-8b09-314fdb09a9f3. (Possible split-brain) >[2016-04-19 07:24:54.570498] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3> (8503dff6-281c-4c57-8b09-314fdb09a9f3) [No such file or directory] >[2016-04-19 07:24:54.570526] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3> (8503dff6-281c-4c57-8b09-314fdb09a9f3) [No such file or directory] >[2016-04-19 07:24:54.571930] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3> (8503dff6-281c-4c57-8b09-314fdb09a9f3) [No such file or directory] >[2016-04-19 07:24:54.572063] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3> (8503dff6-281c-4c57-8b09-314fdb09a9f3) [No such file or directory] >[2016-04-19 07:24:54.572304] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3>: failed to lookup the file on tiervolume-hot-dht [Stale file handle] >[2016-04-19 07:24:54.574921] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 8503dff6-281c-4c57-8b09-314fdb09a9f3. (Possible split-brain) >[2016-04-19 07:24:54.576197] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3> (8503dff6-281c-4c57-8b09-314fdb09a9f3) [No such file or directory] >[2016-04-19 07:24:54.576225] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3> (8503dff6-281c-4c57-8b09-314fdb09a9f3) [No such file or directory] >[2016-04-19 07:24:54.579894] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3> (8503dff6-281c-4c57-8b09-314fdb09a9f3) [No such file or directory] >[2016-04-19 07:24:54.580742] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-14: remote operation failed. Path: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3> (8503dff6-281c-4c57-8b09-314fdb09a9f3) [No such file or directory] >[2016-04-19 07:24:54.581397] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:8503dff6-281c-4c57-8b09-314fdb09a9f3>: failed to lookup the file on tiervolume-tier-dht [Stale file handle] >[2016-04-19 07:24:54.591150] W [MSGID: 114031] [client-rpc-fops.c:531:client3_3_stat_cbk] 0-tiervolume-client-12: remote operation failed [No such file or directory] >[2016-04-19 07:24:54.591886] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c> (10adb0c9-c6b8-440a-aaac-a95645be587c) [No such file or directory] >[2016-04-19 07:24:54.592230] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c> (10adb0c9-c6b8-440a-aaac-a95645be587c) [No such file or directory] >[2016-04-19 07:24:54.593135] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 10adb0c9-c6b8-440a-aaac-a95645be587c. (Possible split-brain) >[2016-04-19 07:24:54.594184] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c> (10adb0c9-c6b8-440a-aaac-a95645be587c) [No such file or directory] >[2016-04-19 07:24:54.594272] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c> (10adb0c9-c6b8-440a-aaac-a95645be587c) [No such file or directory] >[2016-04-19 07:24:54.595459] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c> (10adb0c9-c6b8-440a-aaac-a95645be587c) [No such file or directory] >[2016-04-19 07:24:54.595754] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c> (10adb0c9-c6b8-440a-aaac-a95645be587c) [No such file or directory] >[2016-04-19 07:24:54.596265] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-hot-dht: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c>: failed to lookup the file on tiervolume-hot-dht [No such file or directory] >[2016-04-19 07:24:54.598750] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-1: Unreadable subvolume -1 found with event generation 2 for gfid 10adb0c9-c6b8-440a-aaac-a95645be587c. (Possible split-brain) >[2016-04-19 07:24:54.599679] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c> (10adb0c9-c6b8-440a-aaac-a95645be587c) [No such file or directory] >[2016-04-19 07:24:54.599957] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c> (10adb0c9-c6b8-440a-aaac-a95645be587c) [No such file or directory] >[2016-04-19 07:24:54.603050] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-12: remote operation failed. Path: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c> (10adb0c9-c6b8-440a-aaac-a95645be587c) [No such file or directory] >[2016-04-19 07:24:54.603433] W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-13: remote operation failed. Path: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c> (10adb0c9-c6b8-440a-aaac-a95645be587c) [No such file or directory] >[2016-04-19 07:24:54.603578] E [MSGID: 109040] [dht-helper.c:1179:dht_migration_complete_check_task] 0-tiervolume-tier-dht: <gfid:10adb0c9-c6b8-440a-aaac-a95645be587c>: failed to lookup the file on tiervolume-tier-dht [No such file or directory] >[2016-04-19 07:24:35.365449] W [MSGID: 108008] [afr-read-txn.c:250:afr_read_txn] 0-tiervolume-replicate-0: Unreadable subvolume -1 found with event generation 2 for gfid 0915d529-b94c-4a0a-af1c-d56dfac38a5d. (Possible split-brain) >The message "W [MSGID: 114031] [client-rpc-fops.c:2974:client3_3_lookup_cbk] 0-tiervolume-client-15: remote operation failed. Path: <gfid:0915d529-b94c-4a0a-af1c-d56dfac38a5d> (0915d529-b94c-4a0a-af1c-d56dfac38a5d) [No such file or directory]" repeated 4 times between [2016-04-19 07:24:35.356087] and [2016-04-19 07:24:35.369055]
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1328581
: 1148711