Bug 761953 (GLUSTER-221) - stat prefetch implementation
Summary: stat prefetch implementation
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: GLUSTER-221
Product: GlusterFS
Classification: Community
Component: stat-prefetch
Version: mainline
Hardware: All
OS: Linux
low
low
Target Milestone: ---
Assignee: Raghavendra G
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2009-08-18 08:35 UTC by Raghavendra G
Modified: 2015-12-01 16:45 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:
Regression: ---
Mount Type: ---
Documentation: DNR
CRM:
Verified Versions:


Attachments (Terms of Use)

Description Raghavendra G 2009-08-18 08:35:47 UTC
This bug tracks implementation of stat-prefetch translator.

Comment 1 Raghavendra G 2009-08-24 01:08:34 UTC
An initial patchset has been sent for reviewing

Comment 2 Anand Avati 2009-09-08 05:40:57 UTC
PATCH: http://patches.gluster.com/patch/1071 in master (rewriting stat-prefetch translator)

Comment 3 Anand Avati 2009-09-08 05:41:00 UTC
PATCH: http://patches.gluster.com/patch/1167 in master (performance/stat-prefetch: implement sp_lookup.)

Comment 4 Anand Avati 2009-09-08 05:41:04 UTC
PATCH: http://patches.gluster.com/patch/1073 in master (performance/stat-prefetch: implement sp_readdir.)

Comment 5 Anand Avati 2009-09-08 05:41:07 UTC
PATCH: http://patches.gluster.com/patch/1074 in master (performance/stat-prefetch: implement sp_chmod.)

Comment 6 Anand Avati 2009-09-08 05:41:11 UTC
PATCH: http://patches.gluster.com/patch/1168 in master (performance/stat-prefetch: introduce sp_fd_ctx_t to hold context of fds)

Comment 7 Anand Avati 2009-09-08 05:41:14 UTC
PATCH: http://patches.gluster.com/patch/1076 in master (stat/prefetch: free cache if it cannot be put into context of fd)

Comment 8 Anand Avati 2009-09-08 05:41:18 UTC
PATCH: http://patches.gluster.com/patch/1077 in master (common-utils: introduce new macro GF_VALIDATE_OR_GOTO_WITH_ERROR)

Comment 9 Anand Avati 2009-09-08 05:41:21 UTC
PATCH: http://patches.gluster.com/patch/1078 in master (performance/stat-prefetch: implement sp_open.)

Comment 10 Anand Avati 2009-09-08 05:41:25 UTC
PATCH: http://patches.gluster.com/patch/1079 in master (performance/stat-prefetch: implement sp_create.)

Comment 11 Anand Avati 2009-09-08 05:41:28 UTC
PATCH: http://patches.gluster.com/patch/1080 in master (performance/stat-prefetch: implement sp_opendir.)

Comment 12 Anand Avati 2009-09-08 05:41:32 UTC
PATCH: http://patches.gluster.com/patch/1081 in master (performance/stat-prefetch: implement sp_mkdir.)

Comment 13 Anand Avati 2009-09-08 05:41:35 UTC
PATCH: http://patches.gluster.com/patch/1082 in master (performance/stat-prefetch: implement sp_mknod.)

Comment 14 Anand Avati 2009-09-08 05:41:39 UTC
PATCH: http://patches.gluster.com/patch/1083 in master (performance/stat-prefetch: implement sp_symlink.)

Comment 15 Anand Avati 2009-09-08 05:41:42 UTC
PATCH: http://patches.gluster.com/patch/1084 in master (performance/stat-prefetch: implement sp_link.)

Comment 16 Anand Avati 2009-09-08 05:41:46 UTC
PATCH: http://patches.gluster.com/patch/1085 in master (performance/stat-prefetch: implement sp_fchmod.)

Comment 17 Anand Avati 2009-09-08 05:41:49 UTC
PATCH: http://patches.gluster.com/patch/1086 in master (performance/stat-prefetch: implement sp_chown.)

Comment 18 Anand Avati 2009-09-08 05:41:53 UTC
PATCH: http://patches.gluster.com/patch/1087 in master (performance/stat-prefetch: implement sp_fchown.)

Comment 19 Anand Avati 2009-09-08 05:41:56 UTC
PATCH: http://patches.gluster.com/patch/1088 in master (performance/stat-prefetch: implement sp_truncate.)

Comment 20 Anand Avati 2009-09-08 05:42:00 UTC
PATCH: http://patches.gluster.com/patch/1089 in master (performance/stat-prefetch: implement sp_ftruncate.)

Comment 21 Anand Avati 2009-09-08 05:42:03 UTC
PATCH: http://patches.gluster.com/patch/1090 in master (performance/stat-prefetch: implement sp_utimens.)

Comment 22 Anand Avati 2009-09-08 05:42:07 UTC
PATCH: http://patches.gluster.com/patch/1091 in master (performance/stat-prefetch: implement sp_readlink.)

Comment 23 Anand Avati 2009-09-08 05:42:10 UTC
PATCH: http://patches.gluster.com/patch/1092 in master (performance/stat-prefetch: implement sp_unlink.)

Comment 24 Anand Avati 2009-09-08 05:42:14 UTC
PATCH: http://patches.gluster.com/patch/1093 in master (performance/stat-prefetch: implement sp_rmdir.)

Comment 25 Anand Avati 2009-09-08 05:42:17 UTC
PATCH: http://patches.gluster.com/patch/1094 in master (performance/stat-prefetch: implement sp_readv.)

Comment 26 Anand Avati 2009-09-08 05:42:21 UTC
PATCH: http://patches.gluster.com/patch/1095 in master (performance/stat-prefetch: implement sp_writev.)

Comment 27 Anand Avati 2009-09-08 05:42:24 UTC
PATCH: http://patches.gluster.com/patch/1096 in master (performance/stat-prefetch: implement sp_fsync.)

Comment 28 Anand Avati 2009-09-08 05:42:28 UTC
PATCH: http://patches.gluster.com/patch/1097 in master (performance/stat-prefetch: implement sp_rename.)

Comment 29 Anand Avati 2009-09-08 05:42:32 UTC
PATCH: http://patches.gluster.com/patch/1098 in master (performance/stat-prefetch: implement sp_setxattr.)

Comment 30 Anand Avati 2009-09-08 05:42:35 UTC
PATCH: http://patches.gluster.com/patch/1099 in master (performance/stat-prefetch: implement sp_removexattr.)

Comment 31 Anand Avati 2009-09-08 05:42:39 UTC
PATCH: http://patches.gluster.com/patch/1100 in master (performance/stat-prefetch: implement sp_setdents.)

Comment 32 Anand Avati 2009-09-08 05:42:42 UTC
PATCH: http://patches.gluster.com/patch/1101 in master (performance/stat-prefetch: flush stat corresponding to directory being read in readdir)

Comment 33 Anand Avati 2009-09-08 05:42:46 UTC
PATCH: http://patches.gluster.com/patch/1102 in master (performance/stat-prefetch: implement sp_getdents.)

Comment 34 Anand Avati 2009-09-08 05:42:49 UTC
PATCH: http://patches.gluster.com/patch/1103 in master (performance/stat-prefetch: implement sp_checksum.)

Comment 35 Anand Avati 2009-09-08 05:42:53 UTC
PATCH: http://patches.gluster.com/patch/1104 in master (performance/stat-prefetch: implement sp_xattrop.)

Comment 36 Anand Avati 2009-09-08 05:42:57 UTC
PATCH: http://patches.gluster.com/patch/1105 in master (performance/stat-prefetch: implement sp_fxattrop.)

Comment 37 Anand Avati 2009-09-08 05:43:00 UTC
PATCH: http://patches.gluster.com/patch/1106 in master (performance/stat-prefetch: implement release callbacks.)

Comment 38 Anand Avati 2009-09-08 05:43:04 UTC
PATCH: http://patches.gluster.com/patch/1107 in master (storage/posix: handle dentries from different mount points in readdir)

Comment 39 Anand Avati 2009-09-08 05:43:07 UTC
PATCH: http://patches.gluster.com/patch/1108 in master (performance/stat-prefetch: update design document.)

Comment 40 Anand Avati 2009-09-08 05:43:12 UTC
PATCH: http://patches.gluster.com/patch/1109 in master (performance/stat-prefetch: minor bug-fixes.)

Comment 41 Anand Avati 2009-09-08 05:43:15 UTC
PATCH: http://patches.gluster.com/patch/1110 in master (performance/stat-prefetch: don't check for a non-null parent and inode in newloc during rename.)

Comment 42 Raghavendra G 2009-10-08 08:35:38 UTC
Following issues needs to be fixed:
1. Performance issues (Ref bug-284) 
http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=284
2. memory leaks.

Comment 43 Anand Avati 2009-10-09 04:48:14 UTC
PATCH: http://patches.gluster.com/patch/1797 in master (performance/stat-prefetch: fix memory leaks)

Comment 44 Anand Avati 2009-10-09 04:48:18 UTC
PATCH: http://patches.gluster.com/patch/1798 in master (performance/stat-prefetch: change the cache to use rbtree based hashtable instead of list for caching dentries.)

Comment 45 Anand Avati 2009-10-09 04:48:22 UTC
PATCH: http://patches.gluster.com/patch/1799 in master (performance/stat-prefetch: change behaviour of sp_lookup when xattr_req is not NULL.)

Comment 46 Anand Avati 2009-10-09 04:48:26 UTC
PATCH: http://patches.gluster.com/patch/1800 in master (performance/stat-prefetch: Add accounting of cache hits and misses.)

Comment 47 Anand Avati 2009-10-09 04:48:29 UTC
PATCH: http://patches.gluster.com/patch/1801 in master (performance/stat-prefetch: optimizations to sp_lookup.)

Comment 48 Anand Avati 2009-10-09 04:48:33 UTC
PATCH: http://patches.gluster.com/patch/1802 in master (performance/stat-prefetch: remove lookup-behind in sp_lookup.)

Comment 49 Anand Avati 2009-10-09 04:48:37 UTC
PATCH: http://patches.gluster.com/patch/1803 in master (performance/stat-prefetch: Add support code to implement lookup-behind.)

Comment 50 Anand Avati 2009-10-09 04:48:40 UTC
PATCH: http://patches.gluster.com/patch/1805 in master (performance/stat-prefetch: use op_errno instead of errno to store error code.)

Comment 51 Anand Avati 2009-10-09 04:48:44 UTC
PATCH: http://patches.gluster.com/patch/1804 in master (performance/stat-prefetch: implement procedure sp_process_inode_ctx.)

Comment 52 Anand Avati 2009-10-09 04:48:48 UTC
PATCH: http://patches.gluster.com/patch/1806 in master (performance/stat-prefetch: lookup the path in open if it is not already looked up.)

Comment 53 Anand Avati 2009-10-09 04:48:51 UTC
PATCH: http://patches.gluster.com/patch/1807 in master (performance/stat-prefetch: lookup path in checksum if it is not already looked up.)

Comment 54 Anand Avati 2009-10-09 04:48:55 UTC
PATCH: http://patches.gluster.com/patch/1808 in master (performance/stat-prefetch: implement sp_stat.)

Comment 55 Anand Avati 2009-10-09 04:48:59 UTC
PATCH: http://patches.gluster.com/patch/1809 in master (performance/stat-prefetch: lookup path in setattr if it is not already looked up.)

Comment 56 Anand Avati 2009-10-09 04:49:03 UTC
PATCH: http://patches.gluster.com/patch/1810 in master (performance/stat-prefetch: lookup path in truncate if it is not already looked up.)

Comment 57 Anand Avati 2009-10-09 04:49:06 UTC
PATCH: http://patches.gluster.com/patch/1812 in master (performance/stat-prefetch: implement sp_access)

Comment 58 Anand Avati 2009-10-09 04:49:11 UTC
PATCH: http://patches.gluster.com/patch/1811 in master (peformance/stat-prefetch: lookup path in readlink if it is not already looked up.)

Comment 59 Anand Avati 2009-10-09 04:49:14 UTC
PATCH: http://patches.gluster.com/patch/1813 in master (performance/stat-prefetch: lookup path in mknod if it is not already looked up.)

Comment 60 Anand Avati 2009-10-09 04:49:18 UTC
PATCH: http://patches.gluster.com/patch/1814 in master (performance/stat-prefetch: lookup path in mkdir if it is not already looked up.)

Comment 61 Anand Avati 2009-10-09 04:49:22 UTC
PATCH: http://patches.gluster.com/patch/1815 in master (performance/stat-prefetch: fix mkdir to unwind with proper number of arguments.)

Comment 62 Anand Avati 2009-10-09 04:49:25 UTC
PATCH: http://patches.gluster.com/patch/1816 in master (performance/stat-prefetch: lookup path in unlink if it is not already looked up.)

Comment 63 Anand Avati 2009-10-09 04:49:29 UTC
PATCH: http://patches.gluster.com/patch/1817 in master (performance/stat-prefetch: lookup path in rmdir if it is not already looked up.)

Comment 64 Anand Avati 2009-10-09 04:49:33 UTC
PATCH: http://patches.gluster.com/patch/1818 in master (performance/stat-prefetch: lookup path in symlink if it is not already looked up.)

Comment 65 Anand Avati 2009-10-09 04:49:37 UTC
PATCH: http://patches.gluster.com/patch/1819 in master (performance/stat-prefetch: lookup oldpath and newpath in rename if they've not already been looked up.)

Comment 66 Anand Avati 2009-10-09 04:49:40 UTC
PATCH: http://patches.gluster.com/patch/1820 in master (performance/stat-prefetch: lookup oldloc->path in link if it has not already been looked up.)

Comment 67 Anand Avati 2009-10-09 04:49:44 UTC
PATCH: http://patches.gluster.com/patch/1821 in master (performance/stat-prefetch: remove stat corresponding to oldloc->path from cache in sp_link.)

Comment 68 Anand Avati 2009-10-09 04:49:47 UTC
PATCH: http://patches.gluster.com/patch/1822 in master (performance/stat-prefetch: lookup path in create if it is not already looked up.)

Comment 69 Anand Avati 2009-10-09 04:49:51 UTC
PATCH: http://patches.gluster.com/patch/1824 in master (performance/stat-prefetch: lookup path in opendir if it is not already looked up.)

Comment 70 Anand Avati 2009-10-09 04:49:55 UTC
PATCH: http://patches.gluster.com/patch/1823 in master (performance/stat-prefetch: lookup path in setxattr if it is not already looked up.)

Comment 71 Anand Avati 2009-10-09 04:49:59 UTC
PATCH: http://patches.gluster.com/patch/1825 in master (performance/stat-prefetch: implement sp_getxattr.)

Comment 72 Anand Avati 2009-10-09 04:50:02 UTC
PATCH: http://patches.gluster.com/patch/1826 in master (performance/stat-prefetch: lookup path in removexattr if it is not already looked up.)

Comment 73 Anand Avati 2009-10-09 04:50:06 UTC
PATCH: http://patches.gluster.com/patch/1827 in master (performance/stat-prefetch: implement sp_inodelk.)

Comment 74 Anand Avati 2009-10-09 04:50:10 UTC
PATCH: http://patches.gluster.com/patch/1828 in master (performance/stat-prefetch: implement sp_entrylk.)

Comment 75 Anand Avati 2009-10-09 04:50:13 UTC
PATCH: http://patches.gluster.com/patch/1829 in master (performance/stat-prefetch: lookup path in xattrop if it is not already looked up.)

Comment 76 Anand Avati 2009-10-09 04:50:17 UTC
PATCH: http://patches.gluster.com/patch/1830 in master (performance/stat-prefetch: checking for cache and creation if not present is made atomic.)

Comment 77 Anand Avati 2009-11-26 16:30:01 UTC
PATCH: http://patches.gluster.com/patch/2398 in master (performance/stat-prefetch: Changed rbthash to make use of 1 bucket)

Comment 78 Anand Avati 2009-12-01 10:45:47 UTC
PATCH: http://patches.gluster.com/patch/2444 in master (performance/stat-prefetch: fix errors in handling memory allocation failures in sp_inode_ctx_process.)

Comment 79 Anand Avati 2009-12-01 10:45:51 UTC
PATCH: http://patches.gluster.com/patch/2445 in master (performance/stat-prefetch: don't use same variable for getting inode context of an inode and its parent.)

Comment 80 Anand Avati 2009-12-01 10:45:55 UTC
PATCH: http://patches.gluster.com/patch/2446 in master (performance/stat-prefetch: make lookup to wait for the completion of another lookup on same path if one is in progress.)

Comment 81 Anand Avati 2009-12-02 16:00:06 UTC
PATCH: http://patches.gluster.com/patch/2490 in release-2.0 (Add support in rbthash to make use of user provided mempool.)

Comment 82 Anand Avati 2009-12-04 06:46:29 UTC
PATCH: http://patches.gluster.com/patch/2543 in master (performance/stat-prefetch: dont check for inode context in fops like create, mkdir.)

Comment 83 Anand Avati 2009-12-04 06:46:33 UTC
PATCH: http://patches.gluster.com/patch/2544 in master (performance/stat-prefetch: refactor sp_lookup_cbk to use sp_update_inode_ctx.)

Comment 84 Anand Avati 2009-12-04 06:46:37 UTC
PATCH: http://patches.gluster.com/patch/2545 in master (performance/stat-prefetch: implement sp_check_and_create_inode_ctx.)

Comment 85 Anand Avati 2009-12-04 06:46:41 UTC
PATCH: http://patches.gluster.com/patch/2546 in master (performance/stat-prefetch: add "caller" arguement to sp_process_inode_ctx.)

Comment 86 Anand Avati 2009-12-06 07:30:27 UTC
PATCH: http://patches.gluster.com/patch/2578 in master (performance/stat-prefetch: remove the usage of THIS.)

Comment 87 Anand Avati 2011-01-07 22:43:54 UTC
PATCH: http://patches.gluster.com/patch/5958 in master (check the value of op_ret pointer not the address)


Note You need to log in before you can comment on or make changes to this bug.