Bug 1063606
Summary: | DHT: REBALANCE- spurious data movements upon starting rebalance | |||
---|---|---|---|---|
Product: | [Red Hat Storage] Red Hat Gluster Storage | Reporter: | shylesh <shmohan> | |
Component: | distribute | Assignee: | Nithya Balachandran <nbalacha> | |
Status: | CLOSED DEFERRED | QA Contact: | storage-qa-internal <storage-qa-internal> | |
Severity: | high | Docs Contact: | ||
Priority: | unspecified | |||
Version: | 2.1 | CC: | nlevinki, rwheeler, spalai, vbellur | |
Target Milestone: | --- | |||
Target Release: | --- | |||
Hardware: | x86_64 | |||
OS: | Linux | |||
Whiteboard: | ||||
Fixed In Version: | Doc Type: | Bug Fix | ||
Doc Text: | Story Points: | --- | ||
Clone Of: | ||||
: | 1286129 (view as bug list) | Environment: | ||
Last Closed: | 2015-11-27 11:40:33 UTC | Type: | Bug | |
Regression: | --- | Mount Type: | --- | |
Documentation: | --- | CRM: | ||
Verified Versions: | Category: | --- | ||
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
Cloudforms Team: | --- | Target Upstream Version: | ||
Embargoed: | ||||
Bug Depends On: | ||||
Bug Blocks: | 1286129 |
Description
shylesh
2014-02-11 06:31:31 UTC
From the debugging found that: Link File Creation is happening becase of not able to store the maximum overlap in a variable. if overlap range is from 0x00000000 to 0xffffffff, total length which is 0xffffffff + 1 can not be stored in uint32_t. Different rebalance process will set different layout, and ends up with link file creation. I could reproduce this bug easily on 50 node setup. Created a 46 brick distibute volume , created 100 files on the mount point touch f{1..100}, added 4 more bricks and did rebalance. log snippet =========== Node 1 ======= [2014-07-30 10:30:33.793257] I [dht-rebalance.c:672:dht_migrate_file] 0-newvol-dht: /f28: attempting to move from newvol-client-28 to newvol-client-4 [2014-07-30 10:30:33.820710] I [dht-rebalance.c:881:dht_migrate_file] 0-newvol-dht: completed migration of /f28 from subvolume newvol-client-28 to newvol-client-4 Node2 ===== [2014-07-30 10:30:32.425980] I [dht-rebalance.c:672:dht_migrate_file] 0-newvol-dht: /f28: attempting to move from newvol-client-29 to newvol-client-28 [2014-07-30 10:30:32.453402] I [dht-rebalance.c:881:dht_migrate_file] 0-newvol-dht: completed migration of /f28 from subvolume newvol-client-29 to newvol-client-28 Node2 migrated the file from client-29 to client-28 , again later Node1 migrated the same file from client-28 to client-4. Above log shows that file will be migrated again and again which has serious performance impact. Build used for the testing in comment4 is 3.4.0.59rhs-1.el6rhs.x86_64 Cloning this to 3.1. To be fixed in future. |