Description of problem:
==========================
When I create a new file, a link file is supposed to get created in the cold bricks it hashes to, and the data file in hot tier.

But what I observed is , the link file is getting created on all the bricks of a cold ec layer which is a distributed-disperse  ie 2x(6+2)
Following is my setup information
================================
I have created a dist-EC volume and had following IOs happen on it:
1)create a parent dir, in this dir create other dir, copy linux kernel, untart the kernel.
Again under the parent dir, create another dir, copy linux kernel, untart the kernel.  and so on in a loop of about 1000 so dir.1, dir.2.....dir.1000
2)With an hour lag or so, start to rename or move the dir.1 to rename_dir.1 and so on for all the dirs 

in total created about 100GB of data 

Kept this IO pumping for about a day
and then attached tier.

After attaching tier i changed the some values wrt watermarks and other(look at volinfo)

Now, I started to pump in more files creates and IOs,

Problem: even after 3 days, not a single file has got promoted or demoted

NOW, I CREATED A FILE IN ONE OF THE DIRs where the lookup /fixlayout should have been completed. When i created a file the data file was in hot tier as expected, but all the bricks in cold tier had link files which is not correct
===========================================================================

[root@rhsauto015 linux-4.3.3]# date
Wed Dec 30 12:01:05 IST 2015
[root@rhsauto015 linux-4.3.3]# ls
COPYING  CREDITS  Documentation
[root@rhsauto015 linux-4.3.3]# touch f1
[root@rhsauto015 linux-4.3.3]# pwd
/mnt/stress/kern.legacy/dir.1/linux-4.3.3




ZOD:
[root@zod stress-tier-dht]# ll /rhs/brick*/stress*/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick1/stress/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick2/stress/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick3/stress/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick4/stress/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick5/stress/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick6/stress/kern.legacy/dir.1/linux-4.3.3/f1
-rw-r--r--. 2 root root 0 Dec 30 12:01 /rhs/brick7/stress_hot/kern.legacy/dir.1/linux-4.3.3/f1



yarrow:
[root@yarrow stress-tier-dht]# ll /rhs/brick*/stress*/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick1/stress/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick2/stress/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick3/stress/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick4/stress/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick5/stress/kern.legacy/dir.1/linux-4.3.3/f1
---------T. 2 root root 0 Dec 30 17:33 /rhs/brick6/stress/kern.legacy/dir.1/linux-4.3.3/f1
-rw-r--r--. 2 root root 0 Dec 30 12:01 /rhs/brick7/stress_hot/kern.legacy/dir.1/linux-4.3.3/f1


=========
[root@zod ~]# gluster v info stress;gluster v status stress;gluster v rebal stress status;gluster v tier stress status
 
Volume Name: stress
Type: Tier
Volume ID: 67a53277-2e05-4240-b0fb-38728d7e1bcd
Status: Started
Number of Bricks: 16
Transport-type: tcp
Hot Tier :
Hot Tier Type : Distributed-Replicate
Number of Bricks: 2 x 2 = 4
Brick1: yarrow:/rhs/brick5/stress_hot
Brick2: zod:/rhs/brick5/stress_hot
Brick3: yarrow:/rhs/brick7/stress_hot
Brick4: zod:/rhs/brick7/stress_hot
Cold Tier:
Cold Tier Type : Distributed-Disperse
Number of Bricks: 2 x (4 + 2) = 12
Brick5: zod:/rhs/brick1/stress
Brick6: yarrow:/rhs/brick1/stress
Brick7: zod:/rhs/brick2/stress
Brick8: yarrow:/rhs/brick2/stress
Brick9: zod:/rhs/brick3/stress
Brick10: yarrow:/rhs/brick3/stress
Brick11: zod:/rhs/brick4/stress
Brick12: yarrow:/rhs/brick4/stress
Brick13: zod:/rhs/brick5/stress
Brick14: yarrow:/rhs/brick5/stress
Brick15: yarrow:/rhs/brick6/stress
Brick16: zod:/rhs/brick6/stress
Options Reconfigured:
diagnostics.client-log-level: INFO
cluster.tier-max-files: 100000000000
cluster.tier-max-mb: 10000000000
cluster.watermark-hi: 50
cluster.watermark-low: 15
features.quota-deem-statfs: on
features.inode-quota: on
features.quota: on
cluster.tier-mode: cache
features.ctr-enabled: on
performance.readdir-ahead: on
Status of volume: stress
Gluster process                             TCP Port  RDMA Port  Online  Pid
------------------------------------------------------------------------------
Hot Bricks:
Brick yarrow:/rhs/brick5/stress_hot         49163     0          Y       1877 
Brick zod:/rhs/brick5/stress_hot            49163     0          Y       11298
Brick yarrow:/rhs/brick7/stress_hot         49162     0          Y       1858 
Brick zod:/rhs/brick7/stress_hot            49162     0          Y       11279
Cold Bricks:
Brick zod:/rhs/brick1/stress                49156     0          Y       7639 
Brick yarrow:/rhs/brick1/stress             49156     0          Y       31165
Brick zod:/rhs/brick2/stress                49157     0          Y       7658 
Brick yarrow:/rhs/brick2/stress             49157     0          Y       31186
Brick zod:/rhs/brick3/stress                49158     0          Y       7677 
Brick yarrow:/rhs/brick3/stress             49158     0          Y       31209
Brick zod:/rhs/brick4/stress                49159     0          Y       7696 
Brick yarrow:/rhs/brick4/stress             49159     0          Y       31228
Brick zod:/rhs/brick5/stress                49160     0          Y       7715 
Brick yarrow:/rhs/brick5/stress             49160     0          Y       31247
Brick yarrow:/rhs/brick6/stress             49161     0          Y       31266
Brick zod:/rhs/brick6/stress                49161     0          Y       7734 
NFS Server on localhost                     2049      0          Y       22562
Self-heal Daemon on localhost               N/A       N/A        Y       22579
Quota Daemon on localhost                   N/A       N/A        Y       22587
NFS Server on yarrow                        2049      0          Y       30243
Self-heal Daemon on yarrow                  N/A       N/A        Y       30265
Quota Daemon on yarrow                      N/A       N/A        Y       30287
 
Task Status of Volume stress
------------------------------------------------------------------------------
Task                 : Tier migration      
ID                   : 47b3bd56-9d0e-4025-a84b-a21a6ab99d4e
Status               : in progress         
 
                                    Node Rebalanced-files          size       scanned      failures       skipped               status   run time in secs
                               ---------      -----------   -----------   -----------   -----------   -----------         ------------     --------------
                               localhost                0        0Bytes             0             0             0          in progress          195677.00
                                  yarrow                0        0Bytes             0             0             0          in progress          195671.00
volume rebalance: stress: success
Node                 Promoted files       Demoted files        Status              
---------            ---------            ---------            ---------           
localhost            0                    0                    in progress         
yarrow               0                    0                    in progress         
Tiering Migration Functionality: stress: success




Version-Release number of selected component (if applicable):
========================
3.7.5-13