Bug 1764171

Summary: [Upgrade] Config files are not upgraded to new version
Product: [Community] GlusterFS Reporter: Kotresh HR <khiremat>
Component: geo-replicationAssignee: Kotresh HR <khiremat>
Status: CLOSED NEXTRELEASE QA Contact:
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 6CC: avishwan, bugs, sacharya
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1707731 Environment:
Last Closed: 2019-10-23 04:07:32 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1707731    
Bug Blocks: 1708064, 1764003    

Description Kotresh HR 2019-10-22 12:22:34 UTC
+++ This bug was initially created as a clone of Bug #1707731 +++

Description of problem:

Configuration handling was enhanced with patch https://review.gluster.org/#/c/glusterfs/+/18257/, Old configurations are not applied if Geo-rep session is created in the old version and upgraded.

Actual results:

All configurations reset when upgraded.


Expected results:

Configuration should be upgraded to the new format when Geo-replication is run for the first time after the upgrade.

--- Additional comment from Aravinda VK on 2019-05-17 06:53:49 UTC ---

## Reading Old format:

Config file consists of a section named "__section_order__", read that to get the order of different section. Sort the section based on order(based on values), and prepare a dict with values updated from each section.

For example:

```
[__section_order__]
sec1=0
sec2=2
sec3=1

[sec1]
log_level = INFO

[sec2]
log_level = DEBUG

[sec3]
log_level = ERROR
```

configs = {}
for sec in sorded_sections():
    for item_key, item_value in sec.items:
        configs[item_key] = item_value

With this logic, `log_level` will have final value "DEBUG"


## Upgrade:

During Geo-rep start(In gsyncd.py):

- Read the session config and see it is a new format or old
- If it is old format, read the config as explained above
- Compare the configs collected and write to new config only if it is different from Default configs
- Reload the new config

To get the old format config,

- Install old version of Glusterfs(<4) and create a geo-rep session.
- Set some configurations in Geo-rep
- Copy the config file for reference
- Old parsing code can be referred here https://github.com/gluster/glusterfs/blob/release-3.13/geo-replication/syncdaemon/configinterface.py

--- Additional comment from Worker Ant on 2019-06-18 16:40:34 UTC ---

REVIEW: https://review.gluster.org/22894 (geo-rep: Upgrading config file to new version) posted (#1) for review on master by Shwetha K Acharya

--- Additional comment from Worker Ant on 2019-06-26 14:11:35 UTC ---

REVIEW: https://review.gluster.org/22894 (geo-rep: Upgrading config file to new version) merged (#7) on master by Sunny Kumar

--- Additional comment from Worker Ant on 2019-07-03 06:50:15 UTC ---

REVIEW: https://review.gluster.org/22982 (geo-rep: Test case for upgrading config file) posted (#1) for review on master by Shwetha K Acharya

--- Additional comment from Worker Ant on 2019-07-22 06:45:56 UTC ---

REVIEW: https://review.gluster.org/22982 (geo-rep: Test case for upgrading config file) merged (#5) on master by Sunny Kumar

Comment 1 Worker Ant 2019-10-22 12:52:50 UTC
REVIEW: https://review.gluster.org/23591 (geo-rep: Upgrading config file to new version) posted (#1) for review on release-6 by Kotresh HR

Comment 2 Worker Ant 2019-10-22 12:53:59 UTC
REVIEW: https://review.gluster.org/23593 (geo-rep: Test case for upgrading config file) posted (#1) for review on release-6 by Kotresh HR

Comment 3 Worker Ant 2019-10-23 04:06:24 UTC
REVIEW: https://review.gluster.org/23591 (geo-rep: Upgrading config file to new version) merged (#1) on release-6 by Kotresh HR

Comment 4 Worker Ant 2019-10-23 04:07:32 UTC
REVIEW: https://review.gluster.org/23593 (geo-rep: Test case for upgrading config file) merged (#1) on release-6 by Kotresh HR