Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.
Bug 1509266 - 3.0: Compression ratio is not as effective as source site at destination site
3.0: Compression ratio is not as effective as source site at destination site
Status: ASSIGNED
Product: Red Hat Ceph Storage
Classification: Red Hat
Component: RGW (Show other bugs)
3.0
Unspecified Unspecified
unspecified Severity medium
: rc
: 3.*
Assigned To: Casey Bodley
ceph-qe-bugs
Bara Ancincova
:
Depends On:
Blocks: 1494421
  Show dependency treegraph
 
Reported: 2017-11-03 08:42 EDT by Harish NV Rao
Modified: 2018-10-29 12:57 EDT (History)
5 users (show)

See Also:
Fixed In Version:
Doc Type: Known Issue
Doc Text:
.Compression ratio might not be the same on the destination site as on the source site When data synced from the source to destination site is compressed, the compression ratio on the destination site might not be the same as on the source site.
Story Points: ---
Clone Of:
Environment:
Last Closed:
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)


External Trackers
Tracker ID Priority Status Summary Last Updated
Ceph Project Bug Tracker 23547 None None None 2018-04-12 14:20 EDT

  None (edit)
Description Harish NV Rao 2017-11-03 08:42:31 EDT
Description of problem:

Data synced from source to destination is compressed but compression ratio is not as effective as source site.

Build : ceph version 12.2.1-37.el7cp (c16105a12f94b5e65d175d620d8d548055c8d490) luminous (stable)

Steps followed:
*Enabled "zlib" compression on both sites.
*Written 1 bucket with 1 object in source site.Data is compressed.
*Checked the data in destination site. Data is synced and compressed but it was not effective as source site.

Summary:
Primary to Secondary -> original size in Kb :58924
                        Compressed size in local in Kb : 2684,
                        Synced n compressed size in remote in Kb :3802,

Secondary to Primary -> original size in Kb :58924
                        Compressed size in local in Kb : 2684,
                        Synced n compressed size in remote in Kb :3802,


Primary to secondary

Primary site - Written

[root@aircobra ~]# radosgw-admin bucket stats --bucket test1_0 --cluster primary
{
    "bucket": "test1_0",
    "zonegroup": "aa2114c4-e96f-48b0-a023-825239368582",
    "placement_rule": "default-placement",
    "explicit_placement": {
        "data_pool": "",
        "data_extra_pool": "",
        "index_pool": ""
    },
    "id": "bf0750fa-3531-4110-a224-2df15c2c445f.204098.116",
    "marker": "bf0750fa-3531-4110-a224-2df15c2c445f.204098.116",
    "index_type": "Normal",
    "owner": "synchronization-user",
    "ver": "0#3",
    "master_ver": "0#0",
    "mtime": "2017-11-03 16:22:40.836903",
    "max_marker": "0#00000000002.2343.5",
    "usage": {
        "rgw.main": {
            "size": 60335136,
            "size_actual": 60338176,
            "size_utilized": 2747804,
            "size_kb": 58922,
            "size_kb_actual": 58924,
            "size_kb_utilized": 2684,
            "num_objects": 1
        }
    },
    "bucket_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    }
}
[root@aircobra ~]# 


Secondary site synced

[root@fortress ~]# radosgw-admin bucket stats --bucket test1_0 --cluster secondary
{
   {
    "bucket": "test1_0",
    "zonegroup": "aa2114c4-e96f-48b0-a023-825239368582",
    "placement_rule": "default-placement",
    "explicit_placement": {
        "data_pool": "",
        "data_extra_pool": "",
        "index_pool": ""
    },
    "id": "bf0750fa-3531-4110-a224-2df15c2c445f.204098.116",
    "marker": "bf0750fa-3531-4110-a224-2df15c2c445f.204098.116",
    "index_type": "Normal",
    "owner": "synchronization-user",
    "ver": "0#3",
    "master_ver": "0#0",
    "mtime": "2017-11-03 16:22:40.836903",
    "max_marker": "0#00000000002.2431.1",
    "usage": {
        "rgw.main": {
            "size": 60335136,
            "size_actual": 60338176,
            "size_utilized": 3893016,
            "size_kb": 58922,
            "size_kb_actual": 58924,
            "size_kb_utilized": 3802,
            "num_objects": 1
        }
    },
    "bucket_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    }
}

Secondary to primary
Secondary site - written
[root@fortress ~]# radosgw-admin bucket stats --bucket test2_0 --cluster secondary
{
    "bucket": "test2_0",
    "zonegroup": "aa2114c4-e96f-48b0-a023-825239368582",
    "placement_rule": "default-placement",
    "explicit_placement": {
        "data_pool": "",
        "data_extra_pool": "",
        "index_pool": ""
    },
    "id": "bf0750fa-3531-4110-a224-2df15c2c445f.204098.117",
    "marker": "bf0750fa-3531-4110-a224-2df15c2c445f.204098.117",
    "index_type": "Normal",
    "owner": "synchronization-user",
    "ver": "0#3",
    "master_ver": "0#0",
    "mtime": "2017-11-03 16:35:37.268944",
    "max_marker": "0#00000000002.2277.1",
    "usage": {
        "rgw.main": {
            "size": 60335136,
            "size_actual": 60338176,
            "size_utilized": 2747804,
            "size_kb": 58922,
            "size_kb_actual": 58924,
            "size_kb_utilized": 2684,
            "num_objects": 1
        }
    },
    "bucket_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    }
}

Primary site synced
[root@aircobra ~]# radosgw-admin bucket stats --bucket test2_0 --cluster primary
{
    "bucket": "test2_0",
    "zonegroup": "aa2114c4-e96f-48b0-a023-825239368582",
    "placement_rule": "default-placement",
    "explicit_placement": {
        "data_pool": "",
        "data_extra_pool": "",
        "index_pool": ""
    },
    "id": "bf0750fa-3531-4110-a224-2df15c2c445f.204098.117",
    "marker": "bf0750fa-3531-4110-a224-2df15c2c445f.204098.117",
    "index_type": "Normal",
    "owner": "synchronization-user",
    "ver": "0#3",
    "master_ver": "0#0",
    "mtime": "2017-11-03 16:35:37.268944",
    "max_marker": "0#00000000002.2203.5",
    "usage": {
        "rgw.main": {
            "size": 60335136,
            "size_actual": 60338176,
            "size_utilized": 3893016,
            "size_kb": 58922,
            "size_kb_actual": 58924,
            "size_kb_utilized": 3802,
            "num_objects": 1
        }
    },
    "bucket_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    }
}
[root@aircobra ~]#

Note You need to log in before you can comment on or make changes to this bug.