Bug 1488478 - EC uploads of 1mb file result in 86mb on the storage nodes in deepfreeze EC policy
Summary: EC uploads of 1mb file result in 86mb on the storage nodes in deepfreeze EC p...
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-swift
Version: 12.0 (Pike)
Hardware: x86_64
OS: Linux
medium
medium
Target Milestone: ---
: 12.0 (Pike)
Assignee: Thiago da Silva
QA Contact: Mike Abrams
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2017-09-05 13:32 UTC by Mike Abrams
Modified: 2017-09-25 08:49 UTC (History)
7 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-09-25 08:49:35 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)

Description Mike Abrams 2017-09-05 13:32:53 UTC
Description of problem:
EC uploads of 1mb file result in 80+ mb on the storage nodes in deepfreeze EC policy

Version-Release number of selected component (if applicable):
(overcloud) [stack@undercloud-0 ~]$ rpm -qa python-swift
python-swift-2.15.1-0.20170808011400.7b2faca.el7ost.noarch
(overcloud) [stack@undercloud-0 ~]$ 

How reproducible:
always

Steps to Reproduce:
1. setup EC in /var/lib/config-data/puppet-generated/swift/etc/swift/swift.conf on each controller:
[swift-hash]
swift_hash_path_suffix = cf3guZZ8fPzHH2kYdHd8tydYJ

[swift-constraints]
max_header_size=8192


[storage-policy:0]
name = deepfreeze4-2
default = yes
ec_num_parity_fragments = 2
ec_object_segment_size = 1
ec_type =  liberasurecode_rs_vand
policy_type = erasure_coding
ec_num_data_fragments = 4

2. remakerings on one controller; copy resulting *.gz's to the other controllers and to the storage nodes
3. docker restart swift_proxy on all controllers
4. swift-init restart all on all storage nodes
5. source overcloudrc
6. dd if=/dev/zero of=testobj bs=1M count=1
7. swift post -H 'x-storage-policy:deepfreeze4-2' ec_cont
8. swift upload ec_cont testobj

Actual results:
storage nodes data files are 80+ mb in size

Expected results:
storage nodes data files should be aggregate size of 1mb.

Additional info:


Note You need to log in before you can comment on or make changes to this bug.