Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
This project is now read‑only. Starting Monday, February 2, please use https://ibm-ceph.atlassian.net/ for all bug tracking management.

Bug 1498280

Summary: RGWs quota stats simple fixes, esp. for multiple rgws.
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Marcus Watts <mwatts>
Component: RGWAssignee: Marcus Watts <mwatts>
Status: CLOSED ERRATA QA Contact: ceph-qe-bugs <ceph-qe-bugs>
Severity: medium Docs Contact: Bara Ancincova <bancinco>
Priority: medium    
Version: 2.4CC: cbodley, ceph-eng-bugs, gmeno, kbader, mbenjamin, mwatts, owasserm, sweil, tserlin, vakulkar
Target Milestone: rc   
Target Release: 2.4   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: RHEL: ceph-10.2.7-44.el7cp Ubuntu: ceph_10.2.7-44redhat1 Doc Type: Bug Fix
Doc Text:
.Bugs in the Ceph Object Gateway quota have been fixed An integer underflow in cached quota values in the Ceph Object Gateway server could allow users to exceed quota. In addition, a double counting error in the quota check for multipart uploads caused early enforcement for that operation when it was performed near the quota limit. This update fixes these two errors.
 Story Points: ---
Clone Of:
: 1498668 (view as bug list) Environment:
Last Closed: 2017-10-17 18:12:51 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1498668    
Bug Blocks: 1479701    

Description Marcus Watts 2017-10-03 20:57:21 UTC 
Description of problem:

There are various problems with quota stats in ceph 2.4 that were recently fixed in upstream jewel.  Two problems are,

a. quota underflow - where there are multiple rgws, it is possible to cause num_objects or bytes_used to underflow.  This may happen randomly when large numbers of objects are created or deleted behind a load balancer, and it can be caused deterministically when it's possible to talk directly to the separate rgws.

b. units double rounding issue.  This shouldn't cause any observable abnormalities, so is mainly a code cleanup issue.

There is a larger problem with quota consistency - which we won't be able to fix for 2.4.  So that is a documentation/support issue for now.

Depending on the results of testing, there may be other small fixable problems for 2.4 quota/stats; if so they should be added to this.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 6 Marcus Watts 2017-10-05 19:08:20 UTC 
There are 2 more tracker issue/PRs that that I believe should qualify as small fixes.

This one is straight-forward:
http://tracker.ceph.com/issues/21586
"RGW: Multipart upload may double the quota"
https://github.com/ceph/ceph/pull/17959

Looks like this one misses the window for the immediate future,
http://tracker.ceph.com/issues/21565
RGW: Multipart upload may failed when object size is large and near byte quota limit
https://github.com/ceph/ceph/pull/17960
https://github.com/ceph/ceph/pull/18123
issue for that is that people don't like parsing object names in the cls code...
Comment 15 errata-xmlrpc 2017-10-17 18:12:51 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:2903