Bug 1469355

Summary: RGW : Crashed when system user was used for swift DLO operations
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Vasishta <vashastr>
Component: RGWAssignee: Matt Benjamin (redhat) <mbenjamin>
Status: CLOSED CURRENTRELEASE QA Contact: ceph-qe-bugs <ceph-qe-bugs>
Severity: urgent Docs Contact: Erin Donnelly <edonnell>
Priority: unspecified    
Version: 2.3CC: anharris, cbodley, ceph-eng-bugs, edonnell, hnallurv, kbader, khartsoe, mbenjamin, owasserm, sweil, vashastr
Target Milestone: rc   
Target Release: 3.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Known Issue
Doc Text:
.Ceph Object Gateway crashes with Swift DLO operations The Ceph Object Gateway crashes when a system user attempts Swift DLO operations.
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-07-18 14:59:04 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1437916    
Attachments:
Description Flags
Contains RGW crash log snippet, secondary zone log snippet, terminal operations log snippet none

Description Vasishta 2017-07-11 05:38:46 UTC
Created attachment 1296081 [details]
Contains RGW crash log snippet, secondary zone log snippet, terminal operations log snippet

Description of problem:
RGW crashed when a system user was used for swift DLO operation. The same user was used for s3 operations previously. The crash repeated again till a new user was created. Swift DLO operations worked fine with new users and resulted in error when tried again with the system user.

Version-Release number of selected component (if applicable):
ceph version 10.2.7-30redhat1xenial

How reproducible:
1/1

Steps to Reproduce:
1. Create a system user for RGW.
2. Perform swift DLO to upload a large file.

Actual results:

(Crash log snippet)
11: (RGWHTTPArgs::sys_get(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, bool*)+0x4c) [0x7fa954ecc47c]
 12: (RGWHandler_REST_SWIFT::authorize()+0x1b5) [0x7fa9550e8075]

-- (Error message after creating couple of users) --

('Connection aborted.', BadStatusLine("''",))

Expected results:
RGW shouldn't crash

Additional info:
Based on mail conversation I've set severity as 'urgent'. I'll try to reproduce the issue with higher log levels and update.

Comment 4 Vasishta 2017-07-11 07:21:34 UTC
Hi Matt,

I have tried basic swift DLO operations (upload & download) with non-system user and it had worked fine for me.
I restarted RGW service after it crashed because of using system user, and tried with ordinary user, which worked as expected.

Regards,
Vasishta