Bug 1388578

Summary: RGW Sync Agent should work through load balancers
Product: Red Hat Ceph Storage Reporter: Michael J. Kidd <linuxkidd>
Component: RGWAssignee: Orit Wasserman <owasserm>
Status: CLOSED WONTFIX QA Contact: ceph-qe-bugs <ceph-qe-bugs>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 1.3.3CC: anharris, cbodley, ceph-eng-bugs, hnallurv, kbader, linuxkidd, mbenjamin, owasserm, sweil, uboppana, vumrao
Target Milestone: rc   
Target Release: 1.3.4   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-07-06 14:52:31 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Michael J. Kidd 2016-10-25 17:28:50 UTC 
Description of problem:
RGW sync agent ( at least for the 1.3.x code line ) fails to operate properly when a load balancer is in between the sync traffic.

Version-Release number of selected component (if applicable):
RHCS 1.3.x

How reproducible:
100%

Steps to Reproduce:
1. Configure federated gateway
2. Configure sync-agent to use the Load Balancer end points as it's configured endpoints.
3. Initiate sync-agent

Actual results:
sync-agent goes into infinite loop without copying any data

Expected results:
sync-agent initiates sync between load balanced RGW instances

Additional info:
See linked BZ for more technical details
 - Customers expect the multi-site synchronization to be highly available and fault tolerant.
 - The obvious means of accomplishing this is by using a load balanced gateway end point.
 - RHCS 1.3.x code fails to function when load balancers are used for the sync endpoints.
 - Load balanced RGW sync should be part of the test plan for future RHCS releases

Debug level logs attached to linked BZ for RGW, sync agent as well as packet captures on the load balancers to aid in identifying source of the failure.