Bug 1447115 - [3.6][RFE] Randomize node lists
Summary: [3.6][RFE] Randomize node lists
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Networking
Version: 3.2.0
Hardware: Unspecified
OS: Unspecified
unspecified
urgent
Target Milestone: ---
: ---
Assignee: Rajat Chopra
QA Contact: zhaozhanqi
URL:
Whiteboard:
Depends On:
Blocks: 1455325 1455326 1455327 1456989
TreeView+ depends on / blocked
 
Reported: 2017-05-01 19:21 UTC by Brennan Vincello
Modified: 2022-08-04 22:20 UTC (History)
10 users (show)

Fixed In Version:
Doc Type: Enhancement
Doc Text:
Feature: Setting the router environment variable ROUTER_BACKEND_PROCESS_ENDPOINTS=shuffle will randomize the order of backends in the haproxy configuration. Reason: With long running sessions and a router which reloads regularly the first endpoint in the config may receive significantly more load than other backends. Setting the environment variable will randomize the order of the backends on every reload and thus help spread the load.
Clone Of:
: 1455325 1455326 1455327 1456989 (view as bug list)
Environment:
Last Closed: 2017-08-10 05:21:25 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHEA-2017:1716 0 normal SHIPPED_LIVE Red Hat OpenShift Container Platform 3.6 RPM Release Advisory 2017-08-10 09:02:50 UTC

Description Brennan Vincello 2017-05-01 19:21:16 UTC
Description of problem:

As an OpenShift admin running multiple routers, I'd like the ability to randomize the order with which nodes and routes are loaded in order to ensure more even load distribution across the cluster.

Version-Release number of selected component (if applicable): OCP 3.2

Comment 1 Rajat Chopra 2017-05-02 19:17:52 UTC
Proposed PR: https://github.com/openshift/origin/pull/14008

Comment 5 Ben Bennett 2017-05-11 18:48:37 UTC
Thanks Brian, can you walk me through that data a little?  Is there a particular endpoint that we should focus on there?

Comment 15 Eric Paris 2017-05-30 21:26:20 UTC
https://github.com/openshift/origin/pull/14008

Comment 17 zhaozhanqi 2017-06-01 08:38:09 UTC
hi,

I did not see the fixed version in the https://errata.devel.redhat.com/advisory/28089

and I checked the latest 3.6 env with haproxy image id f2b5e752f72f

the fixed PR did not be merged

Comment 19 zhaozhanqi 2017-07-05 06:20:12 UTC
Verified this bug on openshift v3.6.131

when enable the shuffle, the backend will be random list:

  cookie ffc46b9e81c946e896a03e31ac25ac9d insert indirect nocache httponly
  server pod:test-rc-pmh7d:test-service:10.129.0.73:8080 10.129.0.73:8080 cookie 6cdc8fd2b67c5c9d4e866be5480a2445 weight 100 check inter 5000ms
  server pod:test-rc-hlhw3:test-service:10.129.0.74:8080 10.129.0.74:8080 cookie 794a225214957229fca1711f6cfe7e28 weight 100 check inter 5000ms
  server pod:test-rc-5tz1z:test-service:10.129.0.72:8080 10.129.0.72:8080 cookie 263e0d26415531881bcdc76c0b4491c7 weight 100 check inter 5000ms
  server pod:test-rc-khl12:test-service:10.129.0.76:8080 10.129.0.76:8080 cookie 5d28f95106d4403385d68ebd54d6b80b weight 100 check inter 5000ms
  server pod:test-rc-2j4mm:test-service:10.129.0.75:8080 10.129.0.75:8080 cookie 8f5cff8b0847362a39a32c8c17159079 weight 100 check inter 5000ms

Comment 21 errata-xmlrpc 2017-08-10 05:21:25 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2017:1716


Note You need to log in before you can comment on or make changes to this bug.