Bug 1812379

Summary: [RFE] Octavia failover circuit breaker
Product: Red Hat OpenStack Reporter: Gregory Thiemonge <gthiemon>
Component: openstack-octaviaAssignee: Tom Weininger <tweining>
Status: CLOSED MIGRATED QA Contact: Bruna Bonguardo <bbonguar>
Severity: high Docs Contact:
Priority: high    
Version: 17.0 (Wallaby)CC: beagles, cgoncalves, gurpsing, ihrachys, lpeer, majopela, michjohn, njohnston, scohen, tweining
Target Milestone: ---Keywords: FutureFeature
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-09-26 17:51:42 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Gregory Thiemonge 2020-03-11 08:11:56 UTC
This bug was initially created as a copy of Bug #1774459



Customer thinks that RHOSP13 needs to have the "octavia failover circuit breaker"
feature as follows:

~~~
  When a disaster (e.g. loss of amphora boot network reachability) happens,
  Octavia health manager try to execute failover for all amphorae and these failovers will fail.

  We need to prepare the disaster situations before the situation actually happens.

  As discussed in this story https://storyboard.openstack.org/#!/story/2005604,
  failover circuit breaker is required for production octavia service.
  
  RFE: https://storyboard.openstack.org/#!/story/2005604
  Patch: https://review.opendev.org/#/c/656811/
  
  Step to Reproduce:
    For example, drop all heartbeat from all amphorae in controller nodes. 

  Actual Results:
    Health manager tries to execute failover for all existing amphorae

  Expected Results:
    Health manager stops some failovers based on the number of simultaneous failovers.

  Version-Release number of selected component:
    Red Hat OpenStack Platform Version Number: OSP13 
    Release Number: 
    Related Package Version:
      openstack-octavia-*-2.1.0-1.el7ost.noarch.rpm
    Related Middleware/Application: 
    Underlying RHEL Release Number: 7.6 
    Underlying RHEL Architecture: x86_64
    Underlying RHEL Kernel Version: 3.10.0-957.1.3.el7.x86_64

~~~

Comment 1 Brian Haley 2021-01-14 19:27:32 UTC
We had a discussion upstream on this and I updated the code based on that, so I'll take ownership of this BZ.

Comment 3 Tom Weininger 2022-09-20 09:33:05 UTC
This feature has been integrated upstream for the Zed release.