Bug 983339

Summary: Some gears are down when creating scalable app with a large number of gears
Product: OpenShift Container Platform Reporter: Nan Wei <nwei>
Component: ContainersAssignee: Brenton Leanhardt <bleanhar>
Status: CLOSED DEFERRED QA Contact: libra bugs <libra-bugs>
Severity: medium Docs Contact:
Priority: medium    
Version: 1.2.0CC: libra-onpremise-devel, lmeyer, nwei, xtian
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-09-27 11:52:46 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Nan Wei 2013-07-11 03:06:48 UTC
Description of problem:
After creating a scalable app with the large number gears, check https://url/haproxy-status, found that some gears are down.

Version-Release number of selected component (if applicable):
OSE-1.2 RHN Stage

How reproducible:
always

Steps to Reproduce:
1.create a scale app
  rhc app-create phps php-5.3 -s
2.set cartridge scale number
  rhc cartridge scale php-5.3 -a phps --min 20
3.check haproxy-status
  https://url/haproxy-status

Actual results:
Wait for 10 minutes. Only the first 10 gears are active, the others are down.

[weinan@dhcp-65-25 ~]$ rhc app-show test -l nanwei --gears
ID                       State   Cartridges          Size  SSH URL
------------------------ ------- ------------------- ----- ----------------------------------------------------------------------
51dd2a656e0f5d100400084f started php-5.3 haproxy-1.4 small 51dd2a656e0f5d100400084f.com
51dd2ab66e0f5d1004000870 started php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000870.com
51dd2ab66e0f5d1004000871 started php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000871.com
51dd2ab66e0f5d1004000872 started php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000872.com
51dd2ab66e0f5d1004000873 started php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000873.com
51dd2ab66e0f5d1004000874 started php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000874.com
51dd2ab66e0f5d1004000875 started php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000875.com
51dd2ab66e0f5d1004000876 started php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000876.com
51dd2ab66e0f5d1004000877 started php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000877.com
51dd2ab66e0f5d1004000878 started php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000878.com
51dd2ab66e0f5d1004000879 new     php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000879.com
51dd2ab66e0f5d100400087a new     php-5.3 haproxy-1.4 small 51dd2ab66e0f5d100400087a.com
51dd2ab66e0f5d100400087b new     php-5.3 haproxy-1.4 small 51dd2ab66e0f5d100400087b.com
51dd2ab66e0f5d100400087c new     php-5.3 haproxy-1.4 small 51dd2ab66e0f5d100400087c.com
51dd2ab66e0f5d100400087d new     php-5.3 haproxy-1.4 small 51dd2ab66e0f5d100400087d.com
51dd2ab66e0f5d100400087e new     php-5.3 haproxy-1.4 small 51dd2ab66e0f5d100400087e.com
51dd2ab66e0f5d100400087f new     php-5.3 haproxy-1.4 small 51dd2ab66e0f5d100400087f.com
51dd2ab66e0f5d1004000880 new     php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000880.com
51dd2ab66e0f5d1004000881 new     php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000881.com
51dd2ab66e0f5d1004000882 new     php-5.3 haproxy-1.4 small 51dd2ab66e0f5d1004000882.com


Expected results:
20 gears are active.

Additional info:

Comment 2 Brenton Leanhardt 2013-08-15 14:27:24 UTC
Does this still happen in Online with the recent changes they have shipped?

Comment 3 Luke Meyer 2013-09-05 14:43:25 UTC
Follow up on needinfo

Comment 4 Nan Wei 2013-09-27 10:15:37 UTC
It doesn't happen in online when create a scale php-5.3 app and set --min 20. 
20 gears are active.
Sorry, I just find your needinfo request and sorry for this if it is due to my miss.

Comment 5 Brenton Leanhardt 2013-09-27 11:52:46 UTC
Thanks, we'll close this as DEFERRED and pick it up during the next rebase.