Bug 1228373
| Summary: | Gears from a scaled application are not evenly distributed across nodes in the district or zone | |||
|---|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Timothy Williams <tiwillia> | |
| Component: | Node | Assignee: | Timothy Williams <tiwillia> | |
| Status: | CLOSED ERRATA | QA Contact: | libra bugs <libra-bugs> | |
| Severity: | urgent | Docs Contact: | ||
| Priority: | unspecified | |||
| Version: | 2.2.0 | CC: | abhgupta, adellape, bleanhar, erich, jokerman, libra-onpremise-devel, mbarrett, misalunk, mmccomas, pep, tiwillia, xiama | |
| Target Milestone: | --- | Keywords: | Reopened | |
| Target Release: | --- | |||
| Hardware: | Unspecified | |||
| OS: | Linux | |||
| Whiteboard: | ||||
| Fixed In Version: | rubygem-openshift-origin-msg-broker-mcollective-1.35.3.1-1.el6op rubygem-openshift-origin-controller-1.37.3.1-1.el6op | Doc Type: | Bug Fix | |
| Doc Text: |
When determining which servers are available for gear placement, the least_preferred_servers variable could include all available servers. Additionally, the nodes only update their facts at a one minute interval. If all available nodes for a gear were passed in least_preferred_servers, the last server in the list would be chosen every time. Additionally, gears created for the same application within the same minute (such as through scaling a cartridge up numerous gears at a time) did not consider the placement of gears created within the same minute. These issues combined resulted in very uneven gear spreading for scaled applications. This bug fix updates OpenShift Enterprise so that if all available gears are passed into least_preferred_servers, least_preferred_servers is essentially ignored because all servers are least preferred. Gears now also will take into consideration the placement of the other gears in the application. As a result, spreading across nodes in districts and zones for scaled applications is now even. Scaling an application up multiple gears will result in the gears being spread evenly.
|
Story Points: | --- | |
| Clone Of: | ||||
| : | 1267728 (view as bug list) | Environment: | ||
| Last Closed: | 2015-10-19 08:45:48 UTC | Type: | Bug | |
| Regression: | --- | Mount Type: | --- | |
| Documentation: | --- | CRM: | ||
| Verified Versions: | Category: | --- | ||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
| Cloudforms Team: | --- | Target Upstream Version: | ||
| Embargoed: | ||||
| Bug Depends On: | 1234603 | |||
| Bug Blocks: | 1267728 | |||
|
Description
Timothy Williams
2015-06-04 19:13:09 UTC
Commit pushed to master at https://github.com/openshift/origin-server https://github.com/openshift/origin-server/commit/99d3dcc1dba1c5a1b7f28ecffff7fe65923f6a5b Ignore least preferred servers if all servers are least preferred Bug 1228373 Bug link https://bugzilla.redhat.com/show_bug.cgi?id=1228373 If an application is already scaled out so that it has a gear on all available nodes, all nodes will be considered 'least_preferred_servers'. This will cause only one server to be returned from rpc_find_all_available, giving select_best_fit_node only one server to choose. This caused sparatic and uneven gear placement from highly scaled applications. This fix will ignore the least_preferred_servers list if all available servers are included in the list. The commit pushed only partially resolves the issue. Distribution is better, but not even as expected. A complete fix is being investigated in online bugzilla: https://bugzilla.redhat.com/show_bug.cgi?id=1234603 There is no fixed package in the puddle After installation, QE check the issue [root@broker ~]# oo-admin-ctl-gears list|wc -l 15 [root@node1 ~]# oo-admin-ctl-gears list|wc -l 16 [root@node2 ~]# oo-admin-ctl-gears list|wc -l 8 [root@node3 ~]# oo-admin-ctl-gears list |wc -l 21 QE check the installed package. #rpm -qa|grep rubygem-openshift-origin-controller rubygem-openshift-origin-controller-1.36.2.3-1.el6op.noarch # rpm -qa|grep rubygem-openshift-origin-msg-broker-mcollective rubygem-openshift-origin-msg-broker-mcollective-1.34.1.1-1.el6op.noarch There is no fixed package in the puddle. Check on puddle [2.2.7/2015-09.21.1] After installation, QE check the issue [root@broker ~]# oo-admin-ctl-gears list | wc -l 20 [root@node1 ~]# oo-admin-ctl-gears list | wc -l 20 [root@node2 ~]# oo-admin-ctl-gears list | wc -l 20 [root@node3 ~]# oo-admin-ctl-gears list | wc -l 20 Move this issue to VERIFIED. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHSA-2015-1844.html |