Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.
Bug 1395637 - The masterClientConnectionOverrides are absent on app node node-config.yml in containerized installation/upgrade
The masterClientConnectionOverrides are absent on app node node-config.yml in...
Status: CLOSED ERRATA
Product: OpenShift Container Platform
Classification: Red Hat
Component: Installer (Show other bugs)
3.3.0
Unspecified Unspecified
high Severity medium
: ---
: ---
Assigned To: Russell Teague
Anping Li
:
Depends On:
Blocks:
  Show dependency treegraph
 
Reported: 2016-11-16 05:31 EST by Anping Li
Modified: 2017-07-24 10 EDT (History)
8 users (show)

See Also:
Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Previously, the facts generation procedures may have incorrectly determined major release versions prior to package installation. Since the playbooks are now version specific we've eliminated this defaulting ensuring that 3.5 playbooks receive 3.5 content in all scenarios
Story Points: ---
Clone Of:
Environment:
Last Closed: 2017-04-12 14:48:27 EDT
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)


External Trackers
Tracker ID Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2017:0903 normal SHIPPED_LIVE OpenShift Container Platform atomic-openshift-utils bug fix and enhancement 2017-04-12 18:45:42 EDT

  None (edit)
Description Anping Li 2016-11-16 05:31:01 EST
Description of problem:
The following values are absent in node-config.yaml on seperate node hosts. 
masterClientConnectionOverrides:
  acceptContentTypes: application/vnd.kubernetes.protobuf,application/json
  contentType: application/vnd.kubernetes.protobuf
  burst: 200
  qps: 100

Version-Release number of selected component (if applicable):
atomic-openshift-utils-3.3.50-1.git.0.5bdbeaa.el7.noarch

How reproducible:
always

Steps to Reproduce:
1. install to OCP-3.3 in RHEL 7.2 on GCE
  ansible-playbook /root/openshift-ansible/playbooks/byo/config.yml
2. check the node-config.yml

Actual results:
2. no masterClientConnectionOverrides on app node node-config.yml.

[root@qe-node ~]#cat /etc/origin/node/node-config.yaml
<--snip-->
masterClientConnectionOverrides:
  acceptContentTypes: application/vnd.kubernetes.protobuf,application/json
  contentType: application/vnd.kubernetes.protobuf
  burst: 200
  qps: 100

Expected results:


Additional info:
Comment 1 Scott Dodson 2016-11-16 10:28:13 EST
This is probably a case where the version_gte facts are bad on containerized installs. We could simply get rid of them.
Comment 2 Devan Goodwin 2016-11-17 09:04:57 EST
Can't reproduce in AWS with containerized RHEL 7.2. 

There are 24 mentions of version_gte_3_2_or_1_2 in master right now. I still use master occasionally to install 3.2, but never less than 3.2. We could just remove them all if we think this was it.

However there are another 18 for version_gte_3_1_or_1_1 and a few more for version_gte_3_1_1_or_1_1_1. Potentially disruptive change if these facts are not reliable and we start yanking them out.

It's a little troubling the facts are coming out wrong at all though, could it be gcloud specific somehow?
Comment 4 Devan Goodwin 2016-11-17 10:49:27 EST
Could we get inventory and the installation log attached?

Also if possible, could you apply this patch to your ansible yaml before running:

diff --git a/roles/openshift_node/tasks/main.yml b/roles/openshift_node/tasks/main.yml
index 6022694..b51374a 100644
--- a/roles/openshift_node/tasks/main.yml
+++ b/roles/openshift_node/tasks/main.yml
@@ -82,6 +82,8 @@
     state: directory
   when: openshift_node_kubelet_args is defined and 'config' in openshift_node_kubelet_args
 
+- debug: var=hostvars[inventory_hostname]
+
 # TODO: add the validate parameter when there is a validation command to run
 - name: Create the Node config
   template:


This will include a full dump of all facts for the host in the ansible log, from there we can hopefully pinpoint where the facts are getting confused.
Comment 6 liujia 2016-11-30 03:39:41 EST
Upgrade hit the same question.
Upgrade from 3.3 to 3.4 on aws, it will not add "masterClientConnectionOverrides" info in the node config those are not master roles.
Comment 7 Devan Goodwin 2016-11-30 08:43:35 EST
Fact that controls this section in the template:

{% if openshift.common.version_gte_3_3_or_1_3 | bool %}
masterClientConnectionOverrides:
  acceptContentTypes: application/vnd.kubernetes.protobuf,application/json
  contentType: application/vnd.kubernetes.protobuf
  burst: 200
  qps: 100
{% endif %}

However in Anping's log:

For the first master right before we create the node config on the master the facts show:

                "version": "3.3.1.5", 
                "version_gte_3_1_1_or_1_1_1": true, 
                "version_gte_3_1_or_1_1": true, 
                "version_gte_3_2_or_1_2": true, 
                "version_gte_3_3_or_1_3": true

This looks correct and thus that host, the master, probably gets masterClientConnectionOverrides.

However right before we create the node config on the dedicated node:

                "version_gte_3_1_1_or_1_1_1": true, 
                "version_gte_3_1_or_1_1": true, 
                "version_gte_3_2_or_1_2": true, 
                "version_gte_3_3_or_1_3": false

No version fact is present and the defaults kick in.
Comment 8 Scott Dodson 2017-02-09 09:49:56 EST
We've refactored the version facts, can this be re-rested with the latest 3.5 installer?
Comment 9 Anping Li 2017-02-20 01:44:44 EST
Verified and pass on openshift-ansible-3.5.8-1.git.0.0e02ef8.el7.noarch
Comment 11 errata-xmlrpc 2017-04-12 14:48:27 EDT
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:0903

Note You need to log in before you can comment on or make changes to this bug.