Bug 1959932

Description of problem:
'Insights' clients are failing with below error:

~~~
# insights-client --test-connection
GET https://Satellite_URL:443/redhat_access/r/insights/v1/branch_info
GET branch_info status: 200
Running Connection Tests...
=== Begin Upload URL Connection Test ===
Testing: https://Satellite_URL:443/redhat_access/r/insights/uploads/
HTTP Status Code: 500
HTTP Status Text: Internal Server Error
HTTP Response Text: {
  "error": {"message":"Connection reset by peer - SSL_connect"}
}

Connection failed
=== End Upload URL Connection Test: FAILURE ===

=== Begin API URL Connection Test ===
Testing: https://Satellite_URL:443/redhat_access/r/insights/
HTTP Status Code: 200
HTTP Status Text: OK
HTTP Response Text: {}
Successfully connected to: https://Satellite_URL:443/redhat_access/r/insights/
=== End API URL Connection Test: SUCCESS ===

Connectivity tests completed with some errors
See /var/log/insights-client/insights-client.log for more details.
~~~

Error in /var/log/insights-client/insights-client.log

2021-05-06 13:56:59,730     INFO insights.client.connection === Begin Upload URL Connection Test ===
2021-05-06 13:56:59,730  NETWORK insights.client.connection Testing: https://Satellite_URL:443/redhat_access/r/insights/uploads/
2021-05-06 13:56:59,807  NETWORK insights.client.connection HTTP Status Code: 500
2021-05-06 13:56:59,807  NETWORK insights.client.connection HTTP Status Text: Internal Server Error
2021-05-06 13:56:59,807  NETWORK insights.client.connection HTTP Response Text: {
  "error": {"message":"Connection reset by peer - SSL_connect"}
}

2021-05-06 13:56:59,807     INFO insights.client.connection Connection failed



Version-Release number of selected component (if applicable):
Satellite 6.9

# rpm -q satellite 
satellite-6.9.1-1.el7sat.noarch


How reproducible:
Always
 ENV : Insights Client -> Satellite 6.9 -> Proxy -> cloud.redhat.com

Steps to Reproduce:
1. Install Satellite 6.9 
2. Install SQUID (on a different machine) OR use existing proxy setup
3. Configure Satellite 6.9 to use the Proxy.
   https://access.redhat.com/documentation/en-us/red_hat_satellite/6.9/html-single/installing_satellite_server_from_a_connected_network/index#configuring-satellite-with-an-http-proxy_satellite
4. Go to Satellite CLI.
   - disable DNS to reproduce the issue: 
     - Edit /etc/resolv.conf and comment out all entries so that satellite can not directly communicate outside.
      OR
     - block direct connections from satellite to WAN network.

5. Try #insights-client --test-con on satellite client 
   - It will fail with an error - HTTP Status Code: 500


Actual results:

~~~
#insights-client --test-connection

GET https://Satellite_URL:443/redhat_access/r/insights/v1/branch_info
GET branch_info status: 200
Running Connection Tests...
=== Begin Upload URL Connection Test ===
Testing: https://Satellite_URL:443/redhat_access/r/insights/uploads/
HTTP Status Code: 500
HTTP Status Text: Internal Server Error
HTTP Response Text: {
  "error": {"message":"Connection reset by peer - SSL_connect"}
}
~~~


Expected results:
The request should get routed through a proxy defined on the satellite server.



WORKAROUND:
- It works fine with global proxy settings defined in - Satellite Web UI > Administer > Settings > General > HTTP(S) proxy


Additional info:
- Satellite is unable to route the Insights request via proxy defined in Satellite UI -> Infrastructure -> HTTP proxies
- CDN sync appears to be working fine.