Description of problem:

My OSP16.0 test deploys were getting killed before step1 (install packages to bootstrap triple) when using the ansible-based RHSM subscription method.

Often, random nodes without direct Internet access were failing due to 'download repository metadata'.

This is the rhsm.yaml I am using:

===================================================================================================================
# Note this can be specified either in the call
# to heat stack-create via an additional -e option
# or via the global environment on the seed in
# /etc/heat/environment.d/default.yaml
resource_registry:
  OS::TripleO::Services::Rhsm: /usr/share/openstack-tripleo-heat-templates/deployment/rhsm/rhsm-baremetal-ansible.yaml

parameter_defaults:
  RhsmVars:
    rhsm_activation_key: "ak_rhosp16"
    rhsm_method: "satellite"
    rhsm_org_id: "krynn"
    rhsm_satellite_url: "https://sat6.lasthome.solace.krynn"
    rhsm_baseurl: "https://sat6.lasthome.solace.krynn/pulp/repos"
    rhsm_server_hostname: "sat6.lasthome.solace.krynn"
    rhsm_insecure: yes
    rhsm_rhsm_proxy_hostname: "imladris.lasthome.solace.krynn"
    rhsm_rhsm_proxy_port: "3128"
===================================================================================================================

even though I had rhsm_rhsm_proxy_hostname and rhsm_rhsm_proxy_port both configured, proxy information was missing from:
/etc/yum.conf
/etc/rhsm/rhsm.conf
/etc/dnf/dnf.conf (RHEL8 only)

Fix:
Inject proxy information into host files:

# grep ^proxy /etc/yum.conf /etc/rhsm/rhsm.conf /etc/dnf/dnf.conf 
/etc/yum.conf:proxy=http://imladris.lasthome.solace.krynn:3128
/etc/rhsm/rhsm.conf:proxy_hostname = imladris.lasthome.solace.krynn
/etc/rhsm/rhsm.conf:proxy_scheme = http
/etc/rhsm/rhsm.conf:proxy_port = 3128
/etc/rhsm/rhsm.conf:proxy_user =
/etc/rhsm/rhsm.conf:proxy_password =
/etc/dnf/dnf.conf:proxy=http://imladris.lasthome.solace.krynn:3128