Description of problem:

When a kickstart 7.X repo is being synced for the first time or forcefully republished or getting republished and re-synced due to updated content in it, The pulp on capsule server reads the treeinfo files for each of those repos and then assumes there is a ResilientStorage and HighAvailability addons repo present which it needs to sync.

But since those are not actually present as separate repos but part of the existing kickstart repo itself, pulp gets a 404 not found on those URL's.



Version-Release number of selected component (if applicable):

Satellite 7 (snap 9 )  and Satellite 6.10 [ Pulp3 ]


How reproducible:

Always

Steps to Reproduce:
1. Install a satellite and capsule 7.0 or 6.10
2. Enable RHEL 7.9 kickstart repo on satellite and sync it.
3. Create a Test LCE on satellite and TestView CV. 
4. Associate the Test LCE to capsule for content syncing.
5. Add the kickstart repo to TestView CV, Publish to Library and promote to Test LCE.
6. Monitor /var/log/messages on capsule to observe the capsule auto-sync task. 



Actual results:

The sync is successful but pulpcore logs this is syslog:

Feb 17 00:33:40 capsule70 pulpcore-api: pulp [039160ce-a678-40c4-afb1-0b1c1c1205e7]:  - - [17/Feb/2022:05:33:40 +0000] "GET /pulp/api/v3/tasks/423bf233-85fd-433d-9854-2987ffb71425/ HTTP/1.1" 200 1042 "-" "OpenAPI-Generator/3.16.0/ruby"
Feb 17 00:33:40 capsule70 pulpcore-worker-2: Giving up download_wrapper(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://saydas-rhsat.syslab.pnq2.redhat.com/pulp/content/RedHat/Test/TestView/content/dist/rhel/server/7/7.9/x86_64/kickstart/addons/HighAvailability/repodata/repomd.xml'))
Feb 17 00:33:40 capsule70 pulpcore-worker-2: pulp [039160ce-a678-40c4-afb1-0b1c1c1205e7]: backoff:ERROR: Giving up download_wrapper(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://saydas-rhsat.syslab.pnq2.redhat.com/pulp/content/RedHat/Test/TestView/content/dist/rhel/server/7/7.9/x86_64/kickstart/addons/HighAvailability/repodata/repomd.xml'))
Feb 17 00:33:40 capsule70 pulpcore-worker-2: pulp [039160ce-a678-40c4-afb1-0b1c1c1205e7]: pulp_rpm.app.tasks.synchronizing:WARNING: Unable to sync sub-repo 'HighAvailability' from treeinfo.
Feb 17 00:33:40 capsule70 pulpcore-worker-2: Giving up download_wrapper(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://saydas-rhsat.syslab.pnq2.redhat.com/pulp/content/RedHat/Test/TestView/content/dist/rhel/server/7/7.9/x86_64/kickstart/addons/ResilientStorage/repodata/repomd.xml'))
Feb 17 00:33:40 capsule70 pulpcore-worker-2: pulp [039160ce-a678-40c4-afb1-0b1c1c1205e7]: backoff:ERROR: Giving up download_wrapper(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://saydas-rhsat.syslab.pnq2.redhat.com/pulp/content/RedHat/Test/TestView/content/dist/rhel/server/7/7.9/x86_64/kickstart/addons/ResilientStorage/repodata/repomd.xml'))
Feb 17 00:33:40 capsule70 pulpcore-worker-2: pulp [039160ce-a678-40c4-afb1-0b1c1c1205e7]: pulp_rpm.app.tasks.synchronizing:WARNING: Unable to sync sub-repo 'ResilientStorage' from treeinfo.



Expected results:

We should not see these failures as the URLs pulp had created on their own makes no sense and do not exist anywhere. 



Additional info:

* This was never reproducible in Pulp 2 and with Pulp3 it only happens for RHEL 7.X kickstart repos so far.

* This was visible for many Pulp 3 users\customers and often led to a wrong conclusion and investigation of capsule sync issues.

* I am raising this bug in Sat 7.0 as this is harmless on both 6.10 and 7.0 and even if gets improved later, that's not a big deal but it creates confusion when we see multiple instances of kickstart 7.X repos are being synced to the capsule and for each of those attempts, these many errors will be reported in the logs.