Bug 2055495
| Summary: | If Kickstart 7.X repos are being synced to Capsule 7.0 then Pulp 3 tries to sync a non-existant HighAvailability and ResilientStorage repo as well and gets 404 fnot found | ||
|---|---|---|---|
| Product: | Red Hat Satellite | Reporter: | Sayan Das <saydas> |
| Component: | Pulp | Assignee: | satellite6-bugs <satellite6-bugs> |
| Status: | CLOSED ERRATA | QA Contact: | Vladimír Sedmík <vsedmik> |
| Severity: | medium | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | 6.11.0 | CC: | ahumbe, dalley, dkliban, ehelms, ggainey, lvrtelov, rchan, ttereshc |
| Target Milestone: | 6.11.0 | Keywords: | Triaged |
| Target Release: | Unused | ||
| Hardware: | All | ||
| OS: | All | ||
| Whiteboard: | |||
| Fixed In Version: | pulp_rpm-3.17.2 | Doc Type: | If docs needed, set a value |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2022-07-05 14:33:19 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
Ugh the form is being frustrating today. Tanya, can you confirm that this is the same issue as https://github.com/pulp/pulp_rpm/issues/2373 ? (In reply to Daniel Alley from comment #3) > Ugh the form is being frustrating today. > > Tanya, can you confirm that this is the same issue as > https://github.com/pulp/pulp_rpm/issues/2373 ? Yes, it looks exactly like this issue to me. Verified on 6.11.0 snap 17 (and also checked on 6.10.5 snap 2) - following the steps from comment 0 no errors were observed in capsule's /var/log/messages nor in satellite's production.log or journal. The Capsule sync succeeded. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Moderate: Satellite 6.11 Release), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2022:5498 |
Description of problem: When a kickstart 7.X repo is being synced for the first time or forcefully republished or getting republished and re-synced due to updated content in it, The pulp on capsule server reads the treeinfo files for each of those repos and then assumes there is a ResilientStorage and HighAvailability addons repo present which it needs to sync. But since those are not actually present as separate repos but part of the existing kickstart repo itself, pulp gets a 404 not found on those URL's. Version-Release number of selected component (if applicable): Satellite 7 (snap 9 ) and Satellite 6.10 [ Pulp3 ] How reproducible: Always Steps to Reproduce: 1. Install a satellite and capsule 7.0 or 6.10 2. Enable RHEL 7.9 kickstart repo on satellite and sync it. 3. Create a Test LCE on satellite and TestView CV. 4. Associate the Test LCE to capsule for content syncing. 5. Add the kickstart repo to TestView CV, Publish to Library and promote to Test LCE. 6. Monitor /var/log/messages on capsule to observe the capsule auto-sync task. Actual results: The sync is successful but pulpcore logs this is syslog: Feb 17 00:33:40 capsule70 pulpcore-api: pulp [039160ce-a678-40c4-afb1-0b1c1c1205e7]: - - [17/Feb/2022:05:33:40 +0000] "GET /pulp/api/v3/tasks/423bf233-85fd-433d-9854-2987ffb71425/ HTTP/1.1" 200 1042 "-" "OpenAPI-Generator/3.16.0/ruby" Feb 17 00:33:40 capsule70 pulpcore-worker-2: Giving up download_wrapper(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://saydas-rhsat.syslab.pnq2.redhat.com/pulp/content/RedHat/Test/TestView/content/dist/rhel/server/7/7.9/x86_64/kickstart/addons/HighAvailability/repodata/repomd.xml')) Feb 17 00:33:40 capsule70 pulpcore-worker-2: pulp [039160ce-a678-40c4-afb1-0b1c1c1205e7]: backoff:ERROR: Giving up download_wrapper(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://saydas-rhsat.syslab.pnq2.redhat.com/pulp/content/RedHat/Test/TestView/content/dist/rhel/server/7/7.9/x86_64/kickstart/addons/HighAvailability/repodata/repomd.xml')) Feb 17 00:33:40 capsule70 pulpcore-worker-2: pulp [039160ce-a678-40c4-afb1-0b1c1c1205e7]: pulp_rpm.app.tasks.synchronizing:WARNING: Unable to sync sub-repo 'HighAvailability' from treeinfo. Feb 17 00:33:40 capsule70 pulpcore-worker-2: Giving up download_wrapper(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://saydas-rhsat.syslab.pnq2.redhat.com/pulp/content/RedHat/Test/TestView/content/dist/rhel/server/7/7.9/x86_64/kickstart/addons/ResilientStorage/repodata/repomd.xml')) Feb 17 00:33:40 capsule70 pulpcore-worker-2: pulp [039160ce-a678-40c4-afb1-0b1c1c1205e7]: backoff:ERROR: Giving up download_wrapper(...) after 1 tries (aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://saydas-rhsat.syslab.pnq2.redhat.com/pulp/content/RedHat/Test/TestView/content/dist/rhel/server/7/7.9/x86_64/kickstart/addons/ResilientStorage/repodata/repomd.xml')) Feb 17 00:33:40 capsule70 pulpcore-worker-2: pulp [039160ce-a678-40c4-afb1-0b1c1c1205e7]: pulp_rpm.app.tasks.synchronizing:WARNING: Unable to sync sub-repo 'ResilientStorage' from treeinfo. Expected results: We should not see these failures as the URLs pulp had created on their own makes no sense and do not exist anywhere. Additional info: * This was never reproducible in Pulp 2 and with Pulp3 it only happens for RHEL 7.X kickstart repos so far. * This was visible for many Pulp 3 users\customers and often led to a wrong conclusion and investigation of capsule sync issues. * I am raising this bug in Sat 7.0 as this is harmless on both 6.10 and 7.0 and even if gets improved later, that's not a big deal but it creates confusion when we see multiple instances of kickstart 7.X repos are being synced to the capsule and for each of those attempts, these many errors will be reported in the logs.