Description of problem: Publishing a RedHat repo after Sync can take upto almost 2 hours. See details of publishing RHSCL for RHEL7: The long running step is the 'Publishing Errata' [crash] root@li-lc-1578:~# pulp-admin tasks details --task-id=b144cfc3-2367-4b46-8a19-bccf3059b257 +----------------------------------------------------------------------+ Task Details +----------------------------------------------------------------------+ Operations: publish Resources: Hilti-Red_Hat_Software_Collections__for_RHEL_Server_-Red_Hat_S oftware_Collections_RPMs_for_Red_Hat_Enterprise_Linux_7_Server _x86_64_7Server (repository) State: Successful Start Time: 2016-05-12T09:30:23Z Finish Time: 2016-05-12T11:19:55Z Result: Completed: 2016-05-12T11:19:55Z Details: Description: Copying files Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: bccab06d-6e6a-4376-8fd9-50655d466714 Step Type: save_tar Description: Initializing repo metadata Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: cb31fc58-ac9d-45c4-a052-f6ae7c2860c3 Step Type: initialize_repo_metadata Description: Publishing Distribution files Details: Error Details: Items Total: 0 Num Failures: 0 Num Processed: 0 Num Success: 0 State: FINISHED Step Id: 499d2cc9-05f8-4a48-8774-d6086dbd67ba Step Type: distribution Description: Publishing RPMs Details: Error Details: Items Total: 0 Num Failures: 0 Num Processed: 0 Num Success: 0 State: FINISHED Step Id: dd90e42c-a613-490e-9082-0af938d03e50 Step Type: rpms Description: Publishing Delta RPMs Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 0 Num Success: 0 State: SKIPPED Step Id: 6ba75eb6-575d-46b5-91fa-86a99dbf9600 Step Type: drpms Description: Publishing Errata Details: Error Details: Items Total: 194 Num Failures: 0 Num Processed: 194 Num Success: 194 State: FINISHED Step Id: 00874e17-55d6-4253-b39a-0aa382c68ba8 Step Type: errata Description: Publishing Comps file Details: Error Details: Items Total: 0 Num Failures: 0 Num Processed: 0 Num Success: 0 State: FINISHED Step Id: 1d61ef5e-53c2-4487-9638-07313fce8755 Step Type: comps Description: Publishing Metadata. Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: cf5e4f97-a640-441b-850f-25011995d76b Step Type: metadata Description: Closing repo metadata Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: cdb4476a-179b-40da-98e7-ba629dc6dd7c Step Type: close_repo_metadata Description: Generating sqlite files Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 0 Num Success: 0 State: SKIPPED Step Id: d93ea80b-d5fd-4035-a160-4d9754ab9796 Step Type: generate sqlite Description: Publishing files to web Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: 1ceae3a4-828c-45ba-9505-b72a24a60936 Step Type: publish_directory Description: Writing Listings File Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: 75567411-fc4b-4d04-bc4c-d1711355c045 Step Type: initialize_repo_metadata Distributor Id: Hilti-Red_Hat_Software_Collections__for_RHEL_Server_-Red_ Hat_Software_Collections_RPMs_for_Red_Hat_Enterprise_Linu x_7_Server_x86_64_7Server Distributor Type Id: yum_distributor Error Message: None Exception: None Id: 573466db0586fe31df66f0f3 Repo Id: Hilti-Red_Hat_Software_Collections__for_RHEL_Server_-Red_ Hat_Software_Collections_RPMs_for_Red_Hat_Enterprise_Linu x_7_Server_x86_64_7Server Result: success Started: 2016-05-12T09:30:23Z Summary: Close Repo Metadata: FINISHED Comps: FINISHED Distribution: FINISHED Drpms: SKIPPED Errata: FINISHED Generate sqlite: SKIPPED Initialize Repo Metadata: FINISHED Metadata: FINISHED Publish Directory: FINISHED Rpms: FINISHED Save Tar: FINISHED Traceback: None Task Id: b144cfc3-2367-4b46-8a19-bccf3059b257 Progress Report: Hilti-red Hat Software Collections For Rhel Server -red Hat Software Collections Rpms For Red Hat Enterprise Linux 7 Server X86 64 7server: Description: Copying files Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: bccab06d-6e6a-4376-8fd9-50655d466714 Step Type: save_tar Description: Initializing repo metadata Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: cb31fc58-ac9d-45c4-a052-f6ae7c2860c3 Step Type: initialize_repo_metadata Description: Publishing Distribution files Details: Error Details: Items Total: 0 Num Failures: 0 Num Processed: 0 Num Success: 0 State: FINISHED Step Id: 499d2cc9-05f8-4a48-8774-d6086dbd67ba Step Type: distribution Description: Publishing RPMs Details: Error Details: Items Total: 0 Num Failures: 0 Num Processed: 0 Num Success: 0 State: FINISHED Step Id: dd90e42c-a613-490e-9082-0af938d03e50 Step Type: rpms Description: Publishing Delta RPMs Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 0 Num Success: 0 State: SKIPPED Step Id: 6ba75eb6-575d-46b5-91fa-86a99dbf9600 Step Type: drpms Description: Publishing Errata Details: Error Details: Items Total: 194 Num Failures: 0 Num Processed: 194 Num Success: 194 State: FINISHED Step Id: 00874e17-55d6-4253-b39a-0aa382c68ba8 Step Type: errata Description: Publishing Comps file Details: Error Details: Items Total: 0 Num Failures: 0 Num Processed: 0 Num Success: 0 State: FINISHED Step Id: 1d61ef5e-53c2-4487-9638-07313fce8755 Step Type: comps Description: Publishing Metadata. Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: cf5e4f97-a640-441b-850f-25011995d76b Step Type: metadata Description: Closing repo metadata Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: cdb4476a-179b-40da-98e7-ba629dc6dd7c Step Type: close_repo_metadata Description: Generating sqlite files Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 0 Num Success: 0 State: SKIPPED Step Id: d93ea80b-d5fd-4035-a160-4d9754ab9796 Step Type: generate sqlite Description: Publishing files to web Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: 1ceae3a4-828c-45ba-9505-b72a24a60936 Step Type: publish_directory Description: Writing Listings File Details: Error Details: Items Total: 1 Num Failures: 0 Num Processed: 1 Num Success: 1 State: FINISHED Step Id: 75567411-fc4b-4d04-bc4c-d1711355c045 Step Type: initialize_repo_metadata Version-Release number of selected component (if applicable): How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info:
This is on a fresh Sat6.2.0 on RHEL6.8. The Sat6 insance is still empty for the rest, no hosts or content views etc. yet.
I just dug into this a bit. It didn't take quite 2 hours, but at least an hour. Red Hat Software Collections RPMs for Red Hat Enterprise Linux 7 Server x86_64 7Server about 2 hours ago about 1 hour New packages: 4606 (3.75 GB). Syncing Complete. The content itself synced quite quickly. I came to the same conclusion that the "Errata" step is what is taking so long. We'll have to dig into it and see why errata for SCL seems to be so much more arduous than other repos.
just realized I was seeing slowness during sync, not publish. That said, it was also sticking at errata step. Will try and repro for an actual publish.
Corey, This is for the yum metadata publish step of a repo sync, not a Content View publish.
This is most likely a dupe of: https://bugzilla.redhat.com/show_bug.cgi?id=1315006 which is actively being worked on in 6.2 and will ship with GA.
Moving 6.2 bugs out to sat-backlog.
Based on comment 6 and reading the details on that bug, I am going to close this one as a duplicate. If you re-encounter this behavior after upgrading to Satellite 6.2, please do re-open the bug (placing it in NEW state). *** This bug has been marked as a duplicate of bug 1315006 ***