*** Bug 1131658 has been marked as a duplicate of this bug. ***

This has not started upstream, moving to 6.2.

Jeff, can you add this as a required behavior for the lazy sync workflow? I think we will mostly get this for free; if the file happens to exist in the right place, or someone else puts it there, everything will be fine. We just need to consider this case if we are explicitly tracking which units have been downloaded.

This is already supported in the lazy design as part of the celery task that downloads a single unit.  https://pulp.plan.io/issues/1181.

I will also make sure it's part of the design for the celery task supporting the lazy_mode='active' in the importers.  https://pulp.plan.io/issues/1200

The Pulp upstream bug status is at NEW. Updating the external tracker on this bug.

The Pulp upstream bug priority is at High. Updating the external tracker on this bug.

The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.

This has been moved off of pulp 2.8 as lazy sync makes this much less of a priority, proposing for 6.3

The Pulp upstream bug priority is at High. Updating the external tracker on this bug.

Per 6.3 planning, moving out non acked bugs to the backlog

The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug.

The Pulp upstream bug status is at POST. Updating the external tracker on this bug.

The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.

The Pulp upstream bug status is at ON_QA. Updating the external tracker on this bug.

The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.

*** Bug 1386284 has been marked as a duplicate of this bug. ***

Created redmine issue http://projects.theforeman.org/issues/17424 from this bug

It looks like we should be able to move this bugzilla on to 6.3 and ON_QA.

Looking over the pulp issue, the proposed solution leverages the lazy sync feature (introduced in 6.2.z) and the Advanced Sync option (being introduced in 6.3) to perform a 'verify contents sync'.

Pulp references:
https://github.com/pulp/pulp/pull/2708 - contains the pulp docs

Tested on Sat 6.3 Snap 19, pulp-server-2.13.4-1.el7sat. Reproducer used was basically the one from the initial report, and notes from the doc update (https://github.com/pulp/pulp/pull/2708/files?short_path=02b6a9a#diff-02b6a9ab33100b00c84a132527f245dd)

Steps to check:
- Have a big repo (Centos 7 in my case) created and synced
- Stop the katello-service
- Remove /var/lib/mondgodb/pulp_database.*
- Start the mongodb service
- Run "sudo -u apache pulp-manage-db" to recreate the pulp db
- Create a new yum repo with the same URL in Satellite with "on demand" sync policy
- Run sync for the new repo
- Check the /var/log/messages for pulp messages. Only repodata should be really downloaded. You can check the new repo, packages should be present now. 
- Run "pulp-admin -u admin -p auth_string repo download --repo-id=repo_is_string --verify-all"
- Check the /var/log/messages again. There will be a lot of messages of following type: 

      <...>
      Oct 10 08:05:28 dell-pr5820-01 pulp: nectar.downloaders.threaded:INFO: Download of http://dell-pr5820-01.rhts.eng.bos.redhat.com/streamer/var/lib/pulp/content/units/rpm/f0/8da7a8ce8911f33469561ff9b08a080beabbe94a
      3246ddd869a4bb908b49e9/colord-gtk-devel-0.1.25-4.el7.i686.rpm?policy=eyJleHRlbnNpb25zIjoge30sICJyZXNvdXJjZSI6ICIvc3RyZWFtZXIvdmFyL2xpYi9wdWxwL2NvbnRlbnQvdW5pdHMvcnBtL2YwLzhkYTdhOGNlODkxMWYzMzQ2OTU2MWZmOWIwOGEwODB
      iZWFiYmU5NGEzMjQ2ZGRkODY5YTRiYjkwOGI0OWU5L2NvbG9yZC1ndGstZGV2ZWwtMC4xLjI1LTQuZWw3Lmk2ODYucnBtIiwgImV4cGlyYXRpb24iOiAxNTM5MTczMTI4fQ%3D%3D;signature=cARhRO8QWPI5Xuu0I9QUWbz-pbTdq4HEwXPQAsjy7Mz6hfWycUu_fkoATuuMivnX
      PSw75Mduj8WeMFS9Xiuc9TJi7C6XdFlbZZAVEnI0HRwTEX2PuNPU81DnFJbxfsbsnnrUPT2hs2tjB5NolWXQMe6-Q3VDkVADEWYovEcfRi82lANxUmpyxpONfcVsozV24Fm1WgXNjMxMjK6SdfJVPKHUAdbqeyimrkH22PIPeNNkvqUedOeGerXOI9CUQkAUtnOug1V4Fh1DKFTetlaP
      QtALmJMxMjbumjd3OgOWPYhD6S92PrTe6CNa19_6BkUxqJBqNPWUeW56Tau8AThPAQ%3D%3D was cancelled
      Oct 10 08:05:28 dell-pr5820-01 pulp: nectar.downloaders.threaded:INFO: Download of http://dell-pr5820-01.rhts.eng.bos.redhat.com/streamer/var/lib/pulp/content/units/rpm/fe/0fb319333a7050b5e5306a25440e34c62e6d0913
      5c93fcd20fc8c20b7f1f55/pam_pkcs11-0.6.2-27.el7.x86_64.rpm?policy=eyJleHRlbnNpb25zIjoge30sICJyZXNvdXJjZSI6ICIvc3RyZWFtZXIvdmFyL2xpYi9wdWxwL2NvbnRlbnQvdW5pdHMvcnBtL2ZlLzBmYjMxOTMzM2E3MDUwYjVlNTMwNmEyNTQ0MGUzNGM2MmU
      2ZDA5MTM1YzkzZmNkMjBmYzhjMjBiN2YxZjU1L3BhbV9wa2NzMTEtMC42LjItMjcuZWw3Lng4Nl82NC5ycG0iLCAiZXhwaXJhdGlvbiI6IDE1MzkxNzMxMjh9;signature=s0n5EmF93qUaVRo7cpAf8JPXxrwCQGotz-Ga2mFkik1T6WvdW_C3AxzjInu_500kUSYS87MNeCtpwzM0
      7RJQbRn8upjAoTliCWzaQwNOSTb7YRIV5tqgKKE-fjl3nQhM7egoAoinxtmPwP1xiw2QkAJ6AGuCEGUhb6UluqgELp1LhcF2r47snkk7jTxWoeSUaDz7wIUJ2Efr90QZc2itaeC78GN0HLK_cFDpzjTSkXMJcHrfM9RD6HBPkdpYDW8_qdtxH5jhlFM7GNzXWZQaPBwnavH0ScgobBYz
      paXWMSemABRqgEj_uviSk165H9xRV22rK4MQKOZkdpc7y4tNXA%3D%3D was cancelled
      <...>

No new rpm were dowloaded, rpm files already present in /var/lib/pulp/content have beed used instead. Packages are available under Content->Packages menu.

VERIFIED

Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA.
> 
> For information on the advisory, and where to find the updated files, follow the link below.
> 
> If the solution does not work for you, open a new bug report.
> 
> https://access.redhat.com/errata/RHSA-2018:0336