Hide Forgot
Description of problem: Incremental import is not updating packages from incremental exported CV contents. Version-Release number of selected component (if applicable): Satellite 6.2 Snap 7.1 How reproducible: Always Steps to Reproduce: Pre-requisite: 1. Export whole CV version having mixed(redhat and custom) repos to a directory specified in settings. 2. Explore exported contents to /var/www/html/pub/export directory. 3. Set the step 2 location path as CDN URL for redhat repo to import the exported CV redhat repo. 4. Also set full custom repo path from step 2 location by creating new custom repo to import custom repo contents. 5. Sync both redhat and custom repos in imported org/satellite. For incremental Export and Import: 6. Add some packages to both repos added in earlier exported CV. 7. Publish/promote a new cv version. 8. Export new version incrementally from last exported(step1) date. 9. Explore newly exported versions content to /var/www/html/pub/export/ 10. Incrementally import both custom and redhat repos contents from step 9 location. Actual results: 1. The number of packages are not updated even after successful(100%) completion of incremental import. 2. No error thrown for not updating packages on incremental import of repo. Expected results: 1. The number of packages should be updated after successful(100%) completion of incremental import. 2. Error causing package updates on incremental import should be thrown in bg. Additional info:
moving to GA target, the work required to finish this is too much to get done before beta goes out. Users will need to only use full exports for Beta and use incremental after GA.
To give more detail, the current incremental import is slow and causes a number of strange issues. I can rewrite the incremental export so that it's in the same format as the full export. This avoids needing special code for incremental import and should speed it up significantly. It will also allow use of http for incremental import.
This issue is also reproducible in case of exported as ISO and imported from this ISO contents. So need to look into this as well.
BETA WORKAROUND NOTE: There are a handful of bugs related to incremental import of repositories which are being addressed for GA. I believe the workaround for this bug is to ensure the exported incremental repo has a small (less than 100) number of packages. The incremental export/import mechanism is being reworked for GA, which will resolve these bugs.
Upstream bug component is Content Management
*** Bug 1332616 has been marked as a duplicate of this bug. ***
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.
@Chris, Please update the steps changed for incremental import of cv in GA to repro this issue. Thanks, Jitendra
It should work the same from a user perspective. You should be able to still use "file:///" if you want, but "http" will also work now. Note though that for CV export, the incremental will only work as expected if you are exporting the Default Organization View (typically this is CV with id #1). If you use a published CV version, there is no incremental change to update. For example, if you publish version #1 of a CV, then version #2, the #2 CVV will have an entirely new set of repos, so there's no incremental change in #2.
Verified ! @ Sat 6.2 GA Snap 17 Steps Followed: 1. Exported full RH and custom repo and imported full 2. Added some RPM's to both repos. 3. Incrementally export and imported the repos with newly updated rpms. Result: # hammer repository synchronize --id 1 --incremental 1 --source-url http://qeblade36.rhq.lab.eng.bos.redhat.com/pub/rhel_incre/ [.........................................................................................................................................................................................................] [100%] New packages: 2 (5.53 KB). # hammer repository synchronize --id 2 --incremental 1 --source-url http://qeblade36.rhq.lab.eng.bos.redhat.com/pub/cust_incre/ [.........................................................................................................................................................................................................] [100%] New packages: 2 (5.56 KB). So moving this to Verified !
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2016:1501