Bug 2172564 - Incremental syncable content export of a file repo is not incremental
Summary: Incremental syncable content export of a file repo is not incremental
Keywords:
Status: VERIFIED
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Pulp
Version: 6.13.0
Hardware: x86_64
OS: Linux
unspecified
medium
Target Milestone: 6.14.0
Assignee: satellite6-bugs
QA Contact: Vladimír Sedmík
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2023-02-22 14:49 UTC by Vladimír Sedmík
Modified: 2023-07-31 09:32 UTC (History)
7 users (show)

Fixed In Version: pulpcore-3.18.21-1, pulpcore-3.21.11-1, pulpcore-3.22.8-1
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github pulp pulpcore pull 4052 0 None Merged Incremental Export fix for File/Pass Through publications 2023-07-17 17:49:50 UTC
Red Hat Issue Tracker SAT-17167 0 None None None 2023-04-17 13:23:31 UTC

Description Vladimír Sedmík 2023-02-22 14:49:15 UTC
Description of problem:
Incremental syncable content export of a file repo always export full content of the repository.


Version-Release number of selected component (if applicable):
6.13.0 snap 11


How reproducible:
always


Steps to Reproduce:
1) Create a file repo, sync it.
2) Export complete: hammer content-export complete library --format syncable --organization-id 1
3) Check the export path.
4) Upload one file into the repo.
5) Export incremental: hammer content-export incremental library --format syncable --organization-id 1
6) Check the export path.


Actual results:

3)
[root@sat ~]# ll /var/lib/pulp/exports/Default_Organization/Export-Library-SYNCABLE/1.0/2023-02-21T10-24-55-05-00/custom/Files/X/
total 16
-rw-r--r--. 3 pulp pulp 1024 Feb 21 10:01 1.iso
-rw-r--r--. 3 pulp pulp 1024 Feb 21 10:01 2.iso
-rw-r--r--. 3 pulp pulp 1024 Feb 21 10:01 3.iso
-rw-r--r--. 2 pulp pulp  228 Feb 21 10:01 PULP_MANIFEST

6)
[root@sat ~]# ll /var/lib/pulp/exports/Default_Organization/Export-Library-SYNCABLE/2.0/2023-02-21T10-30-45-05-00/custom/Files/X/
total 20
-rw-r--r--. 3 pulp pulp 1024 Feb 21 10:01 1.iso
-rw-r--r--. 3 pulp pulp 1024 Feb 21 10:01 2.iso
-rw-r--r--. 3 pulp pulp 1024 Feb 21 10:01 3.iso
-rw-r--r--. 2 pulp pulp 1024 Feb 21 10:27 7.iso
-rw-r--r--. 2 pulp pulp  304 Feb 21 10:27 PULP_MANIFEST


Expected results:
1.iso, 2.iso, 3.iso should be missing in the incremental export.


Additional information:
Same behaviour seen for 'repository' and 'version' syncable exports.

Comment 1 Grant Gainey 2023-02-23 14:13:41 UTC
Can we see what Satellite is sending to Pulp in this context?

Comment 2 Grant Gainey 2023-02-23 16:02:45 UTC
I have verified that if you ask for an incremental export using the pulp API directly, it works. I used start_repository_version and repository_version. So we def need to see what Satellite is actually asking pulp to do, to figure out what's going on w/ this test.

Comment 3 Grant Gainey 2023-02-23 16:04:50 UTC
Moving to IIS

Comment 4 Partha Aji 2023-04-14 20:22:15 UTC
I can definitely reproduce the bug in my test evironment. I have not however tried with the pulp api directly. More investigation is needed (so adding team triage)

Comment 5 Partha Aji 2023-07-15 02:12:52 UTC
This is a pulp issue. The steps used in https://bugzilla.redhat.com/show_bug.cgi?id=2172564#c2 is not using a publication. It is using a repository_version and start_repository_version. Katello however uses a publication and start_repository_version which is where the bug occurs. Attached the associated Pulpcore issue and Pulpcore PR on Github.

Comment 7 Vladimír Sedmík 2023-07-31 09:31:43 UTC
Verified in 6.14.0 snap 9 (python39-pulpcore-3.22.9-1.1.el8pc.noarch)

Following steps from comment#0 the actual result meets the expected one:

3)
[root@sat ~]# ll /var/lib/pulp/exports/Default_Organization/Export-Library-SYNCABLE/1.0/2023-07-31T05-17-28-04-00/custom/Files/X/
total 16
-rw-r--r--. 2 pulp pulp 1024 Jul 31 05:16 1.iso
-rw-r--r--. 2 pulp pulp 1024 Jul 31 05:16 2.iso
-rw-r--r--. 2 pulp pulp 1024 Jul 31 05:16 3.iso
-rw-r--r--. 2 pulp pulp  228 Jul 31 05:16 PULP_MANIFEST

6)
[root@sat ~]# ll /var/lib/pulp/exports/Default_Organization/Export-Library-SYNCABLE/2.0/2023-07-31T05-20-06-04-00/custom/Files/X/
total 8
-rw-r--r--. 2 pulp pulp 1024 Jul 31 05:18 7.iso
-rw-r--r--. 2 pulp pulp  304 Jul 31 05:18 PULP_MANIFEST


Note You need to log in before you can comment on or make changes to this bug.