Bug 1991530

Summary: CV Package count ok, but Errata count (huge) mismatches with pulp2
Product: Red Hat Satellite Reporter: Brad Buckingham <bbuckingham>
Component: Content ViewsAssignee: Ian Ballou <iballou>
Status: CLOSED ERRATA QA Contact: Lai <ltran>
Severity: high Docs Contact:
Priority: high    
Version: 6.9.0CC: ahumbe, iballou, osousa, pcreech, peter.vreman
Target Milestone: 6.10.0Keywords: Triaged
Target Release: Unused   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: tfm-rubygem-katello-4.1.1.15-1 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-11-16 14:13:02 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1957813    
Attachments:
Description Flags
correct errata count none

Description Brad Buckingham 2021-08-09 11:16:04 UTC 
Description of problem:

As part of the Satellite 6.9 Pulp 3 High-Touch Beta, a difference in errata counts was observed on Content Views between Pulp 2 & 3.

During this HTB, a Satellite 6.9 instance went through the process of migration to Pulp 3, a switchover to Pulp 3 was performed and content management workflows executed.

Version-Release number of selected component (if applicable):
6.9.2

Scenario:

I published a CV with RedHat repositories. The number of packages is matching correctly, but the number of errata is much lower than the same CV published with Pulp2, the most visible repo is the Optional repo

Sat6.9.2+pulp2

61562 Packages   4090 Errata ( 954  2426  710  )
'Red Hat Enterprise Linux 7 Server - Update Services for SAP Solutions - Optional RPMs x86_64 7.7'     20093 Packages   2237 Errata
Pulp3

61562 Packages   1964 Errata ( 387  1110  467  )
'Red Hat Enterprise Linux 7 Server - Update Services for SAP Solutions - Optional RPMs x86_64 7.7'     20093 Packages   146 Errata
Another CV with the Satellite repositories shows it also, there the ansible repo has even 0 errata associated:

Red Hat Ansible Engine 2.9 RPMs for Red Hat Enterprise Linux 7 Server x86_64

Pulp2:  43 Packages   22 Errata
Pulp3:  43 Packages   0 Errata
Comment 2 Peter Vreman 2021-08-09 11:59:32 UTC 
The CVs used in the description are using a filter on Errata on Datum

Example of the filter setup, the 'Post Freeze Additions' has no additional rules (that triggered the BZ https://bugzilla.redhat.com/show_bug.cgi?id=1981401) and is therefor also not listed.
~~~
[crash/LI] root@li-lc-2222:~# hammer content-view filter list
--content-view-id=1915
----------|-----------------------------------------------------------|-------------|----------|----------
FILTER ID | NAME                                                      |
DESCRIPTION | TYPE     | INCLUSION
----------|-----------------------------------------------------------|-------------|----------|----------
3702      | product-HOIRHEL-7.7SAPSOL-d20210627 Freeze Date           |
        | erratum  | true
3701      | product-HOIRHEL-7.7SAPSOL-d20210627 Original Modules      |
        | modulemd | true
3700      | product-HOIRHEL-7.7SAPSOL-d20210627 Original Packages     |
        | rpm      | true
3703      | product-HOIRHEL-7.7SAPSOL-d20210627 Post Freeze Additions |
        | erratum  | true
----------|-----------------------------------------------------------|-------------|----------|----------
[crash/LI] root@li-lc-2222:~# hammer content-view filter info  --id=3702
Filter ID:    3702
Name:         product-HOIRHEL-7.7SAPSOL-d20210627 Freeze Date
Type:         erratum
Inclusion:    true
Description:
Repositories:

Rules:
   1) ID:         1309
      Start Date: 2000-01-01T00:00:00.000Z
      End Date:   2021-06-27T12:00:00.000Z
      Types:      security, enhancement, bugfix
      Created:    2021/06/28 08:43:56
      Updated:    2021/06/28 08:43:56

[crash/LI] root@li-lc-2222:~#
~~~
Comment 4 Ian Ballou 2021-08-10 15:59:42 UTC 
Hi Peter,

What sort of rules do you have for the filters with IDs 3700 and 3701?  Also, are you able to share which repositories were included in the content view version alongside 'Red Hat Enterprise Linux 7 Server - Update Services for SAP Solutions - Optional RPMs x86_64 7.7'?
Comment 5 Peter Vreman 2021-08-11 09:22:44 UTC 
Ian,

Below the requested output on the latest 7.7-SAPSolutions/E4S. This filter setup like this 5+ years old (except the modulemd that is added in 6.7.3 last year) that is and  use for every RHEL contentview
~~~
[crash/LI] root@li-lc-2222:~# hammer content-view filter list --content-view-id=1968
----------|-----------------------------------------------------------|-------------|----------|----------
FILTER ID | NAME                                                      | DESCRIPTION | TYPE     | INCLUSION
----------|-----------------------------------------------------------|-------------|----------|----------
3827      | product-HOIRHEL-7.7SAPSOL-d20210808 Freeze Date           |             | erratum  | true
3824      | product-HOIRHEL-7.7SAPSOL-d20210808 Original Modules      |             | modulemd | true
3822      | product-HOIRHEL-7.7SAPSOL-d20210808 Original Packages     |             | rpm      | true
3833      | product-HOIRHEL-7.7SAPSOL-d20210808 Post Freeze Additions |             | erratum  | true
----------|-----------------------------------------------------------|-------------|----------|----------
[crash/LI] root@li-lc-2222:~# hammer content-view filter info --id=3827
Filter ID:    3827
Name:         product-HOIRHEL-7.7SAPSOL-d20210808 Freeze Date
Type:         erratum
Inclusion:    true
Description:
Repositories:

Rules:
 1) ID:         1342
    Start Date: 2000-01-01T00:00:00.000Z
    End Date:   2021-08-08T12:00:00.000Z
    Types:      security, enhancement, bugfix
    Created:    2021/08/08 14:15:18
    Updated:    2021/08/08 14:15:18

[crash/LI] root@li-lc-2222:~# hammer content-view filter info --id=3824
Filter ID:    3824
Name:         product-HOIRHEL-7.7SAPSOL-d20210808 Original Modules
Type:         modulemd
Inclusion:    true
Description:
Repositories:

Rules:

[crash/LI] root@li-lc-2222:~# hammer content-view filter info --id=3822
Filter ID:    3822
Name:         product-HOIRHEL-7.7SAPSOL-d20210808 Original Packages
Type:         rpm
Inclusion:    true
Description:
Repositories:

Rules:

[crash/LI] root@li-lc-2222:~# hammer content-view filter info --id=3833
Filter ID:    3833
Name:         product-HOIRHEL-7.7SAPSOL-d20210808 Post Freeze Additions
Type:         erratum
Inclusion:    true
Description:
Repositories:

Rules:

[crash/LI] root@li-lc-2222:~#
~~~


The hammer output is incomplete, it is missing the important values:
- filter 3824: 'original_module_streams=true'
- filter 3822: 'original_packages=true'
~~~
[crash/LI] root@li-lc-2222:~# curl -K /opt/hoici/etc/sat6/curl-hoici.conf "-HContent-Type: application/json" "-d{\"per_page\":9999999,\"organization_id\":3}" -XGET https://localhost/katello/api/content_view_filters/3822 | jq .original_packages
true
[crash/LI] root@li-lc-2222:~# curl -K /opt/hoici/etc/sat6/curl-hoici.conf "-HContent-Type: application/json" "-d{\"per_page\":9999999,\"organization_id\":3}" -XGET https://localhost/katello/api/content_view_filters/3824 | jq .original_module_streams
true
~~~
I leave it up to redhat if you want to create a RFE for it.
Comment 6 Peter Vreman 2021-08-11 09:34:48 UTC 
And the repositories assigned:

~~~
[crash/LI] root@li-lc-2222:~# hammer content-view info --id=1968
ID:                           1968
Name:                         product-HOIRHEL-7.7SAPSOL-d20210808
Label:                        product-HOIRHEL-7_7SAPSOL-d20210808
Composite:                    false
Description:
Content Host Count:           0
Force Puppet:                 false
Solve Dependencies:           false
Organization:                 Hilti
Yum Repositories:
 1) ID:    8022
    Name:  Red Hat Enterprise Linux 7 Server Kickstart x86_64 7.7
    Label: Red_Hat_Enterprise_Linux_7_Server_Kickstart_x86_64_7_7
 2) ID:    8416
    Name:  Red Hat Enterprise Linux 7 Server - Update Services for SAP Solutions RPMs x86_64 7.7
    Label: Red_Hat_Enterprise_Linux_7_Server_-_Update_Services_for_SAP_Solutions_RPMs_x86_64_7_7
 3) ID:    8417
    Name:  Red Hat Enterprise Linux 7 Server - Update Services for SAP Solutions - Optional RPMs x86_64 7.7
    Label: Red_Hat_Enterprise_Linux_7_Server_-_Update_Services_for_SAP_Solutions_-_Optional_RPMs_x86_64_7_7
 4) ID:    8420
    Name:  Red Hat Software Collections RPMs for Red Hat Enterprise Linux 7 RHEL 7 Server EUS x86_64 7.7
    Label: Red_Hat_Software_Collections_RPMs_for_Red_Hat_Enterprise_Linux_7_RHEL_7_Server_EUS_x86_64_7_7
 5) ID:    8424
    Name:  RHEL for SAP for RHEL 7 Server Update Services for SAP Solutions RPMs x86_64 7.7
    Label: RHEL_for_SAP_for_RHEL_7_Server_Update_Services_for_SAP_Solutions_RPMs_x86_64_7_7
 6) ID:    8425
    Name:  RHEL for SAP HANA for RHEL 7 Server Update Services for SAP Solutions RPMs x86_64 7.7
    Label: RHEL_for_SAP_HANA_for_RHEL_7_Server_Update_Services_for_SAP_Solutions_RPMs_x86_64_7_7
 7) ID:    111181
    Name:  Red Hat Satellite Tools 6.9 for RHEL 7 Server - Update Services SAP Solutions RPMs x86_64 7.7
    Label: Red_Hat_Satellite_Tools_6_9_for_RHEL_7_Server_-_Update_Services_SAP_Solutions_RPMs_x86_64_7_7
 8) ID:    115626
    Name:  HOIRHEL-7.7SAPSOL-d20210808
    Label: HOIRHEL-7_7SAPSOL-d20210808
Container Image Repositories:

OSTree Repositories:

Puppet Modules:

Lifecycle Environments:
 1) ID:   2
    Name: Library
Versions:
 1) ID:        13914
    Version:   1.0
    Published: 2021/08/08 14:15:23
Components:

Activation Keys:

[crash/LI] root@li-lc-2222:~#
~~~
Comment 7 Ian Ballou 2021-08-12 20:45:52 UTC 
Created redmine issue https://projects.theforeman.org/issues/33254 from this bug
Comment 8 Bryan Kearney 2021-08-20 04:05:22 UTC 
Moving this bug to POST for triage into Satellite since the upstream issue https://projects.theforeman.org/issues/33254 has been resolved.
Comment 13 Lai 2021-08-31 20:39:59 UTC 
Steps to test:

1. Sync some rh repos that has a large amount of erratas
2. Add the repos to a cv and publish it to get an initial count of erratas
3. Add an inclusion filter that includes most of the erratas
4. Publish new cv version
5. Confirm that the filter is pulling in a lot of erratas correctly
6. Sync a repo with errata but no modules
7. Publish it in a separate cv and note the errata count
8. Repeat steps 3-5
9. Repeat with repo has has errata and modules


Expected:
The errata count should pull in a lot more erratas for the filters

Actual:
The errata count does pull in a lot more erratas for the filters.

Verified in 6.10 snap 15 with tfm-rubygem-katello-4.1.1.15-1.el7sat.noarch
Comment 14 Lai 2021-08-31 20:41:06 UTC 
Created attachment 1819535 [details]
correct errata count

Putting screenshot for verification.
Comment 17 errata-xmlrpc 2021-11-16 14:13:02 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Satellite 6.10 Release), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:4702