Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1917076 - Wrong deps are added when publishing content view with "solve_dependencies=true"
Summary: Wrong deps are added when publishing content view with "solve_dependencies=true"
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Pulp
Version: 6.7.0
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: 6.9.0
Assignee: satellite6-bugs
QA Contact: Danny Synk
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-01-17 02:01 UTC by Hao Chang Yu
Modified: 2023-09-15 00:58 UTC (History)
12 users (show)

Fixed In Version: pulp-rpm-2.21.5
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1919414 (view as bug list)
Environment:
Last Closed: 2021-04-21 13:25:03 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github pulp pulp_rpm pull 1918 0 None closed Fix pulp depsolv issue when copy rpms with recursive config 2021-02-16 20:22:28 UTC
Github pulp pulp_rpm pull 1926 0 None closed Fix pulp depsolv issue when copy rpms with recursive config 2/2 2021-02-16 20:22:29 UTC
Pulp Redmine 8110 0 Normal CLOSED - CURRENTRELEASE Wrong deps are copied to the repo when using "recursive" option to copy rpms 2021-01-25 20:31:31 UTC
Red Hat Product Errata RHSA-2021:1313 0 None None None 2021-04-21 13:25:19 UTC

Internal Links: 1919524

Description Hao Chang Yu 2021-01-17 02:01:43 UTC
Description of problem:
Pulp solves the wrong dependent packages which will cause conflict to other packages.

Steps to Reproduce:
1. Enable the pulp debug log level and restart Pulp services
2. On Satellite Web UI, create a content view name "cv_rhel_8", set the "solve dependencies" to "Yes"
3. Add "Red Hat Enterprise Linux 8 for x86_64 - BaseOS (RPMs)" repository to the CV.
4. Create a filter to include all errata until 1st Oct 2020.
5. Create a filter to include all rpms without errata.
6. Publish the content view
7. Register a rhel 8 host to the CV.
8. Run dnf update on the host.

Actual results:
Update with dependencies issue as below:

# dnf update
Updating Subscription Management repositories.
Red Hat Enterprise Linux 8 for x86_64 - BaseOS (RPMs)                                                                                                                              2.8 MB/s |  21 MB     00:07    
Last metadata expiration check: 0:00:08 ago on Thu 14 Jan 2021 08:40:47 PM AEST.
Error: 
 Problem 1: package bluez-obexd-5.50-3.el8.x86_64 requires bluez(x86-64) = 5.50-3.el8, but none of the providers can be installed
  - cannot install both bluez-5.52-1.el8.x86_64 and bluez-5.50-3.el8.x86_64
  - cannot install the best update candidate for package bluez-obexd-5.50-3.el8.x86_64
  - cannot install the best update candidate for package bluez-5.50-3.el8.x86_64
 Problem 2: problem with installed package bluez-obexd-5.50-3.el8.x86_64
  - package bluez-obexd-5.50-3.el8.x86_64 requires bluez-libs(x86-64) = 5.50-3.el8, but none of the providers can be installed
  - cannot install both bluez-libs-5.52-1.el8.x86_64 and bluez-libs-5.50-3.el8.x86_64
  - cannot install the best update candidate for package bluez-libs-5.50-3.el8.x86_64
(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)


# The following libsolv error is printed in the journal log.

pulp: pulp_rpm.plugins.importers.yum.pulp_solv:DEBUG: [6c1e9667] (30103-60480) Encountered problems solving: cannot install both kpatch-0:0.6.1-noarch.noarch and kpatch-0:0.6.1-noarch.noarch, cannot install both libnl3-0:3.4.0-i686.i686 and libnl3-0:3.4.0-i686.i686, cannot install both krb5-pkinit-0:1.17-x86_64.x86_64 and krb5-pkinit-0:1.17-x86_64.x86_64, cannot install both NetworkManager-libnm-1:1.20.0-x86_64.x86_64 and NetworkManager-libnm-1:1.20.0-x86_64.x86_64, cannot install both systemd-libs-0:239-x86_64.x86_64 and systemd-libs-0:239-x86_64.x86_64, cannot install both glibc-langpack-ro-0:2.28-x86_64.x86_64 and glibc-langpack-ro-0:2.28-x86_64.x86_64, cannot install both glibc-langpack-so-0:2.28-x86_64.x86_64 and glibc-langpack-so-0:2.28-x86_64.x86_64, cannot install both glibc-langpack-sk-0:2.28-x86_64.x86_64 and glibc-langpack-sk-0:2.28-x86_64.x86_64, cannot install both libsss_idmap-0:2.0.0-x86_64.x86_64 and libsss_idmap-0:2.0.0-x86_64.x86_64, cannot install both python3-test-0:3.6.8-x86_64.x86_64 and python3-test-0:3.6.8-x86_64.x86_64, cannot install both glibc-langpack-br-0:2.28-x86_64.x86_64 and glibc-langpack-br-0:2.28-x86_64.x86_64, cannot install both xfsprogs-0:5.0.0-i686.i686 and xfsprogs-0:5.0.0-i686.i686, cannot install both glibc-langpack-li-0:2.28-x86_64.x86_64 and glibc-langpack-li-0:2.28-x86_64.x86_64, cannot install both libcomps-devel-0:0.1.11-x86_64.x86_64 and libcomps-devel-0:0.1.11-x86_64.x86_64, cannot install both iwl5000-firmware-0:8.83.5.1_1-noarch.noarch and iwl5000-firmware-0:8.83.5.1_1-noarch.noarch, cannot install both glibc-langpack-ar-0:2.28-x86_64.x86_64 and glibc-langpack-ar-0:2.28-x86_64.x86_64, cannot install both glibc-langpack-gv-0:2.28-x86_64.x86_64 and glibc-langpack-gv-0:2.28-x86_64.x86_64, cannot install both libxml2-0:2.9.7-x86_64.x86_64 and libxml2-0:2.9.7-x86_64.x86_64, cannot install both samba-client-libs-0:4.10.4-x86_64.x86_64 and samba-client-libs-0:4.10.4-x86_64.x86_64, cannot install both xfsprogs-devel-0:5.0.0-x86_64.x86_64 and xfsprogs-devel-0:5.0.0-x86_64.x86_64, cannot install both libfdisk-devel-0:2.32.1-x86_64.x86_64 and libfdisk-devel-0:2.32.1-x86_64.x86_64, cannot install both glibc-langpack-it-0:2.28-x86_64.x86_64 and glibc-langpack-it-0:2.28-x86_64.x86_64, cannot install both sssd-client-0:2.2.0-x86_64.x86_64 and sssd-client-0:2.2.0-x86_64.x86_64, cannot install both glibc-langpack-en-0:2.28-x86_64.x86_64 and glibc-langpack-en-0:2.28-x86_64.x86_64, cannot install both gnutls-0:3.6.8-i686.i686 and gnutls-0:3.6.8-i686.i686, cannot install both libcurl-minimal-0:7.61.1-x86_64.x86_64 and libcurl-minimal-0:7.61.1-x86_64.x86_64, cannot install both uuidd-0:2.32.1-x86_64.x86_64 and uuidd-0:2.32.1-x86_64.x86_64, cannot install both dnf-data-0:4.2.17-noarch.noarch and dnf-data-0:4.2.17-noarch.noarch, cannot install both cups-libs-1:2.2.6-x86_64.x86_64 and cups-libs-1:2.2.6-x86_64.x86_64, cannot install both sssd-kcm-0:2.2.0-x86_64.x86_64 and sssd-kcm-0:2.2.0-x86_64.x86_64, cannot install both platform-python-0:3.6.8-x86_64.x86_64 and platform-python-0:3.6.8-x86_64.x86_64, cannot install both libipa_hbac-0:2.0.0-i686.i686 and libipa_hbac-0:2.0.0-i686.i686, cannot install both glibc-devel-0:2.28-x86_64.x86_64 and glibc-devel-0:2.28-x86_64.x86_64, cannot install both libtirpc-0:1.1.4-i686.i686 and libtirpc-0:1.1.4-i686.i686, cannot install both dhcp-relay-12:4.3.6-x86_64.x86_64 and dhcp-relay-12:4.3.6-x86_64.x86_64, cannot install both python3-perf-0:4.18.0-x86_64.x86_64 and python3-perf-0:4.18.0-x86_64.x86_64, cannot install both lua-libs-0:5.3.4-i686.i686 and lua-libs-0:5.3.4-i686.i686, cannot install both glibc-langpack-sgs-0:2.28-x86_64.x86_64 and glibc-langpack-sgs-0:2.28-x86_64.x86_64, cannot install both iwl3160-firmware-1:25.30.13.0-noarch.noarch and iwl3160-firmware-1:25.30.13.0-noarch.noarch, cannot install both realmd-0:0.16.3-x86_64.x86_64 and realmd-0:0.16.3-x86_64.x86_64, cannot install both cyrus-sasl-plain-0:2.1.27-x86_64.x86_64....<snip>


Expected results:
1. No problem in libsolv while publishing the CV.
2. Either nothing to update (depend on the rhel8 version) or update packages without problem.


Additional info:
While checking the above log, you should notice that the "nevr" of the rpm is not correct, such as "iwl3160-firmware-1:25.30.13.0-noarch.noarch". This is causing many same rpm versions are parsing to libsolv. Libsolv complains that it can't install the same version of rpms like below:

"cannot install both iwl3160-firmware-1:25.30.13.0-noarch.noarch and iwl3160-firmware-1:25.30.13.0-noarch.noarch"
"cannot install both libtirpc-0:1.1.4-i686.i686 and libtirpc-0:1.1.4-i686.i686"

Below is the offending line in the code. It sets the "r" to "arch", but it should be set to "release".

https://github.com/pulp/pulp_rpm/blob/2-master/plugins/pulp_rpm/plugins/importers/yum/pulp_solv.py#L227

Amending this line seems to solve the issue. Libsolv doesn't complain any problem. The libsolve transaction (transaction.newsolvables() method) pulls the correct number of rpms (which is equal or more than to the associating rpms)

Comment 1 Francesco Ratto 2021-01-18 09:11:31 UTC
Severity and priority raised to urgent since the CU is blocked in its day to day update operations wich also blocks developers

Comment 2 Pavel Moravec 2021-01-18 09:30:17 UTC
This affects Sat6.7 the same way like 6.8 (and in fact it was discovered on 6.7 where we request a fix as well for the customer behind the bug).

Hao++ for finding the cause and patch proposal.

Comment 3 pulp-infra@redhat.com 2021-01-18 15:21:25 UTC
The Pulp upstream bug status is at POST. Updating the external tracker on this bug.

Comment 4 pulp-infra@redhat.com 2021-01-18 15:21:27 UTC
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.

Comment 5 pulp-infra@redhat.com 2021-01-18 18:16:58 UTC
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.

Comment 6 pulp-infra@redhat.com 2021-01-18 19:45:48 UTC
All upstream Pulp bugs are at MODIFIED+. Moving this bug to POST.

Comment 7 Francesco Ratto 2021-01-19 08:13:19 UTC
Good Morning 

 We ask urgent hotfix to solve the issue
 It looks the proposed workaround failed and the CU is blocked in his update activities

 Thanks for the support

Comment 9 Francesco Ratto 2021-01-19 12:45:39 UTC
please when you will release the hotfix add advices about which filter should be applied based on Hao first comment

many thanks

Francesco

Comment 11 Pavel Moravec 2021-01-20 21:23:12 UTC
We need to apply the same code change also here:

https://github.com/pulp/pulp_rpm/blob/2-master/plugins/pulp_rpm/plugins/importers/yum/pulp_solv.py#L305

I will file pulp-2 upstream issue tomorrow for this (until somebody will be faster).

Comment 12 pulp-infra@redhat.com 2021-01-20 21:25:34 UTC
All upstream Pulp bugs are at MODIFIED+. Moving this bug to POST.

Comment 13 Pavel Moravec 2021-01-21 08:08:11 UTC
Important note for backporting:

The upstream pulp issue #8110 requires _two_ upstream PRs backport: #1918 and also #1926 (and optionally #1923 also (fixes typos in debug logs)).

Comment 17 pulp-infra@redhat.com 2021-01-25 20:31:32 UTC
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.

Comment 19 Danny Synk 2021-03-18 20:32:33 UTC
Steps to test:

- Deploy a Satellite 6.9, snap 17.
- Create a content view containing the "Red Hat Enterprise Linux 8 for x86_64 - BaseOS (RPMs)" repository.
- Register and subscribe a RHEL 8 content host and add it to the content view.
- Install the packages bluez-5.50-1.el8.x86_64 and bluez-obexd-5.50-1.el8.x86_64.rpm.
- Create two Yum content filters on the content view: 1) a filter with Inclusion type "include," Content Type "Errata - Date and Type," all Errata Types selected, Date Type "Updated On," and an end date of 1 October 2020; and 2) a filter with Content Type "RPM," Inclusion Type "Include," and the option "Include all RPMs with no errata" selected.
- Publish a new version of the content view.
- Run `dnf update` on the content host.

Expected Results:
1. The new content view version is published without libsolv errors in /var/log/messages.
2. The content host is able to update packages without errors. 


Actual Results:
1. No libsolv errors are present in /var/log/messages on the Satellite.
2. The content host successfully updated bluez, bluez-libs, and bluez-obexd to the expected versions:

~~~
[root@dhcp-2-61 ~]# dnf update
Updating Subscription Management repositories.
Red Hat Enterprise Linux 8 for x86_64 - B  24 kB/s | 2.4 kB     00:00    
Red Hat Enterprise Linux 8 for x86_64 - A  27 kB/s | 2.8 kB     00:00    
Dependencies resolved.
==========================================================================
 Package      Arch    Version        Repository                      Size
==========================================================================
Upgrading:
 bluez        x86_64  5.50-3.el8     rhel-8-for-x86_64-baseos-rpms  1.2 M
 bluez-libs   x86_64  5.50-3.el8     rhel-8-for-x86_64-baseos-rpms   92 k
 bluez-obexd  x86_64  5.50-3.el8     rhel-8-for-x86_64-baseos-rpms  210 k

Transaction Summary
==========================================================================
Upgrade  3 Packages

Total download size: 1.5 M
Is this ok [y/N]: y
Downloading Packages:
(1/3): bluez-libs-5.50-3.el8.x86_64.rpm   630 kB/s |  92 kB     00:00    
(2/3): bluez-obexd-5.50-3.el8.x86_64.rpm  1.4 MB/s | 210 kB     00:00    
(3/3): bluez-5.50-3.el8.x86_64.rpm        7.5 MB/s | 1.2 MB     00:00    
--------------------------------------------------------------------------
Total                                     9.2 MB/s | 1.5 MB     00:00     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                  1/1 
  Running scriptlet: bluez-libs-5.50-3.el8.x86_64                     1/1 
  Upgrading        : bluez-libs-5.50-3.el8.x86_64                     1/6 
  Upgrading        : bluez-5.50-3.el8.x86_64                          2/6 
  Running scriptlet: bluez-5.50-3.el8.x86_64                          2/6 
  Upgrading        : bluez-obexd-5.50-3.el8.x86_64                    3/6 
  Running scriptlet: bluez-obexd-5.50-3.el8.x86_64                    3/6 
  Running scriptlet: bluez-obexd-5.50-1.el8.x86_64                    4/6 
  Cleanup          : bluez-obexd-5.50-1.el8.x86_64                    4/6 
  Running scriptlet: bluez-5.50-1.el8.x86_64                          5/6 
  Cleanup          : bluez-5.50-1.el8.x86_64                          5/6 
  Running scriptlet: bluez-5.50-1.el8.x86_64                          5/6 
  Cleanup          : bluez-libs-5.50-1.el8.x86_64                     6/6 
  Running scriptlet: bluez-libs-5.50-1.el8.x86_64                     6/6 
  Verifying        : bluez-5.50-3.el8.x86_64                          1/6 
  Verifying        : bluez-5.50-1.el8.x86_64                          2/6 
  Verifying        : bluez-libs-5.50-3.el8.x86_64                     3/6 
  Verifying        : bluez-libs-5.50-1.el8.x86_64                     4/6 
  Verifying        : bluez-obexd-5.50-3.el8.x86_64                    5/6 
  Verifying        : bluez-obexd-5.50-1.el8.x86_64                    6/6 
Installed products updated.

Upgraded:
  bluez-5.50-3.el8.x86_64              bluez-libs-5.50-3.el8.x86_64       
  bluez-obexd-5.50-3.el8.x86_64       

Complete!
~~~

Verified on Satellite 6.9, snap 17.

Comment 22 errata-xmlrpc 2021-04-21 13:25:03 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Satellite 6.9 Release), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:1313

Comment 23 Red Hat Bugzilla 2023-09-15 00:58:26 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 500 days


Note You need to log in before you can comment on or make changes to this bug.