Bug 1695038

Summary: Upgrade from RHV 4.0 to 4.2 failing while using "ovirt-fast-forward-upgrade" tool due to wrong "jb-eap*" channel subscribed by the fast-forward-upgrade tool.
Product: Red Hat Enterprise Virtualization Manager Reporter: Sachin Raje <sraje>
Component: ovirt-fast-forward-upgradeAssignee: Douglas Schilling Landgraf <dougsland>
Status: CLOSED ERRATA QA Contact: Petr Kubica <pkubica>
Severity: medium Docs Contact:
Priority: urgent    
Version: 4.2.8-4CC: amarchuk, dougsland, lleistne, lsvaty, mgoldboi, michal.skrivanek, mperina, pkubica, rdlugyhe
Target Milestone: ovirt-4.3.3Keywords: Reopened, ZStream
Target Release: 4.3.0Flags: lsvaty: testing_plan_complete-
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: ovirt-fast-forward-upgrade-1.0.0-11.el7ev Doc Type: Bug Fix
Doc Text:
Previously, upgrading from RHV 4.0 to 4.2 failed while using "ovirt-fast-forward-upgrade" tool due to 'eap7-jboss*' dependency issues. The current release includes a patch that fixes this bug.
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-05-08 12:36:32 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Infra RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Sachin Raje 2019-04-02 11:10:49 UTC
Description of problem:

Upgrade from RHV 4.0 to 4.2 failing while using  "ovirt-fast-forward-upgrade" tool due to 'eap7-jboss*' dependency issues.


Version-Release number of selected component (if applicable):
RHV-4.0
ovirt-fast-forward-upgrade


How reproducible:
Always


Steps to Reproduce:
1. Install "ovirt-fast-forward-upgrade" package on RHEv-M 4.0 system.
2. Execute the "ovirt-fast-forward-upgrade" command to upgrade it to latest RHV-4.2.x version
3. 

Actual results:

Upgrade failed with Transaction check error and aborts the upgrade process.

~~~
Transaction check error:
  file /opt/rh/eap7/root/usr/share/java/weld-api-sources.jar from install of eap7-jboss-weld-3.0-api-weld-api-0:3.0.0-7.SP4_redhat_00001.1.el7eap.noarch conflicts with file from package eap7-jboss-weld-2.2-api-0:2.3.0-7.SP1_redhat_1.1.ep7.el7.noarch
  file /opt/rh/eap7/root/usr/share/java/weld-api.jar from install of eap7-jboss-weld-3.0-api-weld-api-0:3.0.0-7.SP4_redhat_00001.1.el7eap.noarch conflicts with file from package eap7-jboss-weld-2.2-api-0:2.3.0-7.SP1_redhat_1.1.ep7.el7.noarch
  file /opt/rh/eap7/root/usr/share/java/weld-spi-sources.jar from install of eap7-jboss-weld-3.0-api-weld-spi-0:3.0.0-7.SP4_redhat_00001.1.el7eap.noarch conflicts with file from package eap7-jboss-weld-2.2-api-0:2.3.0-7.SP1_redhat_1.1.ep7.el7.noarch
  file /opt/rh/eap7/root/usr/share/java/weld-spi.jar from install of eap7-jboss-weld-3.0-api-weld-spi-0:3.0.0-7.SP4_redhat_00001.1.el7eap.noarch conflicts with file from package eap7-jboss-weld-2.2-api-0:2.3.0-7.SP1_redhat_1.1.ep7.el7.noarch

Error Summary
-------------

[ ERROR  ] Aborting.. yum update failed...
~~~


Expected results:

Upgrade from RHV 4.0 to RHV 4.2 using "ovirt-fast-forward-upgrade" tool should complete successfully without any errors.

Additional info:

The '/usr/sbin/ovirt-fast-forward-upgrade' has following eap repos which gets enabled during upgrade process. These 'jb-eap" channel version for RHV-4.0 and RHV-4.1 are different from the one mentioned in respective 4.0 and 4.1 installation guide. 

It should be,

jb-eap-7.0-for-rhel-7-server-rpms <<== RHV-4.0

and

jb-eap-7.1-for-rhel-7-server-rpms <<== RHV-4.1

But in "/usr/sbin/ovirt-fast-forward-upgrade" following incorrect repos mentioned i.e"jb-eap7*" repo versions wrong for RHV-4.0 and RHV4.1 repos section.

~~~
RHV_40_REPOS = [
    "rhel-7-server-supplementary-rpms",
    "rhel-7-server-rpms",
    "rhel-7-server-rhv-4.0-rpms",
    "jb-eap-7-for-rhel-7-server-rpms"       <<==
]

RHV_41_REPOS = [
    "rhel-7-server-supplementary-rpms",
    "rhel-7-server-rpms",
    "rhel-7-server-rhv-4.1-rpms",
    "rhel-7-server-rhv-4-tools-rpms",
    "jb-eap-7-for-rhel-7-server-rpms"      <<==
]

RHV_42_REPOS = [
    "rhel-7-server-supplementary-rpms",
    "rhel-7-server-rpms",
    "rhel-7-server-rhv-4.2-manager-rpms",
    "rhel-7-server-rhv-4-manager-tools-rpms",
    "rhel-7-server-ansible-2-rpms",
    "jb-eap-7-for-rhel-7-server-rpms"      
]

~~~

References: 

RHEV-4.0 Repositories :

https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.0/html-single/installation_guide/#Subscribing_to_the_Red_Hat_Enterprise_Virtualization_Manager_Channels_using_Subscription_Manager

RHEV-4.1 Repositories :
https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.1/html-single/installation_guide/#Subscribing_to_the_Red_Hat_Enterprise_Virtualization_Manager_Channels_using_Subscription_Manager

RHEV-4.2 Repositories :
https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.2/html-single/installation_guide/#Enabling_the_Red_Hat_Virtualization_Manager_Repositories_standalone_install

Comment 2 Sandro Bonazzola 2019-04-02 12:14:24 UTC
Martin can you please confirm channel listing here?

Comment 3 Martin Perina 2019-04-02 12:29:34 UTC
AFAIK this was already fixed in 4.3, see attached patches

Comment 4 Michal Skrivanek 2019-04-08 12:16:50 UTC
Testable in ovirt-fast-forward-upgrade-1.0.0-8.el7ev

Comment 6 Petr Kubica 2019-04-10 12:58:23 UTC
Testable package isn't included in 4.2.8-9 build
There is still ovirt-fast-forward-upgrade-1.0.0-1.el7ev.noarch

according to documentation [1], the package should be? available also (and primarily) in older versions of RHV to do fast upgrade from 4.0 to latest version 4.x?

next, when I tried to install ovirt-fast-forward-upgrade-1.0.0-8.el7ev on RHV 4.0, I got an issue, which prevent to install package due to missing engine-db-query [2]

[2]
ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch.rpm                                                                                                                                           |  16 kB  00:00:00     
Examining /var/tmp/yum-root-u0R5i3/ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch.rpm: ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch
Marking /var/tmp/yum-root-u0R5i3/ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch.rpm as an update to ovirt-fast-forward-upgrade-1.0.0-1.el7ev.noarch
Resolving Dependencies
--> Running transaction check
---> Package ovirt-fast-forward-upgrade.noarch 0:1.0.0-1.el7ev will be updated
---> Package ovirt-fast-forward-upgrade.noarch 0:1.0.0-8.el7ev will be an update
--> Processing Dependency: engine-db-query for package: ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch
--> Finished Dependency Resolution
Error: Package: ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch (/ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch)
           Requires: engine-db-query
**********************************************************************
yum can be configured to try to resolve such errors by temporarily enabling
disabled repos and searching for missing dependencies.
To enable this functionality please set 'notify_only=0' in /etc/yum/pluginconf.d/search-disabled-repos.conf
**********************************************************************

Error: Package: ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch (/ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch)
           Requires: engine-db-query
 You could try using --skip-broken to work around the problem
 You could try running: rpm -Va --nofiles --nodigest

[1] https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.2/html/upgrade_guide/upgrading_with_ovirt-fast-forward-upgrade

Comment 7 Douglas Schilling Landgraf 2019-04-10 14:15:18 UTC
(In reply to Petr Kubica from comment #6)
> Testable package isn't included in 4.2.8-9 build
> There is still ovirt-fast-forward-upgrade-1.0.0-1.el7ev.noarch
> 
> according to documentation [1], the package should be? available also (and
> primarily) in older versions of RHV to do fast upgrade from 4.0 to latest
> version 4.x?
> 
> next, when I tried to install ovirt-fast-forward-upgrade-1.0.0-8.el7ev on
> RHV 4.0, I got an issue, which prevent to install package due to missing
> engine-db-query [2]
> 
> [2]
> ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch.rpm                         
> |  16 kB  00:00:00     
> Examining
> /var/tmp/yum-root-u0R5i3/ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch.rpm:
> ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch
> Marking
> /var/tmp/yum-root-u0R5i3/ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch.rpm
> as an update to ovirt-fast-forward-upgrade-1.0.0-1.el7ev.noarch
> Resolving Dependencies
> --> Running transaction check
> ---> Package ovirt-fast-forward-upgrade.noarch 0:1.0.0-1.el7ev will be
> updated
> ---> Package ovirt-fast-forward-upgrade.noarch 0:1.0.0-8.el7ev will be an
> update
> --> Processing Dependency: engine-db-query for package:
> ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch
> --> Finished Dependency Resolution
> Error: Package: ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch
> (/ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch)
>            Requires: engine-db-query
> **********************************************************************
> yum can be configured to try to resolve such errors by temporarily enabling
> disabled repos and searching for missing dependencies.
> To enable this functionality please set 'notify_only=0' in
> /etc/yum/pluginconf.d/search-disabled-repos.conf
> **********************************************************************
> 
> Error: Package: ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch
> (/ovirt-fast-forward-upgrade-1.0.0-8.el7ev.noarch)
>            Requires: engine-db-query
>  You could try using --skip-broken to work around the problem
>  You could try running: rpm -Va --nofiles --nodigest
> 
> [1]
> https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.2/
> html/upgrade_guide/upgrading_with_ovirt-fast-forward-upgrade

There is RCM case opened for this:
https://projects.engineering.redhat.com/browse/RCM-54300

Comment 8 Petr Kubica 2019-04-11 13:53:24 UTC
for version 4.3 there are still beta channels

RHV_43_REPOS = [
    "rhel-7-server-supplementary-rpms",
    "rhel-7-server-rpms",
    "rhel-7-server-rhv-4-beta-rpms",
    "rhel-7-server-rhv-4-tools-beta-rpms",
    "rhel-7-server-ansible-2-rpms",
    "jb-eap-7.2-for-rhel-7-server-rpms"
]

should I create a new bug for it or is it already handled somewhere?
ver: ovirt-fast-forward-upgrade-1.0.0-11.el7ev.noarch

Comment 9 Petr Kubica 2019-04-11 15:10:09 UTC
Finally verified in ovirt-fast-forward-upgrade-1.0.0-12.el7ev.noarch
issue with RHV 4.3 beta channels was fixed within this version

Comment 11 Sandro Bonazzola 2019-04-24 13:59:12 UTC
This bug is being fixed with RHV 4.3 GA release. The package will be included in the rhv-m tools channel which is shared with RHV 4.2 and RHV 4.3 so this will be available in RHV 4.2.8 too. Moving target milestone to 4.3.3 to properly record this bug closing time.

Comment 14 errata-xmlrpc 2019-05-08 12:36:32 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:1078

Comment 15 Daniel Gur 2019-08-28 13:15:06 UTC
sync2jira

Comment 16 Daniel Gur 2019-08-28 13:20:09 UTC
sync2jira