Bug 1749486 - octavia upgrade fails with Error: Package: rhosp-director-images-x86_64-13.0-20190304.1.el7ost.noarch Requires: octavia-amphora-image-x86_64 = 13.0-20190304.1.el7ost
Summary: octavia upgrade fails with Error: Package: rhosp-director-images-x86_64-13.0...
Keywords:
Status: CLOSED EOL
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: rhosp-director-images
Version: 13.0 (Queens)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ---
: ---
Assignee: Jason Joyce
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-09-05 18:04 UTC by Andreas Karis
Modified: 2024-03-25 15:24 UTC (History)
15 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2023-07-10 17:32:08 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker OSP-1657 0 None None None 2022-02-05 09:16:48 UTC
Red Hat Knowledge Base (Solution) 5358211 0 None None None 2020-08-29 22:46:23 UTC

Comment 2 Andreas Karis 2019-09-05 18:06:41 UTC
Description of problem:
In an environment where several minor upgrades were run. Octavia fails, I think because several versions of rhosp-director-images octavia-amphora-image  are already installed and only x number are kept. When yum tries to remove the oldest RPMs, the dependencies fail and the upgrade along with it.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

~~~
(undercloud) [10:14:45-stack@director1:~]$ openstack stack failures list overcloud --long
overcloud.AllNodesDeploySteps.WorkflowTasks_Step5_Execution:
  resource_type: OS::TripleO::WorkflowSteps
  physical_resource_id: 40595d04-c2f6-4daf-a234-e98afcbc939e
  status: CREATE_FAILED
  status_reason: |
    resources.WorkflowTasks_Step5_Execution: Failure caused by error in tasks: octavia_post_workflow

      octavia_post_workflow [task_ex_id=0fc250ea-5cde-41c5-a5e5-4ea8ff147448] -> Failure caused by error in tasks: upload_amphora

      upload_amphora [task_ex_id=368931d4-cab9-4a18-9551-f9bf89fd634f] -> Failed to run action [action_ex_id=61df964d-473c-4bad-b6c8-7388fd137ea0, action_cls='<class 'mistral.actions.action_factory.AnsiblePlaybookAction'>', attributes='{}', params='{u'extra_env_variables': {u'ANSIBLE_REMOTE_TEMP': u'/tmp/file-mistral-actionCZKrDN', u'ANSIBLE_LOCAL_TEMP': u'/tmp/file-mistral-actionkbW866', u'ANSIBLE_SSH_RETRIES': u'3', u'ANSIBLE_HOST_KEY_CHECKING': u'False'}, u'extra_vars': {u'amp_ssh_key_path': u'', u'amp_to_raw': False, u'amp_ssh_key_data': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDT+SOnPTgSpEo1QFQaAWgqHdROxw1/LUsE5ru5Yl+0KoxpEFDVIpJsSj7NFBZjgw2R2CuQ2NObtWsFusdk2gh+iO4fAeX94k0+vg/GLoq75UtEf0MS0WSi2RdrKNSV6A1ERPm03+tx/qaoH0oeK9WOgsoNgPmEda6/LZG1dTMqYzF1lTZ1YTh61NUR/wj+8a7Fd8TMCuMfT6fGUFSpLkOEdZ8qku7DM7qO4npfBAv61+/nxE5wa5PHKlp+WaCqgYzMbHY5AmF9WHD1m48D7R3muiFxFt5h1GX3exRQhY5TNwZ50g7XY35PfdyTcIEwomhj/it1LxPHoEPD0FiSVWEd stack.com\n', u'os_username': u'admin', u'os_identity_api_version': u'3', u'amp_image_tag': u'amphora-image', u'amp_image_filename': u'', u'auth_project_name': u'service', u'amp_image_name': u'', u'os_auth_url': u'https://openstack.example.com:13000/v3', u'amp_ssh_key_name': u'octavia-ssh-key', u'os_project_name': u'admin', u'os_password': u'8caeH9rb2xjNQdXcw2Tsbt9Fj', u'os_auth_type': u'password', u'auth_password': u'eEGGJqMdMQEwRq8eWCypVbWXz', u'auth_username': u'octavia'}, u'remote_user': u'stack', u'playbook': u'/usr/share/tripleo-common/playbooks/octavia-files.yaml', u'inventory': {u'undercloud': {u'hosts': {u'localhost': {u'ansible_connection': u'local'}}}}}']
     Unexpected error while running command.
    Command: ansible-playbook -vvvvv /usr/share/tripleo-common/playbooks/octavia-files.yaml --user stack --extra-vars {"amp_ssh_key_path": "", "amp_to_raw": false, "amp_ssh_key_data": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDT+SOnPTgSpEo1QFQaAWgqHdROxw1/LUsE5ru5Yl+0KoxpEFDVIpJsSj7NFBZjgw2R2CuQ2NObtWsFusdk2gh+iO4fAeX94k0+vg/GLoq75UtEf0MS0WSi2RdrKNSV6A1ERPm03+tx/qaoH0oeK9WOgsoNgPmEda6/LZG1dTMqYzF1lTZ1YTh61NUR/wj+8a7Fd8TMCuMfT6fGUFSpLkOEdZ8qku7DM7qO4npfBAv61+/nxE5wa5PHKlp+WaCqgYzMbHY5AmF9WHD1m48D7R3muiFxFt5h1GX3exRQhY5TNwZ50g7XY35PfdyTcIEwomhj/it1LxPHoEPD0FiSVWEd stack.com\n", "os_username": "admin", "os_identity_api_version": "3", "amp_image_tag": "amphora-image", "amp_image_filename": "", "auth_project_name": "service", "amp_image_name": "", "os_auth_url": "https://openstack.example.com:13000/v3", "amp_ssh_key_name": "octavia-ssh-key", "os_project_name": "admin", "os_password": "***", "os_auth_type": "password", "auth_password": "***", "auth_username": "octavia"} --inventory-file /tmp/ansible-mistral-actionoXLEWw/inventory.yaml
    Exit code: 2
~~~

We see that Director executes this on localhost:
~~~
<localhost> EXEC sudo yum -y install octavia-amphora-image
fatal: [localhost]: FAILED! => {
    "changed": true, 
    "msg": "non-zero return code", 
    "rc": 1, 
    "stderr": "Error: Package: rhosp-director-images-x86_64-13.0-20190304.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)\
           Requires: octavia-amphora-image-x86_64 = 13.0-20190304.1.el7ost\
           Removing: octavia-amphora-image-x86_64-13.0-20190304.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)\
               octavia-amphora-image-x86_64 = 13.0-20190304.1.el7ost\
           Installed: octavia-amphora-image-x86_64-13.0-20190418.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)\
               octavia-amphora-image-x86_64 = 13.0-20190418.1.el7ost\
           Installed: octavia-amphora-image-x86_64-13.0-20190806.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)\
               octavia-amphora-image-x86_64 = 13.0-20190806.1.el7ost\
           Available: octavia-amphora-image-x86_64-13.0-20180822.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)\
               octavia-amphora-image-x86_64 = 13.0-20180822.1.el7ost\
           Available: octavia-amphora-image-x86_64-13.0-20180905.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)\
               octavia-amphora-image-x86_64 = 13.0-20180905.1.el7ost\
           Available: octavia-amphora-image-x86_64-13.0-20181101.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)\
               octavia-amphora-image-x86_64 = 13.0-20181101.1.el7ost\
           Available: octavia-amphora-image-x86_64-13.0-20181107.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)\
               octavia-amphora-image-x86_64 = 13.0-20181107.1.el7ost\
           Available: octavia-amphora-image-x86_64-13.0-20190109.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)\
               octavia-amphora-image-x86_64 = 13.0-20190109.1.el7ost\
           Available: octavia-amphora-image-x86_64-13.0-20190627.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)\
               octavia-amphora-image-x86_64 = 13.0-20190627.1.el7ost\
           Installing: octavia-amphora-image-x86_64-13.0-20190827.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)\
               octavia-amphora-image-x86_64 = 13.0-20190827.1.el7ost\
", 
    "stderr_lines": [
        "Error: Package: rhosp-director-images-x86_64-13.0-20190304.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)", 
        "           Requires: octavia-amphora-image-x86_64 = 13.0-20190304.1.el7ost", 
        "           Removing: octavia-amphora-image-x86_64-13.0-20190304.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)", 
        "               octavia-amphora-image-x86_64 = 13.0-20190304.1.el7ost", 
        "           Installed: octavia-amphora-image-x86_64-13.0-20190418.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)", 
        "               octavia-amphora-image-x86_64 = 13.0-20190418.1.el7ost", 
        "           Installed: octavia-amphora-image-x86_64-13.0-20190806.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)", 
        "               octavia-amphora-image-x86_64 = 13.0-20190806.1.el7ost", 
        "           Available: octavia-amphora-image-x86_64-13.0-20180822.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)", 
        "               octavia-amphora-image-x86_64 = 13.0-20180822.1.el7ost", 
        "           Available: octavia-amphora-image-x86_64-13.0-20180905.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)", 
        "               octavia-amphora-image-x86_64 = 13.0-20180905.1.el7ost", 
        "           Available: octavia-amphora-image-x86_64-13.0-20181101.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)", 
        "               octavia-amphora-image-x86_64 = 13.0-20181101.1.el7ost", 
        "           Available: octavia-amphora-image-x86_64-13.0-20181107.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)", 
        "               octavia-amphora-image-x86_64 = 13.0-20181107.1.el7ost", 
        "           Available: octavia-amphora-image-x86_64-13.0-20190109.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)", 
        "               octavia-amphora-image-x86_64 = 13.0-20190109.1.el7ost", 
        "           Available: octavia-amphora-image-x86_64-13.0-20190627.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)", 
        "               octavia-amphora-image-x86_64 = 13.0-20190627.1.el7ost", 
        "           Installing: octavia-amphora-image-x86_64-13.0-20190827.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)", 
        "               octavia-amphora-image-x86_64 = 13.0-20190827.1.el7ost"
    ], 
    "stdout": "Loaded plugins: product-id, rhnplugin, search-disabled-repos, subscription-\
              : manager\
This system is receiving updates from RHN Classic or Red Hat Satellite.\
Resolving Dependencies\
--> Running transaction check\
---> Package octavia-amphora-image.noarch 0:13.0-20190806.1.el7ost will be updated\
---> Package octavia-amphora-image.noarch 0:13.0-20190827.1.el7ost will be an update\
--> Processing Dependency: octavia-amphora-image-x86_64 = 13.0-20190827.1.el7ost for package: octavia-amphora-image-13.0-20190827.1.el7ost.noarch\
--> Running transaction check\
---> Package octavia-amphora-image-x86_64.noarch 0:13.0-20190827.1.el7ost will be installed\
--> Finished Dependency Resolution\
--> Running transaction check\
---> Package octavia-amphora-image-x86_64.noarch 0:13.0-20190304.1.el7ost will be erased\
--> Processing Dependency: octavia-amphora-image-x86_64 = 13.0-20190304.1.el7ost for package: rhosp-director-images-x86_64-13.0-20190304.1.el7ost.noarch\
--> Finished Dependency Resolution\
 You could try using --skip-broken to work around the problem\
 You could try running: rpm -Va --nofiles --nodigest\
~~~

Comment 3 Andreas Karis 2019-09-05 19:35:41 UTC
Hi,

I figured out what the issue is:

There's a dependency of the meta RPM rhosp-director-images which requires octavia-amphora-image (a dependency which I do not understand ...)
3 copies of octavia-amphora-image are retained. Upon installation of a more recent version of that RPM, yum tries to uninstall the oldest one and tries to delete the corresponding rhosp-director-images. That fails.

Reproducing the issue:
~~~
[root@undercloud-r430 ~]# rpm -qa | grep director
rhosp-director-images-x86_64-13.0-20190304.1.el7ost.noarch
rhosp-director-images-ipa-x86_64-13.0-20190418.1.el7ost.noarch
rhosp-director-images-13.0-20190806.1.el7ost.noarch
rhosp-director-images-ipa-13.0-20190806.1.el7ost.noarch
rhosp-director-images-13.0-20190418.1.el7ost.noarch
rhosp-director-images-ipa-x86_64-13.0-20190806.1.el7ost.noarch
rhosp-director-images-ipa-x86_64-13.0-20190304.1.el7ost.noarch
rhosp-director-images-ipa-13.0-20190304.1.el7ost.noarch
rprhosp-director-images-x86_64-13.0-20190418.1.el7ost.noarch
m rhosp-director-images-13.0-20190304.1.el7ost.noarch
-rhosp-director-images-x86_64-13.0-20190806.1.el7ost.noarch
qrhosp-director-images-ipa-13.0-20190418.1.el7ost.noarch
a[root@undercloud-r430 ~]# rpm -qa | grep amphora
octavia-amphora-image-13.0-20190806.1.el7ost.noarch
octavia-amphora-image-x86_64-13.0-20190806.1.el7ost.noarch
octavia-amphora-image-x86_64-13.0-20190418.1.el7ost.noarch
octavia-amphora-image-x86_64-13.0-20190304.1.el7ost.noarch
[root@undercloud-r430 ~]#  yum install octavia-amphora-image
Loaded plugins: product-id, search-disabled-repos, subscription-manager
Resolving Dependencies
--> Running transaction check
---> Package octavia-amphora-image.noarch 0:13.0-20190806.1.el7ost will be updated
---> Package octavia-amphora-image.noarch 0:13.0-20190827.1.el7ost will be an update
--> Processing Dependency: octavia-amphora-image-x86_64 = 13.0-20190827.1.el7ost for package: octavia-amphora-image-13.0-20190827.1.el7ost.noarch
--> Running transaction check
---> Package octavia-amphora-image-x86_64.noarch 0:13.0-20190827.1.el7ost will be installed
--> Finished Dependency Resolution
--> Running transaction check
---> Package octavia-amphora-image-x86_64.noarch 0:13.0-20190304.1.el7ost will be erased
--> Processing Dependency: octavia-amphora-image-x86_64 = 13.0-20190304.1.el7ost for package: rhosp-director-images-x86_64-13.0-20190304.1.el7ost.noarch
--> Finished Dependency Resolution
Error: Package: rhosp-director-images-x86_64-13.0-20190304.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)
           Requires: octavia-amphora-image-x86_64 = 13.0-20190304.1.el7ost
           Removing: octavia-amphora-image-x86_64-13.0-20190304.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)
               octavia-amphora-image-x86_64 = 13.0-20190304.1.el7ost
           Installed: octavia-amphora-image-x86_64-13.0-20190418.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)
               octavia-amphora-image-x86_64 = 13.0-20190418.1.el7ost
           Installed: octavia-amphora-image-x86_64-13.0-20190806.1.el7ost.noarch (@rhel-7-server-openstack-13-rpms)
               octavia-amphora-image-x86_64 = 13.0-20190806.1.el7ost
           Available: octavia-amphora-image-x86_64-13.0-20180822.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)
               octavia-amphora-image-x86_64 = 13.0-20180822.1.el7ost
           Available: octavia-amphora-image-x86_64-13.0-20180905.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)
               octavia-amphora-image-x86_64 = 13.0-20180905.1.el7ost
           Available: octavia-amphora-image-x86_64-13.0-20181101.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)
               octavia-amphora-image-x86_64 = 13.0-20181101.1.el7ost
           Available: octavia-amphora-image-x86_64-13.0-20181107.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)
               octavia-amphora-image-x86_64 = 13.0-20181107.1.el7ost
           Available: octavia-amphora-image-x86_64-13.0-20190109.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)
               octavia-amphora-image-x86_64 = 13.0-20190109.1.el7ost
           Available: octavia-amphora-image-x86_64-13.0-20190627.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)
               octavia-amphora-image-x86_64 = 13.0-20190627.1.el7ost
           Installing: octavia-amphora-image-x86_64-13.0-20190827.1.el7ost.noarch (rhel-7-server-openstack-13-rpms)
               octavia-amphora-image-x86_64 = 13.0-20190827.1.el7ost
 You could try using --skip-broken to work around the problem
 You could try running: rpm -Va --nofiles --nodigest
[root@undercloud-r430 ~]# 
~~~

Demonstrating the dependency chain:
~~~
[root@undercloud-1 ~]# yum install rhosp-director-images
Loaded plugins: product-id, search-disabled-repos, subscription-manager
Resolving Dependencies
--> Running transaction check
---> Package rhosp-director-images.noarch 0:13.0-20190827.1.el7ost will be installed
--> Processing Dependency: rhosp-director-images-x86_64 = 13.0-20190827.1.el7ost for package: rhosp-director-images-13.0-20190827.1.el7ost.noarch
--> Running transaction check
---> Package rhosp-director-images-x86_64.noarch 0:13.0-20190827.1.el7ost will be installed
--> Processing Dependency: octavia-amphora-image-x86_64 = 13.0-20190827.1.el7ost for package: rhosp-director-images-x86_64-13.0-20190827.1.el7ost.noarch
--> Processing Dependency: rhosp-director-images-ipa-x86_64 = 13.0-20190827.1.el7ost for package: rhosp-director-images-x86_64-13.0-20190827.1.el7ost.noarch
--> Running transaction check
---> Package octavia-amphora-image-x86_64.noarch 0:13.0-20190827.1.el7ost will be installed
---> Package rhosp-director-images-ipa-x86_64.noarch 0:13.0-20190827.1.el7ost will be installed
--> Finished Dependency Resolution

Dependencies Resolved

===========================================================================================================================================================================================================================
 Package                                                       Arch                                Version                                              Repository                                                    Size
===========================================================================================================================================================================================================================
Installing:
 rhosp-director-images                                         noarch                              13.0-20190827.1.el7ost                               rhel-7-server-openstack-13-rpms                              6.3 k
Installing for dependencies:
 octavia-amphora-image-x86_64                                  noarch                              13.0-20190827.1.el7ost                               rhel-7-server-openstack-13-rpms                              820 M
 rhosp-director-images-ipa-x86_64                              noarch                              13.0-20190827.1.el7ost                               rhel-7-server-openstack-13-rpms                              444 M
 rhosp-director-images-x86_64                                  noarch                              13.0-20190827.1.el7ost                               rhel-7-server-openstack-13-rpms                              1.4 G

Transaction Summary
===========================================================================================================================================================================================================================
Install  1 Package (+3 Dependent packages)
~~~

And the number of distinct versions to retain is:
https://stackoverflow.com/questions/34683225/rpm-spec-how-to-allow-multiple-versions
~~~
[root@undercloud-1 ~]# grep installonly_limit /etc/yum* -R
/etc/yum.conf:installonly_limit=3
[root@undercloud-1 ~]# grep installonlypkgs /etc/yum* -R
[root@undercloud-1 ~]# 
~~~

Comment 4 Andreas Karis 2019-09-05 21:35:00 UTC
[root@dell-r430-30 home]# grep -B1 installonly rhosp-director-images.spec 
Requires: rhosp-director-images-x86_64 = %{version}-%{release}
Provides: installonlypkg(vm)
--
Requires: rhosp-director-images-ipa-x86_64 = %{version}-%{release}
Provides: installonlypkg(vm)
--
%package ipa
Provides: installonlypkg(vm)
--
%package ipa-x86_64
Provides: installonlypkg(vm)
--
Requires: rhosp-director-images-ipa-ppc64le = %{version}-%{release}
Provides: installonlypkg(vm)
--
%package ipa-ppc64le
Provides: installonlypkg(vm)
--
Requires: rhosp-director-images-ipa-ppc64lep9 = %{version}-%{release}
Provides: installonlypkg(vm)
--
%package ipa-ppc64lep9
Provides: installonlypkg(vm)
--
Obsoletes: octavia-amphora-image < 13.0-20180711.1
Provides: installonlypkg(vm)

Comment 5 Mike Burns 2019-09-06 11:49:09 UTC
The issue is as Andreas stated, the meta-package is basically a "-all x86_64 images" package and ensures that it has the exact set of packages that it came with (this means that you get overcloud-full, ironic-python-agent and octavia-amphora all from the same set of content.  The installonlypkg(vm) directive in comment 4 is what allows us to install multiple versions of these packages side-by-side (along with some logic around the file names, etc to ensure different versions don't conflict).  The installonly_limit=3 -- that governs other similar packages too, like the kernel.  

In general, I don't think we expected this particular case -- multiple updates hitting the maximum number of parallel packages and then someone trying to manually install just the latest (newer than anything else) version of just a subpackage.  

In the short term, there are a couple manual solutions:

* remove the meta package.  yum updates will continue to update the other installed packages (overcloud-full and ipa) even without that.  
* yum update the meta package -- this will remove the oldest of each of the dependent packages

We'll look at how to fix this in the future, but any fix we do is only a future fix, one of the above will need to be done in the interim.

Comment 6 Andreas Karis 2019-09-06 17:43:26 UTC
Hi Mike,

A small clarification: this happens on an overcloud upgrade run! So whereas this can be triggered manually, the issue is encountered during:

~~~
openstack overcloud update run
~~~

Or the update converge step ( I don't know atm where exactly the customer is at, but see above, it shows in the stack failures list)

Hence, we should fork this BZ and update the THT?

Comment 8 Andreas Karis 2019-09-06 18:02:33 UTC
~~~
TASK [octavia-undercloud : set file if already set by heat variable (backwards-compatibility)] ***
task path: /usr/share/openstack-tripleo-common/playbooks/roles/octavia-undercloud/tasks/main.yml:2
Thursday 05 September 2019  10:14:26 +0200 (0:00:00.911)       0:00:00.976 **** 
skipping: [localhost] => {
    "changed": false, 
    "skip_reason": "Conditional result was False"
}

TASK [octavia-undercloud : set location if CentOS] *****************************
task path: /usr/share/openstack-tripleo-common/playbooks/roles/octavia-undercloud/tasks/main.yml:7
Thursday 05 September 2019  10:14:26 +0200 (0:00:00.052)       0:00:01.028 **** 
skipping: [localhost] => {
    "changed": false, 
    "skip_reason": "Conditional result was False"
}

TASK [octavia-undercloud : install Octavia amphora image if Red Hat] ***********
task path: /usr/share/openstack-tripleo-common/playbooks/roles/octavia-undercloud/tasks/main.yml:13
Thursday 05 September 2019  10:14:26 +0200 (0:00:00.063)       0:00:01.092 **** 
<localhost> ESTABLISH LOCAL CONNECTION FOR USER: mistral
<localhost> EXEC sudo yum -y install octavia-amphora-image
~~~

~~~
[root@undercloud-r430 ~]# grep 'yum -y install octavia-amphora-image' /usr/share/openstack-tripleo-common/playbooks/roles/octavia-undercloud/tasks/main.yml
        raw: sudo yum -y install octavia-amphora-image
[root@undercloud-r430 ~]# rpm -qf /usr/share/openstack-tripleo-common/playbooks/roles/octavia-undercloud/tasks/main.yml
openstack-tripleo-common-8.6.8-11.el7ost.noarch
~~~


So there's a whole lot of ifs in before that and perhaps they should have returned that the image was already there? Note that the entire octavia upgrade process is broken so we had to apply a few workarounds to get to this step.

Also, I just looked at this:
https://opendev.org/openstack/tripleo-common/commit/da97fab4cb781b54405db52c7e00c89a8971bca1

Note that Emilien's fix does something else! It will only install amphora when there's none installed, yet. 

And subsequently, this was changed to "latest", hence the yum -y install behavior was reproduced: For Queens, we see the modification requests latest, so it will trigger the same issue:
https://opendev.org/openstack/tripleo-common/src/branch/stable/queens/playbooks/roles/octavia-undercloud/tasks/main.yml

Btw:
And for Rocky and Stein, this is different, again: https://opendev.org/openstack/tripleo-common/src/branch/stable/rocky/playbooks/roles/octavia-undercloud/tasks/main.yml
https://opendev.org/openstack/tripleo-common/src/branch/stable/stein/playbooks/roles/octavia-undercloud/tasks/main.yml

Long story short, in the current downstream and upstream (https://opendev.org/openstack/tripleo-common/src/branch/stable/queens/playbooks/roles/octavia-undercloud/tasks/main.yml) Queens, this issue will be triggered, as far as I can tell.

Comment 9 rstarr 2019-09-25 00:13:41 UTC
Confirmed: I hit this same issue during an update today. I was able to work past it by simply removing the oldest octavia-amphora-image RPM then re-running. 
e.g. 
rpm -e --nodeps "octavia-amphora-image-x86_64-13.0-20190304.1.el7ost.noarch"

Comment 10 David Hill 2019-11-12 21:54:01 UTC
We just hit this issue again ...

Comment 12 Alvaro Soto 2020-06-03 23:48:26 UTC
Just FYI.
The steps solves the issue but leaves rpmdb inconsistencies, I also needed to remove rhosp-director-images to completely fix the issue

Log:
** Found 1 pre-existing rpmdb problem(s), 'yum check' output follows:
rhosp-director-images-x86_64-13.0-20191031.1.el7ost.noarch has missing requires of octavia-amphora-image-x86_64 = ('0', '13.0', '20191031.1.el7ost')

Running the next restores the rpmdb consistency

# rpm -e --nodeps "rhosp-director-images-x86_64-13.0-20191031.1.el7ost.noarch"
# rpm -e --nodeps "rhosp-director-images-13.0-20191031.1.el7ost.noarch"
# rpm -e --nodeps "rhosp-director-images-ipa-13.0-20191031.1.el7ost.noarch"

Comment 13 Roberto Bertó 2020-08-29 23:45:42 UTC
I removed all packages with 
yum remove octavia-amphora-image-x86_64-13.0-20200303.1.el7ost.noarch octavia-amphora-image-x86_64-13.0-20200323.2.el7ost.noarch octavia-amphora-image-x86_64-13.0-20200610.2.el7ost.noarch -y

And then install new ones with
yum install octavia-amphora-image-x86_64 octavia-amphora-image rhosp-director-images rhosp-director-images-ipa -y

Comment 25 Lon Hohberger 2023-07-10 17:32:08 UTC
OSP13 support officially ended on 27 June 2023


Note You need to log in before you can comment on or make changes to this bug.