Description of problem: 2021-01-16 20:06:57.028362 | fa163e2c-4a64-f009-364e-000000002289 | OK | Check podman create status | standalone | item=keystone_db_sync 2021-01-16 20:06:57.033162 | fa163e2c-4a64-f009-364e-000000002289 | TIMING | tripleo_container_manage : Check podman create status | standalone | 0:24:29.102839 | 22.27s 2021-01-16 20:06:57.066554 | fa163e2c-4a64-f009-364e-000000002289 | TIMING | tripleo_container_manage : Check podman create status | standalone | 0:24:29.136227 | 22.30s 2021-01-16 20:06:57.248257 | fa163e2c-4a64-f009-364e-00000000228b | TASK | Check containers status [ERROR]: Container(s) which finished with wrong return code: ['cinder_api_db_sync'] 2021-01-16 20:06:58.769336 | fa163e2c-4a64-f009-364e-00000000228b | FATAL | Check containers status | standalone | error={"changed": false, "msg": "Failed container(s): ['cinder_api_db_sync'], check logs in /var/log/containers/stdouts/"} 2021-01-16 20:06:58.770855 | fa163e2c-4a64-f009-364e-00000000228b | TIMING | tripleo_container_manage : Check containers status | standalone | 0:24:30.840526 | 1.52s https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-rhos-17/92d5d83/logs/undercloud/var/log/containers/stdouts/cinder_api_db_sync.log 2021-01-17T01:06:37.154017442+00:00 stderr F Traceback (most recent call last): 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/bin/cinder-manage", line 6, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder.cmd.manage import main 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/cmd/manage.py", line 65, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder.backup import rpcapi as backup_rpcapi 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/backup/rpcapi.py", line 24, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder import rpc 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/rpc.py", line 37, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F import cinder.context 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/context.py", line 32, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder.objects import base as objects_base 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/objects/base.py", line 26, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder import db 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/db/__init__.py", line 20, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder.db.api import * # noqa 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/db/api.py", line 43, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder.api import common 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/api/common.py", line 27, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder.api import microversions as mv 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/api/microversions.py", line 34, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder.api.openstack import api_version_request as api_version 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/api/openstack/__init__.py", line 25, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder.api.openstack import wsgi 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/api/openstack/wsgi.py", line 32, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder.api.openstack import api_version_request as api_version 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/api/openstack/api_version_request.py", line 19, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder.api.openstack import versioned_method 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/api/openstack/versioned_method.py", line 17, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from cinder import utils 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/cinder/utils.py", line 44, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from os_brick.initiator import connector 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/os_brick/initiator/connector.py", line 187, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F _set_aliases() 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/os_brick/initiator/connector.py", line 184, in _set_aliases 2021-01-17T01:06:37.154017442+00:00 stderr F globals()[_name] = importutils.import_class(item) 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/oslo_utils/importutils.py", line 30, in import_class 2021-01-17T01:06:37.154017442+00:00 stderr F __import__(mod_str) 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/os_brick/initiator/connectors/remotefs.py", line 19, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from os_brick.remotefs import remotefs 2021-01-17T01:06:37.154017442+00:00 stderr F File "/usr/lib/python3.6/site-packages/os_brick/remotefs/remotefs.py", line 24, in <module> 2021-01-17T01:06:37.154017442+00:00 stderr F from oslo_utils.secretutils import md5 2021-01-17T01:06:37.154017442+00:00 stderr F ImportError: cannot import name 'md5'
Version of the packages in the failing container (os-brick, oslo_utils)? There have been no recent changes related to os_brick/remotefs/remotefs.py). Is oslo.utils at least 4.7.0?
It looks like oslo.utils is python3-oslo-utils noarch 4.6.0-0.20200918105215.91497da.el8ost . os-brick from master has lower-constraints.txt:oslo.utils==4.7.0 requirements.txt:oslo.utils>=4.7.0 # Apache-2.0 Moving to distribution component.
The problem is due to os-brick requiring a newer version of oslo.utils. [1] updated os-brick to use the md5 module from oslo_utils.secretutils, which is available in oslo.utils v4.7.0. os-brick's RPM spec file needs to be updated to require that version as well. Interestingly, we are building python-oslo-utils-4.7.0, and it's unclear why that one wasn't pulled in. [1] https://review.opendev.org/plugins/gitiles/openstack/os-brick/+/1425a834ddc06d8b6be50a18408a5aae6c001bf3 [2] https://brewweb.engineering.redhat.com/brew/buildinfo?buildID=1384765
fixed here, https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/192e470e1f1f420cb93c37c95046e5f7 the job is blocked again, but this bug can be closed.