Bug 1868003
| Summary: | python36: Support for alternative architectures' names in Python importlib | |||
|---|---|---|---|---|
| Product: | Red Hat Enterprise Linux 8 | Reporter: | Lumír Balhar <lbalhar> | |
| Component: | python3 | Assignee: | Lumír Balhar <lbalhar> | |
| Status: | CLOSED ERRATA | QA Contact: | Lukáš Zachar <lzachar> | |
| Severity: | unspecified | Docs Contact: | ||
| Priority: | unspecified | |||
| Version: | 8.0 | CC: | pviktori, torsava | |
| Target Milestone: | beta | Keywords: | Reproducer | |
| Target Release: | 8.4 | |||
| Hardware: | Unspecified | |||
| OS: | Unspecified | |||
| Whiteboard: | ||||
| Fixed In Version: | python3-3.6.8-33.el8 | Doc Type: | No Doc Update | |
| Doc Text: | Story Points: | --- | ||
| Clone Of: | ||||
| : | 1868006 (view as bug list) | Environment: | ||
| Last Closed: | 2021-05-18 14:56:51 UTC | Type: | Bug | |
| Regression: | --- | Mount Type: | --- | |
| Documentation: | --- | CRM: | ||
| Verified Versions: | Category: | --- | ||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
| Cloudforms Team: | --- | Target Upstream Version: | ||
| Embargoed: | ||||
| Bug Depends On: | ||||
| Bug Blocks: | 1868006 | |||
|
Description
Lumír Balhar
2020-08-11 11:47:52 UTC
To test this, install and run the third-party Numpy package on ppc64le. The test currently exists (I'm not sure where) but is failing. This can wait for RHEL 8.4.0 because it needs some time in Fedora first. The change is ready in https://src.osci.redhat.com/fork/lbalhar/rpms/python3/c/9cd247471bd589025c08ae66351123499b6b21bd?branch=rhel-8.4.0 Scratch build: https://brewweb.engineering.redhat.com/brew/taskinfo?taskID=30731618 Verification: old: # python3.6 -c "import sys; print(sys.path_importer_cache['/usr/lib64/python3.6']._loaders)" [('.cpython-36m-ppc64le-linux-gnu.so', <class '_frozen_importlib_external.ExtensionFileLoader'>), ('.abi3.so', <class '_frozen_importlib_external.ExtensionFileLoader'>), ('.so', <class '_frozen_importlib_external.ExtensionFileLoader'>), ('.py', <class '_frozen_importlib_external.SourceFileLoader'>), ('.pyc', <class '_frozen_importlib_external.SourcelessFileLoader'>)] # python3.6 -m unittest discover dummyextension.tests E ====================================================================== ERROR: dummyextension.tests.test_extension (unittest.loader._FailedTest) ---------------------------------------------------------------------- ImportError: Failed to import test module: dummyextension.tests.test_extension Traceback (most recent call last): File "/usr/lib64/python3.6/unittest/loader.py", line 428, in _find_test_path module = self._get_module_from_name(name) File "/usr/lib64/python3.6/unittest/loader.py", line 369, in _get_module_from_name __import__(name) File "/usr/local/lib64/python3.6/site-packages/dummyextension/tests/test_extension.py", line 2, in <module> from dummyextension.extension import hello ModuleNotFoundError: No module named 'dummyextension.extension' ---------------------------------------------------------------------- Ran 1 test in 0.000s new: # python3.6 -c "import sys; print(sys.path_importer_cache['/usr/lib64/python3.6']._loaders)" [('.cpython-36m-ppc64le-linux-gnu.so', <class '_frozen_importlib_external.ExtensionFileLoader'>), ('.abi3.so', <class '_frozen_importlib_external.ExtensionFileLoader'>), ('.so', <class '_frozen_importlib_external.ExtensionFileLoader'>), ('.cpython-36m-powerpc64le-linux-gnu.so', <class '_frozen_importlib_external.ExtensionFileLoader'>), ('.py', <class '_frozen_importlib_external.SourceFileLoader'>), ('.pyc', <class '_frozen_importlib_external.SourcelessFileLoader'>)] # python3.6 -m unittest discover dummyextension.tests . ---------------------------------------------------------------------- Ran 1 test in 0.000s OK PR: https://src.osci.redhat.com/rpms/python3/pull-request/63 Verification: Upstream manylinux wheels do not work with the older version: (platform-python-3.6.8-31.el8.ppc64le) # python3 -m venv venv # source venv/bin/activate (venv) # pip install -U pip (venv) # pip install simple-manylinux-demo Collecting simple-manylinux-demo Downloading simple_manylinux_demo-1.0-cp36-cp36m-manylinux2014_ppc64le.whl (17 kB) Installing collected packages: simple-manylinux-demo Successfully installed simple-manylinux-demo-1.0 (venv) # ls -la venv/lib/python3.6/site-packages/dummyextension/ total 120 drwxr-xr-x. 4 root root 4096 Nov 3 09:36 . drwxr-xr-x. 10 root root 4096 Nov 3 09:36 .. -rw-r--r--. 1 root root 0 Nov 3 09:36 __init__.py drwxr-xr-x. 2 root root 4096 Nov 3 09:36 __pycache__ -rwxr-xr-x. 1 root root 89304 Nov 3 09:36 extension.cpython-36m-powerpc64le-linux-gnu.so drwxr-xr-x. 3 root root 4096 Nov 3 09:36 tests (venv) # python Python 3.6.8 (default, Aug 18 2020, 12:45:08) [GCC 8.3.1 20191121 (Red Hat 8.3.1-5)] on linux Type "help", "copyright", "credits" or "license" for more information. >>> from dummyextension import extension Traceback (most recent call last): File "<stdin>", line 1, in <module> ImportError: cannot import name 'extension' >>> import sysconfig >>> sysconfig.get_config_var("EXT_SUFFIX") '.cpython-36m-ppc64le-linux-gnu.so' The upstream name works in the new version (platform-python-3.6.8-32.el8.ppc64le) while it keeps compatibility with the old downstream name and generates own extensions with it: # python3 -m venv venv # source venv/bin/activate (venv) # pip install -U pip (venv) # pip install simple-manylinux-demo (venv) # python Python 3.6.8 (default, Nov 3 2020, 02:08:33) [GCC 8.4.1 20200928 (Red Hat 8.4.1-1)] on linux Type "help", "copyright", "credits" or "license" for more information. >>> from dummyextension import extension >>> >>> import sysconfig >>> sysconfig.get_config_var("EXT_SUFFIX") '.cpython-36m-ppc64le-linux-gnu.so' >>> (venv) # git clone https://github.com/frenzymadness/simple-manylinux-demo.git (venv) # cd simple-manylinux-demo/ (venv) # python setup.py build (venv) # ls -la build total 32 drwxr-xr-x. 4 root root 4096 Nov 3 09:45 . drwxr-xr-x. 5 root root 4096 Nov 3 09:45 .. drwxr-xr-x. 3 root root 4096 Nov 3 09:45 lib.linux-ppc64le-3.6 drwxr-xr-x. 3 root root 4096 Nov 3 09:45 temp.linux-ppc64le-3.6 (venv) # ls -la build/lib.linux-ppc64le-3.6/dummyextension/ total 56 drwxr-xr-x. 3 root root 4096 Nov 3 09:47 . drwxr-xr-x. 3 root root 4096 Nov 3 09:45 .. -rw-r--r--. 1 root root 0 Nov 3 09:45 __init__.py -rwxr-xr-x. 1 root root 89544 Nov 3 09:47 extension.cpython-36m-ppc64le-linux-gnu.so drwxr-xr-x. 2 root root 4096 Nov 3 09:45 tests (venv) # PYTHONPATH=build/lib.linux-ppc64le-3.6/dummyextension/ python Python 3.6.8 (default, Nov 3 2020, 02:08:33) [GCC 8.4.1 20200928 (Red Hat 8.4.1-1)] on linux Type "help", "copyright", "credits" or "license" for more information. >>> import extension >>> Verified manually one more time after the main build. Build: https://brewweb.engineering.redhat.com/brew/taskinfo?taskID=33244250 Gating is done although I had to wave one broken test. Let's wait for the new automation which should add this bug and build to automatic erratum. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Moderate: python3 security update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2021:1633 |