Description of problem: When pycparser is imported, its __pycache__ gets regenerated. This suggests that the way the rpm content got built does not align nicely with the rest of the python stack. Version-Release number of selected component (if applicable): python3-pycparser-2.20-7.fc37.noarch How reproducible: Deterministic. Steps to Reproduce: 1. Have Dockerfile FROM registry.fedoraproject.org/fedora:rawhide RUN dnf install -y python3-pycparser 2. Build a container image: $ podman build -t pycparser-fedora . 3. Run a container $ podman run --rm -ti --name pycparser pycparser-fedora [root@74c5879d48e3 /]# 4. Check that nothing got changed in the container just yet -- from other terminal run $ podman diff pycparser 5. Use pycparser in the container [root@6e34aeedb6ec /]# python3 -c 'import pycparser' 6. In that other terminal, do podman diff again: $ podman diff pycparser Actual results: C /usr/lib/python3.11/site-packages/ply/__pycache__ C /usr/lib/python3.11/site-packages/ply/__pycache__/__init__.cpython-311.pyc C /usr/lib/python3.11/site-packages/ply/__pycache__/lex.cpython-311.pyc C /usr/lib/python3.11/site-packages/ply/__pycache__/yacc.cpython-311.pyc C /usr/lib/python3.11/site-packages/pycparser/__pycache__ C /usr/lib/python3.11/site-packages/pycparser/__pycache__/__init__.cpython-311.pyc C /usr/lib/python3.11/site-packages/pycparser/__pycache__/ast_transforms.cpython-311.pyc C /usr/lib/python3.11/site-packages/pycparser/__pycache__/c_ast.cpython-311.pyc C /usr/lib/python3.11/site-packages/pycparser/__pycache__/c_lexer.cpython-311.pyc C /usr/lib/python3.11/site-packages/pycparser/__pycache__/c_parser.cpython-311.pyc C /usr/lib/python3.11/site-packages/pycparser/__pycache__/plyparser.cpython-311.pyc Expected results: Nothing should have been regenerated in the container in run-time. Additional info: I see in https://github.com/freeipa/freeipa-container/runs/7352518475?check_suite_focus=true that samba, cryptography, wrapt, dbus, cffi, gssapi, lxml, systemd, ldap, SSSDConfig, jwcrypto, dns, ipapython, ipaplatform, lib389, qrcode, dateutil, deprecated, pki, usb, yubico, ipaserver, ipaclient, ipalib, or augeas have the same problem. I started with report against pycparser because, well, the issue seems with the .pyc files, so it felt the closest.
This is because Python 3.11.0b4 has updated the pyc magic number: https://github.com/python/cpython/blob/v3.11.0b4/Lib/importlib/_bootstrap_external.py#L406 Thanks for checking. If this is critical for you, rebuild pycparsing. Otherwise, I'd like the Fedora 37 mass rebuild [1] to handle things before we take any mass action. See also bz1748018. [1] Wed 2022-07-20 https://fedorapeople.org/groups/schedule/f-37/f-37-key-tasks.html
The mass rebuild is over, let's check what remains to be rebuilt.
3.11.0b5 is released and according to https://github.com/python/cpython/blob/v3.11.0b5/Lib/importlib/_bootstrap_external.py#L406 the magic number remains unchanged.
I still see /usr/lib64/python3.11/site-packages/systemd/__pycache__/__init__.cpython-311.pyc /usr/lib64/python3.11/site-packages/systemd/__pycache__/daemon.cpython-311.pyc getting rebuilt in runtime, for the FreeIPA server use case: https://github.com/adelton/freeipa-container/runs/7573207697?check_suite_focus=true.
It seems that python3-psutil might also need the rebuild, seeing also /usr/lib64/python3.11/site-packages/psutil/__pycache__/__init__.cpython-311.pyc /usr/lib64/python3.11/site-packages/psutil/__pycache__/_pslinux.cpython-311.pyc /usr/lib64/python3.11/site-packages/psutil/__pycache__/_common.cpython-311.pyc /usr/lib64/python3.11/site-packages/psutil/__pycache__/_compat.cpython-311.pyc /usr/lib64/python3.11/site-packages/psutil/__pycache__/_psposix.cpython-311.pyc show up in a slightly different test scenario.
Yes, python-systemd and python-psutil both failed to rebuild. So did many others. We will track the remaining failures -- once releng opens FTBFS bugzillas, we will mark them as blocking this one. Please, don't comment here for every single individual package that has failed the mass rebuild, it will likely be at least a hundred. If you care about python-systemd and python-psutil, you can file the FTBFS bugzillas for them before releng does. Just make sure they block this bugzilla and the F37FTBFS tracker.
Here is the list of failed packages that need to be rebuilt. "torebuild": [ "bind", "capstone", "copr-keygen", "crypto-policies", "csound", "espresso", "fedmsg", "future", "gnome-builder", "grass", "libsbml", "link-grammar", "lldb", "net-snmp", "osbs-client", "pesign", "psi4", "pungi", "pybind11", "python-APScheduler", "python-TestSlide", "python-astropy", "python-databases", "python-dirq", "python-django-pyscss", "python-enrich", "python-fasjson-client", "python-gear", "python-httpretty", "python-igor", "python-ipyparallel", "python-jedi", "python-jsons", "python-m2r", "python-mplcursors", "python-networkx", "python-neutronclient", "python-nose2", "python-numpydoc", "python-odml", "python-owl_rl", "python-pandas", "python-patsy", "python-pecan-notario", "python-pikepdf", "python-pingouin", "python-psutil", "python-pybids", "python-pycdlib", "python-pymatreader", "python-pynwb", "python-pysam", "python-pyunicorn", "python-reportlab", "python-socks", "python-sphinx-panels", "python-systemd", "python-typish", "python-vdf", "python-websockets", "python-wsaccel", "python-xarray", "resalloc", "restview", "rpy", "veusz", "xapian-bindings" ]
Bugzillas for packages below weren't opened yet. "fedmsg", "link-grammar", "lldb", "osbs-client", "pesign", "pungi", "pybind11", "python-fasjson-client", "python-gear", "python-neutronclient", "python-nose2", "python-pikepdf", "python-psutil", "python-pycdlib", "python-pynwb", "python-pysam", "restview",
The following packages appear to be rebuilt in the meantime: link-grammar https://koji.fedoraproject.org/koji/buildinfo?buildID=2040588 --should be OK pesign https://koji.fedoraproject.org/koji/buildinfo?buildID=2020730 -- pesign is special, it requires signing permission to tag to rawhide, we need to ask the maintainers or releng The following packages are listed at https://kojipkgs.fedoraproject.org/mass-rebuild/f37-failures.html but we see no F37FTBFS bugzilla: fedmsg lldb pungi pybind11 python-fasjson-client python-nose2 python-pikepdf python-psutil python-pycdlib python-pynwb restview The rest probably failed to even build SRPM and is only listed at https://kojipkgs.fedoraproject.org/mass-rebuild/f37-need-rebuild.html osbs-client python-gear python-neutronclient
osbs-client -- releng script has not incremented the release correctly: https://src.fedoraproject.org/rpms/osbs-client/c/9fcd8043e4bf26f9f1ef92176bf1d2c6a5c0c667?branch=rawhide -- attempted fix in https://src.fedoraproject.org/rpms/osbs-client/pull-request/10 The following two builds hanged and were eventually cancelled: python-gear --https://koji.fedoraproject.org/koji/buildinfo?buildID=2022987 python-neutronclient -- https://koji.fedoraproject.org/koji/buildinfo?buildID=2023678
(In reply to Miro Hrončok from comment #10) > osbs-client -- releng script has not incremented the release correctly: > https://src.fedoraproject.org/rpms/osbs-client/c/ > 9fcd8043e4bf26f9f1ef92176bf1d2c6a5c0c667?branch=rawhide -- attempted fix in > https://src.fedoraproject.org/rpms/osbs-client/pull-request/10 Merged and built.
All bugzillas open. pybind11 was built in the meantime.
(In reply to Miro Hrončok from comment #9) > pesign https://koji.fedoraproject.org/koji/buildinfo?buildID=2020730 -- > pesign is special, it requires signing permission to tag to rawhide, we need > to ask the maintainers or releng pesign was rebuilt and the maintainer added "noautobuild" file into the dist-git. https://koji.fedoraproject.org/koji/buildinfo?buildID=2040965
This bug appears to have been reported against 'rawhide' during the Fedora Linux 37 development cycle. Changing version to 37.
Here is the current list of failed packages that need to be rebuilt: "torebuild": [ "capstone", "copr-keygen", "csound", "fedmsg", "psi4", "python-APScheduler", "python-astropy", "python-databases", "python-enrich", "python-fasjson-client", "python-jsons", "python-nose2", "python-numpydoc", "python-odml", "python-pandas", "python-pecan-notario", "python-pybids", "python-pycdlib", "python-pysam", "python-pyunicorn", "python-typish", "python-xarray", "resalloc", "restview", "rpy" ]
All packages have open bugzillas. We're no longer tracking this so I'm closing the tracker.