Bug 2246347 - python-multiprocess fails to build with Python 3.13: TypeError: cannot pickle '_thread._ThreadHandle' object
Summary: python-multiprocess fails to build with Python 3.13: TypeError: cannot pick...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Fedora
Classification: Fedora
Component: python-multiprocess
Version: rawhide
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Ankur Sinha (FranciscoD)
QA Contact:
URL:
Whiteboard:
: 2291784 (view as bug list)
Depends On: 2264225
Blocks: F41FTBFS F41FailsToInstall PYTHON3.13 2291599 2291659 2291746 2291833 2291919
TreeView+ depends on / blocked
 
Reported: 2023-10-26 10:53 UTC by Karolina Surma
Modified: 2024-10-01 01:14 UTC (History)
7 users (show)

Fixed In Version: python-multiprocess-0.70.16-4.fc41
Clone Of:
Environment:
Last Closed: 2024-10-01 01:14:45 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github uqfoundation dill issues 654 0 None open threading.Thread fails to pickle in python > 3.13.0a5 2024-04-23 22:59:27 UTC
Github uqfoundation multiprocess issues 182 0 None open python 3.13.0a6 tests throw errors due to pickling a `_ThreadHandle` 2024-04-23 22:59:27 UTC

Description Karolina Surma 2023-10-26 10:53:55 UTC
python-multiprocess fails to build with Python 3.13.0a1.

+ find py3.13/doc/ py3.13/examples/ -type f -exec dos2unix --keepdate '{}' +
find: ‘py3.13/doc/’: No such file or directory
find: ‘py3.13/examples/’: No such file or directory

There's no folder named py3.13 upstream.

For the build logs, see:
https://copr-be.cloud.fedoraproject.org/results/@python/python3.13/fedora-rawhide-x86_64/06557783-python-multiprocess/

For all our attempts to build python-multiprocess with Python 3.13, see:
https://copr.fedorainfracloud.org/coprs/g/python/python3.13/package/python-multiprocess/

Testing and mass rebuild of packages is happening in copr.
You can follow these instructions to test locally in mock if your package builds with Python 3.13:
https://copr.fedorainfracloud.org/coprs/g/python/python3.13/

Let us know here if you have any questions.

Python 3.13 is planned to be included in Fedora 41.
To make that update smoother, we're building Fedora packages with all pre-releases of Python 3.13.
A build failure prevents us from testing all dependent packages (transitive [Build]Requires),
so if this package is required a lot, it's important for us to get it fixed soon.

We'd appreciate help from the people who know this package best,
but if you don't want to work on this now, let us know so we can try to work around it on our side.

Comment 1 Aoife Moloney 2024-02-15 23:02:16 UTC
This bug appears to have been reported against 'rawhide' during the Fedora Linux 40 development cycle.
Changing version to 40.

Comment 2 Sandro 2024-03-28 06:55:21 UTC
(In reply to Karolina Surma from comment #0)
> python-multiprocess fails to build with Python 3.13.0a1.
> 
> + find py3.13/doc/ py3.13/examples/ -type f -exec dos2unix --keepdate '{}' +
> find: ‘py3.13/doc/’: No such file or directory
> find: ‘py3.13/examples/’: No such file or directory
> 
> There's no folder named py3.13 upstream.

The directories are there. I checked the tarball with `tar tzf multiprocess-0.70.16.tar.gz | grep 'py3\.13'`.

Attempting a local build with Python 3.13, this appears to fail on dependency resolution:

Problem: package python3-dill-0.3.8-1.fc40.noarch requires python(abi) = 3.12, but none of the providers can be installed
  - package python3-devel-3.13.0~a5-3.fc41.x86_64 conflicts with python3 < 3.13.0~a5-3.fc41 provided by python3-3.12.2-3.fc41.x86_64
  - package python3-devel-3.13.0~a5-3.fc41.x86_64 conflicts with python3 < 3.13.0~a5-3.fc41 provided by python3-3.12.2-3.fc41.i686
  - cannot install the best candidate for the job

It looks like this depends on bug 2264225 being fixed first.

Comment 3 Karolina Surma 2024-04-23 11:53:30 UTC
One more issue after directories for Py 3.13 were added: https://github.com/uqfoundation/multiprocess/pull/183

Comment 4 Ben Beasley 2024-04-23 22:59:28 UTC
Thanks! I agree with the PR you sent upstream, and I’m applying it as a patch. Once I do that, I get 65 errors due to

  TypeError: cannot pickle '_thread._ThreadHandle' object

which appears to be https://github.com/uqfoundation/multiprocess/issues/182 and https://github.com/uqfoundation/dill/issues/654. I’m now monitoring those two upstream issues.

Comment 5 Karolina Surma 2024-06-12 15:04:28 UTC
*** Bug 2291784 has been marked as a duplicate of this bug. ***

Comment 6 Ben Beasley 2024-06-16 18:37:36 UTC
This is still broken because of python-dill, which disabled all tests in order to ship a broken package. Enough of the python-dill API works for some dependent packages’ tests to succeed, but not this one. We’ll have to wait on a fix from python-dill upstream.

Comment 7 Fedora Fails To Install 2024-06-19 19:57:02 UTC
Hello,

Please note that this comment was generated automatically by https://pagure.io/releng/blob/main/f/scripts/ftbfs-fti/follow-policy.py
If you feel that this output has mistakes, please open an issue at https://pagure.io/releng/

This package fails to install and maintainers are advised to take one of the following actions:

 - Fix this bug and close this bugzilla once the update makes it to the repository.
   (The same script that posted this comment will eventually close this bugzilla
   when the fixed package reaches the repository, so you don't have to worry about it.)

or

 - Move this bug to ASSIGNED if you plan on fixing this, but simply haven't done so yet.

or

 - Orphan the package if you no longer plan to maintain it.


If you do not take one of these actions, the process at https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/#_package_removal_for_long_standing_ftbfs_and_fti_bugs will continue.
This package may be orphaned in 7+ weeks.
This is the first reminder (step 3) from the policy.

Don't hesitate to ask for help on https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org/ if you are unsure how to fix this bug.

Comment 8 Sandro 2024-06-19 20:01:56 UTC
I'm setting this to ASSIGNED to avoid it getting orphaned while we are waiting for a proper fix.

Comment 9 Karolina Surma 2024-09-04 14:57:52 UTC
This package has failed to build with Python 3.13 so far. Fedora 41 is already in the Beta Freeze phase. What's your plan going forward? Will the package be fixed in time for the Final Freeze of Fedora 41 (planned on Oct 15th 2024)?
If you don't plan or can't fix the package before Fedora 41 goes into the Final Freeze phase, please retire the package. You can unretire it anytime during the Fedora 41 lifecycle - doing this now will simply ensure that we don't release Fedora with a broken package. Thank you!

Comment 10 Ben Beasley 2024-09-08 11:52:15 UTC
The author of python-dill (which is the origin of the TypeError) plans to release a Python 3.13 compatible version “this coming week.” It’s cutting it close, but that should be good enough to successfully rebuild python-multiprocess and its dependent packages before the Final Freeze.

Comment 11 Fedora Update System 2024-09-21 09:54:55 UTC
FEDORA-2024-725de708a9 (python-cro-0.0.5.2-7.fc41, python-dill-0.3.9~~20240914.8b86f509-1.fc41, and 2 more) has been submitted as an update to Fedora 41.
https://bodhi.fedoraproject.org/updates/FEDORA-2024-725de708a9

Comment 12 Fedora Fails To Install 2024-09-21 10:03:53 UTC
Hello,

Please note that this comment was generated automatically by https://pagure.io/releng/blob/main/f/scripts/ftbfs-fti/follow-policy.py
If you feel that this output has mistakes, please open an issue at https://pagure.io/releng/

All subpackages of a package against which this bug was filled are now installable or removed from Fedora 42.

Thanks for taking care of it!

Comment 13 Fedora Update System 2024-09-22 02:11:46 UTC
FEDORA-2024-725de708a9 has been pushed to the Fedora 41 testing repository.
Soon you'll be able to install the update with the following command:
`sudo dnf upgrade --enablerepo=updates-testing --refresh --advisory=FEDORA-2024-725de708a9`
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2024-725de708a9

See also https://fedoraproject.org/wiki/QA:Updates_Testing for more information on how to test updates.

Comment 14 Fedora Update System 2024-09-23 02:07:47 UTC
FEDORA-2024-725de708a9 has been pushed to the Fedora 41 testing repository.
Soon you'll be able to install the update with the following command:
`sudo dnf upgrade --enablerepo=updates-testing --refresh --advisory=FEDORA-2024-725de708a9`
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2024-725de708a9

See also https://fedoraproject.org/wiki/QA:Updates_Testing for more information on how to test updates.

Comment 15 Fedora Update System 2024-10-01 01:14:45 UTC
FEDORA-2024-725de708a9 (python-cro-0.0.5.2-7.fc41, python-dill-0.3.9~~20240914.8b86f509-1.fc41, and 5 more) has been pushed to the Fedora 41 stable repository.
If problem still persists, please make note of it in this bug report.


Note You need to log in before you can comment on or make changes to this bug.