Bug 1746847

Summary: python-dask fails to build with Python 3.8 on Fedora 32+
Product: [Fedora] Fedora Reporter: Miro Hrončok <mhroncok>
Component: python-daskAssignee: Elliott Sales de Andrade <quantum.analyst>
Status: CLOSED RAWHIDE QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: high Docs Contact:
Priority: unspecified    
Version: rawhideCC: mtasaka, python-sig, quantum.analyst
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: python-dask-2.4.0-1.fc32~bootstrap python-dask-2.3.0-1.fc32~bootstrap Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-09-14 10:07:54 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1750908, 1750909, 1686977    

Description Miro Hrončok 2019-08-29 11:42:15 UTC
python-dask fails to build with Python 3.8.0b3 in Fedora 32.

See the build failures at https://koji.fedoraproject.org/koji/search?match=glob&type=package&terms=python-dask

There are several test failures:

= 36 failed, 5975 passed, 273 skipped, 3 deselected, 27 xfailed, 7 xpassed, 7 warnings in 1148.92 seconds =

E           RuntimeWarning: Mean of empty slice.
/usr/lib64/python3.8/site-packages/numpy/core/_methods.py:141: RuntimeWarning
E       ValueError: zero-size array to reduction operation minimum which has no identity
/usr/lib64/python3.8/site-packages/numpy/core/fromnumeric.py:90: ValueError
E       Failed: DID NOT RAISE (<class 'TypeError'>, <class 'ValueError'>)
dask/dataframe/tests/test_arithmetics_reduction.py:965: Failed

etc...

It is not important whether the problem is relevant to Python 3.8, this issue is blocking the Python 3.8 rebuilds.
If this package won't build with 3.8, it won't be installable, along with all its dependent packages, in Fedora 32 and further.

Furthermore, as it fails to install, its dependent packages will fail to install and/or build as well.

Please rebuild the package in Fedora 32 (rawhide).

Let us know here if you have any questions. Thank You!

Comment 1 Elliott Sales de Andrade 2019-09-13 07:08:48 UTC
2.3.0 fixes many of the bugs, but there are still a couple failures but they seem to be bugs in Pandas:

_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
self = <pandas.core.computation.expr.PandasExprVisitor object at 0x7f8794254580>
node = <_ast.Constant object at 0x7f8794254af0>, kwargs = {'side': 'right'}
method = 'visit_Constant'
visitor = <bound method NodeVisitor.visit_Constant of <pandas.core.computation.expr.PandasExprVisitor object at 0x7f8794254580>>
    def visit(self, node, **kwargs):
        if isinstance(node, str):
            clean = self.preparser(node)
            try:
                node = ast.fix_missing_locations(ast.parse(clean))
            except SyntaxError as e:
                from keyword import iskeyword
    
                if any(iskeyword(x) for x in clean.split()):
                    e.msg = "Python keyword not valid identifier" " in numexpr query"
                raise e
    
        method = "visit_" + node.__class__.__name__
        visitor = getattr(self, method)
>       return visitor(node, **kwargs)
E       TypeError: visit_Constant() got an unexpected keyword argument 'side'
/usr/lib64/python3.8/site-packages/pandas/core/computation/expr.py:441: TypeError

Comment 2 Elliott Sales de Andrade 2019-09-13 08:25:31 UTC
Opened https://src.fedoraproject.org/rpms/python-pandas/pull-request/6 to fix Pandas, and this will also fix Dask tests.

This would have been caught long ago if Pandas had a %check.

Comment 3 Miro Hrončok 2019-09-13 11:11:24 UTC
I got:

____________ test_repartition_npartitions[<lambda>0-float-1-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-1-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-1-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-1-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-1-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-1-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-1-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-1-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-2-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-2-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-2-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-2-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-2-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-2-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-2-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-2-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-4-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-4-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-4-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-4-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-4-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-4-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-4-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-4-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-5-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-5-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-5-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-5-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-5-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-5-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-5-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-5-5-False] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-5-False] ___________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-1-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-1-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-1-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-1-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-1-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-1-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-1-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-1-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-2-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-2-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-2-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-2-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-2-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-2-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-2-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-2-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-4-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-4-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-4-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-4-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-4-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-4-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-4-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-4-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-5-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-5-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-5-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-5-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-5-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-5-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-5-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-5-5-False] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-5-False] ___________
[XPASS(strict)] Unsupported architecture

on i686, s390x

and a segfault on armv7hl.

Trying to hit x86_64

Comment 4 Elliott Sales de Andrade 2019-09-14 10:07:54 UTC
With 2.4.0, I changed the xfail patch so it would not trigger any more XPASS with strict, so it should be more resilient to other arches. (See https://koji.fedoraproject.org/koji/taskinfo?taskID=37656637; failures are only because it not supposed to be arch-ful.) There are still some intermittent failures that I have reported upstream, but they don't really have anything to do with Python 3.8.