Bug 1746847 - python-dask fails to build with Python 3.8 on Fedora 32+
Summary: python-dask fails to build with Python 3.8 on Fedora 32+
Keywords:
Status: CLOSED RAWHIDE
Alias: None
Product: Fedora
Classification: Fedora
Component: python-dask
Version: rawhide
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
Assignee: Elliott Sales de Andrade
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks: F32FTBFS F32FailsToInstall PYTHON38
TreeView+ depends on / blocked
 
Reported: 2019-08-29 11:42 UTC by Miro Hrončok
Modified: 2019-09-14 10:07 UTC (History)
3 users (show)

Fixed In Version: python-dask-2.4.0-1.fc32~bootstrap python-dask-2.3.0-1.fc32~bootstrap
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-09-14 10:07:54 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)

Description Miro Hrončok 2019-08-29 11:42:15 UTC
python-dask fails to build with Python 3.8.0b3 in Fedora 32.

See the build failures at https://koji.fedoraproject.org/koji/search?match=glob&type=package&terms=python-dask

There are several test failures:

= 36 failed, 5975 passed, 273 skipped, 3 deselected, 27 xfailed, 7 xpassed, 7 warnings in 1148.92 seconds =

E           RuntimeWarning: Mean of empty slice.
/usr/lib64/python3.8/site-packages/numpy/core/_methods.py:141: RuntimeWarning
E       ValueError: zero-size array to reduction operation minimum which has no identity
/usr/lib64/python3.8/site-packages/numpy/core/fromnumeric.py:90: ValueError
E       Failed: DID NOT RAISE (<class 'TypeError'>, <class 'ValueError'>)
dask/dataframe/tests/test_arithmetics_reduction.py:965: Failed

etc...

It is not important whether the problem is relevant to Python 3.8, this issue is blocking the Python 3.8 rebuilds.
If this package won't build with 3.8, it won't be installable, along with all its dependent packages, in Fedora 32 and further.

Furthermore, as it fails to install, its dependent packages will fail to install and/or build as well.

Please rebuild the package in Fedora 32 (rawhide).

Let us know here if you have any questions. Thank You!

Comment 1 Elliott Sales de Andrade 2019-09-13 07:08:48 UTC
2.3.0 fixes many of the bugs, but there are still a couple failures but they seem to be bugs in Pandas:

_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
self = <pandas.core.computation.expr.PandasExprVisitor object at 0x7f8794254580>
node = <_ast.Constant object at 0x7f8794254af0>, kwargs = {'side': 'right'}
method = 'visit_Constant'
visitor = <bound method NodeVisitor.visit_Constant of <pandas.core.computation.expr.PandasExprVisitor object at 0x7f8794254580>>
    def visit(self, node, **kwargs):
        if isinstance(node, str):
            clean = self.preparser(node)
            try:
                node = ast.fix_missing_locations(ast.parse(clean))
            except SyntaxError as e:
                from keyword import iskeyword
    
                if any(iskeyword(x) for x in clean.split()):
                    e.msg = "Python keyword not valid identifier" " in numexpr query"
                raise e
    
        method = "visit_" + node.__class__.__name__
        visitor = getattr(self, method)
>       return visitor(node, **kwargs)
E       TypeError: visit_Constant() got an unexpected keyword argument 'side'
/usr/lib64/python3.8/site-packages/pandas/core/computation/expr.py:441: TypeError

Comment 2 Elliott Sales de Andrade 2019-09-13 08:25:31 UTC
Opened https://src.fedoraproject.org/rpms/python-pandas/pull-request/6 to fix Pandas, and this will also fix Dask tests.

This would have been caught long ago if Pandas had a %check.

Comment 3 Miro Hrončok 2019-09-13 11:11:24 UTC
I got:

____________ test_repartition_npartitions[<lambda>0-float-1-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-1-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-1-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-1-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-1-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-1-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-1-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-1-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-2-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-2-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-2-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-2-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-2-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-2-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-2-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-2-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-4-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-4-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-4-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-4-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-4-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-4-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-4-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-4-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-5-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-5-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-5-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-5-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-5-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-5-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>0-float-5-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-float-5-5-False] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-1-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-2-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-4-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>0-M8[ns]-5-5-False] ___________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-1-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-1-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-1-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-1-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-1-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-1-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-1-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-1-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-2-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-2-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-2-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-2-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-2-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-2-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-2-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-2-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-4-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-4-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-4-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-4-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-4-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-4-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-4-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-4-5-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-5-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-5-1-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-5-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-5-2-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-5-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-5-4-False] ____________
[XPASS(strict)] Unsupported architecture
____________ test_repartition_npartitions[<lambda>1-float-5-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-float-5-5-False] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-1-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-2-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-4-5-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-1-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-1-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-2-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-2-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-4-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-4-False] ___________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-5-True] ____________
[XPASS(strict)] Unsupported architecture
___________ test_repartition_npartitions[<lambda>1-M8[ns]-5-5-False] ___________
[XPASS(strict)] Unsupported architecture

on i686, s390x

and a segfault on armv7hl.

Trying to hit x86_64

Comment 4 Elliott Sales de Andrade 2019-09-14 10:07:54 UTC
With 2.4.0, I changed the xfail patch so it would not trigger any more XPASS with strict, so it should be more resilient to other arches. (See https://koji.fedoraproject.org/koji/taskinfo?taskID=37656637; failures are only because it not supposed to be arch-ful.) There are still some intermittent failures that I have reported upstream, but they don't really have anything to do with Python 3.8.


Note You need to log in before you can comment on or make changes to this bug.