Bug 1817699

Summary: python-networkx fails to build with Python 3.9: AttributeError: preprocessors (IPython.utils.shimmodule)
Product: [Fedora] Fedora Reporter: Miro Hrončok <mhroncok>
Component: python-networkxAssignee: Jerry James <loganjerry>
Status: CLOSED NOTABUG QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: rawhideCC: cstratak, lbalhar, loganjerry, mhroncok, mplch
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-03-27 09:32:42 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1817703    
Bug Blocks: 1785415    

Description Miro Hrončok 2020-03-26 19:05:38 UTC
python-networkx fails to build with Python 3.9.0a5.


Exception occurred:
  File "/usr/lib/python3.9/site-packages/IPython/utils/shimmodule.py", line 94, in __getattr__
    raise AttributeError(key)
AttributeError: preprocessors
The full traceback has been saved in /tmp/sphinx-err-hjoy6jwj.log, if you want to report the issue to the developers.


For the build logs, see:
https://copr-be.cloud.fedoraproject.org/results/@python/python3.9/fedora-rawhide-x86_64/01321097-python-networkx/

For all our attempts to build python-networkx with Python 3.9, see:
https://copr.fedorainfracloud.org/coprs/g/python/python3.9/package/python-networkx/

Testing and mass rebuild of packages is happening in copr. You can follow these instructions to test locally in mock if your package builds with Python 3.9:
https://copr.fedorainfracloud.org/coprs/g/python/python3.9/

Let us know here if you have any questions.

Python 3.9 will be included in Fedora 33. To make that update smoother, we're building Fedora packages with early pre-releases of Python 3.9.
A build failure prevents us from testing all dependent packages (transitive [Build]Requires), so if this package is required a lot, it's important for us to get it fixed soon.
We'd appreciate help from the people who know this package best, but if you don't want to work on this now, let us know so we can try to work around it on our side.

Comment 1 Lumír Balhar 2020-03-27 07:43:38 UTC
This is the complete traceback mentioned in the error message:

# cat /tmp/sphinx-err-6orq_cpn.log
# Sphinx version: 2.2.2
# Python version: 3.9.0a5 (CPython)
# Docutils version: 0.15.2 release
# Jinja2 version: 2.11.1
# Last messages:
#   embedding documentation hyperlinks for auto_examples... [ 86%] plot_write_dotfile.html
#   embedding documentation hyperlinks for auto_examples... [ 88%] sg_execution_times.html
#   embedding documentation hyperlinks for auto_examples... [ 90%] plot_pygraphviz_simple.html
#   embedding documentation hyperlinks for auto_examples... [ 91%] mayavi2_spring.html
#   embedding documentation hyperlinks for auto_examples... [ 93%] plot_iterated_dynamical_systems.html
#   embedding documentation hyperlinks for auto_examples... [ 95%] plot_heavy_metal_umlaut.html
#   embedding documentation hyperlinks for auto_examples... [ 96%] sg_execution_times.html
#   embedding documentation hyperlinks for auto_examples... [ 98%] plot_parallel_betweenness.html
#   embedding documentation hyperlinks for auto_examples... [100%] plot_eigenvalues.html
#   
# Loaded extensions:
#   sphinx.ext.mathjax (2.2.2) from /usr/lib/python3.9/site-packages/sphinx/ext/mathjax.py
#   sphinxcontrib.applehelp (1.0.1) from /usr/lib/python3.9/site-packages/sphinxcontrib/applehelp/__init__.py
#   sphinxcontrib.devhelp (1.0.1) from /usr/lib/python3.9/site-packages/sphinxcontrib/devhelp/__init__.py
#   sphinxcontrib.htmlhelp (1.0.1) from /usr/lib/python3.9/site-packages/sphinxcontrib/htmlhelp/__init__.py
#   sphinxcontrib.serializinghtml (1.1.3) from /usr/lib/python3.9/site-packages/sphinxcontrib/serializinghtml/__init__.py
#   sphinxcontrib.qthelp (1.0.2) from /usr/lib/python3.9/site-packages/sphinxcontrib/qthelp/__init__.py
#   alabaster (0.7.12) from /usr/lib/python3.9/site-packages/alabaster/__init__.py
#   sphinx.ext.autodoc (2.2.2) from /usr/lib/python3.9/site-packages/sphinx/ext/autodoc/__init__.py
#   sphinx.ext.autosummary (2.2.2) from /usr/lib/python3.9/site-packages/sphinx/ext/autosummary/__init__.py
#   sphinx.ext.coverage (2.2.2) from /usr/lib/python3.9/site-packages/sphinx/ext/coverage.py
#   sphinx.ext.doctest (2.2.2) from /usr/lib/python3.9/site-packages/sphinx/ext/doctest.py
#   sphinx.ext.intersphinx (2.2.2) from /usr/lib/python3.9/site-packages/sphinx/ext/intersphinx.py
#   sphinx.ext.napoleon (2.2.2) from /usr/lib/python3.9/site-packages/sphinx/ext/napoleon/__init__.py
#   sphinx.ext.todo (2.2.2) from /usr/lib/python3.9/site-packages/sphinx/ext/todo.py
#   sphinx.ext.viewcode (2.2.2) from /usr/lib/python3.9/site-packages/sphinx/ext/viewcode.py
#   sphinx_gallery.gen_gallery (0.5.0) from /usr/lib/python3.9/site-packages/sphinx_gallery/gen_gallery.py
#   nb2plots (unknown version) from /usr/lib/python3.9/site-packages/nb2plots/__init__.py
#   texext (unknown version) from /usr/lib/python3.9/site-packages/texext/__init__.py
Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/IPython/utils/shimmodule.py", line 92, in __getattr__
    return import_item(name)
  File "/usr/lib/python3.9/site-packages/IPython/utils/importstring.py", line 31, in import_item
    module = __import__(package, fromlist=[obj])
  File "/usr/lib/python3.9/site-packages/nbconvert/__init__.py", line 4, in <module>
    from .exporters import *
  File "/usr/lib/python3.9/site-packages/nbconvert/exporters/__init__.py", line 3, in <module>
    from .html import HTMLExporter
  File "/usr/lib/python3.9/site-packages/nbconvert/exporters/html.py", line 15, in <module>
    from nbconvert.filters.markdown_mistune import IPythonRenderer, MarkdownWithMath
  File "/usr/lib/python3.9/site-packages/nbconvert/filters/__init__.py", line 7, in <module>
    from .strings import *
  File "/usr/lib/python3.9/site-packages/nbconvert/filters/strings.py", line 22, in <module>
    from defusedxml import cElementTree as ElementTree
  File "/usr/lib/python3.9/site-packages/defusedxml/cElementTree.py", line 10, in <module>
    from xml.etree.cElementTree import TreeBuilder as _TreeBuilder
ModuleNotFoundError: No module named 'xml.etree.cElementTree'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/sphinx/cmd/build.py", line 276, in build_main
    app.build(args.force_all, filenames)
  File "/usr/lib/python3.9/site-packages/sphinx/application.py", line 388, in build
    self.events.emit('build-finished', None)
  File "/usr/lib/python3.9/site-packages/sphinx/events.py", line 103, in emit
    results.append(callback(self.app, *args))
  File "/usr/lib/python3.9/site-packages/nb2plots/runroles.py", line 309, in write_runfiles
    NAME2ROLE[code_type].write_queue(queue, app)
  File "/usr/lib/python3.9/site-packages/nb2plots/runroles.py", line 216, in write_queue
    self.write(node, app)
  File "/usr/lib/python3.9/site-packages/nb2plots/runroles.py", line 118, in write
    built = self.get_built(node, app)
  File "/usr/lib/python3.9/site-packages/nb2plots/runroles.py", line 142, in get_built
    own_params[code_type] = self._build(node, app)
  File "/usr/lib/python3.9/site-packages/nb2plots/runroles.py", line 222, in _build
    full_nb = fill_notebook(nbf.reads(empty_json), timeout=timeout)
  File "/usr/lib/python3.9/site-packages/nb2plots/runroles.py", line 326, in fill_notebook
    preprocessor = nbc.preprocessors.execute.ExecutePreprocessor(
  File "/usr/lib/python3.9/site-packages/IPython/utils/shimmodule.py", line 94, in __getattr__
    raise AttributeError(key)
AttributeError: preprocessors

"xml.etree.cElementTree" was a deprecated alias for "xml.etree.ElementTree" for a long time and it's removed in the 3.9. https://github.com/python/cpython/blob/3.8/Lib/xml/etree/cElementTree.py

python-defusedxml FTBFS for the same reason so the fix has to be done there: https://copr.fedorainfracloud.org/coprs/g/python/python3.9/build/1321088/

Comment 2 Miro Hrončok 2020-03-27 09:32:42 UTC
Thanks Lumír for the investigation.

Fixed in nbsphinx/nbconvert.