Bug 2098691 - F37FailsToInstall: datagrepper
Summary: F37FailsToInstall: datagrepper
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Fedora
Classification: Fedora
Component: datagrepper
Version: 37
Hardware: Unspecified
OS: Unspecified
unspecified
urgent
Target Milestone: ---
Assignee: Adam Williamson
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks: PYTHON3.11 F37FailsToInstall
TreeView+ depends on / blocked
 
Reported: 2022-06-20 09:29 UTC by Miro Hrončok
Modified: 2022-09-20 00:17 UTC (History)
5 users (show)

Fixed In Version: datagrepper-1.0.1-1.fc37
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-09-20 00:17:11 UTC
Type: ---
Embargoed:


Attachments (Terms of Use)

Description Miro Hrončok 2022-06-20 09:29:48 UTC
Hello,

Please note that this comment was generated automatically. If you feel that this output has mistakes, please contact me via email (mhroncok).

Your package (datagrepper) Fails To Install in Fedora 37:

can't install datagrepper:
  - nothing provides python3.10dist(pygments) needed by datagrepper-0.9.7-5.fc36.noarch
  - nothing provides python3.10dist(docutils) needed by datagrepper-0.9.7-5.fc36.noarch
  - nothing provides python3.10dist(flask) needed by datagrepper-0.9.7-5.fc36.noarch
  - nothing provides python3.10dist(moksha-common) needed by datagrepper-0.9.7-5.fc36.noarch
  - nothing provides python3.10dist(pygal) needed by datagrepper-0.9.7-5.fc36.noarch
  - nothing provides python(abi) = 3.10 needed by datagrepper-0.9.7-5.fc36.noarch
  - nothing provides python3.10dist(datanommer-models) >= 0.6 needed by datagrepper-0.9.7-5.fc36.noarch
  
If you know about this problem and are planning on fixing it, please acknowledge so by setting the bug status to ASSIGNED. If you don't have time to maintain this package, consider orphaning it, so maintainers of dependent packages realize the problem.


If you don't react accordingly to the policy for FTBFS/FTI bugs (https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/), your package may be orphaned in 8+ weeks.


P.S. The data was generated solely from koji buildroot, so it might be newer than the latest compose or the content on mirrors. To reproduce, use the koji/local repo only, e.g. in mock:

    $ mock -r fedora-37-x86_64 --disablerepo='*' --enablerepo=local install datagrepper


P.P.S. If this bug has been reported in the middle of upgrading multiple dependent packages, please consider using side tags: https://docs.fedoraproject.org/en-US/fesco/Updates_Policy/#updating-inter-dependent-packages

Thanks!

Comment 1 Miro Hrončok 2022-06-20 10:03:46 UTC
This bugzilla is likely a fallout from the Python 3.11 rebuild.

If your package (or some of the dependencies it has) failed to rebuild during the Python 3.11 rebuild, they now fail to install. To fix this, packages need to be rebuilt in Rawhide.

We will slowly triage the bugzillas, but we'd appreciate your help.

If you know this is blocked by an existing reported build failure or another package not yet rebuilt with Python 3.11, please mark it as such by using the "Depends On"/"Blocks" bugzilla fields. That will help us determine what failures to prioritize.

If this is not Python 3.11 related, please remove the PYTHON3.11 blocking tracker.

Thank you and sorry for the inconvenience. Let me know if you need any help.

Comment 2 Miro Hrončok 2022-06-27 14:54:43 UTC
Hello,

This is the first reminder (step 3 from https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/#_package_removal_for_long_standing_ftbfs_and_fti_bugs).

If you know about this problem and are planning on fixing it, please acknowledge so by setting the bug status to ASSIGNED. If you don't have time to maintain this package, consider orphaning it, so maintainers of dependent packages realize the problem.

Comment 3 Kevin Fenzi 2022-07-05 19:09:20 UTC
Will take a look.

Comment 4 Aurelien Bompard 2022-07-06 08:14:34 UTC
The rebuild fails with:

Error: 
 Problem: package python3-fasjson-client-1.0.7-2.fc37.noarch requires (python3.11dist(bravado) < 12~~ with python3.11dist(bravado) >= 10.6), but none of the providers can be installed
  - package python3-bravado-11.0.2-6.fc37.noarch requires python3.11dist(bravado-core) >= 5.16.1, but none of the providers can be installed
  - package python3-fedmsg-meta-fedora-infrastructure-0.31.0-5.fc37.noarch requires python3-fasjson-client, but none of the providers can be installed
  - package python3-fedmsg-meta-fedora-infrastructure-0.31.0-5.fc37.noarch requires python3.11dist(fasjson-client), but none of the providers can be installed
  - package python3-bravado-core-5.17.0-6.fc37.noarch requires python3.11dist(jsonschema[format]) >= 2.5.1, but none of the providers can be installed
  - conflicting requests
  - nothing provides python3.11dist(rfc3339-validator) needed by python3-jsonschema+format-4.6.0-3.fc37.noarch

Looks like python3-rfc3339-validator needs to be rebuilt for python 3.11 first?

Comment 5 Miro Hrončok 2022-07-06 09:04:05 UTC
> Looks like python3-rfc3339-validator needs to be rebuilt for python 3.11 first?

No, python3-rfc3339-validator is not packaged in Fedora.

This is now blocked on bz2101857 because jsonschema was updated without checking installability :/



-----


The previous failure here was:

======================================================================
ERROR: Failure: KeyError ('datanommer.sqlalchemy.url')
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python3.11/site-packages/nose/failure.py", line 39, in runTest
    raise self.exc_val.with_traceback(self.tb)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/nose/loader.py", line 416, in loadTestsFromName
    module = self.importer.importFromPath(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/nose/importer.py", line 47, in importFromPath
    return self.importFromDir(dir_path, fqname)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/nose/importer.py", line 94, in importFromDir
    mod = load_module(part_fqname, fh, filename, desc)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/imp.py", line 235, in load_module
    return load_source(name, filename, file)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/imp.py", line 172, in load_source
    module = _load(spec)
             ^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 721, in _load
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 939, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/builddir/build/BUILD/datagrepper-0.9.7/tests/test_api.py", line 10, in <module>
    import datagrepper.app
    ^^^^^^^^^^^^^^^^^^^^^^
  File "/builddir/build/BUILD/datagrepper-0.9.7/datagrepper/app.py", line 66, in <module>
    dm.init(fedmsg_config['datanommer.sqlalchemy.url'])
            ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'datanommer.sqlalchemy.url'
======================================================================
ERROR: Failure: KeyError ('datanommer.sqlalchemy.url')
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python3.11/site-packages/nose/failure.py", line 39, in runTest
    raise self.exc_val.with_traceback(self.tb)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/nose/loader.py", line 416, in loadTestsFromName
    module = self.importer.importFromPath(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/nose/importer.py", line 47, in importFromPath
    return self.importFromDir(dir_path, fqname)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/nose/importer.py", line 94, in importFromDir
    mod = load_module(part_fqname, fh, filename, desc)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/imp.py", line 235, in load_module
    return load_source(name, filename, file)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/imp.py", line 172, in load_source
    module = _load(spec)
             ^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 721, in _load
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 939, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/builddir/build/BUILD/datagrepper-0.9.7/tests/test_cors.py", line 9, in <module>
    import datagrepper.app
    ^^^^^^^^^^^^^^^^^^^^^^
  File "/builddir/build/BUILD/datagrepper-0.9.7/datagrepper/app.py", line 66, in <module>
    dm.init(fedmsg_config['datanommer.sqlalchemy.url'])
            ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'datanommer.sqlalchemy.url'
----------------------------------------------------------------------
Ran 10 tests in 0.838s
FAILED (errors=2)

Comment 6 Miro Hrončok 2022-07-07 10:49:40 UTC
The current failure is:

DEBUG util.py:443:  Error: 
DEBUG util.py:443:   Problem 1: nothing provides requested (python3dist(flask) < 2~~ with python3dist(flask) >= 1.1)
DEBUG util.py:443:   Problem 2: nothing provides requested (python3dist(flask-healthz) < 0.0.2~~ with python3dist(flask-healthz) >= 0.0.1)
DEBUG util.py:443:   Problem 3: nothing provides requested (python3dist(pygal) < 3~~ with python3dist(pygal) >= 2.4)
DEBUG util.py:443:   Problem 4: problem with installed package python3-sqlalchemy-1.4.39-1.fc37.i686
DEBUG util.py:443:    - package python3-sqlalchemy1.3-1.3.24-5.fc37.i686 conflicts with python3-sqlalchemy provided by python3-sqlalchemy-1.4.39-1.fc37.i686
DEBUG util.py:443:    - conflicting requests

Seems like this was updated in dist git to a version that has missing dependencies :/

Comment 7 Ben Cotton 2022-08-09 13:39:13 UTC
This bug appears to have been reported against 'rawhide' during the Fedora Linux 37 development cycle.
Changing version to 37.

Comment 8 Miro Hrončok 2022-08-25 09:45:36 UTC
We are past Fedora 37 Beta Freeze and this package does not even install. What is the plan wrt this package? Can it please be removed from the distribution until this is solved?

Comment 9 Kevin Fenzi 2022-08-30 02:36:05 UTC
It was my intention to update these to modern python guidelines and get them building. Unfortunately there were a ton of fires I had to work on last week. 
Hopefully I can work on these this week. 

Any additional help welcome.

Comment 10 Miro Hrončok 2022-08-30 08:54:12 UTC
Happy to help however I can, but note that:

(In reply to Miro Hrončok from comment #6)
> The current failure is:
> 
> DEBUG util.py:443:  Error: 
> DEBUG util.py:443:   Problem 1: nothing provides requested
> (python3dist(flask) < 2~~ with python3dist(flask) >= 1.1)
> DEBUG util.py:443:   Problem 2: nothing provides requested
> (python3dist(flask-healthz) < 0.0.2~~ with python3dist(flask-healthz) >=
> 0.0.1)
> DEBUG util.py:443:   Problem 3: nothing provides requested
> (python3dist(pygal) < 3~~ with python3dist(pygal) >= 2.4)
> DEBUG util.py:443:   Problem 4: problem with installed package
> python3-sqlalchemy-1.4.39-1.fc37.i686
> DEBUG util.py:443:    - package python3-sqlalchemy1.3-1.3.24-5.fc37.i686
> conflicts with python3-sqlalchemy provided by
> python3-sqlalchemy-1.4.39-1.fc37.i686
> DEBUG util.py:443:    - conflicting requests
> 
> Seems like this was updated in dist git to a version that has missing
> dependencies :/

This looks like upstream pinning dependencies quite aggressively. Looking at the history of https://github.com/fedora-infra/datagrepper/blob/develop/pyproject.toml#L29 I'd say they just do it for good measure without any particular compatibility problem in mind. I'd start by talking to Aurelien about this and trying to explain to them why this is not good for downstream.

Comment 11 Adam Williamson 2022-09-15 22:57:25 UTC
Working on this. All the dep issues go away just by bumping to 1.0.1 (which came out in July). Then just a test issue to fix (which I did) and now a stray missing file to look at.

Comment 12 Fedora Update System 2022-09-15 23:33:05 UTC
FEDORA-2022-97fc4d590e has been submitted as an update to Fedora 37. https://bodhi.fedoraproject.org/updates/FEDORA-2022-97fc4d590e

Comment 13 Fedora Update System 2022-09-16 02:01:32 UTC
FEDORA-2022-97fc4d590e has been pushed to the Fedora 37 testing repository.
Soon you'll be able to install the update with the following command:
`sudo dnf upgrade --enablerepo=updates-testing --refresh --advisory=FEDORA-2022-97fc4d590e`
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2022-97fc4d590e

See also https://fedoraproject.org/wiki/QA:Updates_Testing for more information on how to test updates.

Comment 14 Miro Hrončok 2022-09-18 18:34:27 UTC
Hello,

Please note that this comment was generated automatically. If you feel that this output has mistakes, please contact me via email (mhroncok).

All subpackages of a package against which this bug was filled are now installable or removed from Fedora 38.

Thanks for taking care of it!

Comment 15 Fedora Update System 2022-09-20 00:17:11 UTC
FEDORA-2022-97fc4d590e has been pushed to the Fedora 37 stable repository.
If problem still persists, please make note of it in this bug report.


Note You need to log in before you can comment on or make changes to this bug.