Bug 2280822

Hello,

Please note that this comment was generated automatically by https://pagure.io/releng/blob/main/f/scripts/ftbfs-fti/follow-policy.py
If you feel that this output has mistakes, please open an issue at https://pagure.io/releng/

This package fails to install and maintainers are advised to take one of the following actions:

 - Fix this bug and close this bugzilla once the update makes it to the repository.
   (The same script that posted this comment will eventually close this bugzilla
   when the fixed package reaches the repository, so you don't have to worry about it.)

or

 - Move this bug to ASSIGNED if you plan on fixing this, but simply haven't done so yet.

or

 - Orphan the package if you no longer plan to maintain it.


If you do not take one of these actions, the process at https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/#_package_removal_for_long_standing_ftbfs_and_fti_bugs will continue.
This package may be orphaned in 7+ weeks.
This is the first reminder (step 3) from the policy.

Don't hesitate to ask for help on https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org/ if you are unsure how to fix this bug.

This just needs a bump and rebuild for libgdal.so.35.

Hello,

Please note that this comment was generated automatically by https://pagure.io/releng/blob/main/f/scripts/ftbfs-fti/follow-policy.py
If you feel that this output has mistakes, please open an issue at https://pagure.io/releng/

This package fails to install and maintainers are advised to take one of the following actions:

 - Fix this bug and close this bugzilla once the update makes it to the repository.
   (The same script that posted this comment will eventually close this bugzilla
   when the fixed package reaches the repository, so you don't have to worry about it.)

or

 - Move this bug to ASSIGNED if you plan on fixing this, but simply haven't done so yet.

or

 - Orphan the package if you no longer plan to maintain it.


If you do not take one of these actions, the process at https://docs.fedoraproject.org/en-US/fesco/Fails_to_build_from_source_Fails_to_install/#_package_removal_for_long_standing_ftbfs_and_fti_bugs will continue.
This package may be orphaned in 4+ weeks.
This is the second reminder (step 4) from the policy.

Don't hesitate to ask for help on https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org/ if you are unsure how to fix this bug.

python-fiona fails to build on s390x arch with multiple "fiona._err.CPLE_OpenFailedError: '....parquet' not recognized as being in a supported file format."

See Koji logs: https://koji.fedoraproject.org/koji/taskinfo?taskID=119221197


____________________ test_write_memoryfile_drivers[Parquet] ____________________
>   ???
fiona/ogrext.pyx:136: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
>   ???
E   fiona._err.CPLE_OpenFailedError: '/vsimem/5437486864fb45198b604a295573caa9/5437486864fb45198b604a295573caa9.parquet' not recognized as being in a supported file format.
fiona/_err.pyx:291: CPLE_OpenFailedError
During handling of the above exception, another exception occurred:
driver = 'Parquet'
testdata_generator = <function testdata_generator.<locals>._testdata_generator at 0x3feff778680>
    @pytest.mark.parametrize(
        "driver",
        [
            driver
            for driver in supported_drivers
            if _driver_supports_mode(driver, "w")
            and supports_vsi(driver)
            and driver not in {"MapInfo File"}
        ],
    )
    def test_write_memoryfile_drivers(driver, testdata_generator):
        """ Test if driver is able to write to memoryfile """
        range1 = list(range(0, 5))
        schema, crs, records1, _, _ = testdata_generator(driver, range1, [])
    
        with MemoryFile() as memfile:
            with memfile.open(driver=driver, schema=schema) as c:
                c.writerecords(records1)
    
>           with memfile.open(driver=driver) as c:
tests/test_memoryfile.py:234: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../BUILDROOT/usr/lib64/python3.13/site-packages/fiona/io.py:91: in open
    return Collection(
../BUILDROOT/usr/lib64/python3.13/site-packages/fiona/collection.py:243: in __init__
    self.session.start(self, **kwargs)
fiona/ogrext.pyx:588: in fiona.ogrext.Session.start
    ???
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
>   ???
E   fiona.errors.DriverError: '/vsimem/5437486864fb45198b604a295573caa9/5437486864fb45198b604a295573caa9.parquet' not recognized as being in a supported file format.
fiona/ogrext.pyx:143: DriverError
----------------------------- Captured stderr call -----------------------------
ERROR 4: `/vsimem/5437486864fb45198b604a295573caa9/5437486864fb45198b604a295573caa9.parquet' not recognized as being in a supported file format.
------------------------------ Captured log call -------------------------------
INFO     fiona.ogrext:io.py:86 Setting extension: root='/vsimem/5437486864fb45198b604a295573caa9/5437486864fb45198b604a295573caa9', extension='.parquet'
DEBUG    fiona.ogrext:collection.py:246 File doesn't exist. Creating a new one...
DEBUG    fiona._env:env.py:315 GDAL data files are available at built-in paths.
DEBUG    fiona._env:env.py:315 PROJ data files are available at built-in paths.
DEBUG    fiona._env:env.py:315 GDAL data files are available at built-in paths.
DEBUG    fiona._env:env.py:315 PROJ data files are available at built-in paths.
DEBUG    fiona.ogrext:collection.py:246 Created layer 5437486864fb45198b604a295573caa9
DEBUG    fiona.ogrext:collection.py:246 Writing started
DEBUG    fiona._env:env.py:315 GDAL data files are available at built-in paths.
DEBUG    fiona._env:env.py:315 PROJ data files are available at built-in paths.
DEBUG    fiona.ogrext:collection.py:558 Transaction supported: 0
DEBUG    fiona.ogrext:collection.py:667 Flushed data source cache
DEBUG    fiona.collection:collection.py:678 Flushed buffer
DEBUG    fiona.collection:collection.py:680 Stopped session

= 43 failed, 1691 passed, 167 skipped, 12 deselected, 1 xfailed, 6 xpassed, 1 warning in 61.17s (0:01:01) =

That had to do with the most recent GDAL update; I think @smani was looking into it before.

I'm a bit confused that `test_append_memoryfile_drivers` is showing up there as a failure, as one of @smani's patches was to disable Parquet in that test.

Sorry I had not noticed that the final build had still failed because of s390x after adding the patch. I'd suggest disabling that test on s390x, as it is near-impossible to debug without such hardware.

Copr offers ssh access to builders for debugging if you want to dig into this further:

[1] https://docs.pagure.org/copr.copr/user_documentation.html#ssh-access-to-copr-builders

(In reply to Sandro Mani from comment #6)
> Sorry I had not noticed that the final build had still failed because of
> s390x after adding the patch. I'd suggest disabling that test on s390x, as
> it is near-impossible to debug without such hardware.

https://src.fedoraproject.org/rpms/python-fiona/pull-request/3

My current internet connection for whatever reason is blocking SSH access, I'll try and debug this on the builder next week.

This is a libarrow issue. With a sample file from [1], on s390x I get

ERROR 1: parquet::arrow::OpenFile() failed

whereas on x86_64 it works fine. I'd suggest moving ahead with disabling the test for now.

[1] https://www.tablab.app/datasets/sample/parquet