Bug 1886639

Summary: Parallel support for NetCDF
Product: [Fedora] Fedora EPEL Reporter: jeff.kopera
Component: netcdfAssignee: Orion Poplawski <orion>
Status: CLOSED NOTABUG QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: medium Docs Contact:
Priority: unspecified    
Version: epel7CC: dakingun, jspaleta, orion, pertusus, scitech-bugs
Target Milestone: ---   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-01-26 03:42:27 UTC Type: Enhancement
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description jeff.kopera 2020-10-09 01:51:35 UTC
Would it be possible to adjust how this package is built to support the parallel I/O features of NetCDF?

Comment 1 Orion Poplawski 2020-10-09 02:23:48 UTC
What features exactly?

Comment 2 jeff.kopera 2020-10-09 02:31:33 UTC
Parallel access to netCDF-4/HDF5 files (https://www.unidata.ucar.edu/software/netcdf/docs/parallel_io.html)

I suspect there may be an issue with the hdf5 package it's built against that may prevent this, but these are the instructions from Unidata on how to build with parallel I/O support: https://www.unidata.ucar.edu/software/netcdf/docs/getting_and_building_netcdf.html#build_parallel

Comment 3 Orion Poplawski 2020-10-09 02:41:06 UTC
So, on the pnetcdf side the first step is that someone (probably me :() would need to package pnetcdf for Fedora.  Next concern is whether or not we would need to provide two versions - one with pnetcdf support and one without.

We do already build parallel hdf5 versions (mpich and openmpi) so that should be covered when we get to it.

Comment 4 jeff.kopera 2020-10-09 02:51:21 UTC
There may be desire it from others, but I don't think I have any need for pnetcdf support

Comment 5 Orion Poplawski 2020-10-09 03:02:59 UTC
So do the netcdf-openmpi or netcdf-mpich packages not do what you want already?

It appears that --enable-pnetcdf in the netcdf configure turns on both the pnetcdf and parallel HDF5 io support and appear to not be able to be independent.

Comment 6 jeff.kopera 2020-10-09 03:12:50 UTC
It appears I overlooked their existence. I'll look into it and get back to you on that.

I don't think --enable-pnetcdf is necessary to turn on parallel HDF5 support. I played around a little with this and was able to build hdf5 and netcdf from source, resulting in netcdf having parallel I/O support. Pretty much following the Building with Parallel I/O Support section from https://www.unidata.ucar.edu/software/netcdf/docs/getting_and_building_netcdf.html#build_parallel, stopping before the Building PnetCDF from source section.

Comment 7 jeff.kopera 2020-10-09 03:44:39 UTC
It does look like either netcdf-openmpi or netcdf-mpich can meet my needs. Thanks very much for making me aware of them