Bug 1865241

Summary: pmix: FTBFS in Fedora rawhide/f33
Product: [Fedora] Fedora Reporter: Fedora Release Engineering <releng>
Component: pmixAssignee: Philip Kovacs <pkfed>
Status: CLOSED RAWHIDE QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: rawhideCC: junghans, orion, pkfed, spotrh
Target Milestone: ---Keywords: Reopened
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-08-08 03:29:40 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1803234    
Attachments:
Description Flags
build.log
none
root.log
none
state.log none

Description Fedora Release Engineering 2020-08-03 20:43:24 UTC
pmix failed to build from source in Fedora rawhide/f33

https://koji.fedoraproject.org/koji/taskinfo?taskID=48349804


For details on the mass rebuild see:

https://fedoraproject.org/wiki/Fedora_33_Mass_Rebuild
Please fix pmix at your earliest convenience and set the bug's status to
ASSIGNED when you start fixing it. If the bug remains in NEW state for 8 weeks,
pmix will be orphaned. Before branching of Fedora 34,
pmix will be retired, if it still fails to build.

For more details on the FTBFS policy, please visit:
https://fedoraproject.org/wiki/Fails_to_build_from_source

Comment 1 Fedora Release Engineering 2020-08-03 20:43:26 UTC
Created attachment 1708906 [details]
build.log

file build.log too big, will only attach last 32768 bytes

Comment 2 Fedora Release Engineering 2020-08-03 20:43:27 UTC
Created attachment 1708907 [details]
root.log

file root.log too big, will only attach last 32768 bytes

Comment 3 Fedora Release Engineering 2020-08-03 20:43:28 UTC
Created attachment 1708908 [details]
state.log

Comment 4 Philip Kovacs 2020-08-04 19:19:07 UTC
I don't know why the post-build tests are now failing only on armv7hl (they worked fine prior to the recent f33 mass rebuilds) -- for now I am going to exclude that arch.

Comment 5 Christoph Junghans 2020-08-04 22:14:58 UTC
Excluding armv7hl breaks the whole mpi stack.

Comment 6 Christoph Junghans 2020-08-04 22:31:24 UTC
Now it passed on armv7hl and failed on aarch64: https://koji.fedoraproject.org/koji/taskinfo?taskID=48671697
I guess the tests are just unstable.

Comment 7 Philip Kovacs 2020-08-04 23:12:09 UTC
Koschei has been repeatedly rebuilding pmix on any dependency change for years now, so my feeling is that something changed in rawhide to create this new problem.

Comment 8 Orion Poplawski 2020-08-06 14:21:17 UTC
Can we do another build with disabled tests to get the arm build back?  Like Christoph said - the openmpi stack is broken now and other packages can't be built.

Comment 9 Christoph Junghans 2020-08-06 16:31:59 UTC
Or build openmpi without external pmix. I am happy with either solution.

Comment 10 Philip Kovacs 2020-08-06 19:36:12 UTC
I never intended the armv7hl exclusion to be permanent, but since that arch exclusion is creating more problems than it solves ("breaks the mpi stack") I'll disable the tests for that arch.   This would also be a temporary solution of course until upstream or someone else finds the real problem.

Comment 11 Philip Kovacs 2020-08-06 22:39:15 UTC
All supported arches are back in rawhide.  No promises as to whether or not pmix actually works on arm -- the tests have been disabled.

Comment 12 Christoph Junghans 2020-08-06 22:55:24 UTC
Thanks, let's work with upstream to figure this out.

Comment 13 Philip Kovacs 2020-08-08 03:29:40 UTC
The test timeouts were too brief.  Fixed upstream (timeouts lengthened) and patched in Fedora pending next pmix release.  Closing.