Bug 1034630

Summary: hadoop: Broken upgrade path and FTBFS
Product: [Fedora] Fedora Reporter: Mattias Ellert <mattias.ellert>
Component: hadoopAssignee: Robert Rati <rrati>
Status: CLOSED ERRATA QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 20CC: besser82, matt, rrati
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Linux   
Whiteboard:
Fixed In Version: hadoop-2.2.0-3.fc20 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-12-14 02:57:51 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
Proposed updated specfile
none
Avoid unnecessary linking to jvm none

Description Mattias Ellert 2013-11-26 09:03:06 UTC 
Created attachment 829114 [details]
Proposed updated specfile

Description of problem:

The version of hadoop in f20 is greater than the version of hadoop in rawhide, which means that the upgrade path from f20 to rawhide is broken.

The version of hadoop in rawhide is not rebuildable in rawhide:
https://koji.fedoraproject.org/koji/taskinfo?taskID=6225947

The version of hadoop in f20 is not rebuildable in f20:
https://koji.fedoraproject.org/koji/taskinfo?taskID=6225926

Version-Release number of selected component (if applicable):

hadoop-2.2.0-1.fc20.src.rpm
hadoop-2.0.5-12.fc21.src.rpm

How reproducible:

Always

Steps to Reproduce:
1. Try to rebuild hadoop in rawhide
2. Try to rebuild hadoop in f20
3. Try to upgrade from f20 to rawhide with hadoop installed

Actual results:

Failed rebuilds in rawhide and f20, broken upgrade path.

Expected results:

Successful rebuilds, working upgrade path.

Additional info:

The builds fail due to the use of %mvn_file in the spec file, and because the semantics of %mvn_file has changed in the current version of javapackages-tools, and the %mvn_file call no longer does the same thing as it used to do.

Fixing the issue is straighforward since the bug that forced the use of %mvn_file (wrong install location of jars with native jni support libraries) has been fixed and and the %mvn_file hack in the spec file can simply be dropped.

The attached proposed specfile builds fine in F20 and rawhide:
https://koji.fedoraproject.org/koji/taskinfo?taskID=6225998
https://koji.fedoraproject.org/koji/taskinfo?taskID=6225992

Note the properly identified "stereotype: native" during the %mvn_install in these logs, as well as the correct install path: usr/lib/java/hadoop/hadoop-common.jar
Comment 1 Mattias Ellert 2013-11-26 09:07:35 UTC 
Created attachment 829117 [details]
Avoid unnecessary linking to jvm

Since I added this patch to the spec I attached I attach it for completeness. You probably have this fix in the pipeline already.
Comment 2 Fedora Update System 2013-12-03 19:40:40 UTC 
hadoop-2.2.0-2.fc20 has been submitted as an update for Fedora 20.
https://admin.fedoraproject.org/updates/hadoop-2.2.0-2.fc20
Comment 3 Fedora Update System 2013-12-05 00:41:22 UTC 
Package hadoop-2.2.0-2.fc20:
* should fix your issue,
* was pushed to the Fedora 20 testing repository,
* should be available at your local mirror within two days.
Update it with:
# su -c 'yum update --enablerepo=updates-testing hadoop-2.2.0-2.fc20'
as soon as you are able to.
Please go to the following url:
https://admin.fedoraproject.org/updates/FEDORA-2013-22738/hadoop-2.2.0-2.fc20
then log in and leave karma (feedback).
Comment 4 Fedora Update System 2013-12-06 16:07:47 UTC 
hadoop-2.2.0-3.fc20 has been submitted as an update for Fedora 20.
https://admin.fedoraproject.org/updates/FEDORA-2013-22740/hadoop-2.2.0-3.fc20
Comment 5 Fedora Update System 2013-12-06 16:07:57 UTC 
hadoop-2.2.0-3.fc20 has been submitted as an update for Fedora 20.
https://admin.fedoraproject.org/updates/FEDORA-2013-22740/hadoop-2.2.0-3.fc20
Comment 6 Fedora Update System 2013-12-14 02:57:51 UTC 
hadoop-2.2.0-3.fc20 has been pushed to the Fedora 20 stable repository.  If problems still persist, please make note of it in this bug report.