Bug 1034630 - hadoop: Broken upgrade path and FTBFS
Summary: hadoop: Broken upgrade path and FTBFS
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Fedora
Classification: Fedora
Component: hadoop
Version: 20
Hardware: Unspecified
OS: Linux
urgent
urgent
Target Milestone: ---
Assignee: Robert Rati
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2013-11-26 09:03 UTC by Mattias Ellert
Modified: 2013-12-14 02:57 UTC (History)
3 users (show)

Fixed In Version: hadoop-2.2.0-3.fc20
Clone Of:
Environment:
Last Closed: 2013-12-14 02:57:51 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)
Proposed updated specfile (44.76 KB, text/x-rpm-spec)
2013-11-26 09:03 UTC, Mattias Ellert
no flags Details
Avoid unnecessary linking to jvm (1.44 KB, patch)
2013-11-26 09:07 UTC, Mattias Ellert
no flags Details | Diff

Description Mattias Ellert 2013-11-26 09:03:06 UTC
Created attachment 829114 [details]
Proposed updated specfile

Description of problem:

The version of hadoop in f20 is greater than the version of hadoop in rawhide, which means that the upgrade path from f20 to rawhide is broken.

The version of hadoop in rawhide is not rebuildable in rawhide:
https://koji.fedoraproject.org/koji/taskinfo?taskID=6225947

The version of hadoop in f20 is not rebuildable in f20:
https://koji.fedoraproject.org/koji/taskinfo?taskID=6225926

Version-Release number of selected component (if applicable):

hadoop-2.2.0-1.fc20.src.rpm
hadoop-2.0.5-12.fc21.src.rpm

How reproducible:

Always

Steps to Reproduce:
1. Try to rebuild hadoop in rawhide
2. Try to rebuild hadoop in f20
3. Try to upgrade from f20 to rawhide with hadoop installed

Actual results:

Failed rebuilds in rawhide and f20, broken upgrade path.

Expected results:

Successful rebuilds, working upgrade path.

Additional info:

The builds fail due to the use of %mvn_file in the spec file, and because the semantics of %mvn_file has changed in the current version of javapackages-tools, and the %mvn_file call no longer does the same thing as it used to do.

Fixing the issue is straighforward since the bug that forced the use of %mvn_file (wrong install location of jars with native jni support libraries) has been fixed and and the %mvn_file hack in the spec file can simply be dropped.

The attached proposed specfile builds fine in F20 and rawhide:
https://koji.fedoraproject.org/koji/taskinfo?taskID=6225998
https://koji.fedoraproject.org/koji/taskinfo?taskID=6225992

Note the properly identified "stereotype: native" during the %mvn_install in these logs, as well as the correct install path: usr/lib/java/hadoop/hadoop-common.jar

Comment 1 Mattias Ellert 2013-11-26 09:07:35 UTC
Created attachment 829117 [details]
Avoid unnecessary linking to jvm

Since I added this patch to the spec I attached I attach it for completeness. You probably have this fix in the pipeline already.

Comment 2 Fedora Update System 2013-12-03 19:40:40 UTC
hadoop-2.2.0-2.fc20 has been submitted as an update for Fedora 20.
https://admin.fedoraproject.org/updates/hadoop-2.2.0-2.fc20

Comment 3 Fedora Update System 2013-12-05 00:41:22 UTC
Package hadoop-2.2.0-2.fc20:
* should fix your issue,
* was pushed to the Fedora 20 testing repository,
* should be available at your local mirror within two days.
Update it with:
# su -c 'yum update --enablerepo=updates-testing hadoop-2.2.0-2.fc20'
as soon as you are able to.
Please go to the following url:
https://admin.fedoraproject.org/updates/FEDORA-2013-22738/hadoop-2.2.0-2.fc20
then log in and leave karma (feedback).

Comment 4 Fedora Update System 2013-12-06 16:07:47 UTC
hadoop-2.2.0-3.fc20 has been submitted as an update for Fedora 20.
https://admin.fedoraproject.org/updates/FEDORA-2013-22740/hadoop-2.2.0-3.fc20

Comment 5 Fedora Update System 2013-12-06 16:07:57 UTC
hadoop-2.2.0-3.fc20 has been submitted as an update for Fedora 20.
https://admin.fedoraproject.org/updates/FEDORA-2013-22740/hadoop-2.2.0-3.fc20

Comment 6 Fedora Update System 2013-12-14 02:57:51 UTC
hadoop-2.2.0-3.fc20 has been pushed to the Fedora 20 stable repository.  If problems still persist, please make note of it in this bug report.


Note You need to log in before you can comment on or make changes to this bug.