Bug 1009170

Summary: Add Hadoop 2.x support and generate avro-ipc, avro-mapred artifacts
Product: [Fedora] Fedora Reporter: Pete MacKinnon <pmackinn>
Component: avroAssignee: Ricardo Arguello <ricardo.arguello>
Status: CLOSED ERRATA QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: high Docs Contact:
Priority: unspecified    
Version: rawhideCC: mgoldman, puntogil, ricardo.arguello, supercyper1
Target Milestone: ---Keywords: Improvement
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: avro-1.7.5-1.fc20 Doc Type: Enhancement
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-11-10 06:53:15 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1010003    

Description Pete MacKinnon 2013-09-17 21:25:22 UTC
Now that Hadoop 2.x has been added to Fedora, could you please either:

a) update to the latest avro (1.7.5), or
b) apply the patches at https://issues.apache.org/jira/browse/AVRO-593

This will enable Hadoop 2.x compatibility.

Also certain Hadoop-related ecosystem projects will be coming on line soon (like Hive) in Fedora, and they will need the avro-ipc and avro-mapred dependencies to be published as sub-packages.

Comment 1 Chen Lei 2013-10-17 03:41:14 UTC
(In reply to Pete MacKinnon from comment #0)
> Now that Hadoop 2.x has been added to Fedora, could you please either:
> 
> a) update to the latest avro (1.7.5), or
> b) apply the patches at https://issues.apache.org/jira/browse/AVRO-593
> 
> This will enable Hadoop 2.x compatibility.
> 
> Also certain Hadoop-related ecosystem projects will be coming on line soon
> (like Hive) in Fedora, and they will need the avro-ipc and avro-mapred
> dependencies to be published as sub-packages.

It seems avro-ipc and avro-mapred should be packaged seperately in Fedora.

See http://mirrors.cnnic.cn/apache/avro/avro-1.7.5/java/

Comment 2 Pete MacKinnon 2013-10-17 20:59:13 UTC
I've gone ahead and put together an updated spec/srpm for avro 1.7.5. It can be found at:

http://pmackinn.fedorapeople.org/avro/avro.spec
http://pmackinn.fedorapeople.org/avro/avro-1.7.5-1.fc19.src.rpm

It builds fine on rawhide (koji, mock) but the libthrift-java dep has not shown up yet on f20 testing yet.

Please let me know what you think.

Comment 3 gil cattaneo 2013-10-23 18:32:39 UTC
hi Pete
usually you must create a git patch
e.g.
fedpkg clone [PACKAGE NAME]

cd [PACKAGE NAME]
optional, removes all files no longer needed
git rm [FILES LIST] 
git add [PACKAGE NAME].spec [FILES LIST] e.g. patches or other file which don't a have url
optional, when update a package
fedpkg new-sources [PATH SOURCE ARCHIVE]/[SOURCE ARCHIVE]
git commit -m "[COMMENT]"
git format-patch master^

in this case with this procedure is generate a patch
like 0001-Updated-to-1.7.5.patch
then you can upload here instead of spec file and src rpm

Comment 4 gil cattaneo 2013-10-23 18:35:52 UTC
(In reply to gil cattaneo from comment #3)

> fedpkg new-sources [PATH SOURCE ARCHIVE]/[SOURCE ARCHIVE]
and all those files that have a url

Comment 5 Pete MacKinnon 2013-10-23 19:35:52 UTC
Gil, understood. But I don't own the package and wanted Ricardo to review the preliminary result first before doing what you describe.

Comment 6 gil cattaneo 2013-10-23 19:47:42 UTC
i know, apologized if my comment was inappropriate
see also:
https://bugzilla.redhat.com/show_bug.cgi?id=1020835
https://bugzilla.redhat.com/show_bug.cgi?id=1005502
snappy-java changes

Comment 7 Fedora Update System 2013-10-30 10:58:37 UTC
avro-1.7.5-1.fc20 has been submitted as an update for Fedora 20.
https://admin.fedoraproject.org/updates/avro-1.7.5-1.fc20

Comment 8 Fedora Update System 2013-10-30 17:11:41 UTC
Package avro-1.7.5-1.fc20:
* should fix your issue,
* was pushed to the Fedora 20 testing repository,
* should be available at your local mirror within two days.
Update it with:
# su -c 'yum update --enablerepo=updates-testing avro-1.7.5-1.fc20'
as soon as you are able to.
Please go to the following url:
https://admin.fedoraproject.org/updates/FEDORA-2013-20324/avro-1.7.5-1.fc20
then log in and leave karma (feedback).

Comment 9 Fedora Update System 2013-11-10 06:53:15 UTC
avro-1.7.5-1.fc20 has been pushed to the Fedora 20 stable repository.  If problems still persist, please make note of it in this bug report.