Bug 971132

Summary:	Hadoop JobTracker GUI (port 50030) job counters have incorrect values
Product:	[Community] GlusterFS	Reporter:	Diane Feddema <dfeddema>
Component:	gluster-hadoop	Assignee:	Bradley Childs <bchilds>
Status:	CLOSED CURRENTRELEASE	QA Contact:	Martin Kudlej <mkudlej>
Severity:	medium	Docs Contact:
Priority:	medium
Version:	mainline	CC:	aavati, eboyd, matt, mkudlej, rhs-bugs, vbellur
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2014-03-03 16:31:31 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1057253

Description Diane Feddema 2013-06-05 18:52:39 UTC

Description of problem:
Hadoop JobTracker GUI (port 50030) is reporting incorrect job counter values for some counters.  Some examples include:

"SPLIT_RAW_BYTES" is a negative number (this is a count and should be a positive integer)

"Bytes Read" is zero for jobs that are reading data. 

"Rack-local map tasks" is reported however, Hadoop-glusterfs does not have rack awareness. 

"Data-local map tasks" is not reported

Version-Release number of selected component (if applicable):


How reproducible:
100%

Steps to Reproduce:
1.Run a mapreduce job

2.open a web brower port 50030 for node running your jobtracker
for example:
http://gprfs001.sbu.lab.eng.bos.redhat.com:50030/

3. under "Completed Jobs" click on a jobid and view the job counters for that job.

Actual results:
Incorrect hadoop job counter values displayed in JobTracker GUI

Expected results:
Correct hadoop job counter values displayed in JobTracker GUI



Additional info:

Comment 2 Steve Watt 2013-08-22 19:16:33 UTC

This is a counters issue. We should have full counter support with the new plugin rearchitecture. I suspect, this is no longer an issue.

Comment 3 Bradley Childs 2013-08-29 14:44:43 UTC

Fixed in latest redesign using the (Raw)LocalFileSystem.