Bug 971132 - Hadoop JobTracker GUI (port 50030) job counters have incorrect values
Summary: Hadoop JobTracker GUI (port 50030) job counters have incorrect values
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: GlusterFS
Classification: Community
Component: gluster-hadoop
Version: mainline
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ---
Assignee: Bradley Childs
QA Contact: Martin Kudlej
URL:
Whiteboard:
Depends On:
Blocks: 1057253
TreeView+ depends on / blocked
 
Reported: 2013-06-05 18:52 UTC by Diane Feddema
Modified: 2014-03-03 16:31 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2014-03-03 16:31:31 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)

Description Diane Feddema 2013-06-05 18:52:39 UTC
Description of problem:
Hadoop JobTracker GUI (port 50030) is reporting incorrect job counter values for some counters.  Some examples include:

"SPLIT_RAW_BYTES" is a negative number (this is a count and should be a positive integer)

"Bytes Read" is zero for jobs that are reading data. 

"Rack-local map tasks" is reported however, Hadoop-glusterfs does not have rack awareness. 

"Data-local map tasks" is not reported

Version-Release number of selected component (if applicable):


How reproducible:
100%

Steps to Reproduce:
1.Run a mapreduce job

2.open a web brower port 50030 for node running your jobtracker
for example:
http://gprfs001.sbu.lab.eng.bos.redhat.com:50030/

3. under "Completed Jobs" click on a jobid and view the job counters for that job.

Actual results:
Incorrect hadoop job counter values displayed in JobTracker GUI

Expected results:
Correct hadoop job counter values displayed in JobTracker GUI



Additional info:

Comment 2 Steve Watt 2013-08-22 19:16:33 UTC
This is a counters issue. We should have full counter support with the new plugin rearchitecture. I suspect, this is no longer an issue.

Comment 3 Bradley Childs 2013-08-29 14:44:43 UTC
Fixed in latest redesign using the (Raw)LocalFileSystem.


Note You need to log in before you can comment on or make changes to this bug.