Bug 475334

Summary: [LTC 5.4 FEAT] FCP - Performance Data collection (kernel) [201590]
Product: Red Hat Enterprise Linux 5 Reporter: IBM Bug Proxy <bugproxy>
Component: kernelAssignee: Hans-Joachim Picht <hpicht>
Status: CLOSED ERRATA QA Contact: Red Hat Kernel QE team <kernel-qe>
Severity: high Docs Contact:
Priority: high    
Version: 5.4CC: bhinson, borgan, cward, czhang, dzickus, hpicht, jjarvis, peterm, riek, rlerch, swells
Target Milestone: alphaKeywords: OtherQA, Patch, Reopened
Target Release: 5.4   
Hardware: s390x   
OS: All   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Fibre Channel Protocol (FCP) performance data can be measured on Red Hat Enterprise Linux instances on the IBM System z platform. Metrics that are collected and reported on include: * Performance relevant data on stack components such as Linux devices, Small Computer System Interface (SCSI) Logical Unit Numbers (LUNs) and Host Bus Adapter (HBA) storage controller information. * Per stack component: current values of relevant measurements as throughput, utilization and other applicable measurements. * Statistical aggregations (minimum, maximum, averages and histogram) of data associated with I/O requests including size, latency per component and totals.
Story Points: ---
Clone Of: Environment:
Last Closed: 2009-09-02 08:23:00 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 472898, 493385    
Bug Blocks: 445204, 468301, 483701, 483784    
Attachments:
Description Flags
linux-2.6.18-s390-zfcp-perfdata.patch none

Description IBM Bug Proxy 2008-12-08 21:50:50 UTC
=Comment: #0=================================================
Emily J. Ratliff <ratliff.com> - 
1. Feature Overview:
Feature Id:	[201590]
a. Name of Feature:	FCP - Performance Data collection  (kernel)
b. Feature Description
The item comprises:
 
 a) facilities which provide performance relevant data (see below) at any time
 
 b) facilities which collect the data provided by a), then associate it with a time stamp and and
store it for future processing
 
      - these facilities are configurable in regard of the type and amount of data collected for the
purpose of reducing the amount of temporarily stored data.
 
      - when data is taken as samples, the sampling interval is configurable
 
      - collected data can be filtered by e.g masks for valid stack components (see below) before
data is stored for further processing
 
 c) facilities which present the data stored by b) in  a human readable way.
 
 d) Data presented shall contain enough information to make FCP performance data comparable with
current capabilities of FICON data collections.
 
 
 
 Data collected comprises:
 
 a) Performance relevant data about stack components as Linux devices, SCSI LUNs and HBA and storage
controller information
 
 b) Per stack component: current values of relevant measurements as throughput, utilization and
other applicable measurements 
 
 c) Statistical aggregations (min, max average, histogram) of data associated with I/O requests as
size, latency per component and in total.

2. Feature Details:
Sponsor:	zSeries
Architectures:
s390x

Arch Specificity: Both
Affects Core Kernel: Yes
Affects Kernel Modules: Yes
Delivery Mechanism: Backport
Category:	Kernel
Request Type:	Kernel - Enhancement from Upstream
d. Upstream Acceptance:	Accepted
Sponsor Priority	1
f. Severity: High
IBM Confidential:	no
Code Contribution:	IBM code
g. Component Version Target:	2.6.28

3. Business Case
This item will make possible to have a better understanding of the SCSI activities and performance
of the customer system, being able afterward to better solve FCP issues regarding customer's SCSI
workloads.

4. Primary contact at Red Hat: 
John Jarvis
jjarvis

5. Primary contacts at Partner:
Project Management Contact:
Hans-Georg Markgraf, mgrf.com, Boeblingen 49-7031-16-3978

Technical contact(s):

Gonzalo Muelas Serrano, gmuelas.com

IBM Manager:
Thomas Schwarz, t.schwarz.com

Comment 1 John Jarvis 2008-12-16 20:57:27 UTC
IBM is signed up to test and provide feedback.

Comment 2 RHEL Program Management 2008-12-16 21:18:00 UTC
Quality Engineering Management has reviewed and declined this request.  You may
appeal this decision by reopening this request.

Comment 4 IBM Bug Proxy 2008-12-17 08:30:45 UTC
(In reply to comment #5)
> Quality Engineering Management has reviewed and declined this request.  You may
> appeal this decision by reopening this request.
>

Hello Red Hat QEM,
we are still interested in this request.
Could you please explain to IBM what came out of your review and which are the reasons (technical and/or business) to decline this request?

Note that this feature is needed for:
Red Hat Bugzilla - 475333 - IBM LTC Bug 50340   -  [LTC 5.4 FEAT] FCP - Performance Data collection & analysis (userspace) [201591]
Red Hat Bugzilla - 475548 - IBM LTC Bug 50351   -  [LTC 5.4 FEAT] FCP - Performance data collection (blktrace) [201729]
Red Hat Bugzilla - 475552 - IBM LTC Bug 50352   -  [LTC 5.4 FEAT] FCP - Performance data reports [201730]

You can find more information about the FCP - Performance Data collection features here:
http://www.ibm.com/developerworks/linux/linux390/development_documentation.html
How to use FC-attached SCSI devices with Linux on System z - SC33-8413-01
Chapters 10 and 12.

Thank you!
Gonzalo Muelas Serrano.

Comment 6 IBM Bug Proxy 2009-01-23 10:43:05 UTC
Created attachment 329802 [details]
linux-2.6.18-s390-zfcp-perfdata.patch

Comment 7 Hans-Joachim Picht 2009-02-13 16:53:51 UTC
Posted to rhkernel on Feb 13. by Hans-Joachim Picht <hpicht>

Comment 8 RHEL Program Management 2009-02-16 15:19:00 UTC
Updating PM score.

Comment 9 IBM Bug Proxy 2009-02-18 15:03:06 UTC
Please do not forget to update documentation and/or release notes:

Provides FCP performance data like, SCSI stack, SCSI LUNs, HBA, storage controller information...
??? More details under:
??? ???I/O tracing using blktrace???, ???Collecting FCP performance data with ziomon??? in latest version of How to use FC-attached SCSI
devices with Linux on System z at:
http://www.ibm.com/developerworks/linux/linux390/development_documentation.html

Thank you!

Comment 10 John Jarvis 2009-03-06 14:36:55 UTC
This enhancement request was evaluated by the full Red Hat Enterprise Linux 
team for inclusion in a Red Hat Enterprise Linux minor release.   As a 
result of this evaluation, Red Hat has tentatively approved inclusion of 
this feature in the next Red Hat Enterprise Linux Update minor release.   
While it is a goal to include this enhancement in the next minor release 
of Red Hat Enterprise Linux, the enhancement is not yet committed for 
inclusion in the next minor release pending the next phase of actual 
code integration and successful Red Hat and partner testing.

Comment 11 Don Zickus 2009-04-06 21:17:24 UTC
in kernel-2.6.18-138.el5
You can download this test kernel from http://people.redhat.com/dzickus/el5

Please do NOT transition this bugzilla state to VERIFIED until our QE team
has sent specific instructions indicating when to do so.  However feel free
to provide a comment indicating that this fix has been verified.

Comment 13 Don Zickus 2009-05-05 19:54:57 UTC
moving back to POST to pickup the extra patch bit.

Comment 14 Don Zickus 2009-05-05 19:55:21 UTC
really going to do it this time

Comment 15 Don Zickus 2009-05-12 17:40:27 UTC
in kernel-2.6.18-146.el5
You can download this test kernel from http://people.redhat.com/dzickus/el5

Please do NOT transition this bugzilla state to VERIFIED until our QE team
has sent specific instructions indicating when to do so.  However feel free
to provide a comment indicating that this fix has been verified.

Comment 17 Chris Ward 2009-06-14 23:17:23 UTC
~~ Attention Partners RHEL 5.4 Partner Alpha Released! ~~

RHEL 5.4 Partner Alpha has been released on partners.redhat.com. There should
be a fix present that addresses this particular request. Please test and report back your results here, at your earliest convenience. Our Public Beta release is just around the corner!

If you encounter any issues, please set the bug back to the ASSIGNED state and
describe the issues you encountered. If you have verified the request functions as expected, please set your Partner ID in the Partner field above to indicate successful test results. Do not flip the bug status to VERIFIED. Further questions can be directed to your Red Hat Partner Manager. Thanks!

Comment 18 Chris Ward 2009-07-03 18:15:56 UTC
~~ Attention - RHEL 5.4 Beta Released! ~~

RHEL 5.4 Beta has been released! There should be a fix present in the Beta release that addresses this particular request. Please test and report back results here, at your earliest convenience. RHEL 5.4 General Availability release is just around the corner!

If you encounter any issues while testing Beta, please describe the issues you have encountered and set the bug into NEED_INFO. If you encounter new issues, please clone this bug to open a new issue and request it be reviewed for inclusion in RHEL 5.4 or a later update, if it is not of urgent severity.

Please do not flip the bug status to VERIFIED. Only post your verification results, and if available, update Verified field with the appropriate value.

Questions can be posted to this bug or your customer or partner representative.

Comment 19 Shawn Wells 2009-07-08 19:58:05 UTC
Release note added. If any revisions are required, please set the 
"requires_release_notes" flag to "?" and edit the "Release Notes" field accordingly.
All revisions will be proofread by the Engineering Content Services team.

New Contents:
This feature allows for the collection of FCP performance data on Red Hat Enterprise Linux instances on the IBM System z platform.

Such metrics include:
- Performance relevant data about stack components as Linux devices, SCSI LUNs and HBA and storage controller information.

- Per stack component: current values of relevant measurements as throughput, utilization and
other applicable measurements .

- Statistical aggregations (min, max average, histogram) of data associated with I/O requests as
size, latency per component and in total.

Comment 20 Chris Ward 2009-07-10 19:07:29 UTC
~~ Attention Partners - RHEL 5.4 Snapshot 1 Released! ~~

RHEL 5.4 Snapshot 1 has been released on partners.redhat.com. If you have already reported your test results, you can safely ignore this request. Otherwise, please notice that there should be a fix available now that addresses this particular request. Please test and report back your results here, at your earliest convenience. The RHEL 5.4 exception freeze is quickly approaching.

If you encounter any issues while testing Beta, please describe the issues you have encountered and set the bug into NEED_INFO. If you encounter new issues, please clone this bug to open a new issue and request it be reviewed for inclusion in RHEL 5.4 or a later update, if it is not of urgent severity.

Do not flip the bug status to VERIFIED. Instead, please set your Partner ID in the Verified field above if you have successfully verified the resolution of this issue. 

Further questions can be directed to your Red Hat Partner Manager or other appropriate customer representative.

Comment 22 Ryan Lerch 2009-07-20 22:52:11 UTC
Release note updated. If any revisions are required, please set the 
"requires_release_notes"  flag to "?" and edit the "Release Notes" field accordingly.
All revisions will be proofread by the Engineering Content Services team.

Diffed Contents:
@@ -1,10 +1,7 @@
-This feature allows for the collection of FCP performance data on Red Hat Enterprise Linux instances on the IBM System z platform.
+Fibre Channel Protocol (FCP) performance data can be measured on Red Hat Enterprise Linux instances on the IBM System z platform. Metrics that are collected and reported on include:
 
-Such metrics include:
-- Performance relevant data about stack components as Linux devices, SCSI LUNs and HBA and storage controller information.
+* Performance relevant data on stack components such as Linux devices, Small Computer System Interface (SCSI) Logical Unit Numbers (LUNs) and Host Bus Adapter (HBA) storage controller information.
 
-- Per stack component: current values of relevant measurements as throughput, utilization and
-other applicable measurements .
+* Per stack component: current values of relevant measurements as throughput, utilization and other applicable measurements.
 
-- Statistical aggregations (min, max average, histogram) of data associated with I/O requests as
+* Statistical aggregations (minimum, maximum, averages and histogram) of data associated with I/O requests including size, latency per component and totals.-size, latency per component and in total.

Comment 23 Caspar Zhang 2009-07-29 04:59:51 UTC
Verified the patches to this bug are included in kernel-2.6.18-160.el5

Comment 24 Chris Ward 2009-08-03 15:44:55 UTC
~~ Attention Partners - RHEL 5.4 Snapshot 5 Released! ~~

RHEL 5.4 Snapshot 5 is the FINAL snapshot to be release before RC. It has been 
released on partners.redhat.com. If you have already reported your test results, 
you can safely ignore this request. Otherwise, please notice that there should be 
a fix available now that addresses this particular issue. Please test and report 
back your results here, at your earliest convenience.

If you encounter any issues while testing Beta, please describe the 
issues you have encountered and set the bug into NEED_INFO. If you 
encounter new issues, please clone this bug to open a new issue and 
request it be reviewed for inclusion in RHEL 5.4 or a later update, if it 
is not of urgent severity. If it is urgent, escalate the issue to your partner manager as soon as possible. There is /very/ little time left to get additional code into 5.4 before GA.

Partners, after you have verified, do not flip the bug status to VERIFIED. Instead, please set your Partner ID in the Verified field above if you have successfully verified the resolution of this issue. 

Further questions can be directed to your Red Hat Partner Manager or other 
appropriate customer representative.

Comment 25 IBM Bug Proxy 2009-08-03 16:40:36 UTC
------- Comment From mgrf.com 2009-08-03 12:34 EDT-------
verified on RHEL 5.4 snapshots - closing feature request

Comment 27 errata-xmlrpc 2009-09-02 08:23:00 UTC
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.

http://rhn.redhat.com/errata/RHSA-2009-1243.html