Bug 672238

Summary: vdsm produces too many iops
Product: Red Hat Enterprise Linux 5 Reporter: Chris Pelland <cpelland>
Component: vdsm22Assignee: Dan Kenigsberg <dkenigsb>
Status: CLOSED ERRATA QA Contact: yeylon <yeylon>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 5.5.zCC: abaron, apevec, bazulay, danken, djorm, dornelas, dpaikov, fhirtz, iheim, ohochman, pm-eus, sbombe, sgordon, sgrinber, srevivo, vromanov
Target Milestone: rcKeywords: ZStream
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: vdsm22-4.5-63.14.el5_6 Doc Type: Bug Fix
Doc Text:
C: On Red Hat Enterprise Linux 5.6 hosts that held the SPM role performed additional I/O operations when periodically querying their inbox. C: The additional I/O operations resulted in performance degradation in environments that were backed by SAN storage. F: As of the vdsm22-4.5-63.14.el5_6 package vdsm does not perform additional un-necessary I/O when it periodically polls the inbox. R: The SPM uses less I/O operations. Text: Hosts that held the SPM role performed additional I/O operations when periodically querying their inbox. The additional I/O operations resulted in performance degradation in environments that were backed by SAN storage. With this update, VDSM does not perform additional un-necessary I/O when it periodically polls the inbox. As a result, I/O overhead on the SPM is reduced.
Story Points: ---
Clone Of: Environment:
Last Closed: 2011-03-10 09:18:54 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 664882    
Bug Blocks:    

Description Chris Pelland 2011-01-24 15:01:21 UTC
This bug has been copied from bug #664882 and has been proposed
to be backported to 5.6 z-stream (EUS).

Comment 4 Omri Hochman 2011-01-26 10:25:08 UTC
verified with vdsm22-4.5-63.13.el5_6,

Device:         rrqm/s   wrqm/s   r/s   w/s   rsec/s   wsec/s avgrq-sz avgqu-sz
  await  svctm  %util
sda               0.01    45.52  0.03 20.20     0.68   525.75    26.02     0.20
   9.81   5.42  10.97
sda1              0.00     0.00  0.00  0.00     0.00     0.00    13.33     0.00
   4.26   4.09   0.00
sda2              0.01    45.52  0.03 20.20     0.68   525.75    26.03     0.20
   9.81   5.42  10.97
dm-0              0.00     0.00  0.04 65.72     0.68   525.75     8.01     1.20
  18.22   1.67  10.97
dm-1              0.00     0.00  0.00  0.00     0.00     0.00     8.00     0.00
   5.14   1.31   0.00
dm-14             0.00     0.00  1.00  0.00     8.03     0.00     8.00     0.00
   0.02   0.02   0.00
dm-34             0.00     0.00  0.99  0.01     7.93     0.94     8.85     0.00
   3.11   0.02   0.00
dm-15             0.00     0.00  0.44  0.00     3.44     0.00     7.75     0.00

Comment 5 yeylon@redhat.com 2011-01-26 14:00:18 UTC
moving back to assign due to VDSM RPM needs to have dependencies of the following pack! coreutils-5.97-23.el5_6.3.

Comment 6 Daniel Paikov 2011-01-27 12:02:24 UTC
Checked on vdsm22-4.5-63.14.el5_6.

Comment 7 Stephen Gordon 2011-02-28 23:27:11 UTC
    Technical note added. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    New Contents:
Hosts that hold the SPM role access storage in-efficiently when periodically querying their inbox. These in-efficient reads result in unnecessary I/O operations and performance degradation in environments that use SAN storage. The VDSM package has been updated to use more I/O efficient reads. The SPM now uses less I/O operations for each periodic inbox read.

Comment 8 Stephen Gordon 2011-03-01 00:45:56 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -1 +1,6 @@
-Hosts that hold the SPM role access storage in-efficiently when periodically querying their inbox. These in-efficient reads result in unnecessary I/O operations and performance degradation in environments that use SAN storage. The VDSM package has been updated to use more I/O efficient reads. The SPM now uses less I/O operations for each periodic inbox read.+C: Hosts that hold the SPM role perform additional I/O operations when periodically querying their inbox.
+C: The additional I/O operations result in performance degradation in environments that are backed by SAN storage.
+F: VDSM no longer performs additional un-necessary I/O when it periodically polls the inbox.
+R: The SPM uses less I/O operations.
+
+Text: Hosts that hold the SPM role perform additional I/O operations when periodically querying their inbox. The additional I/O operations result in performance degradation in environments that are backed by SAN storage. VDSM no longer performs additional un-necessary I/O when it periodically polls the inbox. The SPM uses less I/O operations.

Comment 9 Stephen Gordon 2011-03-01 00:47:03 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -1,6 +1,6 @@
 C: Hosts that hold the SPM role perform additional I/O operations when periodically querying their inbox.
 C: The additional I/O operations result in performance degradation in environments that are backed by SAN storage.
-F: VDSM no longer performs additional un-necessary I/O when it periodically polls the inbox.
+F: The vdsm22-4.5-63.14.el5_6 package does not perform additional un-necessary I/O when it periodically polls the inbox.
 R: The SPM uses less I/O operations.
 
 Text: Hosts that hold the SPM role perform additional I/O operations when periodically querying their inbox. The additional I/O operations result in performance degradation in environments that are backed by SAN storage. VDSM no longer performs additional un-necessary I/O when it periodically polls the inbox. The SPM uses less I/O operations.

Comment 10 Stephen Gordon 2011-03-01 02:12:15 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -1,6 +1,6 @@
-C: Hosts that hold the SPM role perform additional I/O operations when periodically querying their inbox.
-C: The additional I/O operations result in performance degradation in environments that are backed by SAN storage.
-F: The vdsm22-4.5-63.14.el5_6 package does not perform additional un-necessary I/O when it periodically polls the inbox.
+C: On Red Hat Enterprise Linux 5.6 hosts that held the SPM role performed additional I/O operations when periodically querying their inbox.
+C: The additional I/O operations resulted in performance degradation in environments that were backed by SAN storage.
+F: As of the vdsm22-4.5-63.14.el5_6 package vdsm does not perform additional un-necessary I/O when it periodically polls the inbox.
 R: The SPM uses less I/O operations.
 
-Text: Hosts that hold the SPM role perform additional I/O operations when periodically querying their inbox. The additional I/O operations result in performance degradation in environments that are backed by SAN storage. VDSM no longer performs additional un-necessary I/O when it periodically polls the inbox. The SPM uses less I/O operations.+Text: On Red Hat Enterprise Linux 5.6 hosts that held the SPM role performed additional I/O operations when periodically querying their inbox. The additional I/O operations resulted in performance degradation in environments that were backed by SAN storage. As of the vdsm22-4.5-63.14.el5_6 package vdsm does not perform additional un-necessary I/O when it periodically polls the inbox. The SPM uses less I/O operations.

Comment 11 David Jorm 2011-03-03 04:20:01 UTC
    Technical note updated. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    Diffed Contents:
@@ -3,4 +3,4 @@
 F: As of the vdsm22-4.5-63.14.el5_6 package vdsm does not perform additional un-necessary I/O when it periodically polls the inbox.
 R: The SPM uses less I/O operations.
 
-Text: On Red Hat Enterprise Linux 5.6 hosts that held the SPM role performed additional I/O operations when periodically querying their inbox. The additional I/O operations resulted in performance degradation in environments that were backed by SAN storage. As of the vdsm22-4.5-63.14.el5_6 package vdsm does not perform additional un-necessary I/O when it periodically polls the inbox. The SPM uses less I/O operations.+Text: Hosts that held the SPM role performed additional I/O operations when periodically querying their inbox. The additional I/O operations resulted in performance degradation in environments that were backed by SAN storage. With this update, VDSM does not perform additional un-necessary I/O when it periodically polls the inbox. As a result, I/O overhead on the SPM is reduced.

Comment 12 errata-xmlrpc 2011-03-10 09:18:54 UTC
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.

http://rhn.redhat.com/errata/RHBA-2011-0319.html