Bug 626963 - AIO uses igrab in the submission path, which causes undue lock contention
AIO uses igrab in the submission path, which causes undue lock contention
Product: Red Hat Enterprise Linux 5
Classification: Red Hat
Component: kernel (Show other bugs)
All Linux
low Severity medium
: rc
: ---
Assigned To: Jeff Moyer
Kernel Performance QE
Depends On: 626595
  Show dependency treegraph
Reported: 2010-08-24 14:41 EDT by Jeff Moyer
Modified: 2011-01-13 16:12 EST (History)
4 users (show)

See Also:
Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: 626595
Last Closed: 2011-01-13 16:12:59 EST
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Attachments (Terms of Use)
change igrab to atomic_inc (886 bytes, patch)
2010-08-24 14:44 EDT, Jeff Moyer
no flags Details | Diff

  None (edit)
Description Jeff Moyer 2010-08-24 14:41:59 EDT
+++ This bug was initially created as a clone of Bug #626595 +++

Description of problem:
From Chris Mason:

The aio batching code is using igrab to get an extra reference on the
inode so it can safely batch.  igrab will go ahead and take the global
inode spinlock, which can be a bottleneck on large machines doing lots
of AIO.

In this case, igrab isn't required because we already have a reference
on the file handle.  It is safe to just bump the i_count directly
on the inode.

Benchmarking shows this patch brings IOP/s on tons of flash up by about

Version-Release number of selected component (if applicable):

How reproducible:

Steps to Reproduce:
1. Run TPC-C on a huge machine
2. run perf report -g and witness time spent on the inode_lock
Comment 1 Jeff Moyer 2010-08-24 14:44:07 EDT
Created attachment 440727 [details]
change igrab to atomic_inc
Comment 2 RHEL Product and Program Management 2010-08-24 14:49:47 EDT
This request was evaluated by Red Hat Product Management for inclusion in a Red
Hat Enterprise Linux maintenance release.  Product Management has requested
further review of this request by Red Hat Engineering, for potential
inclusion in a Red Hat Enterprise Linux Update release for currently deployed
products.  This request is not yet committed for inclusion in an Update
Comment 5 Jarod Wilson 2010-09-15 10:01:38 EDT
in kernel-2.6.18-221.el5
You can download this test kernel from http://people.redhat.com/jwilson/el5

Detailed testing feedback is always welcomed.
Comment 8 errata-xmlrpc 2011-01-13 16:12:59 EST
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.


Note You need to log in before you can comment on or make changes to this bug.