Bug 692690 - dirsrv pegs the CPU and stops answering requests when a large group is imported
Summary: dirsrv pegs the CPU and stops answering requests when a large group is imported
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: slapi-nis
Version: 6.0
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: rc
: ---
Assignee: Nalin Dahyabhai
QA Contact:
URL:
Whiteboard:
: 692599 (view as bug list)
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2011-03-31 20:36 UTC by Stephen Gallagher
Modified: 2011-05-19 13:13 UTC (History)
4 users (show)

Fixed In Version: slapi-nis-0.23-1.el6
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2011-05-19 13:13:03 UTC
Target Upstream Version:


Attachments (Terms of Use)
LDIF to add 75000 memberuid attributes to the largegroup (194.60 KB, application/x-gzip)
2011-03-31 20:36 UTC, Stephen Gallagher
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHEA-2011:0575 0 normal SHIPPED_LIVE new package: slapi-nis 2011-05-18 17:56:59 UTC

Description Stephen Gallagher 2011-03-31 20:36:41 UTC
Created attachment 489221 [details]
LDIF to add 75000 memberuid attributes to the largegroup

Description of problem:
I created a group with ipa group-add and then used ldapmodify to add 75,000 memberuid entries to it. When the compat plugin is enabled, the dirsrv process goes to 100% CPU and stops responding to requests. When the plugin is disabled, the import completes quickly.

Version-Release number of selected component (if applicable):

slapi-nis-0.22-1.el6.x86_64
ipa-server-2.0.0-18.el6.x86_64
389-ds-base-1.2.8-0.9.rc4.el6.x86_64

How reproducible:
Every time

Steps to Reproduce:
1. Set up a FreeIPA v2 server
2. Create a group 'largegroup' with the command 'ipa group-add --desc "large group" largeroup
3. Import the attached ldif with
ldapmodify -x -D "cn=Directory Manager" -W -H ldap://localhost < largegroup1.ldif
  
Actual results:
ldapmodify returns after a few seconds, but the dirsrv process starts using 100% CPU and stops replying to ldapsearch requests.

Expected results:
The ldif should be imported and further requests should complete as expected.


Additional info:

Comment 2 Nalin Dahyabhai 2011-03-31 21:52:16 UTC
Okay, apparently slapi_entry_merge_values_sv() got slower each time we called it to add a single attribute value to the entry being generated... very slow.

Comment 3 Nalin Dahyabhai 2011-03-31 22:17:13 UTC
In 0.23, the compat plugin will call slapi_entry_merge_values_sv() once per attribute per entry rather than once per value per attribute per entry.

Comment 5 Jenny Severance 2011-04-07 18:18:00 UTC
verified:

#time ldapmodify -x -D "cn=Directory Manager" -w Secret123 -h ipaqa64vmb.testrelm < largegroup1.ldif 
modifying entry "cn=largegroup,cn=groups,cn=accounts,dc=testrelm"


real	0m3.318s
user	0m0.066s
sys	0m0.050s


# ipa group-show --all largegroup
  dn: cn=largegroup,cn=groups,cn=accounts,dc=testrelm
  Group name: largegroup
  Description: largegroup
  GID: 167200006
  ipauniqueid: d6226490-6142-11e0-8bb5-021016980183
  memberuid: newuser170900000, newuser170900001, newuser170900002, newuser170900003, newuser170900004, newuser170900005, newuser170900006, newuser170900007, newuser170900008, ne
wuser170900009, newuser170900010, newuser170900011, newuser170900012, newuser170900013, newuser170900014, newuser170900015, newuser170900016, newuser170900017, newuser170900018,
 newuser170900019, newuser170900020, newuser170900021, newuser170900022, newuser170900023, newuser170900024, newuser170900025, newuser170900026, newuser170900027, newuser1709000
28, newuser170900029, newuser170900030, newuser170900031, newuser170900032, newuser170900033, newuser170900034, newuser170900035, newuser170900036, newuser170900037, newuser1709
00038, newuser170900039, newuser170900040, newuser170900041, newuser170900042, newuser170900043, newuser170900044, newuser170900045, newuser170900046, newuser170900047, newuser1
70900048, newuser170900049, newuser170900050, newuser170900051, newuser170900052, newuser170900053, newuser170900054, newuser170900055, newuser170900056, newuser170900057, newus
er170900058, newuser170900059, newuser170900060, newuser170900061, newuser170900062, newuser170900063, newuser170900064, newuser170900065, etc .................................................................................................................


version verified:

slapi-nis-0.23-1.el6.x86_64
ipa-server-2.0.0-20.el6.x86_64

Comment 6 Jenny Severance 2011-04-07 18:19:06 UTC
to note: tested with replica and all replicated.

Comment 7 Stephen Gallagher 2011-04-12 01:04:24 UTC
*** Bug 692599 has been marked as a duplicate of this bug. ***

Comment 8 errata-xmlrpc 2011-05-19 13:13:03 UTC
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.

http://rhn.redhat.com/errata/RHEA-2011-0575.html


Note You need to log in before you can comment on or make changes to this bug.