Bug 1236148
| Summary: | Slow replication when deleting large quantities of multi-valued attributes | ||
|---|---|---|---|
| Product: | Red Hat Enterprise Linux 6 | Reporter: | Noriko Hosoi <nhosoi> |
| Component: | 389-ds-base | Assignee: | Noriko Hosoi <nhosoi> |
| Status: | CLOSED ERRATA | QA Contact: | Viktor Ashirov <vashirov> |
| Severity: | medium | Docs Contact: | Petr Bokoc <pbokoc> |
| Priority: | medium | ||
| Version: | 6.0 | CC: | jgalipea, nkinder, pbokoc, rmeggins, spichugi |
| Target Milestone: | rc | ||
| Target Release: | --- | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | 389-ds-base-1.2.11.15-67.el6 | Doc Type: | Enhancement |
| Doc Text: |
Improved performance when deleting large quantities of multi-valued attributes
The API used to delete entries with large amounts of multi-valued attributes has been replaced with a significantly faster one, causing a large performance improvement in such situations.
|
Story Points: | --- |
| Clone Of: | Environment: | ||
| Last Closed: | 2016-05-10 19:19:35 UTC | Type: | --- |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
|
Description
Noriko Hosoi
2015-06-26 17:11:52 UTC
$ rpm -qa | grep 389-ds-base 389-ds-base-libs-1.2.11.15-74.el6.x86_64 389-ds-base-1.2.11.15-74.el6.x86_641 Verification scenario by lkrispen - https://fedorahosted.org/389/ticket/48195#comment:21 "I tested this fix with the following scenario: have 2 masters, have a group with 90000 members, delete 200 members (members 70001-70200). without the fix, on the master it takes 1 sec, on the replica 40 sec with the fix it takes 1 sec on both" 1) Setup two masters replication master1 - 389 master2 - 390 2) Enable MemberOf Plugin on both instances: $ ldapmodify -x -p 389 -h localhost -D "cn=Directory Manager" -w Secret123 dn: cn=MemberOf Plugin,cn=plugins,cn=config changetype: modify add: memberofgroupattr memberofgroupattr: uniquemember - replace: nsslapd-pluginEnabled nsslapd-pluginEnabled: on 3) Increase nsslapd-maxbersize for adding big attributes on both instances: $ ldapmodify -x -p 389 -h localhost -D "cn=Directory Manager" -w Secret123 dn: cn=config changetype: modify replace: nsslapd-maxbersize nsslapd-maxbersize: 400000000 4) Add 90000 users and add them as members on the group $ head 02users_usrA_grpA.ldif dn: uid=usrA1,dc=example,dc=com uid: usrA1 objectClass: top objectClass: person objectClass: inetUser sn: usrA1 cn: usrA1 memberOf: cn=grpA,ou=groups,dc=example,dc=com dn: uid=usrA2,dc=example,dc=com --- $ head grpA.ldif dn: cn=grpA,ou=groups,dc=example,dc=com objectclass: top objectclass: groupOfNames cn: grpA member: uid=usrA1,dc=example,dc=com member: uid=usrA2,dc=example,dc=com member: uid=usrA3,dc=example,dc=com member: uid=usrA4,dc=example,dc=com member: uid=usrA5,dc=example,dc=com member: uid=usrA6,dc=example,dc=com --- $ ldapmodify -a -x -p 389 -h localhost -D "cn=Directory Manager" -w Secret123 -f 02users_usrA_grpA.ldif $ ldapmodify -a -x -p 389 -h localhost -D "cn=Directory Manager" -w Secret123 -f grpA.ldif 5) Wait for replica $ ldapsearch -x -p 389 -h localhost -D "cn=Directory Manager" -w Secret123 -b "cn=grpA,ou=groups,dc=example,dc=com" |grep -i member: |wc -l 90000 $ ldapsearch -x -p 390 -h localhost -D "cn=Directory Manager" -w Secret123 -b "cn=grpA,ou=groups,dc=example,dc=com" |grep -i member: |wc -l 90000 6) Delete 200 members from master1 $ head del200members.ldif dn: cn=grpA,ou=groups,dc=example,dc=com changetype: modify delete: member member: uid=usrA70001,dc=example,dc=com member: uid=usrA70002,dc=example,dc=com member: uid=usrA70003,dc=example,dc=com member: uid=usrA70004,dc=example,dc=com member: uid=usrA70005,dc=example,dc=com member: uid=usrA70006,dc=example,dc=com member: uid=usrA70007,dc=example,dc=com --- $ time ldapmodify -x -p 389 -h localhost -D "cn=Directory Manager" -w Secret123 -f del200members.ldif modifying entry "cn=grpA,ou=groups,dc=example,dc=com" real 0m0.325s user 0m0.001s sys 0m0.001s 7) Delete 200 members from master2 $ head del200members2.ldif dn: cn=grpA,ou=groups,dc=example,dc=com changetype: modify delete: member member: uid=usrA60001,dc=example,dc=com member: uid=usrA60002,dc=example,dc=com member: uid=usrA60003,dc=example,dc=com member: uid=usrA60004,dc=example,dc=com member: uid=usrA60005,dc=example,dc=com member: uid=usrA60006,dc=example,dc=com member: uid=usrA60007,dc=example,dc=com --- $ time ldapmodify -x -p 390 -h localhost -D "cn=Directory Manager" -w Secret123 -f del200members2.ldif modifying entry "cn=grpA,ou=groups,dc=example,dc=com" real 0m0.326s user 0m0.001s sys 0m0.001s 8) Check $ ldapsearch -x -p 389 -h localhost -D "cn=Directory Manager" -w Secret123 -b "cn=grpA,ou=groups,dc=example,dc=com" |grep -i member: |wc -l 89800 $ ldapsearch -x -p 390 -h localhost -D "cn=Directory Manager" -w Secret123 -b "cn=grpA,ou=groups,dc=example,dc=com" |grep -i member: |wc -l 89600 Result: deletion times on master and replica are the same. Marking as verified. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHBA-2016-0737.html |