Red Hat Bugzilla – Bug 904119
Significant decrease in migration performance
Last modified: 2013-11-21 15:48:56 EST
Description of problem: Migration scenario is 10,000 users and 12 groups RHEL 6.4 with compat plugin enabled 10 hours 14 minutes :: [ LOG ] :: slapd pid : 19259 :: [ LOG ] :: Before migration free memory : 14951256064 :: [ LOG ] :: Before migration slapd VmRSS : 28620kB :: [ LOG ] :: Before migration slapd VmHWM : 29096kB :: [ LOG ] :: ======================= Migration started: Thu Jan 17 05:13:32 EST 2013 ======================== :: [ LOG ] :: EXECUTING: time -p echo mysecret | ipa migrate-ds --with-compat ldap://directoryserver.testrelm.com:389 :: [ PASS ] :: Migration completed successfully. :: [ LOG ] :: ======================= Migration finished: Thu Jan 17 15:28:02 EST 2013 ======================== :: [ LOG ] :: slapd pid : 19259 :: [ LOG ] :: After migration free memory : 12555595776 :: [ LOG ] :: After migration slapd VmRSS : 1183860kB :: [ LOG ] :: After migration slapd VmHWM : 1188992kB with compat plugin disabled 18 hours 39 minutes :: [ LOG ] :: slapd pid : 19443 :: [ LOG ] :: Before migration free memory : 15077851136 :: [ LOG ] :: Before migration slapd VmRSS : 24744kB :: [ LOG ] :: Before migration slapd VmHWM : 24744kB :: [ LOG ] :: ======================= Migration started: Sat Jan 19 01:43:02 EST 2013 ======================== :: [ LOG ] :: EXECUTING: echo mysecret | ipa migrate-ds ldap://directoryserver.testrelm.com:389 :: [ PASS ] :: Migration completed successfully. :: [ LOG ] :: ======================= Migration finished: Sat Jan 19 20:22:05 EST 2013 ======================== :: [ LOG ] :: slapd pid : 19443 :: [ LOG ] :: After migration free memory : 12738027520 :: [ LOG ] :: After migration slapd VmRSS : 1212460kB :: [ LOG ] :: After migration slapd VmHWM : 1217564kB RHEL 6.3 with compat plugin enabled 7 hours 17 minutes :: [ LOG ] :: slapd pid : 21414 :: [ LOG ] :: Before migration free memory : 14818889728 :: [ LOG ] :: Before migration slapd VmRSS : 38200kB :: [ LOG ] :: Before migration slapd VmHWM : 41652kB :: [ LOG ] :: ======================= Migration started: Mon Apr 2 11:12:05 EDT 2012 ======================== :: [ LOG ] :: EXECUTING: time -p echo mysecret | ipa migrate-ds --with-compat ldap://directoryserver.testrelm.com:389 :: [ PASS ] :: Migration completed successfully. :: [ LOG ] :: ======================= Migration finished: Mon Apr 2 18:29:56 EDT 2012 ======================== :: [ LOG ] :: slapd pid : 21414 :: [ LOG ] :: After migration free memory : 13182754816 :: [ LOG ] :: After migration slapd VmRSS : 772656kB :: [ LOG ] :: After migration slapd VmHWM : 772656kB with compat plugin disabled 4 hours 36 minutes :: [ LOG ] :: slapd pid : 21409 :: [ LOG ] :: Before migration free memory : 132102623232 :: [ LOG ] :: Before migration slapd VmRSS : 25168kB :: [ LOG ] :: Before migration slapd VmHWM : 25168kB :: [ LOG ] :: ======================= Migration started: Mon Apr 9 13:26:12 EDT 2012 ======================== :: [ LOG ] :: EXECUTING: echo mysecret | ipa migrate-ds ldap://directoryserver.testrelm.com:389 :: [ PASS ] :: Migration completed successfully. :: [ LOG ] :: ======================= Migration finished: Mon Apr 9 18:02:18 EDT 2012 ======================== :: [ LOG ] :: slapd pid : 21409 :: [ LOG ] :: After migration free memory : 130853560320 :: [ LOG ] :: After migration slapd VmRSS : 331900kB :: [ LOG ] :: After migration slapd VmHWM : 332432kB Version-Release number of selected component (if applicable): ipa-server-3.0.0-22.el6.x86_64 389-ds-base-1.2.11.15-10.el6.x86_64 How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info:
This request was not resolved in time for the current release. Red Hat invites you to ask your support representative to propose this request, if still desired, for consideration in the next release of Red Hat Enterprise Linux.
Upstream ticket: https://fedorahosted.org/freeipa/ticket/3386
Fixed upstream: master: https://fedorahosted.org/freeipa/changeset/53c94361d6d119a68a645ac3e5f702c31afab831 ipa-3-1: https://fedorahosted.org/freeipa/changeset/c796bead5ed9ed52df91b09290028548289440cf ipa-3-0: https://fedorahosted.org/freeipa/changeset/793aa1168d0c60af8c07efd12337b4e7240f5124
Regression fixed. migrate-ds command could crash with Internal Error if there was no group to migrate and --continue option was used. master: https://fedorahosted.org/freeipa/changeset/08b84befbc40faca21ffe44dcc69aaf498a2f9f2 ipa-3-1: https://fedorahosted.org/freeipa/changeset/aa798f3ca0a08e457e7316b7017db5647d1df550 ipa-3-0: https://fedorahosted.org/freeipa/changeset/f0566b3856320334119968b81b6ea31a25bf8ea6
This bug also needs to be cloned for inclusion in RHEL 7.0
Verified using ipa-server-3.0.0-35 with compat plugin enabled 2 hours 44 minutes :: [ 13:25:05 ] :: slapd pid : 20288 :: [ 13:25:05 ] :: Before migration free memory : 3498647552 :: [ 13:25:05 ] :: Before migration slapd VmRSS : 30772kB :: [ 13:25:05 ] :: Before migration slapd VmHWM : 30872kB :: [ 13:25:05 ] :: ======================= Migration started: Mon Sep 9 13:25:05 EDT 2013 ======================== :: [ 13:25:05 ] :: EXECUTING: time -p echo Secret123 | ipa migrate-ds --with-compat ldap://ipaqa64vmh.testrelm.com:389 :: [ PASS ] :: Migration completed successfully. :: [ 16:09:32 ] :: ======================= Migration finished: Mon Sep 9 16:09:32 EDT 2013 ======================== :: [ 16:09:32 ] :: slapd pid : 20288 :: [ 16:09:32 ] :: After migration free memory : 1738301440 :: [ 16:09:32 ] :: After migration slapd VmRSS : 1184088kB :: [ 16:09:32 ] :: After migration slapd VmHWM : 1188280kB with compat plugin disabled 2 hours 36 minutes :: [ 10:53:24 ] :: slapd pid : 18548 :: [ 10:53:24 ] :: Before migration free memory : 15083929600 :: [ 10:53:24 ] :: Before migration slapd VmRSS : 28908kB :: [ 10:53:24 ] :: Before migration slapd VmHWM : 28908kB :: [ 10:53:24 ] :: ======================= Migration started: Wed Sep 11 10:53:24 EDT 2013 ======================== :: [ 10:53:24 ] :: EXECUTING: echo Secret123 | ipa migrate-ds ldap://cloud-qe-1-vm-1.testrelm.com:389 :: [ PASS ] :: Migration completed successfully. :: [ 12:29:08 ] :: ======================= Migration finished: Wed Sep 11 12:29:08 EDT 2013 ======================== :: [ 12:29:08 ] :: slapd pid : 18548 :: [ 12:29:08 ] :: After migration free memory : 13061668864 :: [ 12:29:08 ] :: After migration slapd VmRSS : 1055668kB :: [ 12:29:08 ] :: After migration slapd VmHWM : 1061276kB
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. http://rhn.redhat.com/errata/RHBA-2013-1651.html