Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 796401

Summary: ipa migrate-ds :: Internal Server Error
Product: Red Hat Enterprise Linux 6 Reporter: Jenny Severance <jgalipea>
Component: ipaAssignee: Rob Crittenden <rcritten>
Status: CLOSED ERRATA QA Contact: IDM QE LIST <seceng-idm-qe-list>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 6.3CC: mkosek, stanislav.polasek
Target Milestone: rcKeywords: Regression
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ipa-2.2.0-4.el6 Doc Type: Bug Fix
Doc Text:
No documentation needed.
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-06-20 13:19:09 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Jenny Severance 2012-02-22 19:57:40 UTC
Description of problem:

::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
:: [   LOG    ] :: ds-migration-cmd-003 Invalid Group Container
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

:: [14:56:17] ::  EXECUTING: ipa migrate-ds --user-container="ou=People" --group-container="ou=bad" ldap://dhcp-187-178.testrelm.com:389
ipa: ERROR: an internal error has occurred
:: [   FAIL   ] :: Check return code (Expected 2, got 1)
:: [   FAIL   ] :: File '/tmp/error.out' should contain 'ipa: ERROR: Container for group not found' 





http error-log ::

[Wed Feb 22 14:21:56 2012] [error] ipa: INFO: admin: migrate_ds(u'ldap://dhcp-187-178.testrelm.com:389', u'********', binddn=u'cn=directory manager', usercontainer=u'ou=People', groupcontainer=u'ou=bad', userobjectclass=(u'person',), groupobjectclass=(u'groupOfUniqueNames', u'groupOfNames'), userignoreobjectclass=None, userignoreattribute=None, groupignoreobjectclass=None, groupignoreattribute=None, groupoverwritegid=False, schema=u'RFC2307bis', continue=False, exclude_groups=None, exclude_users=None): DatabaseError
[Wed Feb 22 14:23:49 2012] [error] ipa: ERROR: non-public: KeyError: 'gidnumber'
[Wed Feb 22 14:23:49 2012] [error] Traceback (most recent call last):
[Wed Feb 22 14:23:49 2012] [error]   File "/usr/lib/python2.6/site-packages/ipaserver/rpcserver.py", line 232, in wsgi_execute
[Wed Feb 22 14:23:49 2012] [error]     result = self.Command[name](*args, **options)
[Wed Feb 22 14:23:49 2012] [error]   File "/usr/lib/python2.6/site-packages/ipalib/frontend.py", line 438, in __call__
[Wed Feb 22 14:23:49 2012] [error]     ret = self.run(*args, **options)
[Wed Feb 22 14:23:49 2012] [error]   File "/usr/lib/python2.6/site-packages/ipalib/frontend.py", line 696, in run
[Wed Feb 22 14:23:49 2012] [error]     return self.execute(*args, **options)
[Wed Feb 22 14:23:49 2012] [error]   File "/usr/lib/python2.6/site-packages/ipalib/plugins/migration.py", line 650, in execute
[Wed Feb 22 14:23:49 2012] [error]     ldap, config, ds_ldap, ds_base_dn, options
[Wed Feb 22 14:23:49 2012] [error]   File "/usr/lib/python2.6/site-packages/ipalib/plugins/migration.py", line 594, in migrate
[Wed Feb 22 14:23:49 2012] [error]     **blacklists
[Wed Feb 22 14:23:49 2012] [error]   File "/usr/lib/python2.6/site-packages/ipalib/plugins/migration.py", line 120, in _pre_migrate_user
[Wed Feb 22 14:23:49 2012] [error]     ctx['def_group_gid'] = g_attrs['gidnumber'][0]
[Wed Feb 22 14:23:49 2012] [error] KeyError: 'gidnumber'
[Wed Feb 22 14:23:49 2012] [error] ipa: INFO: admin: migrate_ds(u'ldap://dhcp-187-178.testrelm.com:389', u'********', binddn=u'cn=directory manager', usercontainer=u'ou=People', groupcontainer=u'ou=bad', userobjectclass=(u'person',), groupobjectclass=(u'groupOfUniqueNames', u'groupOfNames'), userignoreobjectclass=None, userignoreattribute=None, groupignoreobjectclass=None, groupignoreattribute=None, groupoverwritegid=False, schema=u'RFC2307bis', continue=False, exclude_groups=None, exclude_users=None): KeyError


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.
  
Actual results:


Expected results:


Additional info:

Comment 1 Jenny Severance 2012-02-22 20:01:51 UTC
Version :: ipa-server-2.2.0-102.20120220T2339zgit7fe095c.el6.x86_64


Further investigation - ipa migrate-ds is not working at all.

Comment 4 Martin Kosek 2012-02-23 09:40:25 UTC
Upstream ticket:
https://fedorahosted.org/freeipa/ticket/2430

Comment 7 Jenny Severance 2012-03-07 20:57:07 UTC
Still broken ::

# ipa migrate-ds ldap://dhcp-187-227.testrelm.com:389
Password: 
ipa: ERROR: no such entry


http-error log ::

[Wed Mar 07 15:50:47 2012] [error] ipa: INFO: admin: migrate_ds(u'ldap://dhcp-187-227.testrelm.com:389', u'********', binddn=u'cn=directory manager', usercontainer=u'ou=people', groupcontainer=u'ou=groups', userobjectclass=(u'person',), groupobjectclass=(u'groupOfUniqueNames', u'groupOfNames'), userignoreobjectclass=None, userignoreattribute=None, groupignoreobjectclass=None, groupignoreattribute=None, groupoverwritegid=False, schema=u'RFC2307bis', continue=False, compat=False, exclude_groups=None, exclude_users=None): NotFound


example user in RHDS migration from ::

dn: cn=Mair Simhan,ou=People,dc=example,dc=com
carLicense: DAV2RFS
cn: Mair Simhan
departmentNumber: 2556
description: This is Mair Simhan's description
employeeType: Contract
facsimileTelephoneNumber: +1 714 961-4177
givenName: Mair
homePhone: +1 818 129-2423
initials: M. S.
l: Santa Clara
mail: Mair_Simhan
manager: cn=Emelyne Settels,ou=People,dc=example,dc=com
mobile: +1 213 230-9793
objectClass: top
objectClass: person
objectClass: organizationalPerson
objectClass: inetOrgPerson
objectClass: posixAccount
ou: Human Resources
pager: +1 510 660-3116
postalAddress: example.com, Human Resources Dept #718, Room#710
roomNumber: 6458
secretary: cn=Chin Hunter,ou=People,dc=example,dc=com
sn: Simhan
telephoneNumber: +1 303 620-6590
title: Supreme Human Resources Figurehead
uid: Mair_Simhan
uidNumber: 10001
gidNumber: 20001
homeDirectory: /home/Mair_Simhan
userPassword:: e1NTSEF9Z2FKbzJwUWt1aWxwbU1JZndkMW9WQzhpbVBrb2FIaXJqbDM2QXc9PQ=


example group ::

dn: cn=Testers,ou=Groups,dc=example,dc=com
objectClass: top
objectClass: inetuser
objectClass: groupofnames
objectClass: posixGroup
cn: Testers
member: cn=Lamar Applications,ou=People,dc=example,dc=com
member: cn=Brenton Samhaber,ou=People,dc=example,dc=com
member: cn=Lanny Bijman,ou=People,dc=example,dc=com
member: cn=Agneta Thorley,ou=People,dc=example,dc=com
member: cn=Huan Hawkes,ou=People,dc=example,dc=com
member: cn=Deonne Le,ou=People,dc=example,dc=com
member: cn=Shakoor Oblak,ou=People,dc=example,dc=com
member: cn=Ning Goddard,ou=People,dc=example,dc=com
member: cn=Gwen Manickam,ou=People,dc=example,dc=com
member: cn=Tape Mawst,ou=People,dc=example,dc=com
member: cn=Rachele Maliepaard,ou=People,dc=example,dc=com
member: cn=Jacklyn Datta,ou=People,dc=example,dc=com
member: cn=Lindsey Drescher,ou=People,dc=example,dc=com
member: cn=Romola McEwen,ou=People,dc=example,dc=com
member: cn=Aime Boocock,ou=People,dc=example,dc=com
member: cn=Tiffani Rodgers,ou=People,dc=example,dc=com
member: cn=Nedda Queries,ou=People,dc=example,dc=com
member: cn=Rhodie Zimmerer,ou=People,dc=example,dc=com
member: cn=Anya Cricker,ou=People,dc=example,dc=com
member: cn=Bethina Pittner,ou=People,dc=example,dc=com
member: cn=Edy Snelling,ou=People,dc=example,dc=com
member: cn=Alvera Macalik,ou=People,dc=example,dc=com
member: cn=Kellen Pagliarulo,ou=People,dc=example,dc=com
member: cn=Wilhelmus Minegishi,ou=People,dc=example,dc=com
member: cn=Candee Murdoch,ou=People,dc=example,dc=com
member: cn=Linzy Muise,ou=People,dc=example,dc=com
member: cn=Sohale Kernodle,ou=People,dc=example,dc=com
member: cn=Randa Chirachanchai,ou=People,dc=example,dc=com
member: cn=Israel Azevedo,ou=People,dc=example,dc=com
member: cn=Cristal Kenmir,ou=People,dc=example,dc=com
member: cn=Mrugesh Lorfano,ou=People,dc=example,dc=com
member: cn=Marjorie Flewelling,ou=People,dc=example,dc=com
member: cn=Sybyl Gattrell,ou=People,dc=example,dc=com
member: cn=Roda Clysdale,ou=People,dc=example,dc=com
member: cn=Abigail Wintour,ou=People,dc=example,dc=com
member: cn=Kambhampati Esson,ou=People,dc=example,dc=com
member: cn=Ling-Zhong Khanna,ou=People,dc=example,dc=com
member: cn=Tricia Rosko,ou=People,dc=example,dc=com
member: cn=Evy Osatuik,ou=People,dc=example,dc=com
member: cn=Kaylee Levasseur,ou=People,dc=example,dc=com
member: cn=Sianna Hord,ou=People,dc=example,dc=com
member: cn=Trent Zelenka,ou=People,dc=example,dc=com
member: cn=Ottcsr Bergmann,ou=People,dc=example,dc=com
member: cn=Orly Izbinsky,ou=People,dc=example,dc=com
member: cn=Yaser Casper,ou=People,dc=example,dc=com
member: cn=Elvira Wolczanski,ou=People,dc=example,dc=com
member: cn=Neilla Nicol,ou=People,dc=example,dc=com
member: cn=Data Werick,ou=People,dc=example,dc=com
member: cn=Prem Pommainville,ou=People,dc=example,dc=com
member: cn=Jacquette St.Laurent,ou=People,dc=example,dc=com
member: cn=Truda Javor,ou=People,dc=example,dc=com
member: cn=Klaas Desilets,ou=People,dc=example,dc=com
member: cn=Shae Breon,ou=People,dc=example,dc=com
member: cn=Tisha Denman,ou=People,dc=example,dc=com
member: cn=Sandye Dantu,ou=People,dc=example,dc=com
member: cn=Katrine Sherrell,ou=People,dc=example,dc=com
member: cn=Dionis Tu,ou=People,dc=example,dc=com
member: cn=Tushar Kebede,ou=People,dc=example,dc=com
member: cn=Crystal Ranoska,ou=People,dc=example,dc=com
member: cn=Loris Charbonneau,ou=People,dc=example,dc=com
member: cn=Felicdad Avard,ou=People,dc=example,dc=com
member: cn=Dacy Valerio,ou=People,dc=example,dc=com
member: cn=Jeanette Sproule,ou=People,dc=example,dc=com
member: cn=Felita Lebel,ou=People,dc=example,dc=com
gidNumber: 30003


version :: 

ipa-server-2.2.0-3.el6.x86_64

Comment 8 Martin Kosek 2012-03-09 11:28:53 UTC
I found out that the compat plugin was broken because of patch in Bug 783270, the compat plugin is not checked correctly. I filed an upstream ticket:

https://fedorahosted.org/freeipa/ticket/2508

I will send a patch for this issue today.

Comment 9 Rob Crittenden 2012-03-12 21:01:06 UTC
fixed upstream.

master: 0cb9882be9dc13781fb566df11df8bb962ea1ca9

ipa-2-2: 26b968c993ba65414d08e3d58991826cd229ed91

Comment 11 Jenny Severance 2012-03-19 14:18:32 UTC
Verified

Passwords have been migrated in pre-hashed format.
IPA is unable to generate Kerberos keys unless provided
with clear text passwords. All migrated users need to
login at https://your.domain/ipa/migration/ before they
can use their Kerberos accounts.

Migration of 10,000 users and 12 groups completed successfully.

version:

ipa-server-2.2.0-4.el6.x86_64

Comment 13 Martin Kosek 2012-04-24 11:58:46 UTC
    Technical note added. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    New Contents:
No documentation needed.

Comment 16 errata-xmlrpc 2012-06-20 13:19:09 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHBA-2012-0819.html