RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 2227832 - Interrupt request processing in ipadb_fill_info3() if connection to 389ds is lost [rhel-7]
Summary: Interrupt request processing in ipadb_fill_info3() if connection to 389ds is ...
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: Red Hat Enterprise Linux 7
Classification: Red Hat
Component: ipa
Version: 7.9
Hardware: All
OS: Linux
high
high
Target Milestone: rc
: ---
Assignee: Julien Rische
QA Contact: Michal Polovka
URL:
Whiteboard:
Depends On: 2214638
Blocks: 2227831
TreeView+ depends on / blocked
 
Reported: 2023-07-31 15:47 UTC by Julien Rische
Modified: 2023-09-20 17:01 UTC (History)
15 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 2214638
Environment:
Last Closed: 2023-08-02 12:58:35 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker FREEIPA-10205 0 None None None 2023-07-31 15:49:49 UTC
Red Hat Issue Tracker RHELPLAN-163905 0 None None None 2023-07-31 15:49:59 UTC

Description Julien Rische 2023-07-31 15:47:27 UTC 
+++ This bug was initially created as a clone of Bug #2214638 +++

Description of problem:
krb5kdc is crashing intermittently on the IPA server even after updating the packages to latest version.

Version-Release number of selected component (if applicable):
ipa-server-4.9.11-5.module+el8.8.0+18146+a1d8660b.x86_64
krb5-server-1.18.2-22.el8_7.x86_64


How reproducible:
Intermittently

--- Additional comment from Rob Crittenden on 2023-06-13 17:53:31 UTC ---

The crash is happening in the ipa kdb code. Changing components.

The ld connection is NULL, hence the failure.

Did this fail in a particular context? e.g. under load, a specific Kerberos request?

--- Additional comment from Rob Crittenden on 2023-06-13 19:43:10 UTC ---

Alexander thinks this may be upstream issue https://pagure.io/freeipa/issue/9251 . We lost traction with an upstream user who had a reproducing system.

--- Additional comment from Têko Mihinto on 2023-07-03 17:33:35 UTC ---

Hi Rob,

(In reply to Rob Crittenden from comment #1)
> The crash is happening in the ipa kdb code. Changing components.
> 
> The ld connection is NULL, hence the failure.
> 
> Did this fail in a particular context? e.g. under load, a specific Kerberos
> request?

Customer mentioned that this typically happens when the LDAP server is under load
( addition / deletion of new hosts triggering multiple and replicated changes ).

Regards,
Têko.

--- Additional comment from Julien Rische on 2023-07-26 10:03:25 UTC ---

This crash is due to the is_master_host() function[1], which is called in ipadb_fill_info3()[2] as part of the process to populate the PAC.

is_master_host() searches for a master host entry using ipadb_simple_search()[3], and interprets an error as the absence of master entry, and the absence of error as a the presence of a master entry. Hence, a connection error would be misinterpreted.

The crash occurs because in case ipadb_simple_search() faces a connection issue during the query, it will try to reset the connection to run the query again. But if it fails to reset the connection, it returns with an error code right away, leaving the LDAP context uninitialized. But, as mentioned above, is_master_host() won't handle this as an actual error. So the process in ipadb_fill_info3() will continue until the ldap_get_entry_controls() call, where the process crashes because of the uninitialized LDAP context.

[1] https://github.com/freeipa/freeipa/blob/release-4-9-12/daemons/ipa-kdb/ipa_kdb_mspac.c#L404
[2] https://github.com/freeipa/freeipa/blob/release-4-9-12/daemons/ipa-kdb/ipa_kdb_mspac.c#L695-L697
[3] https://github.com/freeipa/freeipa/blob/release-4-9-12/daemons/ipa-kdb/ipa_kdb_common.c#L169

--- Additional comment from Julien Rische on 2023-07-31 11:43:36 UTC ---

Upstream ticket:
https://pagure.io/freeipa/issue/9422

--- Additional comment from Julien Rische on 2023-07-31 11:48:31 UTC ---

Upstream pull request:
https://github.com/freeipa/freeipa/pull/6929
Comment 2 Florence Blanc-Renaud 2023-08-01 11:36:54 UTC 
Fixed upstream
master:
https://pagure.io/freeipa/c/c84c59c66f1b22ebc671960cae90088a024d2d62
Comment 3 Florence Blanc-Renaud 2023-08-02 11:54:23 UTC 
Fixed upstream
ipa-4-10:
https://pagure.io/freeipa/c/fd32e6a3d95f28d2d11d41ee5dabb0d563cb5d51

ipa-4-9:
https://pagure.io/freeipa/c/b5793c854035a122ed4c66f917cc427e5024e46a
Comment 4 Julien Rische 2023-08-02 12:58:35 UTC 
Function is_master_host() is not handling errors properly in IPA 4.6.8[1], just as it is in 4.9 an 4.10. However in 4.6.8's case, the ipadb_fill_info3() function fails immediately in case is_master_host() returns false[2][3]. This should keep the NULL LDAP context issue from happening.

For this reason, we won't fix is_master_host() on RHEL7.

[1] https://github.com/freeipa/freeipa/blob/release-4-6-8/daemons/ipa-kdb/ipa_kdb_mspac.c#L361-L382
[2] https://github.com/freeipa/freeipa/blob/release-4-6-8/daemons/ipa-kdb/ipa_kdb_mspac.c#L438-L440
[3] https://github.com/freeipa/freeipa/blob/release-4-6-8/daemons/ipa-kdb/ipa_kdb_mspac.c#L487-L489
Note You need to log in before you can comment on or make changes to this bug.