Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 1911849

Summary: upgrade fail with PKI service trying to start before the LDAP service is ready
Product: Red Hat Enterprise Linux 8 Reporter: Marc Sauton <msauton>
Component: ipaAssignee: Thomas Woerner <twoerner>
Status: CLOSED NOTABUG QA Contact: ipa-qe <ipa-qe>
Severity: medium Docs Contact:
Priority: high    
Version: 8.3CC: cheimes, edewata, fcami, ftweedal, pcech, rcritten, tmihinto, tscherf
Target Milestone: rcKeywords: Triaged
Target Release: 8.0Flags: pm-rhel: mirror+
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-02-18 09:57:32 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Marc Sauton 2020-12-31 20:05:40 UTC
Description of problem:

RHEL IPA upgrade failing in 

2020-12-29T12:57:17Z INFO [Migrating certificate profiles to LDAP]

in
/usr/lib/python3.6/site-packages/ipaserver/install/server/upgrade.py

this happened when the PKI service was starting before the LDAP service was ready.
( does not happen a boot time when systemd is used)


possible workaround to test (originally suggested by Francois C.):

duplicate and edit the file
/usr/lib/python3.6/site-packages/ipaserver/install/server/upgrade.py

from the package python3-ipaserver

locate the line
    logger.info('[Migrating certificate profiles to LDAP]')

it is probably around line 413
add
    time.sleep(10)

so the file is changed from
    logger.info('[Migrating certificate profiles to LDAP]')
    cainstance.migrate_profiles_to_ldap()

to
    logger.info('[Migrating certificate profiles to LDAP]')
    time.sleep(10)
    cainstance.migrate_profiles_to_ldap()

and try again.


Version-Release number of selected component (if applicable):
RHEL-8.3

ugrade from RHEL-8.2
ipa-server-4.8.4-7.module+el8.2.0+6046+aaa49f96

to RHEL-8.3.1
389-ds-base-1.4.3.8-6.module+el8.3.0+8995+c08169ba.x86_64   Wed Dec 16 03:31:30 2020
ipa-server-4.8.7-13.module+el8.3.0+8376+0bba7131.x86_64     Thu Nov  5 03:30:55 2020
redhat-release-8.3-1.0.el8.x86_64                           Wed Nov  4 03:36:12 2020



How reproducible:
N/A

Steps to Reproduce:
1. N/A
2.
3.


Actual results:

var/log/ipaupgrade.log
...
2020-12-29T12:57:17Z INFO [Migrating certificate profiles to LDAP]
...
2020-12-29T12:57:17Z DEBUG request GET https://edited:8443/ca/rest/account/login
2020-12-29T12:57:17Z DEBUG request body ''
2020-12-29T12:57:17Z DEBUG response status 500
...
2020-12-29T12:57:17Z DEBUG   File "/usr/lib/python3.6/site-packages/ipapython/admintool.py", line 179, in execute
    return_value = self.run()
  File "/usr/lib/python3.6/site-packages/ipaserver/install/ipa_server_upgrade.py", line 54, in run
    server.upgrade()
  File "/usr/lib/python3.6/site-packages/ipaserver/install/server/upgrade.py", line 1805, in upgrade
    upgrade_configuration()
  File "/usr/lib/python3.6/site-packages/ipaserver/install/server/upgrade.py", line 1670, in upgrade_configuration
    ca_enable_ldap_profile_subsystem(ca)
  File "/usr/lib/python3.6/site-packages/ipaserver/install/server/upgrade.py", line 414, in ca_enable_ldap_profile_subsystem
    cainstance.migrate_profiles_to_ldap()
  File "/usr/lib/python3.6/site-packages/ipaserver/install/cainstance.py", line 1954, in migrate_profiles_to_ldap
    _create_dogtag_profile(profile_id, profile_data, overwrite=False)
  File "/usr/lib/python3.6/site-packages/ipaserver/install/cainstance.py", line 1960, in _create_dogtag_profile
    with api.Backend.ra_certprofile as profile_api:
  File "/usr/lib/python3.6/site-packages/ipaserver/plugins/dogtag.py", line 1315, in __enter__
    raise errors.RemoteRetrieveError(reason=_('Failed to authenticate to CA REST API'))


Expected results:
yes


Additional info:


from a different attachment and test with different time stamps, but this shows the problem, the LDAP service was not ready while the PKI service was starting:

var/log/pki/pki-tomcat/ca/debug.2020-12-30.log
...
2020-12-30 15:23:00 [main] SEVERE: Unable to create socket: java.net.ConnectException: Connexion refusée (Connection refused)
java.net.ConnectException: Connexion refusée (Connection refused)


var/log/dirsrv/slapd-edited/errors
...
[30/Dec/2020:15:23:00.947237533 +0100] - INFO - main - slapd stopped.
[30/Dec/2020:15:23:01.422101109 +0100] - INFO - slapd_extract_cert - CA CERT NAME: edited IPA CA
...
[30/Dec/2020:15:23:02.865548903 +0100] - ERR - schema-compat-plugin - schema-compat-plugin tree scan will start in about 5 seconds!
[30/Dec/2020:15:23:08.067018376 +0100] - ERR - schema-compat-plugin - warning: no entries set up under cn=computers, cn=compat,dc=idm,dc=edited
[30/Dec/2020:15:23:08.089413336 +0100] - ERR - schema-compat-plugin - Finished plugin initialization.
(END)

Comment 3 Thorsten Scherf 2021-01-03 14:01:35 UTC
(In reply to Marc Sauton from comment #0)
> Description of problem:
> 
> RHEL IPA upgrade failing in 
> 
> 2020-12-29T12:57:17Z INFO [Migrating certificate profiles to LDAP]
> 
> in
> /usr/lib/python3.6/site-packages/ipaserver/install/server/upgrade.py
> 
> this happened when the PKI service was starting before the LDAP service was
> ready.
> ( does not happen a boot time when systemd is used)
> 
> 
> possible workaround to test (originally suggested by Francois C.):
> 
> duplicate and edit the file
> /usr/lib/python3.6/site-packages/ipaserver/install/server/upgrade.py
> 
> from the package python3-ipaserver
> 
> locate the line
>     logger.info('[Migrating certificate profiles to LDAP]')
> 
> it is probably around line 413
> add
>     time.sleep(10)
> 
> so the file is changed from
>     logger.info('[Migrating certificate profiles to LDAP]')
>     cainstance.migrate_profiles_to_ldap()
> 
> to
>     logger.info('[Migrating certificate profiles to LDAP]')
>     time.sleep(10)
>     cainstance.migrate_profiles_to_ldap()
> 
> and try again.

Don't forget to import the 'time' module at the beginning of the file.

Comment 6 François Cami 2021-01-05 14:35:33 UTC
Upstream ticket:
https://pagure.io/freeipa/issue/8645