Note: This bug is displayed in read-only format because
the product is no longer active in Red Hat Bugzilla.
RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
DescriptionNikhil Dehadrai
2017-09-12 09:53:31 UTC
Description of problem:
Linear upgrade for IPA server fails with message "CalledProcessError: Command '/bin/systemctl start named-pkcs11.service', when upgraded using path:
RHEL 7.0.z > 7.1.z > 7.2.z > 7.3.z > 7.4GA
Version-Release number of selected component (if applicable):
ipa-server-4.5.0-20.el7.x86_64
How reproducible:
Always
Steps to Reproduce:
1. Setup IPA server at RHEL 7.0
2. Run upgrade for ipa-server to version RHEL 7.1.z.(using "yum -y update 'ipa*' sssd")
3. Run upgrade for ipa-server to version RHEL 7.2.z.
4. Run upgrade for ipa-server to version RHEL 7.3.z.
5. Run upgrade for ipa-server to version RHEL 7.4GA.
Actual results:
1. After step2, Upgrade is successful.
2. After step3, Upgrade is successful.
3. After step4, Upgrade is successful.
4. After step5, Upgrade FAILS.
#yum -y update 'ipa*' sssd
Cleanup : libsss_sudo-1.14.0-43.el7_3.19.x86_64 163/163
IPA server upgrade failed: Inspect /var/log/ipaupgrade.log and run command ipa-server-upgrade manually.
Unexpected error - see /var/log/ipaupgrade.log for details:
CalledProcessError: Command '/bin/systemctl start named-pkcs11.service' returned non-zero exit status 1
The ipa-server-upgrade command failed. See /var/log/ipaupgrade.log for more information
#tail -50 /var/log/ipaupgrade.log
[root@auto-hv-01-guest07 ~]# tail -50 /var/log/ipaupgrade.log
2017-09-12T07:50:48Z DEBUG Self-signed CA is not installed
2017-09-12T07:50:48Z INFO [Removing Dogtag 9 CA]
2017-09-12T07:50:48Z DEBUG Dogtag is version 10 or above
2017-09-12T07:50:48Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state'
2017-09-12T07:50:48Z DEBUG Loading Index file from '/var/lib/ipa/sysrestore/sysrestore.index'
2017-09-12T07:50:48Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state'
2017-09-12T07:50:48Z INFO [Checking for deprecated KDC configuration files]
2017-09-12T07:50:48Z INFO [Checking for deprecated backups of Samba configuration files]
2017-09-12T07:50:48Z DEBUG raw: ca_is_enabled(version=u'2.228')
2017-09-12T07:50:48Z DEBUG ca_is_enabled(version=u'2.228')
2017-09-12T07:50:48Z DEBUG flushing ldapi://%2fvar%2frun%2fslapd-TESTRELM-TEST.socket from SchemaCache
2017-09-12T07:50:48Z DEBUG retrieving schema for SchemaCache url=ldapi://%2fvar%2frun%2fslapd-TESTRELM-TEST.socket conn=<ldap.ldapobject.SimpleLDAPObject instance at 0xac9fd40>
2017-09-12T07:50:49Z DEBUG raw: kra_is_enabled(version=u'2.228')
2017-09-12T07:50:49Z DEBUG kra_is_enabled(version=u'2.228')
2017-09-12T07:50:49Z DEBUG Cleaning up after pkispawn for the CA subsystem
2017-09-12T07:50:49Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state'
2017-09-12T07:50:49Z DEBUG Loading Index file from '/var/lib/ipa/sysrestore/sysrestore.index'
2017-09-12T07:50:49Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state'
2017-09-12T07:50:49Z DEBUG Starting external process
2017-09-12T07:50:49Z DEBUG args=/bin/systemctl is-active named-pkcs11.service
2017-09-12T07:50:49Z DEBUG Process finished, return code=3
2017-09-12T07:50:49Z DEBUG stdout=failed
2017-09-12T07:50:49Z DEBUG stderr=
2017-09-12T07:50:49Z DEBUG Starting external process
2017-09-12T07:50:49Z DEBUG args=/bin/systemctl start named-pkcs11.service
2017-09-12T07:50:49Z DEBUG Process finished, return code=1
2017-09-12T07:50:49Z DEBUG stdout=
2017-09-12T07:50:49Z DEBUG stderr=Job for named-pkcs11.service failed because the control process exited with error code. See "systemctl status named-pkcs11.service" and "journalctl -xe" for details.
2017-09-12T07:50:49Z ERROR IPA server upgrade failed: Inspect /var/log/ipaupgrade.log and run command ipa-server-upgrade manually.
2017-09-12T07:50:49Z DEBUG File "/usr/lib/python2.7/site-packages/ipapython/admintool.py", line 172, in execute
return_value = self.run()
File "/usr/lib/python2.7/site-packages/ipaserver/install/ipa_server_upgrade.py", line 46, in run
server.upgrade()
File "/usr/lib/python2.7/site-packages/ipaserver/install/server/upgrade.py", line 1913, in upgrade
upgrade_configuration()
File "/usr/lib/python2.7/site-packages/ipaserver/install/server/upgrade.py", line 1744, in upgrade_configuration
bind.start()
File "/usr/lib/python2.7/site-packages/ipaserver/install/service.py", line 401, in start
self.service.start(instance_name, capture_output=capture_output, wait=wait)
File "/usr/lib/python2.7/site-packages/ipaplatform/base/services.py", line 294, in start
skip_output=not capture_output)
File "/usr/lib/python2.7/site-packages/ipapython/ipautil.py", line 511, in run
raise CalledProcessError(p.returncode, arg_string, str(output))
2017-09-12T07:50:49Z DEBUG The ipa-server-upgrade command failed, exception: CalledProcessError: Command '/bin/systemctl start named-pkcs11.service' returned non-zero exit status 1
2017-09-12T07:50:49Z ERROR Unexpected error - see /var/log/ipaupgrade.log for details:
CalledProcessError: Command '/bin/systemctl start named-pkcs11.service' returned non-zero exit status 1
2017-09-12T07:50:49Z ERROR The ipa-server-upgrade command failed. See /var/log/ipaupgrade.log for more information
[root@auto-hv-01-guest07 ~]#
[root@auto-hv-01-guest07 ~]# journalctl -u named-pkcs11
-- Logs begin at Mon 2017-09-11 07:44:18 EDT, end at Tue 2017-09-12 05:44:46 EDT. --
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test systemd[1]: Starting Berkeley Internet Name Domain (DNS) with native P
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test bash[15600]: zone localhost.localdomain/IN: loaded serial 0
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test bash[15600]: zone localhost/IN: loaded serial 0
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test bash[15600]: zone 1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test bash[15600]: zone 1.0.0.127.in-addr.arpa/IN: loaded serial 0
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test bash[15600]: zone 0.in-addr.arpa/IN: loaded serial 0
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: starting BIND 9.9.4-RedHat-9.9.4-29.el7_2.7 -u na
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: built with '--build=x86_64-redhat-linux-gnu' '--h
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: -------------------------------------------------
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: BIND 9 is maintained by Internet Systems Consorti
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: Inc. (ISC), a non-profit 501(c)(3) public-benefit
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: corporation. Support and training for BIND 9 are
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: available at https://www.isc.org/support
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: -------------------------------------------------
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: adjusted limit on open files from 4096 to 1048576
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: found 1 CPU, using 1 worker thread
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: using 1 UDP listener per interface
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: using up to 4096 sockets
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: loading configuration from '/etc/named.conf'
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: reading built-in trusted keys from file '/etc/nam
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: using default UDP/IPv4 port range: [1024, 65535]
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: using default UDP/IPv6 port range: [1024, 65535]
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: listening on IPv6 interfaces, port 53
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: listening on IPv4 interface lo, 127.0.0.1#53
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: listening on IPv4 interface eth0, 10.x.x.x#53
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: generating session key for dynamic DNS
Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: sizing zone task pool based on 6 zones
Expected results:
Linear upgrade of ipa-server should be successful.
Additional info:
Upgrade from following path is successful:
7.0.z > 7.1.z > 7.2.z > 7.3.z > 7.4.z
[root@auto-hv-01-guest10 ~]# rpm -q ipa-server
ipa-server-4.5.0-21.el7_4.1.2.x86_64
[root@auto-hv-01-guest10 ~]# tail -1 /var/log/ipaupgrade.log
2017-09-12T09:17:31Z INFO The ipa-server-upgrade command was successful
Description of problem: Linear upgrade for IPA server fails with message "CalledProcessError: Command '/bin/systemctl start named-pkcs11.service', when upgraded using path: RHEL 7.0.z > 7.1.z > 7.2.z > 7.3.z > 7.4GA Version-Release number of selected component (if applicable): ipa-server-4.5.0-20.el7.x86_64 How reproducible: Always Steps to Reproduce: 1. Setup IPA server at RHEL 7.0 2. Run upgrade for ipa-server to version RHEL 7.1.z.(using "yum -y update 'ipa*' sssd") 3. Run upgrade for ipa-server to version RHEL 7.2.z. 4. Run upgrade for ipa-server to version RHEL 7.3.z. 5. Run upgrade for ipa-server to version RHEL 7.4GA. Actual results: 1. After step2, Upgrade is successful. 2. After step3, Upgrade is successful. 3. After step4, Upgrade is successful. 4. After step5, Upgrade FAILS. #yum -y update 'ipa*' sssd Cleanup : libsss_sudo-1.14.0-43.el7_3.19.x86_64 163/163 IPA server upgrade failed: Inspect /var/log/ipaupgrade.log and run command ipa-server-upgrade manually. Unexpected error - see /var/log/ipaupgrade.log for details: CalledProcessError: Command '/bin/systemctl start named-pkcs11.service' returned non-zero exit status 1 The ipa-server-upgrade command failed. See /var/log/ipaupgrade.log for more information #tail -50 /var/log/ipaupgrade.log [root@auto-hv-01-guest07 ~]# tail -50 /var/log/ipaupgrade.log 2017-09-12T07:50:48Z DEBUG Self-signed CA is not installed 2017-09-12T07:50:48Z INFO [Removing Dogtag 9 CA] 2017-09-12T07:50:48Z DEBUG Dogtag is version 10 or above 2017-09-12T07:50:48Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state' 2017-09-12T07:50:48Z DEBUG Loading Index file from '/var/lib/ipa/sysrestore/sysrestore.index' 2017-09-12T07:50:48Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state' 2017-09-12T07:50:48Z INFO [Checking for deprecated KDC configuration files] 2017-09-12T07:50:48Z INFO [Checking for deprecated backups of Samba configuration files] 2017-09-12T07:50:48Z DEBUG raw: ca_is_enabled(version=u'2.228') 2017-09-12T07:50:48Z DEBUG ca_is_enabled(version=u'2.228') 2017-09-12T07:50:48Z DEBUG flushing ldapi://%2fvar%2frun%2fslapd-TESTRELM-TEST.socket from SchemaCache 2017-09-12T07:50:48Z DEBUG retrieving schema for SchemaCache url=ldapi://%2fvar%2frun%2fslapd-TESTRELM-TEST.socket conn=<ldap.ldapobject.SimpleLDAPObject instance at 0xac9fd40> 2017-09-12T07:50:49Z DEBUG raw: kra_is_enabled(version=u'2.228') 2017-09-12T07:50:49Z DEBUG kra_is_enabled(version=u'2.228') 2017-09-12T07:50:49Z DEBUG Cleaning up after pkispawn for the CA subsystem 2017-09-12T07:50:49Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state' 2017-09-12T07:50:49Z DEBUG Loading Index file from '/var/lib/ipa/sysrestore/sysrestore.index' 2017-09-12T07:50:49Z DEBUG Loading StateFile from '/var/lib/ipa/sysrestore/sysrestore.state' 2017-09-12T07:50:49Z DEBUG Starting external process 2017-09-12T07:50:49Z DEBUG args=/bin/systemctl is-active named-pkcs11.service 2017-09-12T07:50:49Z DEBUG Process finished, return code=3 2017-09-12T07:50:49Z DEBUG stdout=failed 2017-09-12T07:50:49Z DEBUG stderr= 2017-09-12T07:50:49Z DEBUG Starting external process 2017-09-12T07:50:49Z DEBUG args=/bin/systemctl start named-pkcs11.service 2017-09-12T07:50:49Z DEBUG Process finished, return code=1 2017-09-12T07:50:49Z DEBUG stdout= 2017-09-12T07:50:49Z DEBUG stderr=Job for named-pkcs11.service failed because the control process exited with error code. See "systemctl status named-pkcs11.service" and "journalctl -xe" for details. 2017-09-12T07:50:49Z ERROR IPA server upgrade failed: Inspect /var/log/ipaupgrade.log and run command ipa-server-upgrade manually. 2017-09-12T07:50:49Z DEBUG File "/usr/lib/python2.7/site-packages/ipapython/admintool.py", line 172, in execute return_value = self.run() File "/usr/lib/python2.7/site-packages/ipaserver/install/ipa_server_upgrade.py", line 46, in run server.upgrade() File "/usr/lib/python2.7/site-packages/ipaserver/install/server/upgrade.py", line 1913, in upgrade upgrade_configuration() File "/usr/lib/python2.7/site-packages/ipaserver/install/server/upgrade.py", line 1744, in upgrade_configuration bind.start() File "/usr/lib/python2.7/site-packages/ipaserver/install/service.py", line 401, in start self.service.start(instance_name, capture_output=capture_output, wait=wait) File "/usr/lib/python2.7/site-packages/ipaplatform/base/services.py", line 294, in start skip_output=not capture_output) File "/usr/lib/python2.7/site-packages/ipapython/ipautil.py", line 511, in run raise CalledProcessError(p.returncode, arg_string, str(output)) 2017-09-12T07:50:49Z DEBUG The ipa-server-upgrade command failed, exception: CalledProcessError: Command '/bin/systemctl start named-pkcs11.service' returned non-zero exit status 1 2017-09-12T07:50:49Z ERROR Unexpected error - see /var/log/ipaupgrade.log for details: CalledProcessError: Command '/bin/systemctl start named-pkcs11.service' returned non-zero exit status 1 2017-09-12T07:50:49Z ERROR The ipa-server-upgrade command failed. See /var/log/ipaupgrade.log for more information [root@auto-hv-01-guest07 ~]# [root@auto-hv-01-guest07 ~]# journalctl -u named-pkcs11 -- Logs begin at Mon 2017-09-11 07:44:18 EDT, end at Tue 2017-09-12 05:44:46 EDT. -- Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test systemd[1]: Starting Berkeley Internet Name Domain (DNS) with native P Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test bash[15600]: zone localhost.localdomain/IN: loaded serial 0 Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test bash[15600]: zone localhost/IN: loaded serial 0 Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test bash[15600]: zone 1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0. Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test bash[15600]: zone 1.0.0.127.in-addr.arpa/IN: loaded serial 0 Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test bash[15600]: zone 0.in-addr.arpa/IN: loaded serial 0 Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: starting BIND 9.9.4-RedHat-9.9.4-29.el7_2.7 -u na Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: built with '--build=x86_64-redhat-linux-gnu' '--h Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: ------------------------------------------------- Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: BIND 9 is maintained by Internet Systems Consorti Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: Inc. (ISC), a non-profit 501(c)(3) public-benefit Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: corporation. Support and training for BIND 9 are Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: available at https://www.isc.org/support Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: ------------------------------------------------- Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: adjusted limit on open files from 4096 to 1048576 Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: found 1 CPU, using 1 worker thread Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: using 1 UDP listener per interface Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: using up to 4096 sockets Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: loading configuration from '/etc/named.conf' Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: reading built-in trusted keys from file '/etc/nam Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: using default UDP/IPv4 port range: [1024, 65535] Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: using default UDP/IPv6 port range: [1024, 65535] Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: listening on IPv6 interfaces, port 53 Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: listening on IPv4 interface lo, 127.0.0.1#53 Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: listening on IPv4 interface eth0, 10.x.x.x#53 Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: generating session key for dynamic DNS Sep 12 03:28:51 auto-hv-01-guest07.testrelm.test named-pkcs11[15605]: sizing zone task pool based on 6 zones Expected results: Linear upgrade of ipa-server should be successful. Additional info: Upgrade from following path is successful: 7.0.z > 7.1.z > 7.2.z > 7.3.z > 7.4.z [root@auto-hv-01-guest10 ~]# rpm -q ipa-server ipa-server-4.5.0-21.el7_4.1.2.x86_64 [root@auto-hv-01-guest10 ~]# tail -1 /var/log/ipaupgrade.log 2017-09-12T09:17:31Z INFO The ipa-server-upgrade command was successful