rhosp-director: Undercloud deployment fails with: Error: /Stage[main]/Nova::Db::Sync/Exec[nova-db-sync]/returns: change from notrun to 0 failed: Command exceeded timeout Environment: instack-undercloud-6.0.0-0.20170127055514.317db76.el7ost.noarch Steps to reproduce: Attempt to deploy undercloud with "openstack undercloud install" Result: Fails: 2017-02-02 11:36:05,996 INFO: Error: Command exceeded timeout 2017-02-02 11:36:05,997 INFO: Error: /Stage[main]/Nova::Db::Sync/Exec[nova-db-sync]/returns: change from notrun to 0 failed: Command exceeded timeout ... ... 2017-02-02 11:50:28,241 INFO: Warning: /Stage[main]/Firewall::Linux::Redhat/File[/etc/sysconfig/ip6tables]: Skipping because of failed dependencies 2017-02-02 11:50:31,680 INFO: Notice: Applied catalog in 2802.33 seconds 2017-02-02 11:50:48,870 INFO: + rc=6 2017-02-02 11:50:48,870 INFO: + set -e 2017-02-02 11:50:48,871 INFO: + echo 'puppet apply exited with exit code 6' 2017-02-02 11:50:48,872 INFO: puppet apply exited with exit code 6 2017-02-02 11:50:48,872 INFO: + '[' 6 '!=' 2 -a 6 '!=' 0 ']' 2017-02-02 11:50:48,873 INFO: + exit 6 2017-02-02 11:50:48,874 INFO: [2017-02-02 11:50:48,871] (os-refresh-config) [ERROR] during configure phase. [Command '['dib-run-parts', '/usr/libexec/os-refresh-config/configure.d']' returned non-zero exit status 1] 2017-02-02 11:50:48,874 INFO: 2017-02-02 11:50:48,875 INFO: [2017-02-02 11:50:48,873] (os-refresh-config) [ERROR] Aborting... 2017-02-02 11:50:48,883 ERROR: ############################################################################# Undercloud install failed. Reason: os-refresh-config failed. See log for details. See the previous output for details about what went wrong. The full install log can be found at /home/stack/.instack/install-undercloud.log. ############################################################################# Expected result: Successfully deployed undercloud.
Created attachment 1247162 [details] install-undercloud.log
Created attachment 1247163 [details] sosreport from the undercloud node
Was able to workaround the reported issue with: sudo sed -i 's/^innodb_file_per_table.*//' /etc/my.cnf.d/galera.cnf sudo systemctl restart mariadb prior to running "openstack undercloud install"
In reply to #3, that is only if you previously had run the install and did not have the following two patches https://review.openstack.org/#/c/428435/ and https://review.openstack.org/#/c/428843/ applied. Under normal cases, that doesn't fix the problem due to the setting being reapplied when the install process is run.
reproduced on my bare-metal environment
Omri, please provide software versions, logs, and hardware specs. If possible, providing access to the environment would also suffice.
hi Alex - my issue got resolve using the workaround : sudo tee -a /usr/share/instack-undercloud/puppet-stack-config/puppet-stack-config.yaml.template <<'EOF' # https://bugzilla.redhat.com/show_bug.cgi?id=1418782 # NOTE(aschultz): raise upper limit on nova DB syncs for undercloud only. # There is no way this should take 15 minutes and if it does we now have way # different problems. But rather than block undercloud installs let's increase # the timeout for these actions. See LP#1661396 for more details. nova::db::sync::db_sync_timeout: 900 nova::db::sync_api::db_sync_timeout: 900 EOF