Description of problem: ------------------- The appliance black console refuses to come up because of this error. [root@dhcp-8-58-23 log]# LOCK_CONSOLE=false /bin/appliance_console /opt/rh/cfme-gemset/gems/bundler-1.9.9/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.5.11 in any of the sources (Bundler::GemNotFound) from /opt/rh/cfme-gemset/gems/bundler-1.9.9/lib/bundler/spec_set.rb:85:in `map!' from /opt/rh/cfme-gemset/gems/bundler-1.9.9/lib/bundler/spec_set.rb:85:in `materialize' from /opt/rh/cfme-gemset/gems/bundler-1.9.9/lib/bundler/definition.rb:132:in `specs' from /opt/rh/cfme-gemset/gems/bundler-1.9.9/lib/bundler/definition.rb:177:in `specs_for' from /opt/rh/cfme-gemset/gems/bundler-1.9.9/lib/bundler/definition.rb:166:in `requested_specs' from /opt/rh/cfme-gemset/gems/bundler-1.9.9/lib/bundler/environment.rb:18:in `requested_specs' from /opt/rh/cfme-gemset/gems/bundler-1.9.9/lib/bundler/runtime.rb:13:in `setup' from /opt/rh/cfme-gemset/gems/bundler-1.9.9/lib/bundler.rb:122:in `setup' from /var/www/miq/lib/appliance_console.rb:52:in `<main>' Version-Release number of selected component (if applicable): ----------------------- 5.4.0.3 How reproducible: ---------------- Always Steps to Reproduce: ------------------- 1. 2. 3. Actual results: ---------------- Expected results: ------------------ Additional info: -----------------
Confirmed on all builds: vsphere, rhos, and rhev. evmserverd also doesn't start due to the lack of nokogiri.
I just checked the Gemfile.lock and see: nokogiri (1.5.11) Starting up the: cfme-vsphere-5.4-40.x86_64.vsphere.ova 27-May-2015 11:07 558M to check the issue at hand.
Was able to reproduce the issue using the vsphere appliance. Took 15mins to reproduce.
Is this the normal command used in the past? Or are you testing something new? LOCK_CONSOLE=false /bin/appliance_console I ask because 1) /bin/appliance_console is, I think, a new reference. 2) I don't see bundle exec on the command line.
New commit detected on manageiq/master: https://github.com/ManageIQ/manageiq/commit/a87ee57dfb40bcd1b5a181f89214b9262950f2e7 commit a87ee57dfb40bcd1b5a181f89214b9262950f2e7 Author: Joe Rafaniello <jrafanie> AuthorDate: Thu May 28 14:47:09 2015 -0400 Commit: Joe Rafaniello <jrafanie> CommitDate: Thu May 28 14:52:48 2015 -0400 Bundle install directly in the kickstart. We only need to install gems from rubygems.org in upstream. https://bugzilla.redhat.com/show_bug.cgi?id=1225662 [skip ci] build/kickstarts/base.ks.erb | 4 ++++ system/cfme-setup.sh | 11 ++++------- 2 files changed, 8 insertions(+), 7 deletions(-)
New commit detected on cfme/5.4.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=d87f3c7cc92c6d5294ffd8ecf0a9a086399c7564 commit d87f3c7cc92c6d5294ffd8ecf0a9a086399c7564 Author: Joe Rafaniello <jrafanie> AuthorDate: Thu May 28 14:47:09 2015 -0400 Commit: Joe Rafaniello <jrafanie> CommitDate: Thu May 28 16:09:22 2015 -0400 Bundle install directly in the kickstart. We only need to install gems from rubygems.org in upstream. https://bugzilla.redhat.com/show_bug.cgi?id=1225662 [skip ci] build/kickstarts/base.ks.erb | 4 ++++ system/cfme-setup.sh | 11 ++++------- 2 files changed, 8 insertions(+), 7 deletions(-)
New commit detected on cfme/5.4.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=1fdc230275e7ce6474c305ea1615725ba98eb832 commit 1fdc230275e7ce6474c305ea1615725ba98eb832 Merge: ceda8ef d87f3c7 Author: Jason Frey <jfrey> AuthorDate: Thu May 28 16:13:17 2015 -0400 Commit: Jason Frey <jfrey> CommitDate: Thu May 28 16:13:17 2015 -0400 Merge branch 'bundle_install_directly_in_the_kickstart' into '5.4.z' Bundle install directly in the kickstart. We only need to install gems from rubygems.org in upstream. https://bugzilla.redhat.com/show_bug.cgi?id=1225662 [skip ci] See merge request !91 build/kickstarts/base.ks.erb | 4 ++++ system/cfme-setup.sh | 11 ++++------- 2 files changed, 8 insertions(+), 7 deletions(-)
New commit detected on cfme_productization/5.4.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme_productization.git;a=commit;h=12ea6ff888465e3f4ecf8955a08d173a392bfaf1 commit 12ea6ff888465e3f4ecf8955a08d173a392bfaf1 Author: Joe Rafaniello <jrafanie> AuthorDate: Thu May 28 16:32:32 2015 -0400 Commit: Joe Rafaniello <jrafanie> CommitDate: Thu May 28 16:37:40 2015 -0400 Remove unused environment variables https://bugzilla.redhat.com/show_bug.cgi?id=1225662 manageiq/build/productization/kickstarts/base-rhevm.ks | 7 ------- manageiq/build/productization/kickstarts/base-rhos.ks | 7 ------- manageiq/build/productization/kickstarts/base-vsphere.ks | 7 ------- manageiq/build/productization/kickstarts/base.ks.erb | 6 ------ manageiq/build/productization/kickstarts/no-cfme-vsphere.ks | 7 ------- 5 files changed, 34 deletions(-)
New commit detected on cfme_productization/5.4.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme_productization.git;a=commit;h=7db3827dfd14c3de0ef3d1bf43929e7c13b44740 commit 7db3827dfd14c3de0ef3d1bf43929e7c13b44740 Merge: f29c2a1 12ea6ff Author: Jason Frey <jfrey> AuthorDate: Thu May 28 16:38:44 2015 -0400 Commit: Jason Frey <jfrey> CommitDate: Thu May 28 16:38:44 2015 -0400 Merge branch 'remove_unused_environment_variables' into '5.4.z' Remove unused environment variables https://bugzilla.redhat.com/show_bug.cgi?id=1225662 APPLIANCE is set by /etc/default/evm. BUNDLE_CLI_OPTIONS is no longer used per [1](https://github.com/ManageIQ/manageiq/pull/3014) and [2] (http://gitlab.cloudforms.lab.eng.rdu2.redhat.com/cloudforms/cfme/merge_requests/91) BUNDLE_WITHOUT is set by .bundle/config and upstream [3](https://github.com/ManageIQ/manageiq/blob/75852bcf430024631984c38da80f391df7d1248e/system/LINK/etc/default/evm_bundler#L3) See merge request !54 manageiq/build/productization/kickstarts/base-rhevm.ks | 7 ------- manageiq/build/productization/kickstarts/base-rhos.ks | 7 ------- manageiq/build/productization/kickstarts/base-vsphere.ks | 7 ------- manageiq/build/productization/kickstarts/base.ks.erb | 6 ------ manageiq/build/productization/kickstarts/no-cfme-vsphere.ks | 7 ------- 5 files changed, 34 deletions(-)
We set BUNDLE_PATH and GEM_PATH previously to resolve an issue where automate ruby methods did not have access to the git based gems bundler installed into the gemset[1]. This enables bundler to find our bundled rest-client and winrm gems (and others) from automate but bundler has an unexpected side effect, found here [2], where the DISABLE_SHARED_GEMS option gets set to '1' if BUNDLE_PATH is set. The assumption was that you are "vendoring" your gems in one directory if you set BUNDLE_PATH, so any gems not found in the BUNDLE_PATH would NOT be available to you[3]. In our case we have many compiled gems installed OUTSIDE of the gemset rpm directory, so bundler cannot find any of these with DISABLE_SHARED_GEMS set to '1'. This is what caused the current reported bug. Anytime you tried to run bundle, bundle install, or friends, bundler would see BUNDLE_PATH and set DISABLE_SHARED_GEMS to '1'. So, there was no way to both keep BUNDLE_PATH and also run bundle, bundle install, or friends. Our solution was to re-evaluate the use of bundle install in downstream. Because we install all gems via rpms and we ship a Gemfile.lock in the gemset rpm, there is no need to run bundle install on the downstream appliances. Because we aren't running bundle install any longer, there were other ENV variables that were also not needed. [1] https://bugzilla.redhat.com/show_bug.cgi?id=1223042 [2] https://github.com/bundler/bundler/blob/e8c962ef2a3215cdc6fd411b6724f091a16793d6/lib/bundler/cli/install.rb#L99 [3] https://github.com/bundler/bundler/blob/e8c962ef2a3215cdc6fd411b6724f091a16793d6/lib/bundler.rb#L421-L422
Verified in 5.4.0.4
New commit detected on cfme_productization/master: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme_productization.git;a=commit;h=25d54dfc2a64a2acf5cfe764a28b72206c005679 commit 25d54dfc2a64a2acf5cfe764a28b72206c005679 Author: Joe Rafaniello <jrafanie> AuthorDate: Thu May 28 16:32:32 2015 -0400 Commit: Joe Rafaniello <jrafanie> CommitDate: Thu May 28 16:40:44 2015 -0400 Remove unused environment variables https://bugzilla.redhat.com/show_bug.cgi?id=1225662 manageiq/build/productization/kickstarts/base-rhevm.ks | 7 ------- manageiq/build/productization/kickstarts/base-rhos.ks | 7 ------- manageiq/build/productization/kickstarts/base-vsphere.ks | 7 ------- manageiq/build/productization/kickstarts/base.ks.erb | 6 ------ manageiq/build/productization/kickstarts/no-cfme-vsphere.ks | 7 ------- 5 files changed, 34 deletions(-)
New commit detected on cfme_productization/master: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme_productization.git;a=commit;h=ee82ef4cb6097d9146937924f8042f05500430ef commit ee82ef4cb6097d9146937924f8042f05500430ef Merge: 964779f 25d54df Author: Jason Frey <jfrey> AuthorDate: Mon Jun 1 11:44:20 2015 -0400 Commit: Jason Frey <jfrey> CommitDate: Mon Jun 1 11:44:20 2015 -0400 Merge branch 'remove_unused_environment_variables_master' into 'master' Remove unused environment variables https://bugzilla.redhat.com/show_bug.cgi?id=1225662 APPLIANCE is set by /etc/default/evm. BUNDLE_CLI_OPTIONS is no longer used per [1](https://github.com/ManageIQ/manageiq/pull/3014) and [2](http://gitlab.cloudforms.lab.eng.rdu2.redhat.com/cloudforms/cfme/merge_requests/91) BUNDLE_WITHOUT is set by .bundle/config and upstream [3](https://github.com/ManageIQ/manageiq/blob/75852bcf430024631984c38da80f391df7d1248e/system/LINK/etc/default/evm_bundler#L3) Clean cherry-pick from http://gitlab.cloudforms.lab.eng.rdu2.redhat.com/cloudforms/cfme_productization/merge_requests/54 See merge request !55 manageiq/build/productization/kickstarts/base-rhevm.ks | 7 ------- manageiq/build/productization/kickstarts/base-rhos.ks | 7 ------- manageiq/build/productization/kickstarts/base-vsphere.ks | 7 ------- manageiq/build/productization/kickstarts/base.ks.erb | 6 ------ manageiq/build/productization/kickstarts/no-cfme-vsphere.ks | 7 ------- 5 files changed, 34 deletions(-)
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHBA-2015-1100.html