Bug 1016094

Summary: [Mcollective] Error in mcollective log
Product: OpenShift Online Reporter: Kenny Woodson <kwoodson>
Component: ContainersAssignee: Jessica Forrester <jforrest>
Status: CLOSED CURRENTRELEASE QA Contact: libra bugs <libra-bugs>
Severity: medium Docs Contact:
Priority: medium    
Version: 2.xCC: bmeng, dmcphers, rchopra
Target Milestone: ---Keywords: UpcomingRelease
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-10-17 13:33:44 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Kenny Woodson 2013-10-07 13:28:57 UTC 
Description of problem:

Mcollective on a node died and we restarted it.  This was the error message in the logs:

I, [2013-10-07T09:21:19.467653 #18197]  INFO -- : mcollectived:31:in `<main>' The Marionette Collective 2.2.3 started 
logging at info level
W, [2013-10-07T09:21:22.471842 #18415]  WARN -- : agent.rb:234:in `metadata' openshift.rb:24:in `<class:Openshift>': s
etting meta data in agents have been deprecated, DDL files are now being used for this information.
I, [2013-10-07T09:21:28.775022 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, cron, 1.4, 0.0.6) from /usr/libexec/openshift/cartridges/cron
I, [2013-10-07T09:21:29.231627 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, phpmyadmin, 4, 0.0.5) from /usr/libexec/openshift/cartridges/phpmyadmin
I, [2013-10-07T09:21:30.327726 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, nodejs, 0.10, 0.0.6) from /usr/libexec/openshift/cartridges/nodejs
I, [2013-10-07T09:21:31.938456 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, rockmongo, 1.1, 0.0.3) from /usr/libexec/openshift/cartridges/rockmongo
I, [2013-10-07T09:21:33.215582 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, python, 2.6, 0.0.5) from /usr/libexec/openshift/cartridges/python
I, [2013-10-07T09:21:33.524175 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, switchyard, 0, 0.0.4) from /usr/libexec/openshift/cartridges/switchyard
I, [2013-10-07T09:21:35.695482 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, zend, 5.6, 0.0.4) from /usr/libexec/openshift/cartridges/zend
I, [2013-10-07T09:21:36.540779 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, ruby, 1.9, 0.0.7) from /usr/libexec/openshift/cartridges/ruby
I, [2013-10-07T09:21:37.329023 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, jenkins, 1, 0.0.5) from /usr/libexec/openshift/cartridges/jenkins
I, [2013-10-07T09:21:38.034458 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, metrics, 0.1, 0.0.3) from /usr/libexec/openshift/cartridges/metrics
I, [2013-10-07T09:21:38.869457 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed
 cartridge (redhat, jbossews, 2.0, 0.0.7) from /usr/libexec/openshift/cartridges/jbossews
I, [2013-10-07T09:21:39.067354 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, 10gen-mms-agent, 0.1, 0.0.3) from /usr/libexec/openshift/cartridges/10gen-mms-agent
I, [2013-10-07T09:21:39.314654 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, mysql, 5.1, 0.2.3) from /usr/libexec/openshift/cartridges/mysql
I, [2013-10-07T09:21:39.739286 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, perl, 5.10, 0.0.5) from /usr/libexec/openshift/cartridges/perl
I, [2013-10-07T09:21:40.432313 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, php, 5.3, 0.0.5) from /usr/libexec/openshift/cartridges/php
I, [2013-10-07T09:21:41.007346 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, jbosseap, 6, 0.0.6) from /usr/libexec/openshift/cartridges/jbosseap
I, [2013-10-07T09:21:41.251201 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, haproxy, 1.4, 0.0.6) from /usr/libexec/openshift/cartridges/haproxy
I, [2013-10-07T09:21:41.724225 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, postgresql, 9.2, 0.3.3) from /usr/libexec/openshift/cartridges/postgresql
I, [2013-10-07T09:21:42.089103 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, mongodb, 2.2, 0.2.3) from /usr/libexec/openshift/cartridges/mongodb
I, [2013-10-07T09:21:42.398924 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, diy, 0.1, 0.0.4) from /usr/libexec/openshift/cartridges/diy
I, [2013-10-07T09:21:42.814661 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, jbossas, 7, 0.0.6) from /usr/libexec/openshift/cartridges/jbossas
I, [2013-10-07T09:21:43.035119 #18415]  INFO -- : openshift.rb:39:in `block (3 levels) in <class:Openshift>' Installed cartridge (redhat, jenkins-client, 1, 0.0.3) from /usr/libexec/openshift/cartridges/jenkins-client
I, [2013-10-07T09:21:43.035787 #18415]  INFO -- : openshift.rb:47:in `block in <class:Openshift>' 28 cartridge(s) installed in /var/lib/openshift/.cartridge_repository
E, [2013-10-07T09:21:43.048719 #18415] ERROR -- : openshift.rb:57:in `rescue in block in <class:Openshift>' undefined local variable or method `agent_startup' for MCollective::Agent::Openshift:Class
E, [2013-10-07T09:21:43.049202 #18415] ERROR -- : openshift.rb:58:in `rescue in block in <class:Openshift>' ["/opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:54:in `block in <class:Openshift>'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:89:in `activate_agent?'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:54:in `loadagent'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:36:in `block (2 levels) in loadagents'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:34:in `each'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:34:in `block in loadagents'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:30:in `each'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:30:in `loadagents'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:11:in `initialize'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/runner.rb:19:in `new'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/runner.rb:19:in `initialize'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/unix_daemon.rb:29:in `new'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/unix_daemon.rb:29:in `block in daemonize_runner'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/unix_daemon.rb:13:in `block in daemonize'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/unix_daemon.rb:5:in `fork'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/unix_daemon.rb:5:in `daemonize'", "/opt/rh/ruby193/root/usr/share/ruby/mcollective/unix_daemon.rb:20:in `daemonize_runner'", "/usr/sbin/mcollectived:43:in `<main>'"]



Version-Release number of selected component (if applicable):

mcollective-qpid-plugin-1.3.2-1.el6_3.noarch
ruby193-mcollective-common-2.2.3-2.el6oso.noarch

mcollective-client-2.2.3-1.el6.noarch
mcollective-2.2.3-1.el6.noarch
mcollective-common-2.2.3-1.el6.noarch

openshift-origin-msg-node-mcollective-1.14.4-1.el6oso.noarch
ent


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:
This error message was displayed.

Expected results:


Additional info:

Just logging this so that we can take a look at it.
Comment 1 Jessica Forrester 2013-10-09 13:39:00 UTC 
Fix is in https://github.com/openshift/li/pull/1961

Can reproduce the error, which is this part "ERROR -- : openshift.rb:57:in `rescue in block in <class:Openshift>' undefined local variable or method `agent_startup' for MCollective::Agent::Openshift:Class" in the /var/log/ruby*mcollective.log file by restarting the ruby193-mcollective service.  With the fix this error will not show up.
Comment 2 openshift-github-bot 2013-10-09 20:44:52 UTC 
Commit pushed to master at https://github.com/openshift/li

https://github.com/openshift/li/commit/14bc9bd3b44a02d030e0fbb27e8849cb6c211735
Bug 1016094 - error in mcollective log for agent_startup not defined
Comment 3 Meng Bo 2013-10-10 11:01:12 UTC 
Tested on devenv_3880, with restart ruby193-mcolletive service, there is no error in the ruby193-mcollective log.

Move bug to verified.