Hide Forgot
Description of problem: [root@ip-10-243-114-79 rc3.d]# rpm -qa | grep factory rubygem-image_factory_console-0.2.0-2.el6_0.20110401225248git6800ed8.noarch rubygem-image_factory_connector-0.0.2-2.el6.20110414153545git257f8a3.noarch imagefactory-0.1.6.2_8_gbcb427d-2.el6.noarch [root@ip-10-243-114-79 rc3.d]# [root@ip-10-243-114-79 rc3.d]# /etc/init.d/imagefactory stop Stopping imgfac.py: [ OK ] [root@ip-10-243-114-79 rc3.d]# ps -ef | grep factory root 3489 1999 0 11:33 pts/1 00:00:00 grep factory [root@ip-10-243-114-79 rc3.d]# /etc/init.d/qpidd status qpidd (pid 1122) is running... [root@ip-10-243-114-79 rc3.d]# /etc/init.d/qpidd stop Stopping Qpid AMQP daemon: [ OK ] [root@ip-10-243-114-79 rc3.d]# [root@ip-10-243-114-79 rc3.d]# [root@ip-10-243-114-79 rc3.d]# [root@ip-10-243-114-79 rc3.d]# ps -ef | grep qpid root 3511 1999 0 11:34 pts/1 00:00:00 grep qpid [root@ip-10-243-114-79 rc3.d]# /etc/init.d/imagefactory start Starting imgfac.py: [ OK ] [root@ip-10-243-114-79 rc3.d]# cat /var/log/imagefactory.log 2011-04-19 10:51:17,457 INFO root pid(2147) Message: Launched as daemon... 2011-04-19 11:34:14,442 INFO root pid(3523) Message: Launched as daemon... [root@ip-10-243-114-79 rc3.d]#
documenting that qpid is not running or may not be fully functional at ami boot time.. Apr 19 09:35:11 ip-10-80-213-29 ntpd[1645]: Listening on interface #3 eth0, fe80::1031:3dff:fe1c:cad3#123 Enabled Apr 19 09:35:11 ip-10-80-213-29 ntpd[1645]: Listening on interface #4 lo, 127.0.0.1#123 Enabled Apr 19 09:35:11 ip-10-80-213-29 ntpd[1645]: Listening on interface #5 eth0, 10.80.213.29#123 Enabled Apr 19 09:35:11 ip-10-80-213-29 ntpd[1645]: Listening on interface #6 virbr0, 192.168.122.1#123 Enabled Apr 19 09:35:11 ip-10-80-213-29 ntpd[1645]: Listening on routing socket on fd #23 for interface updates Apr 19 09:35:11 ip-10-80-213-29 ntpd[1645]: kernel time sync status 2040 Apr 19 09:35:53 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:35:53 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311) Apr 19 09:36:10 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:36:10 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311) Apr 19 09:36:13 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:36:13 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311) Apr 19 09:36:19 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:36:19 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311) Apr 19 09:36:31 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:36:31 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311) Apr 19 09:36:53 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:36:53 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311) Apr 19 09:36:55 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:36:55 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311) Apr 19 09:37:43 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:37:43 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311) Apr 19 09:37:53 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:37:53 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311) Apr 19 09:38:30 ip-10-80-213-29 ntpd[1645]: synchronized to 38.117.195.101, stratum 3 Apr 19 09:38:30 ip-10-80-213-29 ntpd[1645]: kernel time sync status change 2001 Apr 19 09:38:43 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:38:43 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311) Apr 19 09:38:53 ip-10-80-213-29 qpidd[1178]: 2011-04-19 09:38:53 warning Client closed connection with 501: internal-error: Sasl error: SASL(-1): generic failure: (qpid/SaslFactory.cpp:311)
We can only really reproduce this in the ami, correct? My understanding is that the dependency shouldn't exist (imagefactory is supposed to be able to start before qpidd), but maybe there's something special about the ami. I can play around with service start up ordering a bit and see if I can figure anything out, but more eyes would probably be helpful.
ibm-hs22-02.lab.bos.redhat.com [root@ibm-hs22-02 scratch]# rpm -qa | grep aeolus aeolus-conductor-doc-0.3.0-0.el6.20110616184910gita7515e1.noarch aeolus-configure-2.0.1-0.el6.20110602110128git5cb9257.noarch aeolus-conductor-devel-0.3.0-0.el6.20110616184910gita7515e1.noarch aeolus-conductor-0.3.0-0.el6.20110616184910gita7515e1.noarch aeolus-all-0.3.0-0.el6.20110616184910gita7515e1.noarch aeolus-conductor-daemons-0.3.0-0.el6.20110616184910gita7515e1.noarch [root@ibm-hs22-02 scratch]# less /var/log/iwhd.log [root@ibm-hs22-02 scratch]# /etc/init.d/imagefactory stop Stopping imgfac.py: [ OK ] [root@ibm-hs22-02 scratch]# /etc/init.d/qpidd stop Stopping Qpid AMQP daemon: [ OK ] [root@ibm-hs22-02 scratch]# /etc/init.d/imagefactory start Starting imgfac.py: [ OK ] [root@ibm-hs22-02 scratch]#
[root@hp-ml370g5-01 ~]# rpm -qa | grep aeolus aeolus-conductor-0.3.0-0.el6.20110628135944git2a88782.noarch rubygem-aeolus-cli-0.0.1-1.el6.20110628165632git0dfe3ff.noarch aeolus-all-0.3.0-0.el6.20110628135944git2a88782.noarch aeolus-conductor-daemons-0.3.0-0.el6.20110628135944git2a88782.noarch aeolus-conductor-doc-0.3.0-0.el6.20110628135944git2a88782.noarch aeolus-configure-2.0.1-0.el6.20110628141215gitb8aaf85.noarch [root@hp-ml370g5-01 ~]# /etc/init.d/qpidd stop Stopping Qpid AMQP daemon: [ OK ] [root@hp-ml370g5-01 ~]# /etc/init.d/imagefactory restart Stopping imgfac.py: [ OK ] Starting imgfac.py: [ OK ] [root@hp-ml370g5-01 ~]#
imagefactory seems to run fine even when it comes up before qpid, except when this whole construct is shipped via ami, so I'm going to remove this from blocking beta, but leave it on ce-ami.
making sure all the bugs are at the right version for future queries
imagefactory starts even if qpidd is down. [root@dell-pe1950-02 templates]# /etc/init.d/imagefactory status imagefactory (pid 5043) is running... [root@dell-pe1950-02 templates]# /etc/init.d/qpidd status qpidd (pid 4666) is running... [root@dell-pe1950-02 templates]# /etc/init.d/imagefactory stop Stopping imagefactory: [ OK ] [root@dell-pe1950-02 templates]# /etc/init.d/qpidd stop Stopping Qpid AMQP daemon: [ OK ] [root@dell-pe1950-02 templates]# ps -ef | grep qpidd root 13724 8991 0 06:02 pts/0 00:00:00 grep qpidd [root@dell-pe1950-02 templates]# /etc/init.d/imagefactory start Starting imagefactory: /usr/lib/python2.6/site-packages/oauth2/__init__.py:29: DeprecationWarning: the sha module is deprecated; use the hashlib module instead import sha [ OK ] [root@dell-pe1950-02 templates]# ps -ef | grep factory root 14174 1 0 06:19 ? 00:00:00 /usr/bin/python /usr/bin/imagefactory --qmf --debug root 14205 8991 0 06:20 pts/0 00:00:00 grep factory [root@dell-pe1950-02 templates]cat /var/log/imagefactory.log 2011-10-12 06:19:16,448 INFO root pid(14174) Message: Launched as daemon.. verified on: [root@dell-pe1950-02 templates]# rpm -qa | egrep 'aeolus|factory' rubygem-actionpack-3.0.9-1.aeolus.el6.noarch aeolus-conductor-0.5.0-0.20111007200330gite77b251.el6.noarch imagefactory-jeosconf-ec2-rhel-0.1.0-1.el6.noarch rubygem-activerecord-3.0.9-1.aeolus.el6.noarch rubygem-ZenTest-4.3.3-2.aeolus.el6.noarch rubygem-actionmailer-3.0.9-1.aeolus.el6.noarch aeolus-conductor-doc-0.5.0-0.20111007200330gite77b251.el6.noarch imagefactory-jeosconf-ec2-fedora-0.1.0-1.el6.noarch rubygem-activesupport-3.0.9-1.aeolus.el6.noarch rubygem-arel-2.0.10-0.aeolus.el6.noarch aeolus-configure-2.2.0-1.20111007151942git26136f2.el6.noarch rubygem-imagefactory-console-0.5.0-4.20110824113238gitd9debef.el6.noarch rubygem-aeolus-cli-0.1.0-3.20111003133323git9451323.el6.noarch aeolus-all-0.5.0-0.20111007200330gite77b251.el6.noarch rubygem-aeolus-image-0.1.0-3.20111003170706git8f23238.el6.noarch aeolus-conductor-daemons-0.5.0-0.20111007200330gite77b251.el6.noarch imagefactory-0.7.0-1.el6.noarch rubygem-rack-mount-0.7.1-3.aeolus.el6.noarch DeprecationWarning when imagafactory starts is tracked at https://bugzilla.redhat.com/show_bug.cgi?id=744908
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. http://rhn.redhat.com/errata/RHEA-2012-0588.html