Bug 741954

Summary: iwhd errors at start on RHEL 6.1
Product: [Retired] CloudForms Cloud Engine Reporter: wes hayutin <whayutin>
Component: iwhdAssignee: Jim Meyering <meyering>
Status: CLOSED ERRATA QA Contact: wes hayutin <whayutin>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 1.0.0CC: akarol, dajohnso, deltacloud-maint, dgao, mkoci, ssachdev
Target Milestone: rc   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-05-15 19:55:19 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description wes hayutin 2011-09-28 15:27:08 UTC
Description of problem:
notice: /Stage[main]/Aeolus::Conductor/Service[conductor-dbomatic]/ensure: ensure changed 'stopped' to 'running'
info: Creating state file /var/lib/puppet/state/state.yaml
notice: Finished catalog run in 67.68 seconds
You have new mail in /var/spool/mail/root
[root@hp-z600-01 yum.repos.d]# 
[root@hp-z600-01 yum.repos.d]# 
[root@hp-z600-01 yum.repos.d]# 
[root@hp-z600-01 yum.repos.d]# 
[root@hp-z600-01 yum.repos.d]# aeolus-check-services 

Checking mongod ...
 Success: mongod (pid 4956) is running...

Checking iwhd ...
 FAILURE: iwhd dead but pid file exists

Checking postgresql ...
 Success: postmaster (pid  4874) is running...

Checking httpd ...
 Success: httpd (pid  5352) is running...

Checking qpidd ...
 Success: qpidd (pid  5236) is running...

Checking deltacloud-core ...
 FAILURE: is stopped

Checking libvirtd ...
 Success: libvirtd (pid  4991) is running...

Checking aeolus-conductor ...
 Success: (pid  5447) is running...

Checking conductor-dbomatic ...
 Success: dbomatic (pid  5637) is running...

Checking imagefactory ...
 FAILURE: imagefactory is stopped

Checking ntpd ...
 Success: ntpd (pid  5215) is running...
[root@hp-z600-01 yum.repos.d]# /etc/init.d/iwhd restart
[  OK  ] iwhd daemon:  [FAILED]
waiting for mongod to listen on localhost:27017[  OK  ]
Starting iwhd daemon: [  OK  ]
[root@hp-z600-01 yum.repos.d]# iwhd: Symbol `_ZTVN5mongo17DBClientInterfaceE' has different size in shared object, consider re-linking
iwhd: Symbol `_ZTVN5mongo20DBClientWithCommandsE' has different size in shared object, consider re-linking

[root@hp-z600-01 yum.repos.d]# 
[root@hp-z600-01 yum.repos.d]# /etc/init.d/iwhd status
iwhd (pid  5773) is running...
[root@hp-z600-01 yum.repos.d]# cat /var/log/iwhd.log 
0 replication servers defined
Sep 28 11:24:05 iwhd[5163]: convert-provider: ITER key: name
Sep 28 11:24:05 iwhd[5163]: convert-provider: ITER key: type
Sep 28 11:24:05 iwhd[5163]: convert-provider: ITER key: path
Wed Sep 28 11:24:05 getaddrinfo("hm") failed: Name or service not known
Sep 28 11:24:05 iwhd[5163]: server down, no metadata access
Sep 28 11:24:05 iwhd[5163]: key is _default and we don't care
Sep 28 11:24:05 iwhd[5163]: reconnection to localhost:27017 failed
terminate called after throwing an instance of 'mongo::SocketException'
  what():  socket exception
0 replication servers defined
Sep 28 11:24:55 iwhd[5773]: convert-provider: ITER key: name
Sep 28 11:24:55 iwhd[5773]: convert-provider: ITER key: type
Sep 28 11:24:55 iwhd[5773]: convert-provider: ITER key: path
Wed Sep 28 11:24:55 getaddrinfo("���") failed: Name or service not known
Sep 28 11:24:55 iwhd[5773]: server down, no metadata access
[root@hp-z600-01 yum.repos.d]# 


[root@hp-z600-01 yum.repos.d]# ps -ef | grep iwhd
root      5773     1  0 11:24 pts/0    00:00:00 iwhd -c /etc/iwhd/conf.js -d localhost:27017 -l /var/log/iwhd.log
root      5786  4314  0 11:25 pts/0    00:00:00 grep iwhd


[root@hp-z600-01 yum.repos.d]# rpm -qa | grep iwhd
iwhd-0.98.15.z3-1.el6.x86_64
[root@hp-z600-01 yum.repos.d]#

Comment 1 wes hayutin 2011-09-28 15:35:18 UTC
[root@hp-z600-01 yum.repos.d]# /etc/init.d/mongod status
mongod (pid 4956) is running...
[root@hp-z600-01 yum.repos.d]# ps -ef |grep mongo
mongodb   4956     1  0 11:24 ?        00:00:00 /usr/bin/mongod --quiet -f /etc/mongodb.conf run
root      5838  4314  0 11:30 pts/0    00:00:00 grep mongo

Comment 2 wes hayutin 2011-09-28 16:39:35 UTC
making sure all the bugs are at the right version for future queries

Comment 4 Jim Meyering 2011-10-03 19:12:49 UTC
Thanks for the report.

However, this part of your log suggests that your iwhd binary
is inconsistent with the mongo libraries it's using:

[root@hp-z600-01 yum.repos.d]# iwhd: Symbol `_ZTVN5mongo17DBClientInterfaceE'
has different size in shared object, consider re-linking
iwhd: Symbol `_ZTVN5mongo20DBClientWithCommandsE' has different size in shared
object, consider re-linking

That is a pretty fundamental problem, and more likely to be
due to a packaging/integration error than a bug in iwhd.

I suggest to CLOSE/NOTABUG unless you can reproduce with consistent libraries.

Comment 5 Aziza Karol 2011-10-11 06:37:41 UTC
iwhd starts successfully on RHEL 6.1 

Sun Oct 09 13:43:38 -0400 2011 /Stage[main]/Apache/Exec[reload-apache] (notice): Triggered 'refresh' from 1 events
Sun Oct 09 13:43:39 -0400 2011 /Stage[main]/Aeolus::Iwhd/Service[iwhd]/ensure (notice): ensure changed 'stopped' to 'running'

# cat /var/log/iwhd.log 
0 replication servers defined
Oct 09 13:43:38 iwhd[4815]: convert-provider: ITER key: name
Oct 09 13:43:38 iwhd[4815]: convert-provider: ITER key: type
Oct 09 13:43:38 iwhd[4815]: convert-provider: ITER key: path
Oct 09 13:43:39 iwhd[4815]: key is _default and we don't care
Oct 09 13:53:50 iwhd[4815]: key is _default and we don't care
iwhd: templates: failed to create directory: File exists
Oct 09 13:54:00 iwhd[4815]: key is _default and we don't care
iwhd: templates: failed to create directory: File exists
0 replication servers defined
Oct 09 13:54:01 iwhd[5997]: convert-provider: ITER key: name
Oct 09 13:54:01 iwhd[5997]: convert-provider: ITER key: type
Oct 09 13:54:01 iwhd[5997]: convert-provider: ITER key: path
Oct 09 13:54:30 iwhd[5997]: key is _default and we don't care
iwhd: templates: failed to create directory: File exists
Oct 09 23:54:52 iwhd[5997]: meta_did_put(images,6d49718b-c3a8-41cb-aa73-c7f3f1451bdc,rhevm


[root@dell-pe1950-02 rheltempwes]# aeolus-check-services 

Checking mongod ...
 Success: mongod (pid 4724) is running...

Checking iwhd ...
 Success: iwhd (pid  5997) is running...

Checking postgresql ...
 Success: postmaster (pid  4966) is running...

Checking httpd ...
 Success: httpd (pid  4756) is running...


[root@dell-pe1950-02]# ps -ef | grep iwhd
root      5997     1  0 Oct09 ?        00:02:01 iwhd -c /etc/iwhd/conf.js -d localhost:27017 -l /var/log/iwhd.log
root      9894  4368  0 02:31 pts/0    00:00:00 grep iwhd


verified on:
[root@dell-pe1950-02 rheltempwes]# rpm -qa  | egrep 'conductor|iwhd|imagefactory|oz'
aeolus-conductor-0.5.0-0.20111007200330gite77b251.el6.noarch
imagefactory-jeosconf-ec2-rhel-0.1.0-1.el6.noarch
aeolus-conductor-doc-0.5.0-0.20111007200330gite77b251.el6.noarch
imagefactory-jeosconf-ec2-fedora-0.1.0-1.el6.noarch
iwhd-0.98.15.z3-2.el6.x86_64
rubygem-imagefactory-console-0.5.0-4.20110824113238gitd9debef.el6.noarch
oz-0.7.0-3.el6.noarch
aeolus-conductor-daemons-0.5.0-0.20111007200330gite77b251.el6.noarch
imagefactory-0.7.0-1.el6.noarch

Comment 7 errata-xmlrpc 2012-05-15 19:55:19 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHEA-2012-0589.html