Bug 711225 - dbomatic fails to start after install
Summary: dbomatic fails to start after install
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: CloudForms Cloud Engine
Classification: Retired
Component: aeolus-conductor
Version: 0.3.1
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: alpha
Assignee: Mo Morsi
QA Contact: wes hayutin
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2011-06-06 21:26 UTC by wes hayutin
Modified: 2012-01-26 12:23 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:


Attachments (Terms of Use)
Comment (67.92 KB, text/plain)
2011-06-06 21:26 UTC, wes hayutin
no flags Details

Description wes hayutin 2011-06-06 21:26:54 UTC
Created attachment 915323 [details]
Comment

(This comment was longer than 65,535 characters and has been moved to an attachment by Red Hat Bugzilla).

Comment 1 Mike Orazi 2011-06-14 03:22:37 UTC
Initial triage on the reporting machine indicates that dbomatic fails to start because the condor log it is looking for didn't exist.

Possible resolutions:  
- make dbomatic more tolerant of that initial condition
- ensure the EventLog exists prior to starting dbomatic (via puppet)
- ensure that condor has been started prior to dbomatic starting (via puppet)

Comment 2 Chris Lalancette 2011-06-14 12:58:11 UTC
(In reply to comment #1)
> Initial triage on the reporting machine indicates that dbomatic fails to start
> because the condor log it is looking for didn't exist.
> 
> Possible resolutions:  
> - make dbomatic more tolerant of that initial condition

Yes please!

> - ensure the EventLog exists prior to starting dbomatic (via puppet)

This would work, but seems like a hack.

> - ensure that condor has been started prior to dbomatic starting (via puppet)

I don't believe this will actually work, because not only does condor need to be running, an event must be generated.

Chris Lalancette

Comment 3 Mike Orazi 2011-06-14 20:36:37 UTC
Yea, agree on the last one not being a viable resolution.

Comment 4 wes hayutin 2011-06-16 18:04:31 UTC
need an update on this bug please.
Thank you!

Comment 5 Mo Morsi 2011-06-16 20:44:30 UTC
DBomatic reworking is underway to get around all the issues we've had recently.

Until thats ready a patch with a temporary fix for this issue has been sent to the list, ack'd and pushed


http://git.fedorahosted.org/git/?p=aeolus/conductor.git;a=commitdiff;h=459ec79398329c8fffc2d136f45914f3f95c6601

Comment 6 Mo Morsi 2011-06-16 20:50:26 UTC
*** Bug 712316 has been marked as a duplicate of this bug. ***

Comment 7 wes hayutin 2011-06-30 13:18:01 UTC
moving to on_qa

Comment 8 Aziza Karol 2011-07-05 06:32:19 UTC
DBomatic starts after install.

[root@dell-pe860-01 yum.repos.d]# aeolus-configure 
notice: /File[/data]/ensure: created
notice: /File[/data/db]/ensure: created
notice: /Stage[main]/Aeolus/Yumrepo[aeolus_arch]/descr: descr changed '' to 'aeolus_arch'
notice: /Stage[main]/Aeolus/Yumrepo[aeolus_arch]/baseurl: baseurl changed '' to 'http://repos.fedorapeople.org/repos/aeolus/packages/rhel-6/$basearch'
notice: /Stage[main]/Aeolus/Yumrepo[aeolus_arch]/enabled: enabled changed '' to '0'
notice: /Stage[main]/Aeolus/Yumrepo[aeolus_arch]/gpgcheck: gpgcheck changed '' to '0'
notice: /Stage[main]/Aeolus::Iwhd/Service[mongod]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Aeolus/Yumrepo[aeolus_noarch]/descr: descr changed '' to 'aeolus_noarch'
notice: /Stage[main]/Aeolus/Yumrepo[aeolus_noarch]/baseurl: baseurl changed '' to 'http://repos.fedorapeople.org/repos/aeolus/packages/rhel-6/noarch'
notice: /Stage[main]/Aeolus/Yumrepo[aeolus_noarch]/enabled: enabled changed '' to '0'
notice: /Stage[main]/Aeolus/Yumrepo[aeolus_noarch]/gpgcheck: gpgcheck changed '' to '0'
notice: /Stage[main]/Aeolus::Iwhd/Service[iwhd]/ensure: ensure changed 'stopped' to 'running'
notice: /File[/etc/ntp.conf]/content: content changed '{md5}8d419c008454b9caf1c092fdac4eac1d' to '{md5}2dfb9420ebf32c7d97f86526fe6c21e8'
notice: /File[/etc/ntp/step-tickers]/content: content changed '{md5}32fdc5cdf3f181e7b6987410cf607d15' to '{md5}2dfb9420ebf32c7d97f86526fe6c21e8'
notice: /Stage[main]/Ntp::Client/Service[ntpd]: Triggered 'refresh' from 2 events
notice: /File[/etc/sysconfig/solr]/ensure: defined content as '{md5}87438b964e50cee40f06c06b766e77ef'
notice: /Stage[main]/Aeolus::Image-factory/Service[libvirtd]/ensure: ensure changed 'stopped' to 'running'
notice: /File[/etc/init.d/solr]/ensure: defined content as '{md5}a1d6e9b0cf6877ebf273a429f63b1956'
notice: /Stage[main]/Apache/Exec[permit-http-networking]/returns: executed successfully
notice: /Stage[main]/Apache/Service[httpd]/ensure: ensure changed 'stopped' to 'running'
notice: /File[/etc/httpd/conf.d/aeolus-conductor.conf]/content: content changed '{md5}f1048c6a2c764a670e2f75c4edcd3f9a' to '{md5}0e80e7988b2150b134673b6f9be55c04'
notice: /Stage[main]/Apache/Exec[reload-apache]: Triggered 'refresh' from 1 events
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Create_bucket[aeolus]/Exec[create-bucket-aeolus]/returns:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Create_bucket[aeolus]/Exec[create-bucket-aeolus]/returns:                                  Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0]/Exec[create-bucket-aeolus]/returns: 
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Create_bucket[aeolus]/Exec[create-bucket-aeolus]/returns: executed successfully
notice: /Stage[main]/Aeolus::Image-factory/File[/var/tmp/imagefactory-mock]/ensure: created
notice: /Stage[main]/Postgres::Server/Exec[pginitdb]/returns: executed successfully
notice: /File[/var/lib/pgsql/data/pg_hba.conf]/content: content changed '{md5}75d10aa75d5abb0893682de8622f3061' to '{md5}2d3f1f2e30c9b188961b1acd3ade3b8b'
notice: /File[/var/lib/pgsql/data/pg_hba.conf]/owner: owner changed 'postgres' to 'root'
notice: /File[/var/lib/pgsql/data/pg_hba.conf]/group: group changed 'postgres' to 'root'
notice: /File[/var/lib/pgsql/data/pg_hba.conf]/mode: mode changed '600' to '644'
notice: /File[/var/lib/pgsql/data/pg_hba.conf]/seluser: seluser changed 'unconfined_u' to 'system_u'
notice: /Stage[main]/Postgres::Server/Service[postgresql]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Postgres::Server/Service[postgresql]: Triggered 'refresh' from 6 events
notice: /Stage[main]/Aeolus::Conductor/Postgres::User[aeolus]/Exec[create_aeolus_postgres_user]/returns: executed successfully
notice: /Stage[main]/Aeolus::Conductor/Selinux::Mode[permissive]/Exec[set_selinux_permissive]/returns: executed successfully
notice: /File[/etc/qpidd.conf]/content: content changed '{md5}9536dca919c71073ef0b836e84a66663' to '{md5}3b762fe02ab4c355304d933bad24aee0'
notice: /Stage[main]/Aeolus::Image-factory/Service[qpidd]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Aeolus::Conductor/Service[aeolus-connector]/ensure: ensure changed 'stopped' to 'running'
notice: /File[/etc/condor/config.d/10deltacloud.config]/ensure: defined content as '{md5}f8266a8f5eba4717579d5e14edee0a74'
notice: /Stage[main]/Aeolus::Conductor/Service[condor]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Aeolus::Conductor/Rails::Create::Db[create_aeolus_database]/Exec[create_rails_database]/returns: (in /usr/share/aeolus-conductor)
notice: /Stage[main]/Aeolus::Conductor/Rails::Create::Db[create_aeolus_database]/Exec[create_rails_database]/returns: executed successfully
notice: /Stage[main]/Aeolus::Conductor/Service[solr]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Aeolus::Conductor/Rails::Migrate::Db[migrate_aeolus_database]/Exec[migrate_rails_database]/returns: executed successfully
notice: /Stage[main]/Aeolus::Conductor/Rails::Seed::Db[seed_aeolus_database]/Exec[seed_rails_database]/returns: (in /usr/share/aeolus-conductor)
notice: /Stage[main]/Aeolus::Conductor/Rails::Seed::Db[seed_aeolus_database]/Exec[seed_rails_database]/returns: executed successfully
notice: /File[/var/lib/aeolus-conductor/production.seed]/ensure: created
notice: /Stage[main]/Aeolus::Image-factory/Service[imagefactory]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Site_admin[admin]/Exec[create_site_admin_user]/returns: (in /usr/share/aeolus-conductor)
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Site_admin[admin]/Exec[create_site_admin_user]/returns: User admin registered
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Site_admin[admin]/Exec[create_site_admin_user]/returns: executed successfully
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Site_admin[admin]/Exec[grant_site_admin_privs]/returns: (in /usr/share/aeolus-conductor)
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Site_admin[admin]/Exec[grant_site_admin_privs]/returns: Granting administrator privileges for admin...
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Site_admin[admin]/Exec[grant_site_admin_privs]/returns: executed successfully
notice: /File[/var/log/deltacloud-mock]/ensure: created
notice: /File[/etc/init.d/deltacloud-mock]/ensure: defined content as '{md5}91f7a7b75548184be3bc143f11152ad2'
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Provider[mock]/Aeolus::Deltacloud[mock]/Service[deltacloud-mock]/ensure: ensure changed 'stopped' to 'running'
notice: /File[/etc/init.d/deltacloud-ec2-us-east-1]/ensure: defined content as '{md5}d8e1ef85277e52a647815e3177766704'
notice: /File[/var/log/deltacloud-ec2-us-east-1]/ensure: created
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Provider[ec2-us-east-1]/Aeolus::Deltacloud[ec2-us-east-1]/Service[deltacloud-ec2-us-east-1]/ensure: ensure changed 'stopped' to 'running'
notice: /File[/var/log/deltacloud-ec2-us-west-1]/ensure: created
notice: /File[/etc/init.d/deltacloud-ec2-us-west-1]/ensure: defined content as '{md5}d52f8ab18e5fec3d847c2ec754409857'
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Provider[ec2-us-west-1]/Aeolus::Deltacloud[ec2-us-west-1]/Service[deltacloud-ec2-us-west-1]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Aeolus::Conductor/Service[conductor-delayed_job]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Aeolus::Conductor/Service[conductor-dbomatic]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Aeolus::Conductor/Exec[build_solr_index]/returns: (in /usr/share/aeolus-conductor)
notice: /Stage[main]/Aeolus::Conductor/Exec[build_solr_index]/returns: executed successfully
notice: /Stage[main]/Aeolus::Conductor/Service[aeolus-conductor]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Provider[mock]/Aeolus::Conductor::Provider[mock]/Web_request[provider-mock]/post: post changed '' to 'https://localhost/conductor/providers'
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Conductor::Hwp[hwp1]/Web_request[hwp-hwp1]/post: post changed '' to 'https://localhost/conductor/hardware_profiles'
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Provider[ec2-us-west-1]/Aeolus::Conductor::Provider[ec2-us-west-1]/Web_request[provider-ec2-us-west-1]/post: post changed '' to 'https://localhost/conductor/providers'
notice: /Stage[main]/Aeolus::Conductor::Seed_data/Aeolus::Provider[ec2-us-east-1]/Aeolus::Conductor::Provider[ec2-us-east-1]/Web_request[provider-ec2-us-east-1]/post: post changed '' to 'https://localhost/conductor/providers'
notice: Finished catalog run in 82.66 seconds



ruby /root/checkServices.rb (com.redhat.qe.tools.SSHCommandRunner.run)
201107050159:54.870 - FINE: Stdout: 

Checking aeolus-conductor ...
 [1;32mSuccess:[0m (pid  4030) is running...

Checking aeolus-connector ...
 [1;32mSuccess:[0m image_factory_connector (pid  3754) is running...

Checking condor ...
 [1;32mSuccess:[0m condor_master (pid  3335) is running...

Checking conductor-dbomatic ...
 [1;32mSuccess:[0m dbomatic (pid  4082) is running...

Checking conductor-delayed_job ...
 [1;32mSuccess:[0m delayed_job (pid  4165) is running...

Checking deltacloud-ec2-us-east-1 ...
 [1;32mSuccess:[0m deltacloudd (pid  4416) is running...

Checking deltacloud-ec2-us-west-1 ...
 [1;32mSuccess:[0m deltacloudd (pid  4347) is running...

Checking deltacloud-mock ...
 [1;32mSuccess:[0m deltacloudd (pid  4483) is running...

Checking httpd ...
 [1;32mSuccess:[0m httpd (pid  3681) is running...

Checking imagefactory ...
 [1;32mSuccess:[0m imagefactory (pid  4562) is running...

Checking iwhd ...
 [1;32mSuccess:[0m iwhd (pid  4604) is running...

Checking libvirtd ...
 [1;32mSuccess:[0m libvirtd (pid  3393) is running...

Checking mongod ...
 [1;32mSuccess:[0m mongod (pid 3654) is running...

Checking ntpd ...
 [1;32mSuccess:[0m ntpd (pid  3611) is running...

Checking postgresql ...
 [1;32mSuccess:[0m postmaster (pid  3904) is running...

Checking qpidd ...
 [1;32mSuccess:[0m qpidd (pid  3466) is running...

Checking production solr ...
 [1;32mSuccess:[0m COMMAND  PID USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
java    3953 root   21u  IPv6  63811      0t0  TCP *:8983 (LISTEN)

Checking connector ...
 [1;32mSuccess:[0m COMMAND    PID USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
image_fac 3754 root   12u  IPv4  63505      0t0  TCP localhost:cfinger (LISTEN)

Checking condor_q ...
 [1;32mSuccess:[0m -- Submitter: dell-pem710-01.rhts.eng.bos.redhat.com : <10.16.64.168:39290> : dell-pem710-01.rhts.eng.bos.redhat.com
 ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD               

0 jobs; 0 idle, 0 running, 0 held

Checking condor_status ...
 [1;32mSuccess:[0m 


verified on:
[root@dell-pe860-01 log]# rpm -qa  | grep  aeolus
aeolus-conductor-0.3.0-0.el6.20110701204941gitd66e27c.noarch
aeolus-all-0.3.0-0.el6.20110701204941gitd66e27c.noarch
aeolus-conductor-doc-0.3.0-0.el6.20110701204941gitd66e27c.noarch
aeolus-conductor-daemons-0.3.0-0.el6.20110701204941gitd66e27c.noarch
aeolus-configure-2.0.1-0.el6.20110628141215gitb8aaf85.noarch
rubygem-aeolus-cli-0.0.1-1.el6.20110701204941gitd66e27c.noarch

Comment 9 wes hayutin 2011-07-05 15:04:24 UTC
removing ce-p2-beta

Comment 10 wes hayutin 2011-07-05 15:08:15 UTC
second attempt to remove ce-p2-beta

Comment 11 wes hayutin 2011-08-01 19:59:11 UTC
release pending...

Comment 12 wes hayutin 2011-08-01 19:59:33 UTC
release pending.. 2

Comment 13 wes hayutin 2011-08-01 19:59:56 UTC
release pending...

Comment 15 wes hayutin 2011-12-08 13:59:48 UTC
closing out old bugs

Comment 16 wes hayutin 2011-12-08 14:12:43 UTC
perm close


Note You need to log in before you can comment on or make changes to this bug.