Hide Forgot
Description of problem: Prevents deployments from.. er.. deploying Processing DeploymentsController#create (for 10.11.8.203 at 2011-06-17 14:18:28) [POST] Parameters: {"commit"=>"Launch", "action"=>"create", "controller"=>"deployments", "deployment"=>{"name"=>"deployment02", "frontend_realm_id"=>"", "deployable_xml"=>"<deployable name=\"deployable01\">\r\n <description>deployable01-description</description>\r\n <assemblies>\r\n <assembly name=\"frontend\" hwp=\"hwp1\">\r\n <image id=\"69670585-8123-47c3-a29d-3ff02f6c8b42\">\r\n </image>\r\n </assembly>\r\n </assemblies>\r\n</deployable>\r\n", "pool_id"=>"2"}} Permission denied - /var/lib/aeolus-conductor/jobs /usr/lib/ruby/1.8/fileutils.rb:240:in `mkdir'/usr/lib/ruby/1.8/fileutils.rb:240:in `fu_mkdir'/usr/lib/ruby/1.8/fileutils.rb:217:in `mkdir_p'/usr/lib/ruby/1.8/fileutils.rb:215:in `reverse_each'/usr/lib/ruby/1.8/fileutils.rb:215:in `mkdir_p'/usr/lib/ruby/1.8/fileutils.rb:201:in `each'/usr/lib/ruby/1.8/fileutils.rb:201:in `mkdir_p'/usr/share/aeolus-conductor/app/util/condormatic.rb:85:in `write_pw_file'/usr/share/aeolus-conductor/app/util/condormatic.rb:121:in `condormatic_instance_create'/usr/share/aeolus-conductor/app/models/deployment.rb:147:in `launch'/usr/lib/ruby/gems/1.8/gems/activerecord-2.3.8/lib/active_record/connection_adapters/abstract/database_statements.rb:136:in `transaction'/usr/lib/ruby/gems/1.8/gems/activerecord-2.3.8/lib/active_record/transactions.rb:182:in `transaction'/usr/share/aeolus-conductor/app/models/deployment.rb:129:in `launch'/usr/share/aeolus-conductor/app/models/deployment.rb:126:in `each'/usr/share/aeolus-conductor/app/models/deployment.rb:126:in `launch'/usr/share/aeolus-conductor/app/controllers/deployments_controller.rb:94:in `create'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/mime_responds.rb:106:in `call'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/mime_responds.rb:106:in `respond_to'/usr/share/aeolus-conductor/app/controllers/deployments_controller.rb:92:in `create'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/base.rb:1331:in `send'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/base.rb:1331:in `perform_action_without_filters'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/filters.rb:617:in `call_filters'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/filters.rb:610:in `perform_action_without_benchmark'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/benchmarking.rb:68:in `perform_action_without_rescue'/usr/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/core_ext/benchmark.rb:17:in `ms'/usr/lib/ruby/1.8/benchmark.rb:308:in `realtime'/usr/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/core_ext/benchmark.rb:17:in `ms'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/benchmarking.rb:68:in `perform_action_without_rescue'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/rescue.rb:160:in `perform_action_without_flash'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/flash.rb:151:in `perform_action'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/base.rb:532:in `send'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/base.rb:532:in `process_without_filters'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/filters.rb:606:in `process_without_compass'/usr/lib/ruby/gems/1.8/gems/compass-0.10.4/lib/compass/app_integration/rails/actionpack2/action_controller.rb:7:in `process'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/base.rb:391:in `process'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/base.rb:386:in `call'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/routing/route_set.rb:438:in `call'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/dispatcher.rb:87:in `dispatch'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/dispatcher.rb:121:in `_call'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/dispatcher.rb:130:in `build_middleware_stack'/usr/lib/ruby/gems/1.8/gems/haml-3.0.18/rails/../lib/sass/plugin/rack.rb:41:in `call'/usr/lib/ruby/gems/1.8/gems/haml-3.0.18/rails/../lib/sass/plugin/rack.rb:41:in `call'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/string_coercion.rb:25:in `call'/usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/head.rb:9:in `call'/usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/methodoverride.rb:24:in `call'/usr/lib/ruby/gems/1.8/gems/rack-restful_submit-1.1.2/lib/rack/rack-restful_submit.rb:25:in `call'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/params_parser.rb:15:in `call'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/session/abstract_store.rb:128:in `call'/usr/lib/ruby/gems/1.8/gems/activerecord-2.3.8/lib/active_record/query_cache.rb:29:in `call'/usr/lib/ruby/gems/1.8/gems/activerecord-2.3.8/lib/active_record/connection_adapters/abstract/query_cache.rb:34:in `cache'/usr/lib/ruby/gems/1.8/gems/activerecord-2.3.8/lib/active_record/query_cache.rb:9:in `cache'/usr/lib/ruby/gems/1.8/gems/activerecord-2.3.8/lib/active_record/query_cache.rb:28:in `call'/usr/lib/ruby/gems/1.8/gems/activerecord-2.3.8/lib/active_record/connection_adapters/abstract/connection_pool.rb:361:in `call'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/failsafe.rb:26:in `call'/usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/lock.rb:11:in `call'/usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/lock.rb:11:in `synchronize'/usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/lock.rb:11:in `call'/usr/lib/ruby/gems/1.8/gems/actionpack-2.3.8/lib/action_controller/dispatcher.rb:106:in `call'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/rack/adapter/rails.rb:74:in `call'/usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/urlmap.rb:47:in `call'/usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/urlmap.rb:41:in `each'/usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/urlmap.rb:41:in `call'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/connection.rb:76:in `pre_process'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/connection.rb:74:in `catch'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/connection.rb:74:in `pre_process'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/connection.rb:57:in `process'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/connection.rb:42:in `receive_data'/usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in `run_machine'/usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in `run'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/backends/base.rb:57:in `start'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/server.rb:156:in `start'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/controllers/controller.rb:80:in `start'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/runner.rb:177:in `send'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/runner.rb:177:in `run_command'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/lib/thin/runner.rb:143:in `run!'/usr/lib/ruby/gems/1.8/gems/thin-1.2.5/bin/thin:6/usr/bin/thin:19:in `load'/usr/bin/thin:19 Redirected to https://sgi-xe310-02.rhts.eng.bos.redhat.com/conductor/deployments/2 Completed in 1168ms (DB: 108) | 302 Found [https://sgi-xe310-02.rhts.eng.bos.redhat.com/conductor/deployments]
think this is fixed.. have a git hash?
No, the odd thing here is that I was never able to reproduce and the code to create /var/lib/aeolus-conductor/jobs was always correct. So I'm still not sure what's going on here. I would leave it open for now in case we hit it again. Chris Lalancette
} Rendering template within layouts/application Rendering deployments/new Completed in 81ms (View: 16, DB: 16) | 200 OK [https://ibm-x3950m2-01.rhts.eng.bos.redhat.com/conductor/deployments/new] Processing DeploymentsController#create (for 10.11.9.219 at 2011-06-23 17:14:50) [POST] Parameters: {"commit"=>"Launch", "action"=>"create", "controller"=>"deployments", "deployment"=>{"name"=>"test2", "frontend_realm_id"=>"" , "deployable_xml"=>"<deployable name=\"deployable01\">\r\n <description>one instances test</description>\r\n <assemblies>\r\n <assembly n ame=\"frontend\" hwp=\"hwp1\">\r\n <image id=\"8d4da86e-2e74-4dcc-bada-359ebc8531c6\">\r\n </image>\r\n </assembly>\r\n </assemblies>\ r\n</deployable>\r\n", "pool_id"=>"1"}} Permission denied - /var/lib/aeolus-conductor/jobs /usr/lib/ruby/1.8/fileutils.rb:240:in `mkdir'/usr/lib/ruby/1.8/fileutils.rb:240:in `fu_mkdir'/usr/lib/ruby/1.8/fileutils.rb:217:in `mkdir_p '/usr/lib/ruby/1.8/fileutils.rb:215:in `reverse_each'/usr/lib/ruby/1.8/fileutils.rb:215:in `mkdir_p'/usr/lib/ruby/1.8/fileutils.rb:201:in ` each'/usr/lib/ruby/1.8/fileutils.rb:201:in `mkdir_p'/usr/share/aeolus-conductor/app/util/condormatic.rb:87:in `write_pw_file'/usr/share/aeo lus-conductor/app/util/condormatic.rb:123:in `condormatic_instance_create'/usr/share/aeolus-conductor/app/models/deployment.rb:147:in `laun ch'/usr/share/aeolus-conductor/app/models/deployment.rb:124:in `each'/usr/share root@ibm-x3950m2-01 noarch]# rpm -qa | grep aeolus aeolus-conductor-0.3.0-0.el6.20110623205403git551632a.noarch aeolus-configure-2.0.1-0.el6.20110622123902gitdf4ae05.noarch aeolus-conductor-doc-0.3.0-0.el6.20110623205403git551632a.noarch aeolus-all-0.3.0-0.el6.20110623205403git551632a.noarch rubygem-aeolus-cli-0.0.1-1.el6.20110623205403git551632a.noarch aeolus-conductor-daemons-0.3.0-0.el6.20110623205403git551632a.noarch aeolus-conductor-devel-0.3.0-0.el6.20110623205403git551632a.noarch [root@ibm-x3950m2-01 noarch]#
Looks like rwsu has tracked down this issue and produced patch, which has been Ack'd. So assigning this over to Richard, and setting to ON_QA
Dev should be adding the git has to bugs.. The directory should be owned by aeolus.aeolus. Incorrect permissions prevents instances from being launched. --- recipes/aeolus/manifests/conductor.pp | 4 +++- 1 files changed, 3 insertions(+), 1 deletions(-) diff --git a/recipes/aeolus/manifests/conductor.pp b/recipes/aeolus/manifests/conductor.pp index f14ea45..d04f640 100644 --- a/recipes/aeolus/manifests/conductor.pp +++ b/recipes/aeolus/manifests/conductor.pp @@ -12,7 +12,9 @@ class aeolus::conductor inherits aeolus { ensure => 'installed'} file {"/var/lib/aeolus-conductor": - ensure => directory } + ensure => directory, + owner => 'aeolus', + group => 'aeolus'} ### Setup selinux for deltacloud selinux::mode{"permissive":} -- 1.7.4.4
Directory is owned by aeolus.aeolus. [root@dell-pe860-01 lib]# ll /var/lib/aeolus-conductor/ total 4 drwx------. 2 aeolus aeolus 4096 Jul 5 05:34 jobs -rw-r--r--. 1 root root 0 Jul 5 01:33 production.seed [root@dell-pe860-01 lib]# ll /var/lib/aeolus-conductor/jobs total 4 -rw-------. 1 aeolus aeolus 40 Jul 5 05:10 job_us_west_frontend1_1 Instances launch successfully. rails.log: Processing DeploymentsController#create (for 10.65.201.138 at 2011-07-05 05:10:50) [POST] Parameters: {"commit"=>"Launch", "action"=>"create", "controller"=>"deployments", "deployment"=>{"name"=>"us_west", "frontend_realm_id"=>"2", "deployable_xml"=>"<deployable name=\"deply_west\">\r\n <description>This is an example deployment</description>\r\n <assemblies>\r\n <assembly name=\"frontend1\" hwp=\"hwp1\">\r\n <image id=\"f5ac3b3c-6479-47d8-87b3-915fda339ba6\">\r\n </image>\r\n </assembly>\r\n </assemblies>\r\n</deployable>\r\n\r\n", "pool_id"=>"1"}} universe = grid executable = job_us_west_frontend1_1 grid_resource = deltacloud http://localhost:3004/api DeltacloudUsername = AKIAJRCPNVJYQBHCOBEA DeltacloudPasswordFile = /var/lib/aeolus-conductor/jobs/job_us_west_frontend1_1 DeltacloudImageId = ami-a186d4e4 DeltacloudHardwareProfile = c1.xlarge DeltacloudHardwareProfileMemory = 7168.0 DeltacloudHardwareProfileCPU = 20.0 DeltacloudHardwareProfileStorage = 1690.0 DeltacloudKeyname = aziza_west_1309848730_key_70052696092000 DeltacloudPoolFamily = 1 DeltacloudRealmId = us-west-1a requirements = true notification = never queue $? (return value?) is 0 Redirected to https://10.16.65.45/conductor/deployments/1 Completed in 3094ms (DB: 96) | 302 Found [https://10.16.65.45/conductor/deployments] verified on: [root@dell-pe860-01 lib]# rpm -qa | grep aeolus aeolus-conductor-0.3.0-0.el6.20110701204941gitd66e27c.noarch aeolus-all-0.3.0-0.el6.20110701204941gitd66e27c.noarch aeolus-conductor-doc-0.3.0-0.el6.20110701204941gitd66e27c.noarch aeolus-conductor-daemons-0.3.0-0.el6.20110701204941gitd66e27c.noarch aeolus-configure-2.0.1-0.el6.20110628141215gitb8aaf85.noarch rubygem-aeolus-cli-0.0.1-1.el6.20110701204941gitd66e27c.noarch
removing ce-p2-beta
second attempt to remove ce-p2-beta
release pending...
closing out old bugs
perm close