Attachment 851500 Details for Bug 1054704 – broker_log

broker_log

broker.log (text/plain), 32.58 KB, created by Meng Bo on 2014-01-17 10:14:19 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Meng Bo

Created: 2014-01-17 10:14:19 UTC

Size: 32.58 KB

patch

obsolete

>2014-01-17 05:08:16.186 [INFO ] Started GET "/broker/rest/api" for 203.114.244.88 at 2014-01-17 05:08:16 -0500 (pid:22286)
>2014-01-17 05:08:16.188 [INFO ] Processing by ApiController#show as JSON (pid:22286)
>2014-01-17 05:08:16.188 [DEBUG] API version 1.3 (pid:22286)
>2014-01-17 05:08:16.197 [INFO ] Completed 200 OK in 9ms (Views: 4.5ms) (pid:22286)
>2014-01-17 05:08:16.495 [INFO ] Started GET "/broker/rest/api" for 203.114.244.88 at 2014-01-17 05:08:16 -0500 (pid:22286)
>2014-01-17 05:08:16.497 [INFO ] Processing by ApiController#show as JSON (pid:22286)
>2014-01-17 05:08:16.497 [DEBUG] API version 1.6 (pid:22286)
>2014-01-17 05:08:16.587 [INFO ] Completed 200 OK in 90ms (Views: 86.0ms) (pid:22286)
>2014-01-17 05:08:16.887 [INFO ] Started GET "/broker/rest/cartridges" for 203.114.244.88 at 2014-01-17 05:08:16 -0500 (pid:22286)
>2014-01-17 05:08:16.888 [INFO ] Processing by CartridgesController#index as JSON (pid:22286)
>2014-01-17 05:08:16.889 [DEBUG] API version 1.6 (pid:22286)
>2014-01-17 05:08:16.899 [DEBUG] SUCCESS ACTION=LIST_CARTRIDGE USER_ID=52d8d79c8b0c1bfe5d000020 LOGIN=bmeng+1@redhat.com DOMAIN= List all cartridges (pid:22286)
>2014-01-17 05:08:16.912 [INFO ] Completed 200 OK in 24ms (Views: 12.4ms) (pid:22286)
>2014-01-17 05:08:17.512 [INFO ] Started GET "/broker/rest/domains" for 203.114.244.88 at 2014-01-17 05:08:17 -0500 (pid:22286)
>2014-01-17 05:08:17.514 [INFO ] Processing by DomainsController#index as JSON (pid:22286)
>2014-01-17 05:08:17.514 [DEBUG] API version 1.6 (pid:22286)
>2014-01-17 05:08:17.518 [DEBUG] SUCCESS ACTION=AUTHENTICATE USER_ID=52d8d79c8b0c1bfe5d000020 LOGIN=bmeng+1@redhat.com IP=203.114.244.88 SCOPES=session Authenticated (pid:22286)
>2014-01-17 05:08:17.523 [DEBUG] SUCCESS ACTION=LIST_DOMAIN USER_ID=52d8d79c8b0c1bfe5d000020 LOGIN=bmeng+1@redhat.com DOMAIN= (pid:22286)
>2014-01-17 05:08:17.530 [INFO ] Completed 200 OK in 16ms (Views: 5.0ms) (pid:22286)
>2014-01-17 05:08:17.823 [INFO ] Started POST "/broker/rest/domain/bmengdev/applications" for 203.114.244.88 at 2014-01-17 05:08:17 -0500 (pid:22286)
>2014-01-17 05:08:17.826 [INFO ] Processing by ApplicationsController#create as JSON (pid:22286)
>2014-01-17 05:08:17.826 [INFO ] Parameters: {"name"=>"ssl1", "cartridges"=>[{"url"=>"https://cartreflect-claytondev.rhcloud.com/github/bmeng/ssl_cart"}], "domain_id"=>"bmengdev", "application"=>{"name"=>"ssl1"}} (pid:22286)
>2014-01-17 05:08:17.827 [DEBUG] API version 1.6 (pid:22286)
>2014-01-17 05:08:17.829 [DEBUG] SUCCESS ACTION=AUTHENTICATE USER_ID=52d8d79c8b0c1bfe5d000020 LOGIN=bmeng+1@redhat.com IP=203.114.244.88 SCOPES=session Authenticated (pid:22286)
>2014-01-17 05:08:17.834 [DEBUG] Downloading https://cartreflect-claytondev.rhcloud.com/github/bmeng/ssl_cart... (pid:22286)
>2014-01-17 05:08:17.993 [DEBUG] Loading diy-0.1... (pid:22286)
>2014-01-17 05:08:18.407 [DEBUG] Loading diy-0.1... (pid:22286)
>2014-01-17 05:08:18.376 [DEBUG] Pre-Executing ops... (pid:22286)
>2014-01-17 05:08:18.385 [DEBUG] Pre-Execute SetGroupOverridesOp (pid:22286)
>2014-01-17 05:08:18.390 [DEBUG] Pre-Execute InitGearOp (pid:22286)
>2014-01-17 05:08:18.694 [DEBUG] Execute NotifyAppCreateOp (pid:22286)
>2014-01-17 05:08:18.893 [DEBUG] Execute ReserveGearUidOp (pid:22286)
>2014-01-17 05:08:18.939 [DEBUG] DEBUG: rpc_get_fact: fact=active_capacity (pid:22286)
>2014-01-17 05:08:18.952 [DEBUG] DEBUG: rpc_exec: rpc_client=#<MCollective::RPC::Client:0x000000071ffbd8> (pid:22286)
>2014-01-17 05:08:20.295 [DEBUG] Selecting best fit node: server: domU-12-31-39-0A-2D-7C capacity: 5.555555555555555 (pid:22286)
>2014-01-17 05:08:20.321 [DEBUG] Execute CreateGearOp (pid:22286)
>2014-01-17 05:08:20.325 [DEBUG] DEBUG: rpc_client.custom_request('cartridge_do', {:cartridge=>"openshift-origin-node", :action=>"app-create", :args=>{"--with-app-uuid"=>"52d901128b0c1be6f4000061", "--with-app-name"=>"ssl1", "--with-container-uuid"=>"52d901128b0c1be6f4000061", "--with-container-name"=>"ssl1", "--with-namespace"=>"bmengdev", "--with-request-id"=>"5b00385bab9e441270d869ecc8329ce7", "--with-secret-token"=>"_ZJ4pkmOCg-6mJHhu4mH5YxVBIGEbUe_1qpeREQM2qB_lfcUbsHRq0cG8W3ZFT7e4vY13xBcXVWw-_O3AWgNORGHOvs4txb1Ou9v5BWfEUm_zTFgbmmAvX5trnXTOHvA", "--cart-name"=>"openshift-origin-node"}}, domU-12-31-39-0A-2D-7C, {'identity' => domU-12-31-39-0A-2D-7C}) (Request ID: 5b00385bab9e441270d869ecc8329ce7) (pid:22286)
>2014-01-17 05:08:21.219 [DEBUG] DEBUG: [#<MCollective::RPC::Result:0x00000006bb84f0 @agent="openshift", @action="cartridge_do", @results={:sender=>"domU-12-31-39-0A-2D-7C", :statuscode=>1, :statusmsg=>"cartridge_do_action failed 129. Output Unable to setup tc for 52d901128b0c1be6f4000061", :data=>{:time=>nil, :output=>"Unable to setup tc for 52d901128b0c1be6f4000061", :exitcode=>129, :addtl_params=>nil}}>] (Request ID: 5b00385bab9e441270d869ecc8329ce7) (pid:22286)
>2014-01-17 05:08:21.221 [DEBUG] DEBUG: MCollective Response Time (execute_direct: app-create): 0.897101575s  (Request ID: 5b00385bab9e441270d869ecc8329ce7) (pid:22286)
>2014-01-17 05:08:21.221 [DEBUG] DEBUG: server results: Unable to setup tc for 52d901128b0c1be6f4000061 (pid:22286)
>2014-01-17 05:08:21.230 [DEBUG] DEBUG: rpc_client.custom_request('cartridge_do', {:cartridge=>"openshift-origin-node", :action=>"app-destroy", :args=>{"--with-app-uuid"=>"52d901128b0c1be6f4000061", "--with-app-name"=>"ssl1", "--with-container-uuid"=>"52d901128b0c1be6f4000061", "--with-container-name"=>"ssl1", "--with-namespace"=>"bmengdev", "--with-request-id"=>"5b00385bab9e441270d869ecc8329ce7", "--cart-name"=>"openshift-origin-node"}}, domU-12-31-39-0A-2D-7C, {'identity' => domU-12-31-39-0A-2D-7C}) (Request ID: 5b00385bab9e441270d869ecc8329ce7) (pid:22286)
>2014-01-17 05:08:22.571 [DEBUG] DEBUG: [#<MCollective::RPC::Result:0x00000006c6fc18 @agent="openshift", @action="cartridge_do", @results={:sender=>"domU-12-31-39-0A-2D-7C", :statuscode=>0, :statusmsg=>"OK", :data=>{:time=>nil, :output=>"", :exitcode=>0, :addtl_params=>nil}}>] (Request ID: 5b00385bab9e441270d869ecc8329ce7) (pid:22286)
>2014-01-17 05:08:22.573 [DEBUG] DEBUG: MCollective Response Time (execute_direct: app-destroy): 1.35129573s  (Request ID: 5b00385bab9e441270d869ecc8329ce7) (pid:22286)
>2014-01-17 05:08:22.573 [ERROR] An invalid exit code (129) was returned from the server domU-12-31-39-0A-2D-7C.  This indicates an unexpected problem during the execution of your request. (pid:22286)
>2014-01-17 05:08:22.574 [ERROR] ["/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.19.7/lib/openshift/mcollective_application_container_proxy.rb:2733:in `parse_result'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.19.7/lib/openshift/mcollective_application_container_proxy.rb:400:in `block in create'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.19.7/lib/openshift/mcollective_application_container_proxy.rb:386:in `each'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.19.7/lib/openshift/mcollective_application_container_proxy.rb:386:in `create'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/gear.rb:112:in `create_gear'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/pending_ops_models/create_gear_op.rb:8:in `execute'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/pending_app_op_group.rb:104:in `block in execute'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/pending_app_op_group.rb:93:in `each'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/pending_app_op_group.rb:93:in `execute'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/application.rb:1525:in `run_jobs'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/application.rb:675:in `block in add_features'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/application.rb:1595:in `run_in_application_lock'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/application.rb:656:in `add_features'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/application.rb:253:in `create_app'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/controllers/applications_controller.rb:157:in `create'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/implicit_render.rb:4:in `send_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/base.rb:167:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/rendering.rb:10:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/callbacks.rb:18:in `block in process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:492:in `block in _run__4355410411036247804__process_action__2281387986761761554__callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:215:in `block in _conditional_callback_around_436'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/lib/openshift/controller/action_log.rb:80:in `set_logged_request'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:214:in `_conditional_callback_around_436'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:403:in `_run__4355410411036247804__process_action__2281387986761761554__callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:405:in `__run_callback'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:385:in `_run_process_action_callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:81:in `run_callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/callbacks.rb:17:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/rescue.rb:29:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/instrumentation.rb:30:in `block in process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications.rb:123:in `block in instrument'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications/instrumenter.rb:20:in `instrument'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications.rb:123:in `instrument'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/instrumentation.rb:29:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/params_wrapper.rb:207:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/base.rb:121:in `process'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/rendering.rb:45:in `process'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal.rb:203:in `dispatch'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/rack_delegation.rb:14:in `dispatch'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal.rb:246:in `block in action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:73:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:73:in `dispatch'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:36:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:68:in `block in call'", "/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:56:in `each'", "/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:56:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:600:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/mongo_mapper-0.11.1/lib/mongo_mapper/middleware/identity_map.rb:10:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/mongoid-3.0.21/lib/rack/mongoid/middleware/identity_map.rb:34:in `block in call'", "/opt/rh/ruby193/root/usr/share/gems/gems/mongoid-3.0.21/lib/mongoid/unit_of_work.rb:39:in `unit_of_work'", "/opt/rh/ruby193/root/usr/share/gems/gems/mongoid-3.0.21/lib/rack/mongoid/middleware/identity_map.rb:34:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/best_standards_support.rb:17:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/etag.rb:23:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/conditionalget.rb:35:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/head.rb:14:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/params_parser.rb:21:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/flash.rb:242:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/session/abstract/id.rb:205:in `context'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/session/abstract/id.rb:200:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/cookies.rb:339:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/callbacks.rb:28:in `block in call'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:405:in `_run__4530862941910861678__call__3114165219557672936__callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:405:in `__run_callback'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:385:in `_run_call_callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:81:in `run_callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/callbacks.rb:27:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/remote_ip.rb:31:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/debug_exceptions.rb:16:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/show_exceptions.rb:56:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/rack/logger.rb:26:in `call_app'", "/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/rack/logger.rb:16:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/request_id.rb:22:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/methodoverride.rb:21:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/runtime.rb:17:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/cache/strategy/local_cache.rb:72:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/lock.rb:15:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/static.rb:62:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:136:in `forward'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:143:in `pass'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:155:in `invalidate'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:71:in `call!'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:51:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/engine.rb:479:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/application.rb:223:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/railtie/configurable.rb:30:in `method_missing'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/rack/request_handler.rb:97:in `process_request'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/abstract_request_handler.rb:521:in `accept_and_process_next_request'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/abstract_request_handler.rb:274:in `main_loop'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/rack/application_spawner.rb:206:in `start_request_handler'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/rack/application_spawner.rb:79:in `block in spawn_application'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/utils.rb:470:in `safe_fork'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/rack/application_spawner.rb:64:in `spawn_application'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/spawn_manager.rb:264:in `spawn_rack_application'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/spawn_manager.rb:137:in `spawn_application'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/spawn_manager.rb:275:in `handle_spawn_application'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/abstract_server.rb:357:in `server_main_loop'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/abstract_server.rb:206:in `start_synchronously'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/helper-scripts/passenger-spawn-server:102:in `<main>'"] (pid:22286)
>2014-01-17 05:08:22.574 [ERROR] Encountered error during execute 'An invalid exit code (129) was returned from the server domU-12-31-39-0A-2D-7C.  This indicates an unexpected problem during the execution of your request.' (pid:22286)
>2014-01-17 05:08:22.574 [ERROR] Encountered error during execute 'An invalid exit code (129) was returned from the server domU-12-31-39-0A-2D-7C.  This indicates an unexpected problem during the execution of your request.' (pid:22286)
>2014-01-17 05:08:22.575 [DEBUG] ["/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.19.7/lib/openshift/mcollective_application_container_proxy.rb:2733:in `parse_result'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.19.7/lib/openshift/mcollective_application_container_proxy.rb:400:in `block in create'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.19.7/lib/openshift/mcollective_application_container_proxy.rb:386:in `each'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.19.7/lib/openshift/mcollective_application_container_proxy.rb:386:in `create'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/gear.rb:112:in `create_gear'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/pending_ops_models/create_gear_op.rb:8:in `execute'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/pending_app_op_group.rb:104:in `block in execute'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/pending_app_op_group.rb:93:in `each'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/pending_app_op_group.rb:93:in `execute'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/application.rb:1525:in `run_jobs'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/application.rb:675:in `block in add_features'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/application.rb:1595:in `run_in_application_lock'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/application.rb:656:in `add_features'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/models/application.rb:253:in `create_app'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/app/controllers/applications_controller.rb:157:in `create'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/implicit_render.rb:4:in `send_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/base.rb:167:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/rendering.rb:10:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/callbacks.rb:18:in `block in process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:492:in `block in _run__4355410411036247804__process_action__2281387986761761554__callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:215:in `block in _conditional_callback_around_436'", "/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.19.10/lib/openshift/controller/action_log.rb:80:in `set_logged_request'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:214:in `_conditional_callback_around_436'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:403:in `_run__4355410411036247804__process_action__2281387986761761554__callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:405:in `__run_callback'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:385:in `_run_process_action_callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:81:in `run_callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/callbacks.rb:17:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/rescue.rb:29:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/instrumentation.rb:30:in `block in process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications.rb:123:in `block in instrument'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications/instrumenter.rb:20:in `instrument'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/notifications.rb:123:in `instrument'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/instrumentation.rb:29:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/params_wrapper.rb:207:in `process_action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/base.rb:121:in `process'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/abstract_controller/rendering.rb:45:in `process'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal.rb:203:in `dispatch'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal/rack_delegation.rb:14:in `dispatch'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_controller/metal.rb:246:in `block in action'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:73:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:73:in `dispatch'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:36:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:68:in `block in call'", "/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:56:in `each'", "/opt/rh/ruby193/root/usr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:56:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/routing/route_set.rb:600:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/mongo_mapper-0.11.1/lib/mongo_mapper/middleware/identity_map.rb:10:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/mongoid-3.0.21/lib/rack/mongoid/middleware/identity_map.rb:34:in `block in call'", "/opt/rh/ruby193/root/usr/share/gems/gems/mongoid-3.0.21/lib/mongoid/unit_of_work.rb:39:in `unit_of_work'", "/opt/rh/ruby193/root/usr/share/gems/gems/mongoid-3.0.21/lib/rack/mongoid/middleware/identity_map.rb:34:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/best_standards_support.rb:17:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/etag.rb:23:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/conditionalget.rb:35:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/head.rb:14:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/params_parser.rb:21:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/flash.rb:242:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/session/abstract/id.rb:205:in `context'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/session/abstract/id.rb:200:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/cookies.rb:339:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/callbacks.rb:28:in `block in call'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:405:in `_run__4530862941910861678__call__3114165219557672936__callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:405:in `__run_callback'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:385:in `_run_call_callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:81:in `run_callbacks'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/callbacks.rb:27:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/remote_ip.rb:31:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/debug_exceptions.rb:16:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/show_exceptions.rb:56:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/rack/logger.rb:26:in `call_app'", "/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/rack/logger.rb:16:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/request_id.rb:22:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/methodoverride.rb:21:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/runtime.rb:17:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/cache/strategy/local_cache.rb:72:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-1.4.1/lib/rack/lock.rb:15:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/actionpack-3.2.8/lib/action_dispatch/middleware/static.rb:62:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:136:in `forward'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:143:in `pass'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:155:in `invalidate'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:71:in `call!'", "/opt/rh/ruby193/root/usr/share/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:51:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/engine.rb:479:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/application.rb:223:in `call'", "/opt/rh/ruby193/root/usr/share/gems/gems/railties-3.2.8/lib/rails/railtie/configurable.rb:30:in `method_missing'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/rack/request_handler.rb:97:in `process_request'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/abstract_request_handler.rb:521:in `accept_and_process_next_request'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/abstract_request_handler.rb:274:in `main_loop'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/rack/application_spawner.rb:206:in `start_request_handler'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/rack/application_spawner.rb:79:in `block in spawn_application'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/utils.rb:470:in `safe_fork'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/rack/application_spawner.rb:64:in `spawn_application'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/spawn_manager.rb:264:in `spawn_rack_application'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/spawn_manager.rb:137:in `spawn_application'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/spawn_manager.rb:275:in `handle_spawn_application'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/abstract_server.rb:357:in `server_main_loop'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/lib/phusion_passenger/abstract_server.rb:206:in `start_synchronously'", "/opt/rh/ruby193/root/usr/share/gems/gems/passenger-3.0.21/helper-scripts/passenger-spawn-server:102:in `<main>'"] (pid:22286)
>2014-01-17 05:08:22.612 [DEBUG] Rollback SetGroupOverridesOp (pid:22286)
>2014-01-17 05:08:22.617 [DEBUG] Rollback CreateGearOp (pid:22286)
>2014-01-17 05:08:22.618 [DEBUG] DEBUG: rpc_client.custom_request('cartridge_do', {:cartridge=>"openshift-origin-node", :action=>"app-destroy", :args=>{"--with-app-uuid"=>"52d901128b0c1be6f4000061", "--with-app-name"=>"ssl1", "--with-container-uuid"=>"52d901128b0c1be6f4000061", "--with-container-name"=>"ssl1", "--with-namespace"=>"bmengdev", "--with-request-id"=>"5b00385bab9e441270d869ecc8329ce7", "--cart-name"=>"openshift-origin-node"}}, domU-12-31-39-0A-2D-7C, {'identity' => domU-12-31-39-0A-2D-7C}) (Request ID: 5b00385bab9e441270d869ecc8329ce7) (pid:22286)
>2014-01-17 05:08:22.684 [DEBUG] DEBUG: [#<MCollective::RPC::Result:0x00000006ec0ff8 @agent="openshift", @action="cartridge_do", @results={:sender=>"domU-12-31-39-0A-2D-7C", :statuscode=>0, :statusmsg=>"OK", :data=>{:time=>nil, :output=>"", :exitcode=>0, :addtl_params=>nil}}>] (Request ID: 5b00385bab9e441270d869ecc8329ce7) (pid:22286)
>2014-01-17 05:08:22.686 [DEBUG] DEBUG: MCollective Response Time (execute_direct: app-destroy): 0.068382051s  (Request ID: 5b00385bab9e441270d869ecc8329ce7) (pid:22286)
>2014-01-17 05:08:22.707 [DEBUG] Rollback ReserveGearUidOp (pid:22286)
>2014-01-17 05:08:22.810 [DEBUG] Rollback NotifyAppCreateOp (pid:22286)
>2014-01-17 05:08:22.811 [DEBUG] Rollback not implemented: NotifyAppCreateOp (pid:22286)
>2014-01-17 05:08:22.812 [DEBUG] Rollback InitGearOp (pid:22286)
>2014-01-17 05:08:22.842 [DEBUG] FAILURE ACTION=ADD_APPLICATION USER_ID=52d8d79c8b0c1bfe5d000020 LOGIN=bmeng+1@redhat.com DOMAIN=bmengdev Unable to complete the requested operation due to: An invalid exit code (129) was returned from the server domU-12-31-39-0A-2D-7C.  This indicates an unexpected problem during the execution of your request. Unable to setup tc for 52d901128b0c1be6f4000061, Unable to complete the requested operation due to: An invalid exit code (129) was returned from the server domU-12-31-39-0A-2D-7C.  This indicates an unexpected problem during the execution of your request.
>Reference ID: 5b00385bab9e441270d869ecc8329ce7 (pid:22286)
>2014-01-17 05:08:22.844 [INFO ] Completed 500 Internal Server Error in 5018ms (Views: 0.6ms) (pid:22286)
>
>

Actions: View

Attachments on bug 1054704: 851500 | 851501